After the divorcees were spotted holidaying in Hawaii recently, gossips speculated they were getting back together and had plans to wed again.
But following former BAYWATCH star Anderson's recent announcement it was all just for publicity, Lee has stepped forward to tell People magazine that he's holding out for another chance.
He says, "We're crazy in love. We're going to take things slowly and see where they go.
"(Our sons) miss Pam and me together. When we're together, they're so happy. At the end of the day, that's truly what my heart wants. I want us all to be together."
Lee served approximately four months in jail after he pleaded no contest to kicking Anderson while she held their baby son, Dylan, in February 1998.
The couple, who had wed in 1995, divorced that same year, but have been on and off again ever since.
Lee and Anderson have two sons together - BRANDON, nine, and DYLAN, seven.