The Malcolm X director waded into the racism drama swirling around businessman Sterling at the end of last month (Apr14), insisting recorded remarks he made about African-Americans to an ex-girlfriend were "tainting the league and tainting America".
Sterling hit headlines on 27 April (14) when audio of him rebuking his ex for posting a photo of herself with basketball legend Magic Johnson on Instagram went viral.
The ill-advised remarks prompted an immediate backlash, with celebrities like Snoop Dogg, Lil Wayne and Clippers fan Queen Latifah calling for a boycott of Sterling's team.
Basketball superfan Lee added his thoughts to the mix, telling CNN that Sterling's remarks make the Clippers boss look like a slave owner.
He says, "I don't know the bylaws of the league but he (Sterling) has to go... because he's tainting all the other 29 partners, he's tainting the league, and he's tainting America.
"When you hear something like that, that is the mentality of a slave master. He sees his players as slaves."
And he has repeated his concerns during an interview with Anderson Cooper, whose chat with a remorseful Sterling aired on Sunday (11May14).
Addressing Sterling's claims that all his players love him, despite what he said, Lee raged, "That sounds like a (slavery) plantation owner: 'My darkies love me!'"
He added, "This thing is getting volatile now."
Sterling has been handed a lifetime ban from the Nba and league officials are working on a plan to strip him of ownership of the Clippers.