The Scooby-Doo star appeared on U.S. Tv series 24 alongside Sutherland in 2010, but admits working with him was a real challenge.
He tells ABC News, "It was terrible. I hated every moment of it. I just wanted to quit the business after that.
"Kiefer was the most unprofessional dude in the world. That's not me talking trash; I'd say it to his face. I think everyone that's worked with him has said that."
Sutherland has yet to respond to Prinze, Jr.'s comments.