The Take That frontman - who has children Daniel, 11, Emily, nine, and two-year-old Daisy with wife Dawn - doesn't like the explicit lyrics the group use and will turn off their records so the youngsters are not exposed to swear words.
He said: "Luckily, lyrics go over their heads for the most part, but I have had five nine year olds in my back seat singing along to Black Eyed Peas songs with 'F' this 'F' that and I'm like, 'Right, I'm stopping the car!'
"I don't like my kids listening to swearing. I'm the kind of parent who doesn't like his kids to learn bad language like that too early on."
Gary also hit out at the sexualisation of music, admitting he is astonished by how "rude" some promotional videos are.
He told Britain's OK! Magazine: "Music videos these days are so sexual. The other day, I wanted some music in the kitchen and put on one of the music TV channels and a video came on which as so rude that I had to turn it off because my nine year old was with me.
"Don't get me wrong, I'm not a prude but I don't think I really want my children seeing those kind of videos at that age.
"I'm a parent. I have a responsibility, but I also understand that these videos are sexual to attract people's attention but when you have young children, it's not to be promoted."