The former 'x factor' winner was named in 'I'm Coming (Tarzan Part 2)' - the rapper's explicit rant against the reality show - and thinks he is ''a bit sad'' for putting others down in his lyrics.
Speaking at the European premiere of new film 'Magic Mike' on Tuesday (10.07.12), Joe told BANG Showbiz: ''I'm never one for putting people down in the music industry, I think everybody should just support one another.
''You can be criticised and judged by a lot of people and I think it's just a bit sad that people do that but if that's what he wants to do, go for it. Personally I wouldn't do that to someone.''
Lyrics include: ''I heard Simon Cowell thinks I'm a little w***er/ And that I'm getting on his t**s like cancer/ I don't want to start mentioning names (f**k it)/ Where they all now? They're bankrupt.
''Joe McElderry, oh what a stand up/ Alexandra [Burke], pull your socks up/ Where your hits at, you ain't no winner/ I feel bad cos your voice is amazing.''
Joe also accused Dappy of trying to sell records by picking on others, and said he doesn't find the rapper ''interesting enough'' to sing about himself.
He added: ''I'm not really bothered if he wants to write about me in a song. I don't really find him interesting enough to write about in my songs but if that's what he wants to do, he can do that.
''I've met him loads of times and it's just one of those things. I'm sure he's probably just doing it to sell more singles, but there you go.''
Joe's next album 'Here's What I Believe' is out on September 17.