The 45-year-old milliner was good friends with the late designer, who tragically committed suicide in 2007, says she could have had more help when she was alive.
He also thinks the upcoming exhibition of her wardrobe, 'Isabella Blow: Fashion Galore!' at London's Somerset House is well overdue.
Philip told The Daily Telegraph newspaper: ''She was never feted while she was alive. She gave so much and worked so hard.
''She supported careers of many young people who didn't stand a chance without her, yet she never won a single award.
''It's all very well then feting her now and going on about how wonderful and brilliant she was.''
Philip, whose clients include Lady GaGa and Madonna, thinks it's a case of too little too late when it comes to his muse Isabella and is worried people will turn up at the exhibition who laughed at her when she was alive.
He said: ''They're hypocrites and they make my bloody boil!''
Although he was reluctant to name any of Isabella's critics, he said they mocked her and described it as ''cruel''.
Philip added: ''She thought she no longer mattered. For all her flamboyance and humour and warmth, Isabella actually suffered from low self-esteem.
''Very few people got to see that. She also had this thing about getting old.
''She hated it. Before she died, she told me that she felt as if she had been somehow left behind in the fashion world.''
'Isabella Blow: Fashion Galore!' opens on November 20.
The novel's author saw a cut of the film and loved each of the changes the movie's director had made.