The 'Lego House' hitmaker has narrowed down 50 prospective tracks to 12 for the follow-up to 2011 debut '+', but he explained the pair prefer to relax when they have time off rather than writing all the time.
He told MTV: ''There have been no talks with Taylor about writing tunes, because when we both have time off we just want to have time off.
''And she's got a beautiful new house, which is always fun to hang out in. I don't want to pick up a guitar and be like, 'Hey, let's write another hit song'.
''I just want to chill. She's got a pool table. I quite like that.''
The two friends duetted on 'Everything Has Changed' from Taylor's last album, 'Red', and they have both previously said they plan to work together at some point in the future.
As he concentrates on his second album, Ed has also dashed any rumours of hip-hop producers such as Timbaland working on songs with him, insisting fans just want to feel the emotion in his music.
He added: ''I don't think anyone wants to dance to the sorts of words I have to sing. They just want to cry and eat ice cream.''
Superman is missing from the 'Justice League' trailer.
The 'Power Rangers' reminded Elizabeth Banks of that 'team' aesthetic.
Charlie Hunnam has described his odd relationship on the set of 'The Lost City Of Z' with Robert Pattinson, who he "didn't say more than 10 words to...
The two actors worked together on 2003 western 'The Missing'.
Captain America actor Chris Evans has hinted he'd be open to returning for more Marvel movies in the future despite his contract coming up.
They say you should never meet your heroes, but Michael Fassbender is glad he met Brendan Gleeson.
'Prison Break' returns in April for a fifth season, but how will Robert Knepper's character T-Bag fit into the folds of the new episodes?
As it's been 12 years since the last Bridget Jones movie, expectations aren't too high...
Bridget has always known how to get herself into a muddle - catastrophic muddles at...
After battling the dating scene and finally finding love with Mark Darcy, Bridget Jones is...
In July of 2015, Ed Sheeran played his biggest gigs to date, selling out Wembley...