The drummer thinks it would have been a ''great'' event to perform at but the group - who have delayed plans for a tour until 2013 - don't have the time to fit in the special show.
Charlie said: ''I don't think we'll do the Olympics opening ceremony. I didn't want to do it for a start.
''I'd love to have done the Queen's diamond jubilee because that's a great thing I think, but I don't think we'd have the time to do it.
Charlie, 70, also admitted the group feel ''lucky'' to be able to take their time when recording as few bands are afforded the luxury of being able to stay in the studio for as long as they want.
He added: ''We've been lucky that we've been able to afford the time to do that because most people are in the studio for a day and out again.
''With the Stones, we go into the studio for a month and if it hasn't worked by then we go back for another one.
''It's ridiculous, really, it's not how people make records now. But out of that process would come thinks like 'Sympathy for the Devil'. We tried everything on that before we figured out what was the best beat to do.''