I adore both M Henry( the bread pudding should be available during the week) and Lula, however, there is no way I would do either with six people, one being a grandma, on a weekend, unless we were prepared to be there when the doors open!
The surfaces are hard and those places are packed. So conversation would be difficult plus you would probably be disinclined to linger. My husband and I had a similar issue this past Sunday. My mum-in-law will be 83 in 8 days. We were also meeting three other people (six in our party).
My husband despises the wait for breakfast food that exists at M Henry, Lula, Toast, Sweet Maple, and many other yummy breakfast places. I was not the least bit inclined to be out of my warm bed on a Sunday morning around the time the sun rose. After much discussion, we settled on a 10 am meeting at Fox and Obel, they even have free parking.
He dropped us off and went to park a few moments before ten. We rushed in and I headed over to the atrium side expecting it to be empty and quiet. I was shocked to discover it was packed and there was not space for six. I then hurried back over to the cafe-side and it is just now ten am, and there are not sufficient tables for six. I hover and manage to see a guy leaving at the back of the room, voila six was now available. My mum-in-law and I cover coats and scarves over the area and then head back to the front to check out the menu.
It is standard breakfast fare, you order and pay at the counter and then they bring the food out. We managed, although they brought my mum-in-law french toast, instead of the waffle she had ordered. They fixed it. Still it was loud and packed!
My suggestion, if you are not a fan of the buffets at the hotels-- they do generally let you linger for their over-priced offerings (The Lobby, at the Peninsula, is not bad and it is pleasant for conversation--albeit pricey), is either Green Zebra, they do not open until eleven am, but if you are there at that time you should not have a problem being seated.
My next choice, albeit a bit pricey, would be North Pond. I took my mum-in-law there for Easter Brunch(they do not do that in England) and she really enjoyed it. She is generally quite simple in her food choices, but she went on about that place, both the food and the setting, for weeks. She is, however quite agile, and if anyone has a problem walking(someone mentioned this earlier in this thread) then I would phone North Pond first, I think there is a closer accessible entrance with a car drop-off.
Enjoy and let us know where you land and how things went.