Looking for Sunday dinner recommendation

Hopefully someone can help me with a recommendation for a good place to have a nice Sunday dinner (not brunch, and hopefully earlier than even early dinner, which seems to start at 5 p.m).

Fairly upscale, downtown or adjacent neighborhoods. It's with my 77 year old dad, so noisy and crowded are not good.

Perhaps a hotel dining room? I'm just not familiar with any of them.

Thanks.

What about the Pump Room? I haven't been there in a few years, but it's a nice, quiet, pretty room and the food has always been good.

Kim