That hypothetical question — Would a Whole Foods make it in Midtown? — is just that. I have not heard even the tiniest peep about this actually happening.
In Flyerland, we talk a lot about grocery stores, so this question has come up before. What brought it up most recently was the Wall Street Journal story (warning: paywall) about Whole Foods opening a store in Detroit, Michigan.