In actual numbers, yes, the minority do pay the majority of taxes, but they also have the majority access to opportunity to expand their wealth, and the ability to pay those taxes is much greater. It will have a far less detrimental effect on the lifestyle of the minority if their taxes double (too exteme, but fits the analogy), than if the taxes of the bottom 95% double. Such an extreme tax hike will never sink the top 5% into poverty, but it will destroy the lives of 95% of the citizenry.
The dinner companion analogy also doesn't fit. If in that story, I am the poor majority, the gov't handouts which it alludes to certainly aren't lobster or fancy desserts. It also does nothing to address the flow of wealth upwards from the poor to the wealthy due to the monopoly of basic services and institutions. It's also wrong to make it seem like you're taking me out out of the goodness of your heart. You're doing it because someone else (the gov't) said you had to.