In my experience, wealthy people are typically in one of two modes: 0 to 1 or 1 to 0. That's why they own both jets and yachts, rolls and lambos. Sometimes you're going fast, sometimes you're going slow, but there isn't really a need to do anything between.
Supersonic flight isn't necessarily for the 0.1%, just the 1% (or whatever other made up number) whose price per hour times the travel time reductions is greater than the added cost of the fare.
It's not just the 0.1% who appreciate amenities over speed. A more-comfortable, reliable high speed rail so I do not have to go to airports would displace a lot of Boston-NYC-DC air travel.
Because sitting in the air is useless. When I take my family to the Maldives or w/e out-there place to holiday, I’d gladly spend $10k more to get there many hours faster.