I'd have to disagree with you. There's tons of people who use them as a mobile-first service (my wife only ever uses the mobile app). I think a subset of tech/privacy savvy people don't like that they went to a cloud based model, but that's a small subset of a small subset.
Mint is another example of a popular financial management tool, that was always cloud-first. It would import transactions by using the same credentials you would use to login to online banking. This wasn't appealing to me. This didn't deter many other people.
I didn't like sharing my credentials either but I was using it – until it stopped working for most of my accounts.
I've since stopped using even the 'manual import' and I've found that reconciling to my bank/financial-company statements manually is much easier overall as importing auto-reconciled transactions but then it was basically impossible to then match any specific balance reported by the bank/financial-company.