You do have a point. I think a big part of the issue shifting the perception and expectation of what your product actually is.

A lot of people invested into a hardware wallet because they were promised an unstoppable solution to hold your crypto, where no one, under any circumstances has access to your bags.

The outrage is people realizing that Ledger was never this in the first place. And the way the announcement and backlash was handled, is a terrible way to try and do damage limitation.

People may forget about it in time, but it definitely damaged their reputation.