Yes, I understand that there are things that you can do. But, as those are in the way of convenience, we can assume that not everyone will take the extra effort to create constantly new wallets, etc.

So, in case someone can trace you to a wallet, that someone can know all your transactions (of course, only the transactions for that wallet), which is a huge potential privacy risk.