Right, and while you could store cash or bitcoins physically in a bank, there's no point in doing so for the average consumer. Cash is comparable to bitcoins in this regard: it's a riskier form of money because it's anonymous and can be stolen relatively easily, but it's also really convenient for financial transactions.