Right, but it's not the bank giving this guarantee but some other body, for example the FDIC in the US.
But according to the book, this also applies to securities. So any stocks or bonds you hold, are not actually yours, and in case your custodian goes bankrupt, "your" stocks will go to someone else.