Yes. People aren't walking around staring down at their wallet all day everywhere, lol. They aren't walleting and driving. Your wallet doesn't run out of battery. If you sit on your wallet, the screen can't crack, because there isn't one. Your mother in law can't call you on your wallet.
To be fair, your wallet also can't take pics, text, or find directions to places. Phones really do have their uses. But they can also be a pain in the neck.
It really isn't carrying the phone that's the biggest issue (especially for me since I just put it in my bag. DH hates having it in his pocket, however). It's having no other option but to have an expensive phone, and to have it charged and in your hand at all times while on vacation, and more-so for people who aren't techy, or just want to unplug sometimes - especially on vacation, that's really the annoying thing.
Also, why is it that people always argue with anyone who says they're not a phone person? Why isn't that okay? Why can't people just accept other's quirks and uniqueness?