I agree. I think a pocket device that only has GPS Navigation, MP3 player capabilities, and calling/texting would be perfect. Maybe some basic stuff like a notes, app, alarms, etc too. Stuff that's actually useful.
Edit: This is actually basically exactly what my own phone is. It's graphene OS with no google services and that's what I use it for.