On it's bacsic premise, no, you're allowed to move my arms or person (to the extent that it is not assault, kidnapping, etc) but say, altering the state of my atoms in a way that ends my life or does me physical harm is criminal.

see! there's nuance! not everything is a useless sea of light switches. there is no problem with squishing a grape, but there is a problem with causing similar physical harm to living beings

My claim is that altering the position of a switch is not destruction of property,

switches are like grapes. digital storage in your phone is like living beings. something that is not easy or possible to reproduce the same way it was before the damage.