The same language rules are used for control/ownership of objects as well. A book is on you, (or with you), as is your car and your clothes.

That said, the concepts in english aren’t foreign or lost in translation. When the language became more than a tool for people to communicate, miscommunications start happening.