In a recent patent filing by Sony, the company are exploring methods to find “passive non-luminous objects” being held by a user so that the item can be used as a controller.
This technology infrastructure would allow household items such as a banana, to be used as a gaming accessory. Through a “trained learning model”, a camera would be able to detect the identity of where user’s fingers would be placed so that virtual buttons can be located via a user input generator.
In its proposal, Sony sketched the proposed technique with a handheld banana controller as displayed in the tweet below.
— Instant Gaming (@InstantGamingEN) March 3, 2021
You can find out more details of the patent by visiting the U.S Patent and Trademark Office’s website.