Toronto-based robotics startup SmartArm is using AI hardware to help its prosthetic arm grab objects more easily.
SmartArm, which gained recognition for winning Microsoft’s Imagine Cup in 2018, uses self-built AI software and hardware from Meta to let the limb “see” the object and adjust to make grabbing it easier.
It does this using an onboard camera built into the palm that streams video to the operating system, which SmartARM calls Dexterity OS. It identifies the object and automatically selects the optimal grip. From there, the multi-articulating fingers move to grab the object, applying the right pressure for each individual object.
The SmartARM also uses three pieces of Meta technology: the Meta AI glasses, the DINOv2 open-source vision model, and the Meta Wearables Device Access Toolkit. SmartARM’s founder, Hamayal Choudry, noted that the Meta AI glasses let the arm see more of its environment than the palm camera alone. With DINOv2, users can train new objects by taking a few photos in the SmartARM app, and the software identifies similarities and determines the best grip. This means that it allows the arm to grip and pick up objects based directly on visual feature reading, and without needing prior understanding or traditional programming.
The toolkit allows SmartARM to extend and improve object recognition and understanding, which will provide more data from the egocentric point of view that the glasses offer. According to SmartARM’s website, the device currently recognizes over 365 everyday objects, with the library “constantly growing” through over-the-air updates. SmartARM also notes that the more you use the arm, the more objects get added to your personal recognition profile.
Although no device specs are listed yet, SmartARM notes an expected battery life of 12-16 hours, depending on activity level.
Pricing also hasn’t been released, but the company is actively working with insurers and health systems to establish coverage options. The device is currently in beta in Canada, and if you want one, you can join the company’s waitlist for updates and early access to pricing, specs, and more.
Image Credit: SmartARM via Linkedin
MobileSyrup may earn a commission from purchases made via our links, which helps fund the journalism we provide free on our website. These links do not influence our editorial content. Support us here.
