• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer
Engineering Designer Magazine

Engineering Designer

  • Home
  • Technology
  • Education
  • Sustainability
  • Materials
  • Medical
  • Construction
  • Advertise
  • iED
You are here: Home / Technology / Wrist-mounted camera captures entire body in 3D

Wrist-mounted camera captures entire body in 3D

November 10, 2022 by Geordie Torr

Researchers at Cornell University in New York have developed a first-of-its-kind wristband-mounted miniature camera that is capable of tracking an entire body’s posture in 3D.

Advertisement

Dubbed BodyTrak, the device, which also features a customised deep neural network, is the first wearable that can track the full body pose with a single camera. According to Cheng Zhang, an assistant professor of information science at Cornell, if integrated into future smartwatches, BodyTrak could be a game-changer in monitoring user body mechanics in physical activities where precision is critical.

‘Since smartwatches already have a camera, technology like BodyTrak could understand the user’s pose and give real-time feedback,’ Zhang said. ‘That’s handy, affordable and does not limit the user’s moving area.’

Advertisement

BodyTrak is the latest body-sensing system developed by SciFiLab – a group based in the Cornell Ann S Bowers College of Computing and Information Science that has previously developed and leveraged similar deep-learning models to track hand and finger movements, facial expressions and even silent-speech recognition.

The secret to BodyTrak is not only in the five-pence-sized camera on the wrist, but also the deep neural network behind it. This deep neural network – a method of AI that trains computers to learn from mistakes – reads the camera’s rudimentary images or ‘silhouettes’ of the user’s body in motion and virtually re-creates 14 body poses in 3D and in real time.

In other words, the model accurately fills out and completes the partial images captured by the camera, said Hyunchul Lim, a doctoral student in the field of information science.

‘Our research shows that we don’t need our body frames to be fully within camera view for body sensing,’ Lim said. ‘If we are able to capture just a part of our bodies, that is a lot of information to infer to reconstruct the full body.’

Maintaining privacy for bystanders near someone wearing such a sensing device is a legitimate concern when developing these technologies, said Zhang and Lim. According to the researchers, BodyTrak mitigates privacy concerns for bystanders since the camera is pointed toward the user’s body and collects only partial body images of the user.

They also recognise that today’s smartwatches don’t yet have small or powerful enough cameras and adequate battery life to integrate full body sensing, but could in the future.

The research has been published in the Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technology.

Filed Under: Technology

Advertisement

Primary Sidebar

SUBSCRIBE And get a FREE Magazine

Want a FREE magazine each and every month jam-packed with the latest engineering and design news, views and features?

ED Update Magazine

Simply let us know where to send it by entering your name and email below. Immediate access.

Trending

New method developed for optimising structural design

Propeller advance paves way for quiet, efficient electric aviation

Last chance to register for a trip to Mars

Mix-and-match kit could enable astronauts to build a menagerie of lunar robots

Puppet-maker innovates with 3D printing thanks to Made Smarter support

Zebra stripes inspire new flexible thermoelectric generator

Engineer designs world’s most powerful handheld laser

Blast furnace adaptation could reduce steelmaking emissions by 90 per cent

First Hydrogen releases concept sketches for its next-generation zero-emission vehicle

UCLA engineers design solar roofs for greenhouses

Footer

About Engineering Designer

Engineering Designer is the quarterly journal of the Insitution of Engineering Designers.

It is produced by the IED for our Members and for those who have an interest in engineering and product design, as well as CAD users.

Click here to learn more about the IED.

Other Pages

  • Contact us
  • About us
  • Privacy policy
  • Terms
  • Institution of Engineering Designers

Search

Tags

ied

Copyright © 2023 · Site by Syon Media