Mobile
News
1/18/2013
10:39 AM
Connect Directly
RSS
E-Mail
50%
50%

Microsoft Kinect Technology Helps Surgeons Manipulate Images

Study shows device can preserve sterility by letting surgeons alter MR images without touching computer.

10 Medical Robots That Could Change Healthcare
10 Medical Robots That Could Change Healthcare
(click image for larger view and for slideshow)
A system based partly on the Xbox Kinect motion-sensing technology can be effective in helping surgeons manipulate MR images in the OR while preserving sterility, according to a new study in the Journal of the American Medical Informatics Association.

Surgeons are interested in this technology because the manual use of computer workstations to manipulate these images creates potential for infection. Physicians who touch a mouse or a keyboard need to scrub in again, wasting precious time. Although surgeons can ask staffers to rotate or enlarge images, this approach can be cumbersome, inefficient and frustrating.

The hands-free Kinect gaming device, which Microsoft created in 2010, has been used before to safeguard sterility in ORs. For example, surgeons at Sunnybrook Hospital in Toronto have been using Kinect since 2011 to manipulate images without touching a computer. But the JAMIA study, conducted by researchers at Purdue University in Indiana, used scientific methods to establish the reliability and efficacy of the technique.

[ Technology can play a key role in improving health care, but it will never replace the human touch. Read Internet Has Yet To Replace Family Doctors. ]

The team used a three-step process in their research. First, they developed an MR image browser application and studied the gestures of 10 surgeons to establish which of their gestures would be appropriate to use with the application. Second, the team developed gesture-recognition software that would detect the intentionality of users' gestures. And finally, they performed three experiments to validate whether the system could discriminate between intentional and unintentional gestures.

The first experiment, which included both intentional and unintentional gestures, showed that the system could detect the correct gestures with an accuracy rate of 97.9%, with a 1.36% false positive rate. Similar results were obtained when the number of users was increased from two to ten in the second experiment. In the third experiment, the research team determined that the system could correctly determine intent or context 98.7% of the time. Mean gesture recognition accuracy was 92.6% with context and 93.6% without context.

Juan Pablo Wachs, an assistant professor at Purdue University and one of the study's authors, told InformationWeek Healthcare that the importance of context was the key finding in the study. "When you don't look at the context, you're just looking at the hand movement to control a medical image in a browser. There are a lot of reasons a surgeon may want to perform hand movements. The critical point is that the application has to be able to recognize the intent of the surgeon to be able to know whether he's performing movement to manipulate the images in the browser."

The high rate of gesture recognition using motion-sensing technology is not new, Wachs pointed out. What is new is that the system his team created decreased the number of "false alarms" -- gestures that were unintentional or that had nothing to do with image manipulation.

Wachs added that he and his colleagues have been studying the use of motion-sensing devices in the OR since 2008, long before Kinect came along. "Kinect helped us get better results, but it was not solving the scientific problems. It just provided a tool."

Despite the promising results of this study, Wachs and his colleagues conclude that more studies are needed with larger groups of surgeons, since people gesture in different ways and signal their intent to use the system differently.

Clinical, patient engagement, and consumer apps promise to re-energize healthcare. Also in the new, all-digital Mobile Power issue of InformationWeek Healthcare: Comparative effectiveness research taps the IT toolbox to compare treatments to determine which ones are most effective. (Free registration required.)

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
jaysimmons
50%
50%
jaysimmons,
User Rank: Apprentice
2/2/2013 | 12:01:27 AM
re: Microsoft Kinect Technology Helps Surgeons Manipulate Images
This is a great idea. By finding a new use for already existing technology, they've been able to lower the R&D cost required to bring something very useful to market. I agree with Paul as well. Microsoft should look into repurposing this technology themselves as well, and perhaps provide a version that is better suited for this industry. I'm also a little confused how the Kinect was less accurate when context was provided, but maybe that is due to the margin of error and small sample size of the study.

Jay Simmons
Information Week Contributor
PJS880
50%
50%
PJS880,
User Rank: Apprentice
1/21/2013 | 11:40:41 PM
re: Microsoft Kinect Technology Helps Surgeons Manipulate Images
This is just one area where video game technology can be used in a variety of ways with a little creativity. I am looking forward to the ideas that will begin to flow just based upon this article and the publicG«÷s knowledge now. If I were Microsoft I would be all over this and researching what the possibilities are with their existing technology and how it can be used in other industries. Great article and a good read!

Paul Sprague
InformationWeek Contributor
InformationWeek Elite 100
InformationWeek Elite 100
Our data shows these innovators using digital technology in two key areas: providing better products and cutting costs. Almost half of them expect to introduce a new IT-led product this year, and 46% are using technology to make business processes more efficient.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest - September 10, 2014
A high-scale relational database? NoSQL database? Hadoop? Event-processing technology? When it comes to big data, one size doesn't fit all. Here's how to decide.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
A look at the top stories from InformationWeek.com for the week of September 7, 2014.
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.