Microsoft Kinect Technology Helps Surgeons Manipulate Images - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

10:39 AM

Microsoft Kinect Technology Helps Surgeons Manipulate Images

Study shows device can preserve sterility by letting surgeons alter MR images without touching computer.

10 Medical Robots That Could Change Healthcare
10 Medical Robots That Could Change Healthcare
(click image for larger view and for slideshow)
A system based partly on the Xbox Kinect motion-sensing technology can be effective in helping surgeons manipulate MR images in the OR while preserving sterility, according to a new study in the Journal of the American Medical Informatics Association.

Surgeons are interested in this technology because the manual use of computer workstations to manipulate these images creates potential for infection. Physicians who touch a mouse or a keyboard need to scrub in again, wasting precious time. Although surgeons can ask staffers to rotate or enlarge images, this approach can be cumbersome, inefficient and frustrating.

The hands-free Kinect gaming device, which Microsoft created in 2010, has been used before to safeguard sterility in ORs. For example, surgeons at Sunnybrook Hospital in Toronto have been using Kinect since 2011 to manipulate images without touching a computer. But the JAMIA study, conducted by researchers at Purdue University in Indiana, used scientific methods to establish the reliability and efficacy of the technique.

[ Technology can play a key role in improving health care, but it will never replace the human touch. Read Internet Has Yet To Replace Family Doctors. ]

The team used a three-step process in their research. First, they developed an MR image browser application and studied the gestures of 10 surgeons to establish which of their gestures would be appropriate to use with the application. Second, the team developed gesture-recognition software that would detect the intentionality of users' gestures. And finally, they performed three experiments to validate whether the system could discriminate between intentional and unintentional gestures.

The first experiment, which included both intentional and unintentional gestures, showed that the system could detect the correct gestures with an accuracy rate of 97.9%, with a 1.36% false positive rate. Similar results were obtained when the number of users was increased from two to ten in the second experiment. In the third experiment, the research team determined that the system could correctly determine intent or context 98.7% of the time. Mean gesture recognition accuracy was 92.6% with context and 93.6% without context.

Juan Pablo Wachs, an assistant professor at Purdue University and one of the study's authors, told InformationWeek Healthcare that the importance of context was the key finding in the study. "When you don't look at the context, you're just looking at the hand movement to control a medical image in a browser. There are a lot of reasons a surgeon may want to perform hand movements. The critical point is that the application has to be able to recognize the intent of the surgeon to be able to know whether he's performing movement to manipulate the images in the browser."

The high rate of gesture recognition using motion-sensing technology is not new, Wachs pointed out. What is new is that the system his team created decreased the number of "false alarms" -- gestures that were unintentional or that had nothing to do with image manipulation.

Wachs added that he and his colleagues have been studying the use of motion-sensing devices in the OR since 2008, long before Kinect came along. "Kinect helped us get better results, but it was not solving the scientific problems. It just provided a tool."

Despite the promising results of this study, Wachs and his colleagues conclude that more studies are needed with larger groups of surgeons, since people gesture in different ways and signal their intent to use the system differently.

Clinical, patient engagement, and consumer apps promise to re-energize healthcare. Also in the new, all-digital Mobile Power issue of InformationWeek Healthcare: Comparative effectiveness research taps the IT toolbox to compare treatments to determine which ones are most effective. (Free registration required.)

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
User Rank: Apprentice
2/2/2013 | 12:01:27 AM
re: Microsoft Kinect Technology Helps Surgeons Manipulate Images
This is a great idea. By finding a new use for already existing technology, they've been able to lower the R&D cost required to bring something very useful to market. I agree with Paul as well. Microsoft should look into repurposing this technology themselves as well, and perhaps provide a version that is better suited for this industry. I'm also a little confused how the Kinect was less accurate when context was provided, but maybe that is due to the margin of error and small sample size of the study.

Jay Simmons
Information Week Contributor
User Rank: Apprentice
1/21/2013 | 11:40:41 PM
re: Microsoft Kinect Technology Helps Surgeons Manipulate Images
This is just one area where video game technology can be used in a variety of ways with a little creativity. I am looking forward to the ideas that will begin to flow just based upon this article and the publicG«÷s knowledge now. If I were Microsoft I would be all over this and researching what the possibilities are with their existing technology and how it can be used in other industries. Great article and a good read!

Paul Sprague
InformationWeek Contributor
10 Ways to Transition Traditional IT Talent to Cloud Talent
Lisa Morgan, Freelance Writer,  11/23/2020
Top 10 Data and Analytics Trends for 2021
Jessica Davis, Senior Editor, Enterprise Apps,  11/13/2020
Can Low Code Measure Up to Tomorrow's Programming Demands?
Joao-Pierre S. Ruth, Senior Writer,  11/16/2020
White Papers
Register for InformationWeek Newsletters
The State of Cloud Computing - Fall 2020
The State of Cloud Computing - Fall 2020
Download this report to compare how cloud usage and spending patterns have changed in 2020, and how respondents think they'll evolve over the next two years.
Current Issue
Why Chatbots Are So Popular Right Now
In this IT Trend Report, you will learn more about why chatbots are gaining traction within businesses, particularly while a pandemic is impacting the world.
Flash Poll