Navigation Links
Surgeons may use hand gestures to manipulate MRI images in OR
Date:1/10/2013

WEST LAFAYETTE, Ind. Doctors may soon be using a system in the operating room that recognizes hand gestures as commands to tell a computer to browse and display medical images of the patient during a surgery.

Surgeons routinely need to review medical images and records during surgery, but stepping away from the operating table and touching a keyboard and mouse can delay the procedure and increase the risk of spreading infection-causing bacteria, said Juan Pablo Wachs, an assistant professor of industrial engineering at Purdue University.

"One of the most ubiquitous pieces of equipment in U.S. surgical units is the computer workstation, which allows access to medical images before and during surgery," he said. "However, computers and their peripherals are difficult to sterilize, and keyboards and mice have been found to be a source of contamination. Also, when nurses or assistants operate the keyboard for the surgeon, the process of conveying information accurately has proven cumbersome and inefficient since spoken dialogue can be time-consuming and leads to frustration and delays in the surgery."

Researchers are creating a system that uses depth-sensing cameras and specialized algorithms to recognize hand gestures as commands to manipulate MRI images on a large display. Recent research to develop the algorithms has been led by doctoral student Mithun George Jacob.

Findings from the research were detailed in a paper published in December in the Journal of the American Medical Informatics Association. The paper was written by Jacob, Wachs and Rebecca A. Packer, an associate professor of neurology and neurosurgery in Purdue's College of Veterinary Medicine.

The researchers validated the system, working with veterinary surgeons to collect a set of gestures natural for clinicians and surgeons. The surgeons were asked to specify functions they perform with MRI images in typical surgeries and to suggest gestures for commands. Ten gestures were chosen: rotate clockwise and counterclockwise; browse left and right; up and down; increase and decrease brightness; and zoom in and out.

Critical to the system's accuracy is the use of "contextual information" in the operating room -- cameras observe the surgeon's torso and head -- to determine and continuously monitor what the surgeon wants to do.

"A major challenge is to endow computers with the ability to understand the context in which gestures are made and to discriminate between intended gestures versus unintended gestures," Wachs said. "Surgeons will make many gestures during the course of a surgery to communicate with other doctors and nurses. The main challenge is to create algorithms capable of understanding the difference between these gestures and those specifically intended as commands to browse the image-viewing system. We can determine context by looking at the position of the torso and the orientation of the surgeon's gaze. Based on the direction of the gaze and the torso position we can assess whether the surgeon wants to access medical images."

The hand-gesture recognition system uses a camera developed by Microsoft, called Kinect, which senses three-dimensional space. The camera, found in consumer electronics games that can track a person's hands, maps the surgeon's body in 3-D. Findings showed that integrating context allows the algorithms to accurately distinguish image-browsing commands from unrelated gestures, reducing false positives from 20.8 percent to 2.3 percent.

"If you are getting false alarms 20 percent of the time, that's a big drawback," Wachs said. "So we've been able to greatly improve accuracy in distinguishing commands from other gestures."

The system also has been shown to have a mean accuracy of about 93 percent in translating gestures into specific commands, such as rotating and browsing images.

The algorithm takes into account what phase the surgery is in, which aids in determining the proper context for interpreting the gestures and reducing the browsing time.

"By observing the progress of the surgery we can tell what is the most likely image the surgeon will want to see next," Wachs said.

The researchers also are exploring context using a mock brain biopsy needle that can be tracked in the brain.

"The needle's location provides context, allowing the system to anticipate which images the surgeon will need to see next and reducing the number of gestures needed," Wachs said. "So instead of taking five minutes to browse, the surgeon gets there faster."

Sensors in the surgical needle reveal the position of its tip.


'/>"/>

Contact: Emil Venere
venere@purdue.edu
765-494-4709
Purdue University
Source:Eurekalert  

Related medicine news :

1. Clinical news alert from the American Academy of Orthopaedic Surgeons
2. NYU Langone experts present research, clinical advances at neurosurgeons meeting
3. Slicing mitotic spindle with lasers, nanosurgeons unravel old pole-to-pole theory
4. Clinical news alert: Journal of the American Academy of Orthopaedic Surgeons May highlights
5. Surgeons Seek Repeal of Transplant Ban Between HIV-Positive People
6. Greater availability of neurosurgeons could reduce risk of death from motor vehicle accidents
7. Adding More Neurosurgeons Could Cut Traffic Deaths: Study
8. General surgeons identify postoperative complications posing strongest readmission risk
9. Young Surgeons May Be Easily Distracted
10. In US first, Johns Hopkins surgeons implant brain pacemaker for Alzheimers disease
11. General thoracic surgeons emerge as leading providers of complex, noncardiac thoracic surgery
Post Your Comments:
*Name:
*Comment:
*Email:
Related Image:
Surgeons may use hand gestures to manipulate MRI images in OR
(Date:4/29/2016)... ... April 29, 2016 , ... For those who skip meals occasionally ... miss. That was among the many new lifestyle diet tips offered by nutritionists Pam ... Hour® Power of Water® radio show. Bonny and Lawrence noted that because proper nutrition, ...
(Date:4/29/2016)... ... ... Regenerative Medicine Solutions (RMS) scored 94.8124 out of 100 on Tampa ... for Tampa’s Best Places to Work. They were ranked in the Big Category, which ... our team,” says RMS Human Resources Manager Irene Miller. “We work hard to build ...
(Date:4/29/2016)... ... 2016 , ... Nike Softball Camp at the College of Brockport in New ... girls aged 10-18. All facets of the game will be covered; hitting, fielding, base-running, ... one of the finest softball facilities in the region. The outstanding professional college staff ...
(Date:4/29/2016)... ... April 29, 2016 , ... HEALTHCAREfirst , ... coding services, and Deyta Analytics, recently announced the recipients of the fourth annual ... quality as measured from the caregiver’s point of view. The official list of ...
(Date:4/29/2016)... ... 2016 , ... Intellitec Solutions will be a sponsor at ... the Broward County Convention Center. The event is a chance for finance professionals ... public facility management. Intellitec Solutions will highlight their customized accounting solutions designed for ...
Breaking Medicine News(10 mins):
(Date:4/27/2016)... 2016  Hologic, Inc. (Nasdaq: HOLX ... the fiscal second quarter ended March 26, 2016.  ... increased 41.2%, and non-GAAP diluted EPS of $0.47 ... on a reported basis, and 6.3% on a ... another good quarter, highlighted by 14.6% growth in ...
(Date:4/27/2016)... Transparency Market Research has published ... Global Industry Analysis, Size, Share, Growth, Trends, and Forecast ... skincare devices market was valued at US$ 7,255.8 Mn ... CAGR of 10.1% from 2015 to 2023 to reach ... full Skincare Devices Market (Treatment Device - LED Therapy Devices, ...
(Date:4/27/2016)... April 27, 2016 ... the  "Global Anesthesia Disposables Market 2016-2020"  report ... ) ,The global anesthesia disposables market ... of 4.03% during the period 2016-2020.  ... threat to patients, safety. Organizations like the ...
Breaking Medicine Technology: