Researchers from the Fraunhofer Institute for Integrated Circuits IIS have introduced the prototype of a virtual surgery trainer at MEDICA 2018. “HandsOn.surgery” helps surgeons prepare for individual patient cases prior to surgery, and enables them to practice the surgery. Visitors could experience HandsOn.surgery live at the trade fair.

Both the surgical placement of implantable hearing aids and the surgical treatment of tumor diseases require milling the petrosal bone. Operations on the petrosal bone are both challenging and risky for any surgeon, as the facial nerve runs through the bone there, concealed, and the tight access offers a particularly limited surgical view.

Aspiring surgeons therefore need extensive training before they can routinely perform such difficult procedures. To date, training opportunities are limited to just a few specialized centers, making large-scale training impossible. The virtual surgery trainer supports physicians in their education and training and is expected to help minimize surgery time and the risk of injury.

An immersive experience

With HandsOn.surgery, surgeons can simulate individual procedures in oral and maxillofacial surgery, orthopedics and other areas before the actual operation using the patient’s digital twin – at any time, as often as they want, and with no risk.

The highly immersive HandsOn.surgery trainer enables doctors to see, feel and practice a virtual operation: because it uses real CT patient data, force feedback from the surgical instrument, intuitive touchscreen selection and a 3D monitor or VR headset, the trainer lets doctors experience the operation as if they were performing it live on the patient, including original operating room sounds.

HandsOn.surgery was created in the “HaptiVisT” project, which is being funded by the German Federal Ministry of Education and Research (BMBF) (funding code 16SV7559) from June 1, 2016 to May 31, 2019. The aim of the project is to develop and evaluate a haptic-visual learning system for surgical procedures that can be used in both urban and rural hospitals to address the widespread shortage of medical specialists.

Source: Fraunhofer Institute for Integrated Circuits IIS