Mixed Reality enables Google Maps for surgery
University of Oklahoma researcher Mohammad Abdul Mukit and surgeon Dr. Christian El Amm at OU Health are making a Google Maps for surgery. The vision is to utilize mixed reality to guide surgeons and use AI to “visualize superimposed and anatomically aligned 3D CT scan data during surgery.”
They noticed surgeons were missing something that a pilot flying an airplane or a google map user has. A user guided application that would tell surgeons where they are in the surgery and other vital data. The vision for this application was to modernize surgeries, reduce prep time, and equip surgeons with every scenario in a matter of seconds. The design has a similar effect to google maps. Prep time is eliminated or reduced, and the technology corrects users when they take a detour or go the wrong direction.
Complex surgeries require a significant amount of prep time and to memorize unique cases. From the moment a procedure starts, surgeons are on their own with “no targeting or homing devices or head-mounted displays to assist them.” This application will “be used to see the reconstruction steps he had planned during surgery while never losing sight of the patient.”
The use of mixed reality and the HoloLens was a no brainer. The HoloLens unlocked new possibilities to improve efficiency and increase safety. Two big doors unlocked are hands free operations and collaboration.
In surgery we want surgeons to remain focused on the task at hand and not computer after their hands are sanitized touching a computer. The HoloLens provides surgeons with a computer in their field of view, where they no longer bounce back and forth between computer screen and operating table. Virtually touching objects, voice, and gaze commands reduce touch point where hands are contaminated.