University of Oklahoma researcher Mohammad Abdul Mukit and surgeon Dr. Christian El Amm at OU Health are developing a surgical navigation system akin to Google Maps. Their vision involves leveraging mixed reality to guide surgeons and utilizing AI to “visualize superimposed and anatomically aligned 3D CT scan data during surgery.”

Recognizing that surgeons lacked a crucial tool that pilots have while flying planes or that Google Maps users enjoy, Mukit and Dr. El Amm aimed to create a guided application for surgeons. This application would provide surgeons with essential information during surgery, much like how a navigation app provides real-time guidance. Their goal was to modernize surgical procedures, minimize preparation time, and equip surgeons to respond to any scenario in a matter of seconds. The design of this application shares similarities with Google Maps, as it eliminates or reduces prep time and corrects surgeons if they stray from their intended path.

Complex surgeries demand extensive preparation time and the memorization of unique cases. Once a procedure commences, surgeons often work without targeting or homing devices or head-mounted displays to assist them. This new application, however, allows surgeons to visualize planned reconstruction steps during surgery while keeping their focus on the patient.

The adoption of mixed reality and the HoloLens was an obvious choice. The HoloLens introduced new opportunities to enhance efficiency and bolster safety. Two significant advantages emerged: hands-free operations and collaboration.

In surgical contexts, maintaining a surgeon’s concentration on the task at hand is paramount. With the HoloLens, surgeons have a computer interface within their field of view, eliminating the need to switch between a computer screen and the operating table. By using virtual interactions like touch, voice commands, and gaze, surgeons can reduce touch points that could potentially lead to contamination.

Collaboration not only enhances patient care but also improves hospital efficiency. The HoloLens enables surgeons to share their field of view with experts worldwide. These subject matter experts can annotate and highlight concerning areas or indicate where surgery should occur. As these experts can work remotely, travel requirements decrease, allowing them to participate virtually in more operations from a centralized location.

Additionally, the system has training benefits. Anyone can virtually observe surgical procedures from an advantageous angle without disrupting the procedure. The HoloLens can also record surgeries for future on-demand training purposes.

In essence, the collaborative efforts of Mukit and Dr. El Amm, along with the utilization of mixed reality and the HoloLens, are reshaping the landscape of surgical practices, improving efficiency, safety, collaboration, and training possibilities.