Is mixed reality doctor consultation the future?

 In CraneMorley, Mixed Reality Industry Insight

A new show has debuted on BBC Two and is unlike anything you’ve ever seen before. “Your Body Uncovered with Kate Garraway” offers viewers a preview of what the future of doctor-patient consultations will look like in the near future.

X-rays, MRIs, and CT scans are brought to life in the form of digital twins, which are then used to vividly portray what is happening in a patient’s body. Doctors and patients utilize the Microsoft HoloLens 2 to view these digital twins in mixed reality, enabling them to interact in ways never before possible with state-of-the-art technology. The capabilities extend far beyond exact replication. These models provide an intricate insight into the human body, allowing users to zoom in to examine tissues and fibers within a patient’s lungs, and animations simulate various medical scenarios.

Dr. Stephen Quinn, a gynaecologist at hospitals in the NHS Trust Imperial College, shared his thoughts after experiencing the new technology during the latest episode, particularly in comparison to traditional MRI scans. He stated, “Using augmented reality just took that to a whole different level. It was fantastic being able to fully visualize exactly what was going on in the pelvis ahead of the surgery to remove the fibroids.”

*Warning the videos shown below contains graphic medical scenes*

The two videos above showcase what doctor appointments will be like in the future. The first video effectively highlights the difference between a 2D scan and a 3D model. Patients can now better understand and visualize medical issues when doctors explain them, enabling patients to make the most informed decisions possible. Although the videos don’t depict a mock procedure, they do demonstrate what will occur during surgery.

The second video demonstrates the effects of Covid-19 on a patient. Key capabilities include the technology’s ability to allow doctors to isolate the lung for a separate, simplified view, and to zoom in to show microscopic details. The simulation provides a comprehensive before-and-after comparison, illustrating how the virus affects human lungs.

When can we expect mainstream adoption of this type of doctor consultation?

Unlike training and medical education, where a one-size-fits-all design approach is acceptable, creating a cost-effective and time-efficient method for each custom digital twin is still a work in progress. Once we develop a way to convert x-rays, MRIs, and CT scans into digital twins similar to those shown in the video, we’ll be prepared for widespread use. The good news is that the technology already exists, and with recent technological advancements, it’s only a matter of time before a converter tool becomes available.

Recent Posts