Lead Developer
UX Designer
​UI Designer

---

Platforms
Microsoft HoloLens 2
​Microsoft HoloLens
Virtual Reality via Immersive HMDs

Dev Team Size
5

Development
Unity Engine
Visual Studio
C#
TFS (Team Foundation Server)
​
​Duration
2 Years - Ongoing

DICOM Director
Mixed Reality Viewer
Provides medical professionals a new way to visualize medical data that can improve diagnosis and treatment. The Mixed Reality Viewer also assist patients in making informed decisions by providing another tool for education about diagnosis and treatment.

Responsibilities for this project

• Working with Subject Matter Experts like Radiologists and Surgeons to understand their needs and wants
• Optimizations
• Testing

Create a Proof of Concept that utilizes static data

• Design and implement a user-friendly interface
• View and scroll through CAT scans, MRI scans, and more
• Display a pre-generated 3D Model
• Allow the user to manipulate the 3D Model with gestures and voice commands​

Create a fully-realized app that utilizes dynamic data

• Design / Develop for both Mixed Reality (HoloLens) and Virtual Reality
• Designing and implementing visual interfaces
• Coordinating and interfacing with Dev team across time zones
• Dynamically download, read, and render patient data including images & series.
• Dynamically download, read, and render 3D model data for visualization and manipulation
• Provide segmentation options for dynamically rendered models
• Create and implement a demo mode (offline capable)

Thoughts & Impressions

• The code for both Mixed and Virtual Reality is heavily shared. The technical limits are vastly different though since the HoloLens is completely wireless and runs off a battery. Due to this, the most difficult aspect of developing this application has been optimizing it for multiple devices.
• We initially thought the big benefit of the Mixed Reality Viewer would be the mobility (HoloLens) and ability to view medical data from anywhere like a hotel room, conference, subway, etc. After meeting with several Radiologists and Surgeons it quickly became clear that the 3D visualizations were the main draw. 

Noteworthy

• Proof of Concept has been featured on the first page of the Windows App Store and the Mixed Reality Website