Lead Developer
UX Designer
​UI Designer

---

Platforms
Microsoft HoloLens 2
​Microsoft HoloLens
Virtual Reality via Immersive HMDs

Dev Team Size
5

Development
Unity Engine
Visual Studio
C#
MRTK
TFS
​
​Duration
2 Years - Ongoing

DICOM Director
Mixed Reality Viewer
Provides medical professionals a new way to visualize medical data that can improve diagnosis and treatment. The Mixed Reality Viewer also assist patients in making informed decisions by providing another tool for education about diagnosis and treatment.

Responsibilities

• Work with Subject Matter Experts like Radiologists and Surgeons to prioritize features for development cycle
• Optimizations
• Testing

Create a Proof of Concept that utilizes static data

• Design and implement a user-friendly interface
• View and scroll through CAT scans, MRI scans, and more
• Display a pre-generated 3D Model
• Allow the user to manipulate the 3D Model with gestures and voice commands​

Create a feature-rich app utilizing dynamic data

• Design / Develop for both Mixed Reality (HoloLens) and Virtual Reality
• Designing and implementing visual interfaces
• Coordinating and interfacing with Dev team across time zones
• Download, Read, and Render dynamic patient data including series images.
• Dynamically download, read, and render 3D model data for visualization and manipulation
• Provide segmentation options for dynamically rendered models
• Implement a demo mode (offline capable)

Thoughts & Impressions

• The code for both Mixed and Virtual Reality is heavily shared. The technical limits are vastly different though since the HoloLens is completely wireless and runs off a battery. Due to this, the most difficult aspect of developing this application has been optimizing it for multiple devices.
• We initially thought the big benefit of the Mixed Reality Viewer would be the mobility (HoloLens) and ability to view medical data from anywhere like a hotel room, conference, subway, etc. After meeting with several Radiologists and Surgeons it quickly became clear that the 3D visualizations were the main draw. 

Noteworthy

• Proof of Concept has been featured on the first page of the Windows App Store and the Mixed Reality Website