SurgeonPedia
An integrated ecosystem that helps doctors explore, learn, and share procedures using mixed reality before, during and after an operation.
SurgeonPedia was created to help doctors who were going to preform the 1st XR-assisted surgery in LATAM. The patient was an Olympic Athlete, no pressure.

I was tasked with designing the XR digital experience using Microsoft HoloLens and the SurgeonPedia platform. I was responsible for user research, UX design, UI design, and usability testing.

SurgeonPedia is an ecosystem that pairs mixed reality with a platform that allows doctors to prepare for surgeries, have patient information at hand in the OR and share their knowledge with other colleagues.

↓ Check out the nerdy details below ↓
The Nerdy Details
Role:
Product Designer / Design Lead

Date:
January 2020

Responsibilities:
User Research, UX Design, UI Design, Usability Testing

Team:
XR Architect
Project Context:

THE CHANCE OF A LIFETIME
This project appeared as an opportunity to work with another Innovation company. A high-performing Olympian Athlete was going to have shoulder surgery in three weeks and the doctor performing the operation wanted to use mixed reality in the OR as it was a very delicate procedure. It was the first operation preformed in Latin America using XR.

When me and the team’s XR architect were assigned the project, we got down to business.The task sounded pretty straightforward: To make sure the surgeon had the information he needed at hand so he could access it without having to leave the room.  

For the second iteration, our Innovation Lead wanted us to create an ecosystem out of the prototype. After learning that 90% of surgeons use platforms like YouTube to study and prepare for procedures, we saw an opportunity and created SurgeonPedia.
Users:

THANK GOODNESS FOR ALL OUR MEDICAL CARE WORKERS! 
This digital product was targeted to doctors and surgeons who preform difficult and high-risk surgeries and use digital platforms to prepare for operations and procedures.
Scope & Contraints:

TIME'S TICKING!
As we had a very limited amount of time, we made sure we didn’t waste a second. I also created this product as a side project in addition to my daily meetings and work.  

Me and the XR Architect sat down to plan and learned the doctor was going to be using our Microsoft HoloLens for the operation.

This meant researching and making sure I had the HoloLens’s design guidelines down for a smoother experience.
Process:

LET'S BRING SCI-FI TO REAL LIFE
The journey began by visiting a few doctors and surgeons so we could get to know their specific needs in the OR.
We learned so much and some of our key findings were:
Doctors consult with other colleagues for advice and ideas on how to tackle an operation

Patient records are still physical
Doctors rely on another’s interpretation of the patient’s information in the OR
Preforming a high-risk surgery means running out of the OR to review X-rays & MRI/CT Scans making these procedures long

Surgeons rely on their memory of a scan during an operation
X-rays, MRI and CT Scans can only be opened using special software and take forever to load
With all this research, we each focused on our responsibilities. While the XR Architect was busy researching development guides for the HoloLens, I was busy looking into the design guidelines, best practices, software and hardware limitations etc. After I felt I had a strong knowledge base to start designing, we listed out the requirements and I got started sketching wireframes.
After a lot of crumbled up paper and lost pencils, I got down the final ideas that would be feasible in the amount of time we had left (two weeks). I created grayscale wireframes to start testing out the user experience.
I tested this version with 2 UX designers and the doctor. After making adjustments I designed the interface.
Then it was time. The surgery we were all waiting for happened. It was a complete success and the estimated time of surgery was reduced by 40%.

We both got excellent feedback by Accenture’s Innovation Team, the partnered company, and the surgeon. The story was even featured on the news!
IT DOESN'T END HERE...
This project was submitted to Accenture’s Greater Than Awards which is a Global competition for projects that have made a big impact in the company and society. It ended up winning its category.  

Then we were encouraged to submit our demo to Accenture’s Global Innovation & Technology Contest, which looks for crazy, innovative solutions to add value to the company. That’s when we started the second iteration…
The next iteration for this project was discussed with doctors who revealed they would love for the content to be shared with other colleagues.

As we started the discovery phase for this next iteration, we had new findings:
90% of surgeons use video platforms to study and prepare for procedures
In the last 10 years there has been an increase in the medical content uploaded to video platforms
Out of 1800 Heart Transplant videos only 19% of them contained useful and relevant information
So we asked ourselves: How would a patient feel if they knew their surgeon watched a YouTube video to prepare for the surgery?

We designed an integrated ecosystem that feeds itself accurate and relevant information for surgeons before, during and after surgery and called it SugeronPedia.
It’s made up of an extensive catalog of updated procedure videos that have been validated by specialists, giving doctors the ability to create playlists to prepare for an operation and get recommendations for their next surgery.
The platform follows a step-by-step approach to surgery videos which include, detailed voice notes from the surgeon and highlights of relevant and useful information they found in the OR.
During a procedure, the team needs to keep track of different sources of information and make a quick decisions based on that data.

While operating on the Olympic athlete, her vitals started dropping and at that moment, the doctor needed more information. Instead of sending staff to retrieve and interpret X-Rays, MRI/CT Scans, 3D models, or other data, or worse, stepping away her/himself… that’s when MR saved the day.
The HoloLens records all interactions, while providing access to the patient’s information and the playlist created for this surgery. With this feature we can empower doctors with information to make better decisions and reduce infection that could happen by touching physical objects.
The video would then be uploaded to the Content Creation tool where users can add relevant information about the procedure like notes, audios, drawings and highlights where it would then be validated by specialists.

All this translates to quicker recovery times, increased space in hospitals and improved tools to benefit patients.
THEN WHAT HAPPENED?

SurgeonPedia is still ongoing and made it into the next phase in the Innovation for Business category of Accenture’s Global Innovation & Technology Contest. It will now go up against 5 other projects from Latin America.
WHAT I LEARNED...
I am so proud of this particular project. I'm especially motivated when creativity and technology come together to improve our way of life. It’s also received very good feedback from senior leadership and is one of the most visited demos of our showroom. 

I learned so much during this project, including designing for mixed reality which was a first for me. It sparked a curiosity for 3D modeling and I’m currently playing around with Blender.

I am very excited to find out where all these new learnings will take me next.
To comply with my non-disclosure agreement, I have omitted and blurred confidential information. All of this case study's material is copyrighted and property of Accenture.
Up next
NewBe →
Let's talk!

Linkedin
Life moves pretty fast, if you don't stop and look around once in a while, you could miss it
Thanks for stopping by

Have some fun