Unifying In-Person and Remote Collaboration for Cardiovascular Surgical Planning in Mobile Augmented Reality
HybridCollab is the first iOS AR application that introduces a novel paradigm that enables both in-person and remote medical teams to interact with a shared AR heart model in a single surgical planning session.
For example, a team of two doctors in one hospital room can collaborate in real time with another team in a different hospital. Our approach is the first to leverage Apple’s GameKit service for surgical planning, ensuring an identical collaborative experience for all participants, regardless of location. Additionally, co-located users can interact with the same anchored heart model in their shared physical space.
Watch a video demo of HybridCollab here.
To use HybridCollab, you will need to have a .obj version of an AR heart model. Follow the instructions to setup the project.
- Clone the repo and open the
HybridCollab.xcodeprojfile inXcode. - Add the heart model to the project:
a. Ensure theobjfile is named asheart_model.obj
b. Drag the file into the project directory in Xcode, under the project and theHybridCollabgroup. - Run the app on a physical device. (Note: you may need to change the bundle id and follow the instructions here using a paid Apple Developer Account).
HybridCollab is created by Pratham Mehta, Rahul Narayanan, Vidhi Kulkarni, and Polo Chau.
The software is available under the MIT License.