Mixed Reality

Mixed Reality Group for EYE Surgery Training

Mixed Reality Group Research

ARAS Mixed Reality research group, is aimed to build a simulator of vitrectomy and cataract surgery using virtual reality to provide a completely similar environment for real surgery for eye surgery residents. The Objective of research in this group will be completed with a joint collaboration research with Surgical Robotic (SR) research group of ARAS. We aim to incorporate the mixed reality simulation tool developed in this group to ARASH:ASiST, the product developed in SR group for Vitrectomy training.

For implementing an online Mixed reality platform for the eye surgery training system, different core projects are presented which are progressing simultaneously. For each project, different phases are moving forward. Some movies are added below to show the flow:

ARASH:ASiST surgical robot in Unity

Online simulation of ARASH:ASiSTsurgical robot in Unity has been implemented in order to bring data of the surgeon’s needle movements to the mixed reality system in realtime mode, specialized for vitrectomy surgery.

Geomagic haptic in Sofa framework

Online simulation of Geomagic haptic device in Sofa framework is added to cover cataract surgery’s workspace

Application of online data by a Geomagic haptic robot on a simulated object in Sofa framework

vitrectomy surgery in Sofa framework

Different parts of vitrectomy surgery are initially accomplished in Sofa framework concerning the essential physical accuracy of vitrectomy surgery simulation. The stages consist of, tissue suction by tool , grab and pull the vitreous tissue out of the eye, Rupture and destruction of tissue by surgical instruments

Tissue suction in Sofa framework

Simulation of eye tissue suction by surgical instrument

Catching and pulling eye tissue in Sofa framework

Simulation of handling and pulling tissue by forceps surgical instruments