XR at its most basic level enables the learner to see and interact with the “un-seeable.” In the case of mixed reality, holograms are overlaid on top of reality to provide context which helps apply for the learning job. In this case, the mixed reality was used in a formal learning experience. Its “heads up – hands-free” function also can guide a technician while actually performing a repair procedure solo and/or with a remote live expert who sees everything the technician sees while providing guidance.
As covered in the automotive press, the new Mercedes – Benz GLE has an innovative suspension system combining hydraulics and airbag components in independent configurations at all four wheels. There was no practical way for technicians to actually see the components under the car and how they interact in different ride modes.
Working closely with the Mercedes Team in order to understand the complexity of the new system, CM enabled “X-ray Vision” on the Microsoft Hololens. Technicians were able to “see” the suspension system in operation and extract each component to examine its function all mapped to the actual vehicle during the new model training workshop.
Technicians gained a comprehensive understanding of the overall system and each component’s role depending on mode and how it delivered the benefits to the customer’s ride situation – off road, on road, beach, sporty driving, etc.
Anything from levels 1 – 4 in an immersive headset:
- Mixed (augmented) Reality – guided procedure, head up, hands free
- Virtual Reality – selling skills and product introduction examples
New Denso technicians who required training in component rebuilding are located throughout the globe. Denso’s training team could not travel to every global location to keep up with demand.
Using the Microsoft Hololens as the delivery means, CM developed hands free, voice-actuated step by step training that could be completed without the presence of an instructor.
The training came in the form of a life size hologram that guided the technician through each step of the process.
This Mixed Reality application provided self-paced skills training while keeping the technician’s hands free to perform the work. It eliminated the need for instructors to travel to remote locations.