In simple terms, AR means overlaying digital content onto the real world, typically using a phone or smart glasses. While AR can enhance the user’s perception of an environment, spatial computing embeds digital content in 3D space and provides a sense of depth. This blog explains the benefits of these enhancements in more detail, and provides examples of spatial computing used in six key business and industry categories.
Augmented Reality (AR) is a technology that overlays digital elements—like images, sounds, or 3D objects—onto the real world, viewed through a device like a smartphone, tablet, or AR headset. AR blends the digital with the physical, allowing users to interact with virtual elements in their environment. For example, apps like Pokémon GO or Snapchat filters place digital visuals on top of the real world as seen through a phone screen, enhancing a user’s physical surroundings with additional information or interactivity.
Spatial Computing, while it includes AR, is a broader concept. It refers to computing that integrates digital and physical spaces by using technology to interact with three-dimensional environments. It enables computers to blend in with the physical world in a natural way. Spatial computing encompasses AR, Virtual Reality (VR), and Mixed Reality (MR), as well as technologies like gesture recognition, 3D mapping, and AI to create experiences that interact intelligently with physical space. This goes beyond AR by allowing for more complex, immersive interactions and environments that understand and respond to a user’s movements and surroundings.
AR is therefore one form of spatial computing, though spatial computing is a more comprehensive framework that aims to make digital experiences seamlessly integrate with the physical world across multiple dimensions and devices. Spatial computing builds on AR’s strengths by adding greater depth perception, interaction, and spatial awareness. It enables:
Environment mapping in which the system can recognize and adapt to physical surroundings, enabling more realistic interactions.
Multi-modal interactions for users to interact with virtual elements using gestures, voice commands, and physical objects, creating a richer, more hands-free experience.
Persistent virtual elements whereby digital objects can remain in place in physical environments, meaning users can return to a scene and find digital items where they left them, increasing continuity in applications like collaborative work or interior design.
These advancements make spatial computing particularly transformative in fields where real-time interaction, precision, and contextual awareness are critical. At Apple’s entry price for Vision Pro of $3,500 in U.S. and £3,500 in the UK, consumer sales in 2024 have fallen below expectations and development is in hand for a lower price version. The number of apps released for consumer use has also been below expectations, though many corporations have created spatial computing apps for internal use among its professional and specialist employees.
Spatial computing in practice
Augmented Reality (AR) has already been transforming industries including retail, education, healthcare, and manufacturing by overlaying useful digital information onto the real world. Spatial computing takes these benefits further by enabling more complex, immersive interactions that integrate the physical and digital worlds seamlessly. Here’s a look at some of the best uses of AR and how spatial computing can elevate these experiences.
Retail and Shopping
Many retailers use AR to help customers visualise products in their own environments, such as IKEA’s AR app, which allows users to see how furniture would look in their space. Beauty brands like Sephora offer virtual try-on experiences for makeup.
Spatial computing improves this by using spatial awareness and depth sensing to give even more accurate product placement and movement in a room. For instance, spatial computing could allow users to interact with virtual furniture in real size and even see how it behaves in different lighting, enhancing the “try-before-you-buy” experience.
Gucci’s Vision Pro app allows users to virtually try-on accessories, watch Gucci fashion shows, play Gucci Arcade games, personalize products in the Gucci DIY section, discover the House’s signature bags through an immersive 3D experience, and enter special sections – such as Gucci Places to explore curious corners of the world, and Gucci Garden, designed with the creative spirit of the exhibit space in Florence.
Education and Training
AR helps in interactive learning by superimposing educational information onto real-world objects. In biology, for instance, AR apps can bring anatomy models to life for students, helping them learn complex systems in 3D.
With spatial computing, these models become even more dynamic and responsive. In medical training, a spatial computing environment could allow students to virtually “enter” body systems, interact with tissues and organs, and simulate procedures with realistic feedback. This interactivity provides a deeper level of understanding compared to standard AR. It also allows comprehensive training for operating in dangerous environments.
NASA and SpaceX use VR headsets and AR systems to create immersive environments replicating the Moon’s or Mars’ surface, complete with realistic landscapes, potential hazards, and atmospheric conditions. These simulations allow astronauts to train for upcoming missions to the Moon (Artemis missions) and Mars. They practice navigation, habitat setup, and geological sampling, ensuring they’re prepared for alien conditions. Despite Elon Musk’s initial reservations about the first model of Apple’s Vision Pro (and as the founder of SpaceX his opinion matters), he believes it could evolve significantly in the future.
To operate in another dangerous environment, the U.S. National Oceanic and Atmospheric Administration (NOAA) uses VR and spatial computing to train researchers and marine biologists in the complexities of deep-sea ecosystems. They simulate various underwater environments, allowing trainees to experience ocean pressure, darkness, and the hazards of navigating around fragile coral reefs or hydrothermal vents, without any physical risk. This spatial computing approach helps them gain familiarity with tools and procedures in a controlled, immersive environment before diving
Navigation and Wayfinding
AR can display directional arrows or labels directly on the screen while navigating through real-world environments. Google Maps uses AR to show directions as you walk, making it easier to find your way in complex areas.
Spatial computing could expand this by making these directions interactive and context-aware. It could recognise specific locations or landmarks and provide detailed information or alternative routes based on current traffic and pedestrian flow, potentially integrating with smart city infrastructure for real-time updates.
The NAXIT DePIN (Decentralised Physical Infrastructure Network) is a blockchain-based and crowdsourced provider of the required data (imagery).
Healthcare and Surgery
AR is already aiding in minimally invasive surgeries by overlaying CT scans or MRI images directly on a patient’s body to guide surgeons in real-time.
Using haptic technology, healthtech VR company FundamentalVR has created the first low cost ‘flight simulator for surgeons’ with a sense of touch. Its CEO, Richard Vincent, put it this way: “It’s about getting to a point where someone has what we call ‘pre-human competence’. It’s about people feeling happy with their knowledge and skills before they interact with a human being.”
With spatial computing, doctors could have enhanced access to a 3D holographic model that responds to voice commands, gestures, and real-time patient data, enabling a multi-dimensional approach to surgery. This kind of precise, real-time spatial visualization offers surgeons a comprehensive view of complex structures, improving accuracy and outcomes even further.
Health records company Epic Systems has released Spatial Computing Concept for use with Apple Vision Pro. It allows medical professionals to use hand gestures or virtual keyboards to manage patient records, chart notes, and secure communications. This app is designed for intuitive, gesture-based control in healthcare settings.
Manufacturing and Maintenance
AR applications provide real-time guidance in manufacturing and maintenance. Technicians can see step-by-step instructions superimposed on equipment, reducing errors and increasing efficiency.
Spatial computing could enhance this with gesture control and environment mapping, allowing technicians to interact with complex virtual interfaces hands-free. For example, the system might recognize when a user reaches for a tool and offer relevant guidance on usage. This hands-free, interactive environment is invaluable in high-stakes situations where precision is critical.
When it comes to aircraft maintenance, taking a plane offline for training can be costly and cause delays throughout the system. KLM’s Engine Shop app for Apple Vision Pro helps streamline inspections and repairs with greater precision and less downtime, prepares technicians to install equipment, teaches complex tasks that require hundreds of hours of hands-on work, and makes training procedures that are critical to employee success more interactive and impactful.
Entertainment and Gaming
AR gaming apps like Pokémon GO bring digital elements into real-world surroundings, creating a mixed-reality experience.
Spatial Computing takes this further with fully immersive environments where virtual characters or objects interact realistically with the physical space, responding to furniture, walls, or lighting conditions. In gaming, spatial computing allows for a more seamless blending of virtual and physical worlds, making interactions feel lifelike and immersive.
Soul Spire provides a unique puzzle adventure where players interact with colour-changing structures and guide friendly ghosts to freedom. It is designed to utilize Vision Pro’s eye and hand-tracking features, creating an immersive and responsive gaming experience. The game’s integration of sound and visual effects, paired with Vision Pro’s spatial computing abilities, makes it a solid example of Vision Pro’s gaming potential
Puzzling Places is a relaxing 3D puzzle experience that allows players to assemble intricate virtual models of real-world locations. Rebuilt for Vision Pro, it uses spatial computing to enhance the user’s sense of depth and scale, allowing for more natural puzzle assembly with hand-tracking input. This tactile experience benefits from Vision Pro’s high-resolution display and spatial audio, making it a top choice for immersive puzzle fans.
BOLD Awards 2025
We are proud to announce that our BOLD Awards VI edition ceremony will be hosted in the vibrant city of Lisbon, Portugal on March 28th, 2025. This edition is supported in strategic partnerships with APDC (Portuguese Association for the Development of Communications) and Unicorn Factory Lisboa, two prominent organisations dedicated to fostering innovation and entrepreneurial success.
The BOLD Awards 2025 categories will encompass a wide range of 33 fields such as AI, Quantum Computing, Sustainability, HealthTech, and more. The Boldest AR/VR category award will go to the best overall AR/VR and XR project from an aesthetic, usability, and technology perspective. Additional points will be given to evidence of multiple successful applications of AR/VR reality technology. FundamentalVR is a previous winner.
You can check the full list of categories, and submit your project now. You can return and update it as many times as you want up to the final submission deadline of December 6th 2024. Be BOLD!
