Google Earth VR is the first virtual reality experience to let users freely navigate the entire planet and see the world from impossible perspectives. It demonstrates VR’s empathic ability to trigger memories and feel more connected to the world.

Achieving the design of this virtual reality experience was an immense challenge. In addition to the technical difficulty of rendering the entire planet fast enough to keep players immersed, I had to discard what I knew about screen-based design patterns and interaction models. To do this right, I had to dive deep into human ergonomics, physiology and perception in order to rethink navigation and interfaces for VR. In doing so, Earth VR paved the way for users to fly, move and explore our planet in a comfortable and delightful way.

 



Process

A view into the UX process for Google Earth VR.
[talk time: 9 min]

 
 

For the first two years on Earth VR, I was the sole UX designer, responsible for wearing many hats: UX flows, concepting, prototyping, visual design, 3D modeling, motion design, sound design and delivery of the complete experience.

Designing high-quality immersive experiences for VR is a new field and until late-2016, there were no strong examples of good UX in VR due to an unusual amount of constraints. Bad UX in VR can be the result of not paying close attention to any one of the following constraints:

  • Optics and resolution
  • Users vestibular system
  • Users vision system
  • Users peripheral vision
  • Users ergonomics
  • Users posture (seated vs standing)
  • Users emotional triggers (eg: proximity, scale and motion)
  • Various room sizes

New design patterns

My UX contributions on Earth VR involved pioneering design patterns for VR.

Navigation – Flying

Scaled flying was invented to allow users to fly at varying altitudes without sensing a fear of heights. It works by combining smooth motion while scaling the user, so their feet are always on the ground.

 

Navigation – Tunneling

Tunnel Vision was invented to allow users to fly like Superman without getting sick. It works by projecting world-locked elements in the user’s periphery to trick their vestibular system into thinking that it is not physically moving.

 

Navigation – drag

Cone drag was invented to allow users to move around like Spiderman without getting stuck inside terrain. It works by moving the selected terrain along a proxy-cone that emanates from the base of the user’s feet.

 

Modes – Globe / Terrain

Because users have different mental models of how to find places on Earth, we provide them with Globe and Terrain modes that they can switch between. Globe mode puts the Earth right in front of the user and lets them drag and zoom it. Terrain mode puts the Earth under their feet and lets them drag and fly around it.

 

Browse Menu

The browse menu provides users with instant access to featured places, tours, saved places, search and settings. This was the first browse menu of its kind within Google and paved the way for design patterns.

 

Spatial Audio

Adding spatial audio to Earth greatly elevates the level of delight and immersion. Atmospheric sound effects and music dynamically adapt based on the user’s flight speed, the time of day and elevation. All audio is rendered in true 3D using Google’s spatial audio technology (Resonance Audio).

 

 

Search

Search works as expected to teleport users to any address on the globe. To ensure users can see the destination after teleporting, users are set at a specific height and distance from the destination.

 

Street View

Street View was integrated into Earth to add realistic presence at ground level. After extensive exploration, we found that the easiest way to achieve this was to put a preview of Street View on the secondary controller and let users pop their head into it.

 

Awards

Since Earth VR’s launch in Nov 2016, it has been widely recognized as one the best and highest quality VR apps and is one of the go-to apps people show friends and family to help them understand the power of VR.

Stats

 

Steam

  • #2 Most Owned

  • #3 Most Played
  • #18 Best Rated of 730 VR titles
  • Rating of 96% “Overwhelmingly Positive"

Oculus

  • #2 App by Weekly and Monthly Active Players
  • #8 by Time Spent
 

Related posts

 

May 24, 2016

Spatial audio design
 

May 19, 2017

2D UI’s in VR