What would an NFL football game be without the yellow 1st down line painted on the field? Emmy award winning Sportvision from Mountain View, California introduced "1st and Ten" in 1998 and the game has never been the same. Fans watching from home know when a team gets a first down before fans in the stadium. The players seem to be able to walk on top of the line painted on the field. The yellow 1st down line is an example of augmented reality.
What is augmented reality?Augmented reality is technology that combines virtual reality with the real world. The current world of augmented reality deals with live video imagery which is digitally enhanced with computer generated graphics. For example, a user might wear translucent goggles or view the screen of a camera equipped mobile device where they can see the real world as well as strategically placed computer generated images. Ronald Azuma's definition of augmented reality is widely referenced in research literature. He defines an augmented reality application as one that (1) combines the real world with the virtual world, (2) is interactive and in real-time and (3) is registered in 3 dimensions.
Augmented reality has existed since the 1930's but recent advances in smartphone technology has fueled the recent hype. For a couple of bucks, an average person can point their iPhone at the night sky and view the layout of the stars and planets in their exact locations with full definitions. While the smartphone doesn't have the computing power for many augmented reality applications, it is introducing the world to this concept. Many researchers have pointed to the mobile phone industry as saving their augmented reality research programs by making it more mainstream.
There are essentially 3 different kinds of displays of augmented reality:
- The head mounted display (HMD) is worn on the head or attached to a helmet. This display can resemble goggles or glasses. In some instances, there is a screen that covers a single eye.
- The handheld device is a portable computer or mobile smartphone such as the iPhone.
- Spatial display makes use of projected graphical displays onto fixed surfaces.
Applications for augmented reality are broad. The military uses augmented reality to assist men and women making repairs in the field. The gaming industry is moving games outside like the old days…equipped with wearable head gear of course. And then there is everything in between.Navigation
Navigation applications are possibly the most natural fit of augmented reality with our everyday lives. Enhanced GPS systems are using augmented reality to make it easier to get from point A to point B. Wikitude Drive for the Android operating system which is currently in beta brings the GPS into the 21st century. Using the phone's camera in combination with the GPS, the users see the selected route over the live view of what is in front of the car.Sightseeing
There are a number of applications for augmented reality in the sightseeing and tourism industries. The ability to augment a live view of displays in a museum with facts and figures is a natural use of the technology. Total Immersion, a global leader in augmented reality, develops systems designed to enhance the experience of the museum attendee. Their interactive kiosk solution allows guests to interact with the display in 3D. They choose a model card such as a human heart and hold it under the camera. On screen, a perfect 3D representation of the heart appears on screen allowing the guest to interact as if it's a real heart.
Out in the real world, sightseeing has been enhanced using augmented reality. Using a smartphone equipped with a camera, tourists can walk through historic sites and see facts and figures presented as an overlay on their live screen. These applications use GPS and image recognition technology to look up data from an online database. In addition to information about a historic site, applications exists that look back in history and show how the location looked 10, 50 or even 100 years ago.Military
The Heads-Up Display (HUD) is the typical example of augmented reality when it comes to military applications of the technology. A transparent display is positioned directly in the fighter pilots view. Data typically displayed to the pilot includes altitude, airspeed and the horizon line in addition to other critical data. The term "heads-up" comes from the fact that the pilot doesn't have to look down at the aircraft's instrumentation to get the data they need.
The Head-Mounted Display (HMD) is used by ground troops. Critical data such as enemy location can be presented to the soldier within their line of sight. This technology is also used for simulations for training purposes.Medical
There have been really interesting advances in medical application of augmented reality. Medical students use the technology to practice surgery in a controlled environment. Visualizations aid in explaining complex medical conditions to patients. Augmented reality can reduce the risk of an operation by giving the surgeon improved sensory perception. This technology can be combined with MRI or X-ray systems and bring everything into a single view for the surgeon.
Neurosurgery is at the forefront when it comes to surgical applications of augmented reality. The ability to image the brain in 3D on top of the patient's actual anatomy is very powerful for the surgeon. Since the brain is somewhat fixed compared to other parts of the body, the registration of exact coordinates can be achieved. Concern still exists surrounding the movement of tissue during surgery. This can affect the exact positioning required for augmented reality to work.