Article by Joel Zimba, Special Projects Coordinator, MDTAP
The idea of “augmented reality” is nearly as old as it’s better-known brother “virtual reality.” Augmented reality starts when the real world is included in a virtual experience or viceversa. One of the simplest forms of augmented reality is a recorded audio tour of a museum exhibit. In a sense, a virtual map which changes in relation to real world GPS coordinates is also augmented reality. While the promise of virtual reality has yet to materialize, augmented reality is moving along at a brisk pace.
In the last two years, several smartphone-based apps have been developed which demonstrate the concept of augmented reality. While looking at the phone screen and pointing the camera at objects such as street signs or buildings, additional information is included with the image of the world around you. For example, a restaurant sign might retrieve information such as that day’s lunch special while a subway entrance would list the time left until the next train arrives. While these apps are a good demonstration, it’s not a particularly practical system.
Google recently announced a new product which may be the first workable means of augmented reality. A pair of glasses which combine a digital display with conventional lenses. Throw in a couple of cameras, speakers, wireless connectivity and GPS, and the possibilities are unlimited.
Some simple examples of practical uses are virtual arrows or perhaps a bouncing red ball guiding your way along a desired route, or simply having the time and other such information just at the edge of your field of vision. The author William Gibson has written about augmented reality art installations which would only show a virtual sculpture when you are standing in exactly the right location. This could lead to an entire layer of digital scenery interwoven with the solid familiar objects around us.
But this is a blog about assistive technology. How will this particular piece of technology prove useful to people with disabilities? The answer is that we just don’t know. Remember, nobody knew what the Internet would prove to be when it was in its infancy. Here are a couple of early guesses.
Let’s say a group of students are on a field trip to the zoo. While watching the chimps play, the teacher momentarily switches on an overlay which shows the natural habitat. Later, a cross-section cutaway of the cheeta’s foot accompanies an explanation of how they run. The ability to zoom in could provide a microscope like function, but it would also enlarge nearly anything in almost real time. This may blur the line between assistive technology and education, but remember, we’re already blurring the line between the real world and virtual reality.
Scottish researchers have recently announced a project which will turn sign language into text. Augmented reality is the perfect platform for such software. Optical character recognition for any text a wearer focuses on would be an invaluable tool for both the visually impaired and those with learning disabilities. Word definitions, word highlighting and contrast control would also be helpful.
This is early speculation about an initial product release which is set for the end of 2012 at the earliest. Given the popularity of the augmented reality concept, we will likely see rapid advances in this technology. Stay tuned for future posts as we learn more.
