Amazon Patents Have Designs On Augmented-Reality Living Rooms - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IT Life
03:10 PM
Larry Loeb
Larry Loeb

Amazon Patents Have Designs On Augmented-Reality Living Rooms

Not satisfied with online sales and cloud computing, Amazon has been awarded two patents to create augmented reality in the living room.

8 Ways You're Failing At Data Science
8 Ways You're Failing At Data Science
(Click image for larger view and slideshow.)

During its history, Amazon has managed to conquer the book market, traditional retail, and, through Amazon Web Services, cloud computing. Now, thanks to two patents it was awarded on Dec. 1, it seems the company has more plans for your living room than just its Echo voice-controlled device.

The US Patent and Trademark Office granted the Seattle company a patent for technologies that can project an augmented reality representation into a room (#9,204,121) and another patent that provides a way to navigate that world (#9,201,499).

The patents were submitted by Rawles LLC of Wilmington, Del., in February 2013 and officially assigned to Amazon this week.

One of the patents issued on Dec. 1 concentrates on determining the depth of an object in a scene.

It describes a system that includes a single light source with an attached shutter, and ellipsoidal reflection, and a camera. The light source is directed to the scene and toward the reflector. The camera captures the first source light as well as the reflected light. Comparison of both light beams will yield a determination of the depth of an object within the scene. It discusses at some detail how an augmented reality functional node (ARFN) can be used to generate and augmented reality environment. There may be multiple ARFNs within the environment, which can interact.

(Image: JurgaR/iStockphoto)

(Image: JurgaR/iStockphoto)

The other Dec. 1 patent tracks the movement of an object in a 3D environment -- such as a hand -- which is then used for "gesture input to an augmented reality system." The 3D images are captured and can be used to generate 2D contours of that object. The overlap in the 2D regions of the object can then determine if the object is the correct one to track.

It is also tied to the use of the technique inside ARFN-enabled environments.

When used together, these two technologies outlined in the patents could simultaneously generate an augmented reality environment (by depth determination) and track user input by the gestures used in that environment.

To gain some insight into what Amazon may or may not be doing with these patents, I emailed SmartUp Legal, a legal firm that follows patents in the IT and technologies market. Mikhail Avady, the company's co-founder and current CMO, wrote that these patents relate back to Lab126, Amazon's subsidiary for research and development. Avady noted:

Amazon seems to be using an entity called "Rawles LLC" for their Lab126 division (the team responsible for Kindle, Dash, Echo etc…). The way we determined that these two organizations are related are through the patent filings. A couple of patents surfaced with Amazon and Rawles as co-applicants, as we dug deeper we found that the inventors on each of these applications are current or past employees of Lab126. We also noticed that most if not all the patents from Rawles were transferred over to Amazon on 11/12/15.

This isn't the first time that Amazon has dipped its toes into augmented reality, or AR, for one business purpose or another.

In October, Amazon was granted another patent (#9,158,115) for a head-mounted display that featured a way to toggle from opaque to transparent when interacting with a tablet. It may be that this is not going to be a public-facing product, since such a device could be more useful in Amazon fulfillment centers, for example, as a way for workers to scan barcodes.

The newest patents take a totally different approach, projecting the AR into physical space and then allowing the user's gestures to manipulate the AR.

[Read how Wikipedia is using AI and machine learning to edit.]

In some ways, this effort is similar to what Microsoft has done with the RoomAlive project, which uses projectors and Kinect technology to construct an AR environment.

"We do not know if it [the patents] is a response to Microsoft, but, it does seem to fit their vision," Avady added. "As we saw with Echo and Dash, Amazon wants to be in your living room and these patents were invented by the same division as those."

**New deadline of Dec. 18, 2015** Be a part of the prestigious InformationWeek Elite 100! Time is running out to submit your company's application by Dec. 18, 2015. Go to our 2016 registration page: InformationWeek's Elite 100 list for 2016.

Larry Loeb has written for many of the last century's major "dead tree" computer magazines, having been, among other things, a consulting editor for BYTE magazine and senior editor for the launch of WebWeek. He has written a book on the Secure Electronic Transaction Internet ... View Full Bio
We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Learning: It's a Give and Take Thing
James M. Connolly, Editorial Director, InformationWeek and Network Computing,  1/24/2020
IT Careers: Top 10 US Cities for Tech Jobs
Cynthia Harvey, Freelance Journalist, InformationWeek,  1/14/2020
Predictions for Cloud Computing in 2020
James Kobielus, Research Director, Futurum,  1/9/2020
White Papers
Register for InformationWeek Newsletters
State of the Cloud
State of the Cloud
Cloud has drastically changed how IT organizations consume and deploy services in the digital age. This research report will delve into public, private and hybrid cloud adoption trends, with a special focus on infrastructure as a service and its role in the enterprise. Find out the challenges organizations are experiencing, and the technologies and strategies they are using to manage and mitigate those challenges today.
Current Issue
The Cloud Gets Ready for the 20's
This IT Trend Report explores how cloud computing is being shaped for the next phase in its maturation. It will help enterprise IT decision makers and business leaders understand some of the key trends reflected emerging cloud concepts and technologies, and in enterprise cloud usage patterns. Get it today!
Flash Poll