Apparatus and method for superimposing a virtual object on a lens

Patent metadata

Field	Value
Publication number	US-10547798-B2
Application number	US-201414209612-A
Country	US
Kind code	B2
Filing date	Mar 13, 2014
Priority date	May 22, 2008
Publication date	Jan 28, 2020
Grant date	Jan 28, 2020

Abstract

Disclosed are methods and apparatus for implementing a reality overlay device. A reality overlay device captures information that is pertinent to physical surroundings with respect to a device, the information including at least one of visual information or audio information. The reality overlay device may transmit at least a portion of the captured information to a second device. For instance, the reality overlay device may transmit at least a portion of the captured information to a server via the Internet, where the server is capable of identifying an appropriate virtual billboard. The reality overlay device may then receive overlay information for use in generating a transparent overlay via the reality overlay device. The transparent overlay is then superimposed via the device using the overlay information, wherein the transparent overlay provides one or more transparent images that are pertinent to the physical surroundings. Specifically, one or more of the transparent images may operate as “virtual billboards.” Similarly, a portable device such as a cell phone may automatically receive a virtual billboard when the portable device enters an area within a specified distance from an associated establishment.

First claim

What is claimed is:

1. A method, comprising:
capturing visual information by a device;
transmitting at least a portion of the captured visual information and current location information from the device to a server;
receiving object information at the device from the server for use in generating a virtual object via the device,
wherein the object information is received after the device has entered an area within a predefined specified distance from a location of a business entity; and
superimposing, by a placement of the virtual object, the virtual object via one or more lenses of the device over physical surroundings using the object information, thereby enabling a user to view the virtual object disposed in front of the business entity and facing the same direction with a front of the business entity on the physical surroundings, wherein the placement of the virtual object is determined based on a position and an orientation of the business entity in the captured visual information, and the location of the business entity.

2. The method as recited in claim 1 , wherein the virtual object comprises directions to the business entity.

3. The method as recited in claim 1 , further comprising:
receiving input from the user of the device via interaction of the user with at least a portion of the virtual object, wherein the interaction comprises an eye movement, hand movement, or other gesture, wherein the input is pertinent to information presented within the virtual object.

4. The method as recited in claim 1 , wherein the object information specifies a length of time that content of the virtual object is to be displayed.

5. The method as recited in claim 1 , wherein the transmitting of the at least a portion of the captured visual information and the current location information from the device to the server comprises:
transmitting the information of an orientation of the device to the server.

6. The method as recited in claim 1 , further comprising:
ascertaining a placement of the virtual object with respect to the physical surroundings based, at least in part, on preferences of the user;
wherein the object information indicates the placement of the virtual object with respect to the physical surroundings.

7. The method as recited in claim 1 , wherein superimposing the virtual object is suppressed based upon settings indicating preferences of the user.

8. The method as recited in claim 1 , wherein the virtual object does not correspond to a particular physical surface.

9. An apparatus, comprising:
one or more lenses;
a processor; and
a memory, at least one of the processor or the memory being configured for:
transmitting at least a portion of captured visual information and current location information to a server;
receiving object information from the server for use in generating a virtual object, wherein the object information is received after the apparatus has entered an area within a predefined specified distance from a location of a business entity; and

superimposing, by a placement of the virtual object, the virtual object via the one or more lenses over physical surroundings using the object information, thereby enabling a user to view the virtual object disposed in front of the business entity and facing the same direction with a front of the business entity on the physical surroundings, wherein the placement of the virtual object is determined based on a position and an orientation of the business entity in the captured visual information and the location of the business entity.

10. The apparatus as recited in claim 9 , wherein the apparatus is wearable by the user.

11. The apparatus as recited in claim 9 , wherein the virtual object pertains to an affiliate of the business entity.

12. The apparatus as recited in claim 9 , wherein the virtual object comprises directions to the business entity.

13. The apparatus as recited in claim 9 , wherein the lenses are transparent when in a first state and opaque when in a second state.

14. The apparatus as recited in claim 9 , wherein the transmitting at least a portion of the captured visual information and the current location information to the server comprises:
transmitting information of an orientation of the apparatus to the server.

15. The apparatus as recited in claim 9 , wherein the object information specifies a length of time that content of the virtual object is to be displayed.

16. A system, comprising:
a processor; and
a memory, at least one of the processor or the memory being configured for:
receiving information comprising at least a portion of captured visual information and current location information from a device;
obtaining object information based, at least in part, upon the received information, the object information for use in generating a virtual object; and
after it is determined that the device has entered an area within a predefined specified distance from a location of a business entity, transmitting the object information to the device for presentation of the virtual object via one or more lenses of the device, wherein the virtual object is superimposed, by a placement of the virtual object, via the one or more lenses of the device over physical surroundings using the object information, thereby enabling a user to view the virtual object disposed in front of the business entity and facing the same direction with a front of the business entity on the physical surroundings, and the placement of the virtual object is determined based on a position and an orientation of the business entity in the received information and the location of the business entity.

17. The system as recited in claim 16 , wherein the received information comprises information of a location of the device and an orientation of the device.

18. The system as recited in claim 16 , wherein the virtual object comprises directions to the business entity.

19. The system as recited in claim 16 , at least one of the processor or the memory being configured to perform operations, further comprising:
determining the placement of the virtual object based, at least in part, upon the received information and preferences of the user,
wherein the object information indicates the placement of the virtual object.

20. The system as recited in claim 16 , wherein content of the virtual object pertains to the business entity.

21. The system as recited in claim 16 , wherein the object information is obtained based, at least in part, upon user information associated with the user of the device.

22. The system as recited in claim 16 , wherein the object information specifies a length of time that the virtual object is to be displayed.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Douris Stephan
• Perry Marc
• Crane Barry
• Kalaboukis Chris
• Athsani Athellina

Classifications

• G06Q30/0267

  Wireless devices · CPC title

• G06Q30/0273

  Determination of fees for advertising · CPC title

• G06F16/9537

  Spatial or temporal dependent retrieval, e.g. spatiotemporal queries · CPC title

• G01C21/3602 Primary

  Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera · CPC title

• G06Q30/0269

  based on user profile or attribute · CPC title