Extended reality information for identified objects

Patent metadata

Field	Value
Publication number	US-2020257484-A1
Application number	US-201916273731-A
Country	US
Kind code	A1
Filing date	Feb 12, 2019
Priority date	Feb 12, 2019
Publication date	Aug 13, 2020
Grant date	—

Abstract

One embodiment provides a method, including: receiving, at an information handling device, an indication to display extended reality content; determining, using a processor, a user's geographic position in an area; accessing, from an accessible storage location, map data associated with the area; identifying, using at least one sensor associated with the information handling device, a user's line of sight; determining, based on the user's geographic position and the map data, an object associated with the user's line of sight; determining, using a processor, an identity of the object; and displaying the extended-reality content for the identified object in a field of view of the information handling device. Other aspects are described and claimed.

First claim

1 . A method, comprising:
receiving, at an information handling device, an indication to display extended reality content on a display; determining, using a processor, a user's geographic position in an area; accessing, from an accessible storage location, map data associated with the area; identifying, using at least one sensor associated with the information handling device, a user's line of sight; determining, based on the user's geographic position and the map data, an object associated with the user's line of sight, wherein the object is a real-world, non-interactive object; determining, using a processor, an identity of the object; obtaining additional information associated with the identified object; and displaying, as the extended-reality content, the additional information on the display of the information handling device, wherein the displaying comprises adjusting at least one display parameter of the extended-reality content so that the additional information is displayed only within a portion of the display that corresponds to boundaries associated with the identified object.

2 . The method of claim 1 , wherein the receiving the indication comprises receiving a user command to display extended reality content.

3 . The method of claim 1 , wherein the extended reality content comprises content selected from the group consisting of augmented reality content and mixed reality content.

4 . The method of claim 1 , wherein the information handling device is associated with at least one of: a head-mounted wearable device and a hand-held smart device.

5 . The method of claim 1 , wherein the determining the user's geographic position in the area comprises determining using global positioning system (GPS) data.

6 . The method of claim 1 , wherein the object is selected from the group consisting of a building, a statue, an artistic structure, and a monument.

7 . The method of claim 1 , wherein the identifying the user's line of sight comprises identifying a gaze direction and a gaze point of the user.

8 .- 9 . (canceled)

10 . The method of claim 1 , wherein the displaying comprises visually distinguishing, in the field of view, a portion of the object associated with the content.

11 . An information handling device, comprising:
at least one sensor; a processor; a memory device that stores instructions executable by the processor to: receive an indication to display extended reality content on a display of the information handling device; determine a user's geographic position in an area; access, from an accessible storage database, map data associated with the area; identify a user's line of sight; determine, based on the user's geographic position and the map data, an object associated with the user's line of sight, wherein the object is a real-world, non-interactive object; determine an identity of the object; obtain additional information associated with the identified object; and display, as the extended-reality content, the additional information on the display of the information handling device, wherein the displaying comprises adjusting at least one display parameter of the extended-reality content so that the additional information is displayed only within a portion of the display that corresponds to boundaries associated with the identified object.

12 . The information handling device of claim 11 , wherein the instructions executable by the processor to receive the indication comprise instructions executable by the processor to receive a user command to display extended reality content.

13 . The information handling device of claim 11 , wherein the extended reality content comprises content selected from the group consisting of augmented reality content and mixed reality content.

14 . The information handling device of claim 11 , wherein the information handling device is associated with at least one of: a head-mounted wearable device and a hand-held smart device.

15 . The information handling device of claim 11 , wherein the instructions executable by the processor to determine the user's geographic position in the area comprise instructions executable by the processor to determine using global positioning system (GPS) data.

16 . The information handling device of claim 11 , wherein the object is selected from the group consisting of a building, a statue, an artistic structure, and a monument.

17 . The information handling device of claim 11 , wherein the instructions executable by the processor to identify the user's line of sight comprise instructions executable by the processor to identify a gaze direction and a gaze point of the user.

18 . (canceled)

19 . The information handling device of claim 11 , wherein the instructions executable by the processor to display comprise instructions executable by the processor to visually distinguish, in the field of view, a portion of the object associated with the content.

20 . A product, comprising:
a storage device that stores code, the code being executable by a processor and comprising: code that receives an indication to display extended reality content on a display; code that determines a user's geographic position in an area; code that accesses map data associated with the area; code that identifies a user's line of sight; code that determines, based on the user's geographic position and the map data, an object associated with the user's line of sight, wherein the object is a real-world, non-interactive object; code that determines an identity of the object; code that obtains additional information associated with the identified object; and code that displays the extended reality content for the identified object on the display, wherein the code that displays comprises code that adjusts at least one display parameter of the extended-reality content so that the additional information is displayed only within a portion of the display that corresponds to boundaries associated with the identified object.

Assignees

• Lenovo Singapore Pte Ltd

Inventors

• Qian Ming
• Wang Song
• Li Jian
• Zhang Jianbang

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F16/29

  Geographical information databases · CPC title

• G09G2340/12

  Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels · CPC title