User equipment and control method for the same

Patent metadata

Field	Value
Publication number	US-11625142-B2
Application number	US-202117643107-A
Country	US
Kind code	B2
Filing date	Dec 7, 2021
Priority date	Feb 8, 2021
Publication date	Apr 11, 2023
Grant date	Apr 11, 2023

Abstract

An embodiment user equipment includes an image sensor, a user interface configured to display an image photographed by the image sensor and to receive a user input, a location detection sensor configured to detect a location of the user equipment, and a controller configured to identify a point of interest (POI) located in a shooting direction of the image sensor based on an output of the location detection sensor, control the user interface to display an augmented reality (AR) icon corresponding to the POI by superimposing the AR icon on the image photographed by the image sensor, and add information about the POI to a scrap list based on an input to the AR icon.

First claim

What is claimed is:

1. A user equipment comprising:
an image sensor;
a user interface configured to display an image photographed by the image sensor and to receive a user input;
a location detection sensor configured to detect a location of the user equipment; and
a controller configured to:
identify a point of interest (POI) located in a shooting direction of the image sensor based on an output of the location detection sensor;
control the user interface to display an augmented reality (AR) icon corresponding to the identified POI by superimposing the AR icon on the image photographed by the image sensor; and
add information about the identified POI to a scrap list among a plurality of POIs based on an input to the AR icon, wherein the controller is configured to control the user interface to display the AR icon of the identified POI by superimposing the AR icon on the image photographed by the image sensor based on a selection of a scrap display filter, and only the AR icon of the identified POI corresponding to the selection of the scrap display filter and corresponding to the shooting direction of the image sensor based on the output of the location detection sensor is superimposed and displayed.

2. The user equipment of claim 1 , wherein the input to the AR icon comprises double tapping of the AR icon.

3. The user equipment of claim 1 , wherein the controller is configured to control the user interface to display a scrap button and add the information about the identified POI to the scrap list based on an input to the scrap button.

4. The user equipment of claim 1 , wherein the controller is configured to control the user interface to display information about each of the plurality of POIs included in the scrap list based on a selection of a scrap list display.

5. The user equipment of claim 4 , wherein the controller is configured to control the user interface to display information about at least one POI corresponding to a business type filter among the plurality of POIs included in the scrap list based on a selection of the business t e filter.

6. The user equipment of claim 4 , wherein the controller is configured to control the user interface to display the information about each of the plurality of POIs in an order of closest to the user equipment.

7. The user equipment of claim 4 , wherein, during addition of the information about the identified POI to the scrap list, the controller is configured to add a preference value for the identified POI to the information about the identified POI, and to control the user interface to display the information about each of the plurality of POIs in an order of highest preference value.

8. The user equipment of claim 1 , further comprising a communicator, wherein the controller is configured to control the communicator to transmit the information about the identified POI included in the scrap list to an external device.

9. The user equipment of claim 1 , further comprising a communicator, wherein the controller is configured to control the user interface to display a list of surrounding POIs located in a vicinity of the user equipment based on an input to a create post button, and based on a selection of a first POI from the list of surrounding POIs and a post about the first POI being input, to control the communicator to transmit to an external server post information including an AR image of the post and location information of the first POI.

10. The user equipment of claim 9 , wherein the controller is configured to control the user interface to display the AR image of the post by superimposing the AR image of the post about a location of the first POI on the image photographed by the image sensor.

11. The user equipment of claim 9 , wherein the controller is configured to control the user interface to display a list of posts about the first POI based on an input to the AR icon corresponding to the first POI.

12. The user equipment of claim 9 , wherein the controller is configured to control the communicator to transmit the post information to an external device.

13. A control method for a user equipment comprising an image sensor, a user interface, and a location detection sensor, the control method comprising:
identifying a point of interest (POI) located in a shooting direction of the image sensor based on an output of the location detection sensor;
controlling the user interface to display an augmented reality (AR) icon corresponding to the POI by superimposing the AR icon on an image photographed by the image sensor;
adding information about the identified POI to a scrap list among a plurality of POIs based on an input to the AR icon; and
controlling the user interface to display the AR icon of the identified POI by superimposing the AR icon on the image photographed by the image sensor based on a selection of a scrap display filter, wherein only the AR icon of the identified POI corresponding to the selection of the scrap display filter and corresponding to the shooting direction of the image sensor based on the output of the location detection sensor is superimposed and displayed.

14. The control method of claim 13 , wherein the input to the AR icon comprises double tapping of the AR icon.

15. The control method of claim 13 , further comprising:
controlling the user interface to display a scrap button; and
adding the information about the identified POI to the scrap list based on an input to the scrap button.

16. The control method of claim 13 , further comprising controlling the user interface to display information about each of the plurality of POIs included in the scrap list based on a selection of a scrap list display.

17. The control method of claim 16 , further comprising controlling the user interface to display information about at least one POI corresponding to a business type filter among the plurality of POIs included in the scrap list based on a selection of the business type filter.

18. The control method of claim 16 , further comprising controlling the user interface to display the information about each of the plurality of POIs in an order of closest to the user equipment.

19. A system comprising:
a user interface configured to display an image photographed by an image sensor and to receive a user input; and
a controller configured to:
receive the image photographed by the image sensor;
receive a location of user equipment from a location detection sensor;
identify a point of interest (POI) located in a shooting direction of the image sensor based on an output of the location detection sensor;
control the user interface to display an augmented reality (AR) icon corresponding to the identified POI by superimposing the AR icon on the image photographed by the image sensor; and
add information about the identified POI to a scrap list among a plurality of POIs based on an input to the AR icon, wherein the controller is configured to control the user interface to display the AR icon of the identified POI by superimposing the AR icon on the image photographed by the image sensor based on a selection of a scrap display filter, and only the AR icon of the identified POI corresponding to the selection of the scrap display filter and corresponding to the shooting direction of the image sensor based on the output of the location detection sensor is superimposed and displayed.

20. The system of claim 19 , wherein the controller is configured to control the user interface to display information about each of the plurality of POIs includ

Assignees

• Hyundai Motor Co Ltd
• Kia Corp

Inventors

• An Rowoon
• Woo Jae Yul
• Woo Seunghyun
• Kim Soobin

Classifications

• G06F1/1684

  Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• H04M1/72457

  according to geographic location · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title