Electronic device and method for providing service corresponding to selection of object in image

Patent metadata

Field	Value
Publication number	US-12062237-B2
Application number	US-201917432271-A
Country	US
Kind code	B2
Filing date	Sep 23, 2019
Priority date	Feb 19, 2019
Publication date	Aug 13, 2024
Grant date	Aug 13, 2024

Abstract

An electronic device and a method for providing a service corresponding to the selection of an object in an image are provided. The electronic device includes a camera, a display, a memory, and a processor operationally connected to the camera, the display, and the memory, wherein the processor can be configured to detect a plurality of object regions included in an image acquired using the camera, remove object regions having a size exceeding a threshold range from among the detected plurality of object regions, calculate the importance of objects within the threshold range, select a number of main objects that is no greater than the number of objects allowed by the electronic device, select auxiliary objects spatially related to the selected main objects, recognize the main objects and the auxiliary objects, recognize service attributes provided by the recognized main objects and auxiliary objects, determine services provided by the main objects and the auxiliary objects, and display the determined services on the display.

First claim

The invention claimed is:

1. An electronic device comprising:
a camera;
a display;
a processor; and
memory storing instructions that, when executed by the processor, cause the electronic device to;
obtain an image using the camera,
display the obtained image on the display,
detect a plurality of object regions included in the displayed image,
determine an object region among the plurality of object regions having a size within a predetermined threshold range,
identify a main object and an auxiliary object within the determined object region, the auxiliary object being an object displayed within the main object,
recognize a plurality of services respectively related to the main object and the auxiliary object in the identified object region
determine, based on a user's selection, a service among the plurality of services respectively related to the main object and the auxiliary object, and
display detailed information corresponding to the determined service on the display.

2. The electronic device of claim 1 ,
wherein an object displaying at least one piece of information is determined as the auxiliary object.

3. The electronic device of claim 1 , wherein, the instructions, when executed by the processor, cause the electronic device to display, in case that one of the services related to the first main object is selected,
an additional service list corresponding to the main object in the display.

4. The electronic device of claim 3 , wherein the first additional service list includes entry points of applications providing services related to the main object.

5. A method for a processor of an electronic device to provide a service corresponding to selection of an object in an image, the method comprising:
obtaining the image using a camera;
displaying the obtained image on a display;
detecting, by the processor, a plurality of object regions included in the displayed image;
determining, by the processor, an object region among the plurality of object regions having a size out of a within a predetermined threshold range;
identifying, by the processor, a main object and an auxiliary object within the determined object region, the auxiliary object being an object displayed within the main object;
recognizing, by the processor, a plurality of services respectively related to the main object and the auxiliary object in the identified object region,
determining, by the processor, based on a user's selection, a service among the plurality of services respectively related to the main object and the auxiliary object, and
displaying, by the processor, detailed information corresponding to the determined service on the display.

6. The method of claim 5 ,
wherein an object displaying at least one piece of information is determined as auxiliary object.

7. The method of claim 5 , further comprising:
displaying, in case that one of the services related to the main object is selected,
an additional service list corresponding to the main object in the display.

8. The method of claim 7 ,
wherein the additional service list includes entry points of applications providing services related to the main object.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Sihyoung
• Lee Kyungjae
• Kim Daehee
• Hong Taehwa

Classifications

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title

• G06F16/953

  Querying, e.g. by the use of web search engines · CPC title

• G06F16/583

  using metadata automatically derived from the content · CPC title

• G06Q30/0633

  Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087) · CPC title

• G06V20/60

  Type of objects · CPC title