Apparatus and method for displaying image

Patent metadata

Field	Value
Publication number	US-10524018-B2
Application number	US-201715494030-A
Country	US
Kind code	B2
Filing date	Apr 21, 2017
Priority date	Aug 30, 2016
Publication date	Dec 31, 2019
Grant date	Dec 31, 2019

Abstract

An image display apparatus may include a display, and a processor configured to generate a viewpoint guide map based on at least one of viewing-history data of the 360-degree image and characteristics of the 360-degree image, generate a list of recommended viewpoints for the 360-degree image based on the viewpoint guide map, and control the display to display an image included in the 360-degree image corresponding to a viewpoint from among the list of recommended viewpoints.

First claim

What is claimed is:

1. An image display apparatus comprising:
a display; and
a processor configured to:
generate a viewpoint guide map, which represents a degree of recommendation of each viewpoint in a frame, based on at least one of viewing-history data of a 360-degree image and characteristics of the 360-degree image,
generate a list of recommended viewpoints, including viewpoints to be recommended for a plurality of frames, for the 360-degree image based on the viewpoint guide map, and
control the display to display an image included in the 360-degree image corresponding to a viewpoint from among the list of recommended viewpoints,
wherein the processor is further configured to determine a highlight area, based on at least one of information regarding a plurality of pixels of each of frames of the 360-degree image and information regarding a motion of an object detected in the 360-degree image, and generate the viewpoint guide map by setting a recommendation grade of the highlight area to be higher than recommendation grades of other areas,
wherein the information regarding the plurality of pixels comprises at least one from among colors, brightness, gradients, and directions of the gradients of the plurality of pixels of each of the frames of the 360-degree image, and
wherein the information regarding the motion of the object detected in the 360-degree image comprises at least one from among information regarding displacement of the object, information regarding change in size of the object, and information regarding time when the object appears in the 360-degree image.

2. The image display apparatus of claim 1 , wherein the viewpoint guide map corresponds to the frame from among a plurality of frames of the 360-degree image.

3. The image display apparatus of claim 1 , wherein the processor is further configured to control the display to display a user interface for selecting a reproduction mode, and generate the viewpoint guide map in response to a user input for selecting the reproduction mode through the user interface.

4. The image display apparatus of claim 1 , wherein the processor is further configured to:
select at least one viewing-history provider, based on at least one of a first characteristic of the 360-degree image and information regarding the user,
obtain as the viewing-history data of the 360-degree image the list of recommended viewpoints generated in response to the at least one viewing-history provider viewing the 360-degree image, and
generate the viewpoint guide map based on the viewing-history data of the 360-degree image.

5. The image display apparatus of claim 1 , wherein the processor is further configured to generate a first guide map based on the viewing-history data of the 360-degree image, generate a second guide map based on the characteristics of the 360-degree image, and generate the viewpoint guide map by respectively applying weights to the first guide map and the second guide map.

6. The image display apparatus of claim 5 , wherein the processor is further configured to determine the weights, based on at least one from among a distribution of recommendation grades in the first guide map, a second characteristic of the 360-degree image, and a cumulative number of viewing times the 360-degree image.

7. The image display apparatus of claim 1 , wherein, for a first frame and a second frame of the 360-degree image, the processor determines a viewpoint to be recommended for the second frame based on at least one of a point of a highest recommendation grade in a viewpoint guide map corresponding to the second frame and a distance between the point of the highest recommendation grade in the viewpoint guide map corresponding to the second frame and a point representing a viewpoint of the first frame.

8. The image display apparatus of claim 1 , wherein, when the 360-degree image is reproduced in response to a user's input, the processor is further configured to generate the viewpoint guide map based on the viewing-history data generated when the user views the 360-degree image and a second guide map generated based on the characteristics of the 360-degree image.

9. The image display apparatus of claim 1 , wherein the processor is further configured to control the display to display a second image corresponding to a second viewpoint changed in response to a user input for changing viewpoints, and to display information representing a location of a third viewpoint of a recommendation grade higher than or equal to a threshold value in the viewpoint guide map as the third viewpoint of the recommendation grade higher than or equal to the threshold value is located outside the second image corresponding to the second viewpoint.

10. An image display method comprising:
generating a viewpoint guide map, which represents a degree of recommendation of each viewpoint in a frame, based on at least one of viewing-history data of a 360-degree image and characteristics of the 360-degree image;
generating a list of recommended viewpoints, including viewpoints to be recommended for a plurality of frames, for the 360-degree image based on the viewpoint guide map; and
displaying an image included in the 360-degree image corresponding to a viewpoint from among the list of recommended viewpoints,
wherein the generating the viewpoint guide map comprises:
determining a highlight area, based on at least one of information regarding a plurality of pixels of each of frames of the 360-degree image and information regarding a motion of an object detected in the 360-degree image; and
generating the viewpoint guide map by setting a recommendation grade of the highlight area to be higher than recommendation grades of other areas,
wherein the information regarding the plurality of pixels comprises at least one from among colors, brightness, gradients, and directions of the gradients of the plurality of pixels of each of the frames of the 360-degree image, and
wherein the information regarding the motion of the object detected in the 360-degree image comprises at least one from among information regarding a displacement of the object, information regarding a change in size of the object, and information regarding time when the object appears in the 360-degree image.

11. The image display method of claim 10 , wherein the generating the viewpoint guide map comprises:
displaying a user interface for selecting a reproduction mode; and
generating the viewpoint guide map, in response to a user input for selecting the reproduction mode through the user interface.

12. The image display method of claim 10 , wherein the generating the viewpoint guide map comprises:
selecting at least one viewing-history provider, based on at least one of a first characteristic of the 360-degree image and information regarding the user;
obtaining as the viewing-history data of the 360-degree image the list of recommended viewpoints generated in response to the at least one viewing-history provider viewing the 360-degree image; and
generating the viewpoint guide map based on the viewing-history data of the 360-degree image.

13. The image display method of claim 10 , wherein the generating the viewpoint guide map comprises:
generating a first guide map based on the viewing-history data of the 360-degree image;
generating a second guide map based on the characteristics of the 360-degree image; and
generating the viewpoint guide map by respectively applying weights to the first guide map and the second guide map.

14. The image display method of claim 13 , wherein the generating the viewpoint guide map further comprises determining the weights

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Bo-Eun
• Kim Sung-Hyun
• Lee Jong-In
• Kim Yong-Deok

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G09G3/2096

  Details of the interface to the display terminal specific for a flat panel (suitable for both CRT and flat panel G09G5/006; specific for a CRT G09G1/167) · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• H04N21/8146 Primary

  involving graphical data, e.g. 3D object, 2D graphics · CPC title

• H04N21/431

  Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering · CPC title