Server and display apparatus, and control methods thereof

Patent metadata

Field	Value
Publication number	US-11303871-B2
Application number	US-201816638585-A
Country	US
Kind code	B2
Filing date	Aug 2, 2018
Priority date	Aug 16, 2017
Publication date	Apr 12, 2022
Grant date	Apr 12, 2022

Abstract

A server according to the disclosure includes a communicator configured to communicate with a plurality of display apparatuses; and a controller configured to produce a plurality of split images corresponding to individual view angles of screens of the plurality of display apparatuses from each frame of a 360-degree image including a plurality of frames, transmit the plurality of split images according to the frames to the corresponding display apparatus, and control the communicator to transmit a split image updated corresponding to change in the individual view angle based on movement of a view point.

First claim

What is claimed is:

1. A server comprising:
a communicator, including communication circuitry, configured to communicate with a plurality of display apparatuses; and
a processor configured to:
identify individual viewpoints of the plurality of display apparatuses,
produce a plurality of split images corresponding to the identified individual viewpoints from a 360-degree image,
control the communicator to transmit the plurality of split images to the plurality of display apparatuses, respectively, so that each display apparatus displays a projection image within a boundary area of the transmitted split image, the boundary area being provided inwardly from a boundary of the transmitted split image by a predetermined width,
in response to information indicating that the projection image is to be beyond the boundary area being received from a first display apparatus among the plurality of display apparatuses, update a viewpoint of the first display apparatus, and
control the communicator to transmit a split image corresponding to the updated viewpoint to the first display apparatus.

2. The server according to claim 1 , wherein the processor is configured to control the communicator to transmit the plurality of split images corresponding to updated individual viewpoints to the plurality of display apparatuses, according to an order being determined based on the projection image being displayed beyond the boundary area.

3. The server according to claim 1 , wherein the processor is configured to control the communicator to transmit layout information about the 360-degree image to the plurality of display apparatuses, and transmit the plurality of split images based on the transmitted layout information, and
the layout information comprises information about locations and sizes of the plurality of split images.

4. The server according to claim 1 , wherein the processor is configured to adjust a resolution of the split image transmitted to the display apparatus based on at least one of the viewpoint, a network state, a transceiving cycle, or a bandwidth of a screen of the display apparatus.

5. A computer program product comprising:
a memory configured to store an instruction; and
a processor,
the instruction being executed by the processor to:
identify individual viewpoints of the plurality of display apparatuses,
produce a plurality of split images corresponding to the identified individual viewpoints from a 360-degree image,
control a communicator including communication circuitry to transmit the plurality of split images to the plurality of display apparatuses, respectively, so that each display apparatus displays a projection image within a boundary area of the transmitted split image, the boundary area being provided inwardly from a boundary of the transmitted split image by a predetermined width,
in response to information indicating that the projection image is to be beyond the boundary area being received from a first display apparatus among the plurality of display apparatuses, update a viewpoint of the first display apparatus, and
control the communicator to transmit a split image corresponding to the updated viewpoint to the first display apparatus.

6. A display apparatus comprising:
an image processor configured to process an image signal;
a display;
a communicator including communication circuitry configured to communicate with a server; and
a processor configured to:
identify a viewpoint of the display apparatus,
control the communicator to transmit to the server information on the identified viewpoint,
receive from the server a split image corresponding to the identified viewpoint, obtained from a 360-degree image,
perform mapping the received split image to a three-dimensional image,
receive a user input to move the viewpoint,
according to the user input, identify an area to produce a projection image within a boundary area of the received split image, the boundary area being provided inwardly from a boundary of the received split image by a predetermined width, and
in response to the identified area to produce the projection image being beyond the boundary area,

control the communicator to transmit, to the server, information indicating that the projection image to be displayed is beyond the boundary area such that the server updates viewpoint information of the display apparatus.

7. The display apparatus according to claim 6 , wherein the processor is configured to receive a split image corresponding to the updated viewpoint information from the server.

8. The display apparatus according to claim 6 , wherein the processor is configured to control the image processor to perform mapping the received split image to a spherical shape based on the viewpoint.

9. The display apparatus according to claim 6 , wherein the processor is configured to control the communicator to transmit a request for the split image corresponding to the updated viewpoint information to the server, according to an order being determined based on the projection image to be displayed being beyond the boundary area.

10. The display apparatus according to claim 6 , wherein
the processor is configured to control the communicator to receive layout information about the 360-degree image from the server, and receive the split image based on the received layout information, and
the layout information comprises information about a location and a size of the received split image.

11. A computer program product comprising:
a memory configured to store an instruction; and
a processor,
the instruction being executed by the processor to:
identify a viewpoint of the display apparatus,
control a communicator including communication circuitry to transmit to a server information on the identified viewpoint,
receive from the server a split image corresponding to the identified viewpoint, obtained from a 360-degree image,
perform mapping the received split image to a three-dimensional image,
receive a user input to move the viewpoint,
according to the user input, identify an area to produce a projection image within a boundary area of the received split image, the boundary area being provided inwardly from a boundary of the received split image by a predetermined width, and
in response to the identified area to produce the projection image being beyond the boundary area,

control the communicator to transmit, to the server, information indicating that the projection image to be displayed is beyond the boundary area such that the server updates viewpoint information of the display apparatus.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Yong-Deok
• Kim Bo-Eun
• Kim Sung-Hyun
• Lee Jong-In

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N21/43076

  of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices · CPC title

• H04N13/117 Primary

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• G06F3/1446

  display composed of modules, e.g. video walls · CPC title

• H04N9/3147

  Multi-projection systems (video walls G06F3/1446) · CPC title