Method and system for correcting field of view using user terminal information upon playback of 360-degree image

Patent metadata

Field	Value
Publication number	US-10600188-B2
Application number	US-201715595568-A
Country	US
Kind code	B2
Filing date	May 15, 2017
Priority date	May 16, 2016
Publication date	Mar 24, 2020
Grant date	Mar 24, 2020

Abstract

A method and a system for correcting a field of view (FOV) using tilt information of a user terminal upon playback of a 360-degree image. The method includes requesting to load a 360-degree image, correcting at least one of a tilt of the mobile terminal and a sensing value associated with a gesture input of the mobile terminal, for determining an FOV of the 360-degree image, with respect to the 360-degree image, and playing back the 360-degree image by exposing an FOV depending on at least the corrected tilt or the corrected sensing value.

First claim

What is claimed is:

1. A field of view (FOV) correction method performed in a mobile terminal implemented with a computer, the method comprising:
requesting to load a 360-degree image;
correcting a basic tilt of the mobile terminal to a corrected tilt, and using the corrected tilt to determine an FOV of the 360-degree image; and
playing the 360-degree image by exposing the FOV, wherein the FOV is different than an FOV that would be exposed using the basic tilt;
wherein said correcting corrects a horizontal value of the FOV; and
wherein the FOV determined using the corrected tilt includes an important scene.

2. The method of claim 1 ,
wherein the basic tilt is calculated by averaging tilt values of the mobile terminal.

3. The method of claim 1 ,
wherein the tilt values that are averaged are recorded in a cache on an application loaded into the mobile terminal or in a cookie or cache on a browser.

4. The method of claim 1 ,
wherein the basic tilt is an average tilt value of the mobile terminal that is stored on a service which provides the 360-degree image.

5. The method of claim 1 , wherein the corrected tilt forms an angle of approximately 90 degrees with the ground.

6. The method of claim 1 , wherein the mobile terminal comprises a smartphone comprising one or more sensors, the method further comprising measuring the the basic tilt using said one or more sensors.

7. The method of claim 1 , wherein the corrected tilt is based on one or more attributes of the 360-degree image.

8. The method of claim 1 , wherein the corrected tilt forms an angle of approximately 90 degrees with the ground.

9. An FOV correction method performed in a server implemented with a computer, the method comprising:
receiving a protocol or a message for requesting a streaming service for a 360-degree image from a user terminal;
analyzing application information included in the protocol or the message for requesting the streaming service, and determining a content consumption environment of the user terminal, said determining comprising determining whether the content consumption environment is a smartphone environment;
if the content consumption environment is a smartphone environment, connecting configuration information, to support correction for a tilt of a mobile terminal;
transmitting the 360-degree image connected to the configuration information to the mobile terminal, the 360-degree image being transmitted as a response to the protocol or the message for requesting the streaming service;
wherein the mobile terminal plays the 360-degree image based on the correction of the tilt, wherein the FOV played by the mobile terminal is different than an FOV that would have been played without the correction for the tilt, and wherein the FOV played by the mobile terminal includes a scene of the 360-degree image designated as important.

10. The method of claim 9 , wherein the tilt is corrected to form an angle of approximately 90 degrees with the ground.

11. The method of claim 9 , wherein the configuration information is connected if and only if the content consumption environment is a smartphone environment.

12. The method of claim 9 , wherein an initial FOV of the 360-degree image connected to the configuration information is different than if the 360-degree image were not connected to the configuration information.

13. A computer program stored in a non-transitory computer-readable medium to execute an FOV correction method performed in a mobile terminal implemented with a computer, the method comprising:
requesting to load a 360-degree image;
correcting for a tilt of the mobile terminal, for determining an FOV of the 360-degree image; and
playing the 360-degree image by exposing the FOV depending on at least said correcting, wherein the FOV is different than an FOV that would be exposed without said correcting, and wherein the FOV includes a scene of the 360-degree image designated as important.

14. A mobile terminal implemented with a computer, the mobile terminal comprising:
at least one processor configured to execute a computer-readable instruction, wherein the at least one processor is configured to:
request to load a 360-degree image;
correct for a tilt of the mobile terminal, for determining an FOV of the 360-degree image; and
play the 360-degree image by exposing the FOV depending on at least said correcting, wherein the FOV is different than an FOV that would be exposed without said correcting, and wherein the FOV includes a scene of the 360-degree image designated as important.

15. A server implemented with a computer, the server comprising:
at least one processor configured to execute a computer-readable instruction, wherein the at least one processor is configured to:
receive a protocol or a message for requesting a streaming service for a 360-degree image from a user terminal;
analyze application information included in the protocol or the message for requesting the streaming service, and determine a content consumption environment of the user terminal, including at least determining whether the content consumption environment is a smartphone environment;
if the content consumption environment is a smartphone environment, connect configuration information, to support the correction for a tilt of a mobile terminal such that an initial FOV of the 360-degree image is different than an FOV that would be played without the correction for the tilt and such that the initial FOV includes a scene of the 360-degree image designated as important; and
transmit the 360-degree image connected to the configuration information to the mobile terminal, the 360-degree image being transmitted as a response to the protocol or the message for requesting the streaming service.

16. The server of claim 15 , wherein the process is configured to connect said configuration information if and only if the content consumption environment is a smartphone environment.

Assignees

• Korea Advanced Inst Sci & Tech

Inventors

• Choi Junkyun
• Yang Jinhong
• Jeon Kyu Yeong
• Park Hyo Jin

Classifications

• H04N5/2224

  related to virtual studio applications · CPC title

• G02B13/06

  Panoramic objectives; So-called "sky lenses" {including panoramic objectives having reflecting surfaces} · CPC title

• G06T7/215 Primary

  Motion-based segmentation · CPC title

• H04N13/366

  using viewer tracking · CPC title

• G06F40/137

  Hierarchical processing, e.g. outlines · CPC title