Method and apparatus for presenting and controlling panoramic image, and storage medium

Patent metadata

Field	Value
Publication number	US-2019246162-A1
Application number	US-201916390171-A
Country	US
Kind code	A1
Filing date	Apr 22, 2019
Priority date	Mar 28, 2017
Publication date	Aug 8, 2019
Grant date	—

Abstract

A method for presenting and controlling a panoramic image is provided. The method includes: sending a panoramic image trigger instruction to a media content server in response to a panoramic image trigger operation, wherein the panoramic image trigger instruction causes the media content server to send the panoramic image trigger instruction to a smart television bound with the mobile terminal, and the panoramic image trigger instruction causes the smart television to present the panoramic image corresponding to currently presented media content; obtaining a description parameter indicating a position of the mobile terminal in three-dimensional space; and sending the description parameter to the media content server, wherein the media content server determines an adjustment parameter of the panoramic image in panoramic space according to the description parameter and sends the adjustment parameter to the smart television, and the smart television adjusts the panoramic image according to the adjustment parameter.

First claim

What is claimed is:

1 . A method for presenting and controlling a panoramic image, performed by at least one processor of a mobile terminal, the method comprising:
sending, by the at least one processor, a panoramic image trigger instruction to a media content server in response to a panoramic image trigger operation, wherein the panoramic image trigger instruction causes the media content server to send the panoramic image trigger instruction to a smart television bound with the mobile terminal, and the panoramic image trigger instruction causes the smart television to present the panoramic image corresponding to currently presented media content; obtaining, by the at least one processor, a description parameter indicating a position of the mobile terminal in three-dimensional space in response to an operation of the mobile terminal; and sending, by the at least one processor, the description parameter to the media content server, wherein the media content server determines an adjustment parameter of the panoramic image in panoramic space according to the description parameter and sends the adjustment parameter to the smart television, and the smart television adjusts the panoramic image according to the adjustment parameter.

2 . The method according to claim 1 , wherein the description parameter comprises a location change parameter and a posture change parameter,
wherein the adjustment parameter comprises a viewing-angle adjustment parameter and a viewpoint adjustment parameter, wherein the obtaining the description parameter of the mobile terminal in three-dimensional space in response to the operation of the mobile terminal comprises:
obtaining the location change parameter in response to a movement operation of the mobile terminal; and
obtaining the posture change parameter in response to a rotation operation of the mobile terminal, and
wherein the sending the description parameter to the media content server comprises:
sending the location change parameter and the posture change parameter to the media content server, wherein the media content server determines the viewpoint adjustment parameter of the panoramic image in the panoramic space according to the location change parameter, determines the viewing-angle adjustment parameter of the panoramic image in the panoramic space according to the posture change parameter, and sends the viewpoint adjustment parameter and the viewing-angle adjustment parameter to the smart television, and wherein the smart television adjusts a viewpoint of the panoramic image according to the viewpoint adjustment parameter and adjusts a viewing angle of the panoramic image according to the viewing-angle adjustment parameter.

3 . The method according to claim 1 , wherein the description parameter comprises a location change parameter,
wherein M network access points are disposed in the three-dimensional space, M being an integer that is greater than or equal to 3, and wherein the obtaining the description parameter of the mobile terminal in three-dimensional space comprises:
determining coordinates of a reference point location according to M wireless signal strengths that respectively correspond to the M network access points and that are received by the mobile terminal at the reference point location;
determining coordinates of a current location according to M wireless signal strengths that respectively correspond to the M network access points and that are received by the mobile terminal at the current location; and
determining the location change parameter of the mobile terminal in the three-dimensional space according to the coordinates of the reference point location and the coordinates of the current location.

4 . The method according to claim 1 , wherein the description parameter comprises a location change parameter, and
wherein the obtaining the description parameter of the mobile terminal in three-dimensional space comprises:
determining wireless signal strengths of a network access point that are received by the mobile terminal at a plurality of locations, and storing coordinates of each of the plurality of locations and a corresponding wireless signal strength in an associated manner;
determining a first wireless signal strength of the network access point received by the mobile terminal at a reference point location;
determining a second wireless signal strength of the network access point received by the mobile terminal at a current location;
at the current location, separately searching the stored wireless signal strengths for wireless signal strengths closest to the first wireless signal strength and the second wireless signal strength, and using location coordinates of locations corresponding to the found wireless signal strengths respectively closest to the first wireless signal strength and the second wireless signal strength as coordinates of the reference point location and coordinates of the current location; and
determining the location change parameter of the mobile terminal in the three-dimensional space according to the coordinates of the reference point location and the coordinates of the current location.

5 . The method according to claim 1 , wherein the description parameter comprises a posture change parameter, and
wherein the obtaining the description parameter of the mobile terminal in three-dimensional space comprises:
determining a reference point deflection angle and a current deflection angle of the mobile terminal according to a sensor parameter obtained from a gyroscope; and
determining the posture change parameter of the mobile terminal according to the reference point deflection angle and the current deflection angle of the mobile terminal.

6 . The method according to claim 1 , wherein the method further comprises:
receiving panoramic image data from the media content server; and presenting the panoramic image.

7 . The method according to claim 6 , wherein the method further comprises:
receiving the adjustment parameter from the media content server; and adjusting the panoramic image according to the adjustment parameter.

8 . The method according to claim 6 , wherein the method further comprises presenting prompt information received from the media content server to prompt a user of the mobile terminal whether to present the panoramic image.

9 . An apparatus for presenting and controlling a panoramic image, the apparatus comprising:
at least one memory configured to store computer program code; and at least one processor configured to access the at least one memory and operate as instructed by the computer program code, the computer program code including: trigger instruction sending code configured to cause the at least one processor to send a panoramic image trigger instruction to a media content server in response to a panoramic image trigger operation, wherein the panoramic image trigger instruction causes the media content server to send the panoramic image trigger instruction to a smart television bound with the apparatus, and the panoramic image trigger instruction causes the smart television to present the panoramic image corresponding to currently presented media content; obtaining code configured to cause the at least one processor to obtain a description parameter indicating a position of the apparatus in three-dimensional space in response to an operation of the apparatus, and sending code configured to cause the at least one processor to send the description parameter to the media content server, wherein the media content server determines an adjustment parameter of the panoramic image in panoramic space according to the description parameter and sends the adjustment parameter to the smart t

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Yang Dan
• Wang Xian Jun
• Zhou You
• Xie Yi
• Xu Gang
• Qu Jia

Classifications

• H04N21/478

  Supplemental services, e.g. displaying phone caller identification, shopping application · CPC title

• H04N21/4222 Primary

  Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy (remote control device for a television receiver integrated into a mobile phone H04M1/72415) · CPC title

• H04N21/472 Primary

  End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)} · CPC title

• H04N21/436

  Interfacing a local distribution network, e.g. communicating with another STB {or one or more peripheral devices} inside the home · CPC title

• H04N21/4312

  involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations · CPC title