Media processing method, device and system, and readable storage medium

Patent metadata

Field	Value
Publication number	US-11974015-B2
Application number	US-202017623190-A
Country	US
Kind code	B2
Filing date	Jun 23, 2020
Priority date	Jun 28, 2019
Publication date	Apr 30, 2024
Grant date	Apr 30, 2024

Abstract

Provided in embodiments of the disclosure are a media processing method, device and system, and the computer-readable storage medium. The media processing method includes: in a media file, describing position information and/or position change information of a user; and processing the media file to determine a video to be played. As such, by describing position information and/or position change information of a user in the media file, the video frame can be adjusted in real time according to the position of the user, thereby improving the quality of viewing by the user and improving user experience.

First claim

What is claimed is:

1. A media processing method, comprising:
in a media file, describing position change information or position information and position change information of a user; and
processing the media file to determine a video to be played;
wherein media samples included in a media track in the media file corresponds to the position change information or the position information and the position change information of the user;
wherein the position change information of the user corresponding to the media samples included in the media track in the media file comprises:
a difference between a current position of the user and a previous position of the user described according to timed metadata of user position change, which represents the position change information of the user corresponding to the media sample(s) in the period.

2. The media processing method according to claim 1 , wherein before describing the position information and/or position change information of the user, the method further comprises:
periodically acquiring the position information of the user.

3. The media processing method according to claim 1 , wherein the position information of the user corresponding to the media samples included in the media track in the media file comprises:
the position information of the user in any period described according to timed metadata of user position tracing, which represents the position information of the user corresponding to the media sample(s) in the period.

4. The media processing method according to claim 1 , wherein the position information of the user corresponding to each media sample is represented according to a position trace data box.

5. The media processing method according to claim 1 , wherein the position change information of the user corresponding to each media samples is represented according to a position change data box.

6. The media processing method according to claim 1 , wherein
the position information includes at least one of a viewing position or a viewing direction of the user, or,
the position change information correspondingly includes at least one of change information of the viewing position and change information of the viewing direction of the user,
wherein the viewing position includes coordinate(s) of the user's position in a global coordinate system and/or a position of the user determined by a GPS system.

7. The media processing method according to claim 6 , wherein the viewing direction includes orientation of a viewpoint of the user in the global coordinate system.

8. The media processing method according to claim 1 , wherein processing the media file to determine the video to be played comprises:
determining a current position of the user according to the position information and/or position change information of the user; and
reconstructing/rendering the video to be played according to the current position of the user.

9. The media processing method according to claim 8 , wherein after reconstructing/rendering the video to be played according to the current position of the user, the method further comprises:
describing the reconstructed/rendered video to be played according to a media file format.

10. A media processing device, comprising:
a position description module, configured to describe position change information or position information and position change information of a user in a media file; and
a video processing module, configured to process the media file to determine a video to be played;
wherein media samples included in a media track in the media file corresponds to the position change information or the position information and the position change information of the user;
wherein the position change information of the user corresponding to the media samples included in the media track in the media file comprises:
a difference between a current position of the user and a previous position of the user described according to timed metadata of user position change, which represents the position change information of the user corresponding to the media sample(s) in the period.

11. A media processing system, the media processing system comprising a media processor, a sensor, a display, and a communication bus, wherein
the communication bus is configured for connection communication among devices; and
the media processor is configured to execute at least one computer program to control the sensor and the display to implement the media processing method according to claim 1 .

12. A non-transitory computer-readable non-volatile storage medium, wherein the non-transitory computer-readable non-volatile storage medium stores at least one computer program which is executable by at least one processor to implement the media processing method according to claim 1 .

Assignees

• Zte Corp

Inventors

• Li Qiuting
• Wu Ping
• Ye Xiaoyang

Classifications

• H04N21/44218 Primary

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• H04N21/21805

  enabling multiple viewpoints, e.g. using a plurality of cameras · CPC title

• H04N21/44 Primary

  Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs · CPC title

• H04N21/816

  involving special video data, e.g 3D video · CPC title