Data transmission method, apparatus, and device, and storage medium

Patent metadata

Field	Value
Publication number	US-12457312-B2
Application number	US-202118256121-A
Country	US
Kind code	B2
Filing date	Dec 2, 2021
Priority date	Dec 6, 2020
Publication date	Oct 28, 2025
Grant date	Oct 28, 2025

Abstract

Provided are a data transmission method, apparatus and device, and a storage medium. The data transmission method includes the following: receiving current status information sent by a client; determining status-dependent point cloud spatial region information corresponding to the current status information according to the current status information; selecting status-dependent point cloud spatial region data corresponding to the status-dependent point cloud spatial region information; and sending the status-dependent point cloud spatial region information and the status-dependent point cloud spatial region data to the client.

First claim

What is claimed is:

1. A data transmission method, being applied to a server side and comprising:
receiving current status information sent by a client;
determining, according to the current status information, status-dependent point cloud spatial region information corresponding to the current status information;
selecting status-dependent point cloud spatial region data corresponding to the status-dependent point cloud spatial region information; and
sending the status-dependent point cloud spatial region information and the status-dependent point cloud spatial region data to the client;
wherein determining, according to the current status information, the status-dependent point cloud spatial region information corresponding to the current status information comprises one of the following:
selecting a point cloud region with a preset shape according to the current status information, and determining information about the selected point cloud region as the status-dependent point cloud spatial region information;
determining a position of a next movement status of a user using the client and an orientation of the next movement status according to current position information of the user, current orientation information of the user and movement information of the user which are included in the current status information, and determining point cloud spatial region information corresponding to the position and the orientation as the status-dependent point cloud spatial region information; or
determining a spatial region touched by a hand of a user using the client according to a hand position of the user and a hand motion of the user which are included in the current status information, and using information about the spatial region touched by the hand as the status-dependent point cloud spatial region information.

2. The method according to claim 1 , before receiving the current status information sent by the client, further comprising:
receiving a media asset request sent by the client; and
sending media asset description information corresponding to the media asset request to the client.

3. The method according to claim 2 , wherein the media asset description information comprises: a status dependent flag and media asset, wherein the status dependent flag is used for indicating whether a media asset corresponding to the media asset description information contains status-dependent point cloud spatial region data corresponding to the media asset.

4. The method according to claim 3 , wherein the media asset comprises: initial status information and status-dependent point cloud spatial region information corresponding to the initial status information.

5. The method according to claim 4 , wherein the initial status information comprises one of the following: media asset initial viewing information; initial body position information of the user using the client and an initial body direction of the user using the client; an initial position of the user using the client and initial movement information of the user using the client; an initial partial-body position of the user using the client and an initial partial-body motion of the user using the client; or last status information in a case of a last use of a current media asset by the client;
wherein the media asset initial viewing information comprises one of the following: an initial viewing position of the user or an initial viewing direction of the user.

6. The method according to claim 4 , further comprising:
receiving a request, sent by the client, for the status-dependent point cloud spatial region information and status-dependent point cloud spatial region data which correspond to the initial status information; and
sending the status-dependent point cloud spatial region information and the status-dependent point cloud spatial region data which correspond to the initial status information to the client.

7. The method according to claim 2 , wherein the status-dependent point cloud spatial region information comprises one of the following: a number of spatial regions, a spatial region index, an anchor of each spatial region, a shape of each spatial region, or a size of each spatial region.

8. The method according to claim 1 , wherein the current status information comprises one of the following: a current viewing position of a user using the client and a current viewing direction of the user using the client; a current body position of a user using the client and a current body direction of the user using the client; a current position of a user using the client and current movement information of the user using the client; or a current partial-body position of a user using the client and a current partial-body motion of the user using the client.

9. The method according to claim 8 , wherein representation manners of the current viewing position, the current body position, the current position, the current partial-body position and an initial viewing position all comprise three-dimensional coordinates in a global coordinate system;
a representation manner of an initial viewing direction comprises a unit vector of a local coordinate system with the initial viewing position as an origin;
a representation manner of the current body direction comprises a unit vector of a local coordinate system with the current body position as an origin; and
a representation manner of the current viewing direction comprises a unit vector of a local coordinate system with the current viewing position as an origin.

10. The method according to claim 1 , wherein the status-dependent point cloud spatial region information comprises one of the following: a number of spatial regions, a spatial region index, an anchor of each spatial region, a shape of each spatial region, or a size of each spatial region.

11. A non-transitory storage medium storing a computer program which, when executed by a processor, implements the data transmission method according to claim 1 .

12. A data transmission method, being applied to a client and comprising:
sending pre-acquired current status information to a server side;
receiving status-dependent point cloud spatial region information and status-dependent point cloud spatial region data both corresponding to the pre-acquired current status information and sent by the server side, wherein the status-dependent point cloud spatial region information comprises one of:
information about a point cloud region with a preset shape and selected according to the pre-acquired current status information;
point cloud spatial region information corresponding to a position and an orientation of a next movement status of a user using the client and determined according to current position information of the user, current orientation information of the user and movement information of the user which are included in the pre-acquired current status information; or
information about a spatial region touched by a hand of a user using the client and determined according to a hand position of the user and a hand motion of the user which are included in the pre-acquired current status information; and

processing the status-dependent point cloud spatial region information and the status-dependent point cloud spatial region data.

13. The method according to claim 12 , before sending the pre-acquired current status information to the server side, further comprising:
sending a media asset request to the server side; and
receiving media asset description information corresponding to the media asset request and sent by the server side.

14. The method according to claim 13 , wherein t

Assignees

• Zte Corp
• Univ Shanghai Jiaotong

Inventors

• Xu Yiling
• Hou Puyue
• Gao Linyao
• Sun Jun
• Wu Zhao
• Wu Ping
• Li Qiuting

Classifications

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/597

  specially adapted for multi-view video sequence encoding · CPC title

• H04N21/85406

  involving a specific file format, e.g. MP4 format · CPC title

• H04N21/21805

  enabling multiple viewpoints, e.g. using a plurality of cameras · CPC title

• H04N21/6587

  Control parameters, e.g. trick play commands, viewpoint selection · CPC title