Method for processing media data, client, and server

Patent metadata

Field	Value
Publication number	US-2025240383-A1
Application number	US-202519173556-A
Country	US
Kind code	A1
Filing date	Apr 8, 2025
Priority date	Sep 27, 2018
Publication date	Jul 24, 2025
Grant date	—

Abstract

A client, a server, and a method for processing media data, the method including obtaining an overlay and information about a region associated with the overlay, where the information about the region associated with the overlay is used to indicate the region associated with the overlay, and displaying the overlay when a trigger operation for the region associated with the overlay is detected.

First claim

1 . A method for processing media data, comprising:
receiving an omnidirectional bitstream; obtaining an overlay and information about a region associated with the overlay according to the omnidirectional bitstream, wherein the information about the region associated with the overlay indicates the region associated with the overlay, wherein the information about the region associated with the overlay is disposed in an associated region structure (AssociatedSphereRegionStruct), wherein the associated region structure is an overlay control structure of an existing overlay_control_struct of an omnidirectional media format (OMAF) standard, wherein the region associated with the overlay is a sphere region; and displaying the overlay in response to a trigger operation on the region associated with the overlay being detected; wherein the trigger operation on the region associated with the overlay is caused by a user and is associated with controlling display or undisplay of the overlay.

2 . The method according to claim 1 , wherein the trigger operation on the region associated with the overlay comprises a tapping operation within the region associated with the overlay or a trigger operation associated with a line of sight of a user being within the region associated with the overlay.

3 . The method according to claim 2 , wherein the information about the region associated with the overlay comprises a sphere coordinate value of a center point of the sphere region.

4 . The method according to claim 2 , wherein a control for user interaction overlay control structure of the existing overlay_control_struct comprises a conditional trigger flag (conditional_switch_on_off_flag) indicating that the display of the overlay is conditionally triggered, wherein a first preset value of the conditional trigger flag indicates that display or undisplay of the overlay is controlled using the trigger operation for triggering display or undisplay of the overlay.

5 . A method for processing media data, comprising:
determining information about a region associated with an overlay, where the information about the region associated with the overlay indicates the region associated with the overlay; sending the information about the region associated with the overlay to a client; and sending an omnidirectional bitstream of the overlay to the client; wherein the information about the region associated with the overlay is disposed in an associated region structure (AssociatedSphereRegionStruct), wherein the associated region structure is an overlay control structure to an existing overlay_control_struct of an omnidirectional media format (OMAF) standard, wherein the region associated with the overlay is a sphere region; and wherein the overlay is displayed in response to a trigger operation caused by a user on the region associated with the overlay being detected.

6 . The method according to claim 5 , wherein the trigger operation on the region associated with the overlay comprises a tapping operation within the region associated with the overlay or a trigger operation associated with a line of sight of a user being within the region associated with the overlay.

7 . The method according to claim 6 , wherein a control for user interaction overlay control structure of the existing overlay_control_struct comprises a newly-added conditional trigger flag (conditional_switch_on_off_flag) indicating that the display of the overlay is conditionally triggered, wherein a first preset value of the conditional trigger flag indicates that display or undisplay of the overlay is controlled using the trigger operation for triggering display or undisplay of the overlay.

8 . An apparatus, comprising:
one or more processors; and at least one non-transitory computer readable memory connected to the one or more processors and including computer program code stored thereon, wherein the at least one non-transitory computer readable memory and the computer program code are configured, with the one or more processors, to cause the apparatus to at least:
receive an omnidirectional bitstream;
obtain an overlay and information about a region associated with the overlay according to the omnidirectional bitstream, wherein the information about the region associated with the overlay indicates the region associated with the overlay, wherein the information about the region associated with the overlay is disposed in an associated region structure (AssociatedSphereRegionStruct), wherein the associated region structure is an overlay control structure to an existing overlay_control_struct of an omnidirectional media format (OMAF) standard, wherein the region associated with the overlay is a sphere region; and
display the overlay in response to a trigger operation on the region associated with the overlay being detected; wherein the trigger operation on the region associated with the overlay is caused by a user and is associated with controlling display or undisplay of the overlay.

9 . The apparatus according to claim 8 , wherein the trigger operation on the region associated with the overlay comprises a tapping operation within the region associated with the overlay or a trigger operation associated with a line of sight of a user being within the region associated with the overlay.

10 . The apparatus according to claim 9 , wherein the information about the region associated with the overlay comprises a sphere coordinate value of a center point of the sphere region.

11 . The apparatus according to claim 9 , wherein a control for user interaction overlay control structure of the existing overlay_control_struct comprises a conditional trigger flag (conditional_switch_on_off_flag) indicating that the display of the overlay is conditionally triggered, wherein a first preset value of the conditional trigger flag indicates that display or undisplay of the overlay is controlled using the trigger operation for triggering display or undisplay of the overlay.

12 . An apparatus, comprising:
one or more processors; and at least one non-transitory computer readable memory connected to the one or more processors and including computer program code stored thereon, wherein the at least one non-transitory computer readable memory and the computer program code are configured, with the one or more processors, to cause the apparatus to at least: determine information about a region associated with an overlay, where the information about the region associated with the overlay indicates the region associated with the overlay; send the information about the region associated with the overlay to a client; and send an omnidirectional bitstream of the overlay to the client; wherein the information about the region associated with the overlay is disposed in an associated region structure (AssociatedSphereRegionStruct), wherein the associated region structure is an overlay control structure to an existing overlay_control_struct of an omnidirectional media format (OMAF) standard, wherein the region associated with the overlay is a sphere region; and wherein the overlay is displayed in response to a trigger operation caused by a user on the region associated with the overlay being detected.

13 . The apparatus according to claim 12 , wherein the trigger operation on the region associated with the overlay comprises a tapping operation within the region associated with the overlay or a trigger operation associated with a line of sight of a user being within the region associated with the overlay.

14 . The apparatus according to claim 13 , wherein a control for user interaction overlay control structure of the ex

Assignees

• Huawei Tech Co Ltd

Inventors

• Fan Yuqun
• Di Peiyun
• Wang Ye-Kui

Classifications

• H04N21/4312

  involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• H04N13/183

  On-screen display [OSD] information, e.g. subtitles or menus · CPC title

• H04N13/178

  Metadata, e.g. disparity information · CPC title