Subtitle information display method and apparatus, and electronic device, and computer readable medium

Patent metadata

Field	Value
Publication number	US-11678024-B2
Application number	US-202217868503-A
Country	US
Kind code	B2
Filing date	Jul 19, 2022
Priority date	Jan 21, 2020
Publication date	Jun 13, 2023
Grant date	Jun 13, 2023

Abstract

A subtitle information display method includes: when an editing operation of a user for initial subtitle information of video information is detected, determining a video display region and an edited subtitle display region in an application display page; if the subtitle display region is not a subregion in the video display region, determining a first extension length and a first extension direction for each edge length of the video display region based on region information of the video display region and region information of the subtitle display region; extend the video display region within a region range corresponding to the application display page, based on the first extension length and the first extension direction, so that the extended video display region includes the subtitle display region; and displaying edited subtitle information in the subtitle display region.

First claim

The invention claimed is:

1. A method for displaying subtitle information, comprising:
determining a video display region in an application display page and en-a subtitle display region after an editing operation, in response to a detection of the editing operation of a user for initial subtitle information of video information;
determining a first extension length and a first extension direction for each of edges of the video display region based on region information of the video display region and region information of the subtitle display region, if the subtitle display region is not a subregion comprised in the video display region;
extending the video display region within a region range corresponding to the application display page based on the first extension length and the first extension direction, wherein the extended video display region comprises the subtitle display region; and
displaying edited subtitle information in the subtitle display region.

2. The method according to claim 1 , wherein the editing operation comprises at least one of:
adjusting a font color of a subtitle, adjusting a font size of the subtitle, adjusting a text content of the subtitle, adjusting a position of the subtitle display region, adjusting a size of the subtitle display region, and adjusting a shape of the subtitle display region.

3. The method according to claim 1 , wherein region information of any display region comprises coordinates of endpoints of the display region; and
the determining the first extension length and the first extension direction for each of the edges of the video display region based on the region information of the video display region and the region information of the subtitle display region comprises:
determining a positional relationship between the video display region and the subtitle display region, based on coordinates of endpoints of the video display region and coordinates of endpoints of the subtitle display region;
determining the first extension direction for each of the edges of the video display region based on the positional relationship; and
determining, for each of the edges of the video display region, a coordinate of a first target endpoint from the coordinates of the endpoints of the video display region and a coordinate of a second target endpoint from the coordinates of the endpoints of the subtitle display region based on the first extension direction of the edge, and determining the first extension length of the edge based on the coordinate of the first target endpoint and the coordinate of the second target endpoint.

4. The method according to claim 1 , wherein before the detecting the editing operation of the user for the initial subtitle information, the method further comprises:
acquiring video data to be processed, and obtaining audio information based on the video data;
sending the audio information to a server, to obtain the initial subtitle information by the server performing text recognition on the audio information; and
receiving the initial subtitle information from the server.

5. The method according to claim 4 , wherein after the extending the video display region within the region range corresponding to the application display page based on the first extension length and the first extension direction, the method further comprises:
determining the edited subtitle information based on the editing operation and the initial subtitle information, in response to a detection of a video release instruction; and
performing video synthesis on the video data and the edited subtitle information, and obtaining video information carrying the edited subtitle information.

6. The method according to claim 5 , wherein after the obtaining video information carrying the edited subtitle information, the method further comprises:
displaying the video information, in the video display region before extending.

7. An apparatus for displaying subtitle information, comprising:
a memory; and
a processor,
wherein a computer program is stored in the memory; and the computer program, when executed by a processor, causes the processor to
determine a video display region in an application display page and a subtitle display region after an editing operation, in response to a detection of the editing operation of a user for initial subtitle information of video information;
determine a first extension length and a first extension direction for each of edges of the video display region based on region information of the video display region and region information of the subtitle display region, if the subtitle display region is not a subregion comprised in the video display region;
extend the video display region within a region range corresponding to the application display page based on the first extension length and the first extension direction, wherein the extended video display region comprises the subtitle display region; and
display edited subtitle information in the subtitle display region.

8. The apparatus according to claim 7 , wherein the editing operation comprises at least one of:
adjusting a font color of a subtitle, adjusting a font size of the subtitle, adjusting a text content of the subtitle, adjusting a position of the subtitle display region, adjusting a size of the subtitle display region, and adjusting a shape of the subtitle display region.

9. The apparatus according to claim 7 , wherein region information of any display region comprises coordinates of endpoints of the display region; and
the computer program, when executed by a processor, causes the processor to:
determine a positional relationship between the video display region and the subtitle display region, based on coordinates of endpoints of the video display region and coordinates of endpoints of the subtitle display region;
determine the first extension direction for each of the edges of the video display region based on the positional relationship; and
determine, for each of the edges of the video display region, a coordinate of a first target endpoint from the coordinates of the endpoints of the video display region and a coordinate of a second target endpoint from the coordinates of the endpoints of the subtitle display region based on the first extension direction of the edge, and determine the first extension length of the edge based on the coordinate of the first target endpoint and the coordinate of the second target endpoint.

10. The apparatus according to claim 7 , wherein the computer program, when executed by a processor, causes the processor further to:
acquire video data to be processed, and obtain audio information based on the video data;
send the audio information to a server, to obtain the initial subtitle information by the server performing text recognition on the audio information; and
receive the initial subtitle information from the server.

11. The apparatus according to claim 10 , wherein the computer program, when executed by a processor, causes the processor to:
determine the edited subtitle information based on the editing operation and the initial subtitle information, in response to a detection of a video release instruction; and
perform video synthesis on the video data and the edited subtitle information, and obtain video information carrying the edited subtitle information.

12. The apparatus according to claim 11 , wherein the computer program, when executed by a processor, causes the processor to:
display the video information, in the video display region before extending.

13. A non-transitory computer readable medium storing a computer program thereon, wherein the computer pro

Assignees

• Beijing Bytedance Network Tech Co Ltd

Inventors

• Sun Yingzhao
• Li Xingdong
• Wang Haiting

Classifications

• H04N21/47205

  for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally · CPC title

• H04N21/435

  Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream · CPC title

• H04N21/4884 Primary

  for displaying subtitles · CPC title

• H04N21/4312

  involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations · CPC title

• H04N21/233

  Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)} · CPC title