Method, apparatus, server, and storage medium for generating live broadcast video of highlight collection

Patent metadata

Field	Value
Publication number	US-11025964-B2
Application number	US-201916569866-A
Country	US
Kind code	B2
Filing date	Sep 13, 2019
Priority date	Apr 2, 2019
Publication date	Jun 1, 2021
Grant date	Jun 1, 2021

Abstract

Some embodiments of the present disclosure relate to the field of video processing, and disclose a method, an apparatus, a server, and a storage medium for generating a live broadcast video of highlight collection. The method for generating a live broadcast video highlight in the embodiments of the present disclosure includes: identifying a live broadcast picture from a live broadcast video and determining if a target image element exists in the live broadcast picture; if the target image element exists in the live broadcast picture, saving, as a highlight segment, a segment of live broadcast video having the live broadcast picture; when a merging condition is satisfied, merging the highlight segment into the live broadcast video based on the merging condition to obtain a merged video of highlight collection; and switching an output live broadcast video to the merged video of highlight collection.

First claim

What is claimed is:

1. A method for generating a live broadcast video of highlight collection, comprising:
identifying a live broadcast picture from a live broadcast video and determining if a target image element exists in the live broadcast picture;
if the target image element exists in the live broadcast picture, saving, as a highlight segment, a segment of the live broadcast video having the live broadcast picture;
when a merging condition is satisfied, merging the highlight segment into the live broadcast video based on the merging condition to obtain a merged video of highlight collection; and
switching an output live broadcast video to the merged video of highlight collection;
wherein the identifying a live broadcast picture and determining if a target image element exists in the live broadcast picture specifically comprises:
autonomously identifying the live broadcast picture and autonomously determining if the target image element exists in the live broadcast picture, according to an image identification model established in advance, wherein the image identification model is established by training according to collected image features;

wherein the merging condition is autonomously determined according to the image identification model; and
wherein the merging the highlight segment into the live broadcast video based on the merging condition to obtain a merged video of highlight collection comprises:
decoding the highlight segment, and decoding the live broadcast video;
merging each video frame of the decoded highlight segment with each video frame of the
decoded live broadcast video in a preset mode, to obtain merged video data; and
recoding the merged video data to obtain the merged video of highlight collection, such that the merged video of highlight collection displays the live broadcast video and the highlight segment simultaneously.

2. The method for generating a live broadcast video of highlight collection according to claim 1 , wherein the merged data comprises: merged video data and merged audio data; and
the merging the decoded highlight segment into the decoded live broadcast video specifically comprises: merging an audio stream of the decoded highlight segment and an audio stream of the decoded live broadcast video in form of audio mixing, to obtain the merged audio data.

3. The method for generating a live broadcast video of highlight collection according to claim 1 , wherein, the method further comprises performing the following steps before the determining if a target image element exists in the live broadcast picture: caching a data packet of the live broadcast video in real time; and
the saving, as a highlight segment, a segment of live broadcast video having the live broadcast picture specifically comprises: saving a currently cached data packet of the live broadcast video as the highlight segment.

4. The method for generating a live broadcast video of highlight collection according to claim 3 , wherein the method further comprises performing the following step before the saving the currently cached data packet of the live broadcast video as the highlight segment:
determining if a playing duration of the currently cached data packet of the live broadcast video exceeds a preset upper limit; and
if the preset upper limit is exceeded, discarding a part of data in the cached data packet of the live broadcast video.

5. The method for generating a live broadcast video of highlight collection according to claim 4 , wherein the discarding a part of data in the cached data packet live broadcast video specifically comprises:
sequentially discarding, according to a playing order of the data packet of the live broadcast video, video frame sequences in the currently cached data packet of the live broadcast video from front to back, until the playing duration of the cached data packet of the live broadcast video obtained after the discarding does not exceed the preset upper limit.

6. The method for generating a live broadcast video of highlight collection according to claim 3 , wherein the data packet of the live broadcast video saved as the highlight segment is specifically a cached data packet of the live broadcast video in which a first video frame thereof is a key frame.

7. The method for generating a live broadcast video of highlight collection according to claim 1 , wherein, the method further comprises performing the following step before the merging the highlight segment into the live broadcast video based on the merging condition:
if the number of the saved highlight segment is more than one, splicing a plurality of highlight segments into one highlight collection; and
the merging the highlight segment into the live broadcast video is specifically: merging the highlight collection into the live broadcast video.

8. The method for generating a live broadcast video of highlight collection according to claim 7 , wherein the splicing the plurality of highlight segments into one highlight collection specifically comprises:
editing each of the highlight segment;
performing a timestamp recovery on each of the edited highlight segment; and
splicing each of the highlight segment obtained after the timestamp recovery, into one highlight collection according to a timestamp order.

9. The method for generating a live broadcast video of highlight collection according to claim 1 , wherein the switching the output live broadcast video to the merged video of highlight collection specifically comprises:
determining if a switching time point is satisfied, according to a timestamp of the live broadcast video; and
if the switching time point is satisfied, switching the output live broadcast video to the merged video of highlight collection.

10. The method for generating a live broadcast video of highlight collection according to claim 1 , wherein the method further comprises performing the following after the switching the output live broadcast video to the merged video of highlight collection:
determining remaining duration of the merged video of highlight collection; and
when the remaining duration is zero, switching, an output merged video of highlight collection to the live broadcast video.

11. The method for generating a live broadcast video of highlight collection according to claim 1 , wherein the method further comprises performing the following after the switching the output live broadcast video to the merged video of highlight collection:
determining remaining duration of the merged video of highlight collection; and
when the remaining duration of the merged video of highlight collection is zero, determining if a first video frame of the live broadcast video is a key frame; and
if the first video frame of the live broadcast video is the key frame, switching an output merged video of highlight collection to the live broadcast video.

12. The method for generating a live broadcast video of highlight collection according to claim 1 , wherein identifying the live broadcast picture and determining if the target image element exists in the live broadcast picture, according to an image identification model established in advance specifically comprises:
obtaining a specified area in the live broadcast picture;
identifying if the target image element exists in the specified area according to the image identification model established in advance; and
if the target image element exists in the specified area, determining that the target image element exists in the live broadcast picture.

13. The method for generating a live broadcast video of highlight collection according to claim 12 , wherein the identifying if

Assignees

• Wangsu Science & Tech Co Ltd

Inventors

• Zheng Zhengui
• Sun Lei
• Chen Xiangxiang

Classifications

• H04N21/23424

  involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement · CPC title

• H04N21/8549

  Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)} · CPC title

• H04N21/2343

  involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)} · CPC title

• H04N21/23106

  involving caching operations (prefetching while addressing of a memory level in which the access to the desired data or data block requires associative addressing means within memory systems or architectures G06F12/0862; caching at an intermediate stage in a data network H04L67/568) · CPC title

• H04N21/2187 Primary

  Live feed · CPC title