Method and apparatus for determining live streaming keyframe, storage medium, and electronic device

Patent metadata

Field	Value
Publication number	US-2026095601-A1
Application number	US-202519317170-A
Country	US
Kind code	A1
Filing date	Sep 3, 2025
Priority date	Sep 29, 2024
Publication date	Apr 2, 2026
Grant date	—

Abstract

Embodiments of this specification disclose a method and an apparatus for determining a live streaming keyframe, a storage medium, and an electronic device. Feature extraction is performed on a current captured frame of target live streaming by using a feature extraction module, to obtain a feature vector of the current captured frame. The feature vector of the current captured frame is stored in a cache, and a target historical captured frame that is in the cache and that corresponds to the current captured frame is deleted. A feature vector of a plurality of captured frames is read from the cache by using a keyframe calculation module, and at least one keyframe is determined based on the feature vector of the plurality of captured frames. If the current captured frame is in the at least one keyframe, it is determined that the current captured frame is a keyframe.

First claim

1 . A method for determining a live streaming keyframe, comprising:
performing, by using a feature extraction module, feature extraction on a current captured frame of target live streaming, to obtain a feature vector of the current captured frame, wherein a frame sequence number corresponding to the current captured frame is a first sequence number; storing the feature vector of the current captured frame in a cache, and deleting a target historical captured frame that is in the cache and that corresponds to the current captured frame, wherein a difference between the first sequence number and a target sequence number corresponding to the target historical captured frame is a target quantity; reading, from the cache by using a keyframe calculation module, a feature vector of a plurality of captured frames whose corresponding frame sequence numbers are from a second sequence number to the first sequence number, and determining at least one keyframe based on the feature vector of the plurality of captured frames, wherein a difference between the first sequence number and the second sequence number is the target quantity minus one, and a capture time of a captured frame corresponding to the second sequence number is earlier than a capture time of a captured frame corresponding to the first sequence number; and if the current captured frame is in the at least one keyframe, determining that the current captured frame is a keyframe.

2 . The method according to claim 1 , further comprising:
obtaining a sliding window corresponding to a historical captured frame of the target live streaming, wherein a window length of the sliding window is the target quantity, and a current right boundary of the sliding window is a previous historical captured frame corresponding to the current captured frame; the deleting a target historical captured frame that is in the cache and that corresponds to the current captured frame comprises:
sliding the sliding window rightward by one step, so that the current right boundary of the sliding window becomes the current captured frame, and deleting a previous target historical captured frame of a historical captured frame that is in the cache and that corresponds to a current left boundary of the sliding window; and
the reading, from the cache by using a keyframe calculation module, a feature vector of a plurality of captured frames whose corresponding frame sequence numbers are from a second sequence number to the first sequence number comprises:
reading, from the cache based on the sliding window by using the keyframe calculation module, the feature vector of the plurality of captured frames whose corresponding frame sequence numbers are from the second sequence number to the first sequence number.

3 . The method according to claim 2 , wherein the sliding the sliding window rightward by one step, so that the current right boundary of the sliding window becomes the current captured frame, and deleting a previous target historical captured frame of a historical captured frame that is in the cache and that corresponds to a current left boundary of the sliding window comprises:
obtaining a frame quantity corresponding to the historical captured frame that is of the target live streaming and that is currently cached in the cache; and if the frame quantity is greater than or equal to the window length of the sliding window, sliding the sliding window rightward by one step, so that the current right boundary of the sliding window becomes the current captured frame, and deleting the previous target historical captured frame of the historical captured frame that is in the cache and that corresponds to the current left boundary of the sliding window.

4 . The method according to claim 2 , further comprising:
determining the window length of the sliding window based on the target live streaming.

5 . The method according to claim 4 , wherein the determining the window length of the sliding window based on the target live streaming comprises:
determining the window length of the sliding window based on streamer information and/or product information corresponding to the target live streaming.

6 . The method according to claim 5 , wherein the determining the window length of the sliding window based on streamer information and/or product information that correspond/corresponds to the target live streaming comprises:
determining the window length of the sliding window based on the streamer information and/or the product information corresponding to the target live streaming and with reference to audience information corresponding to the target live streaming.

7 . The method according to claim 2 , further comprising:
performing content detection on the current captured frame by using a content detection module, to obtain a content detection result corresponding to the current captured frame.

8 . The method according to claim 7 , further comprising:
determining, based on the content detection result corresponding to the current captured frame, whether the window length of the sliding window needs to be adjusted; and sliding the current right boundary of the sliding window rightward if it is determined that the window length of the sliding window needs to be increased; or sliding the current left boundary of the sliding window rightward if it is determined that the window length of the sliding window needs to be decreased.

9 . The method according to claim 8 , wherein the determining, based on the content detection result corresponding to the current captured frame, whether the window length of the sliding window needs to be adjusted comprises:
determining, based on the content detection result corresponding to the current captured frame and a content detection result corresponding to a historical keyframe that corresponds to the target live streaming and that is located before the current captured frames, whether the window length of the sliding window needs to be adjusted.

10 - 11 . (canceled)

12 . An electronic device, comprising a processor and a memory, wherein the memory stores a computer program, and when the processor executes the computer program, the electronic device is caused to:
perform, by using a feature extraction module, feature extraction on a current captured frame of target live streaming, to obtain a feature vector of the current captured frame, wherein a frame sequence number corresponding to the current captured frame is a first sequence number; store the feature vector of the current captured frame in a cache, and delete a target historical captured frame that is in the cache and that corresponds to the current captured frame, wherein a difference between the first sequence number and a target sequence number corresponding to the target historical captured frame is a target quantity; read, from the cache by using a keyframe calculation module, a feature vector of a plurality of captured frames whose corresponding frame sequence numbers are from a second sequence number to the first sequence number, and determine at least one keyframe based on the feature vector of the plurality of captured frames, wherein a difference between the first sequence number and the second sequence number is the target quantity minus one, and a capture time of a captured frame corresponding to the second sequence number is earlier than a capture time of a captured frame corresponding to the first sequence number; and if the current captured frame is in the at least one keyframe, determine that the current captured frame is a keyframe.

13 . (canceled)

14 . The electronic device according to claim 12 , is further caused to:

Assignees

• Alipay Hangzhou Inf Tech Co Ltd

Inventors

• Zhu Hailiang
• Hu Zongwang

Classifications

• H04N21/44008

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• G06V20/46

  Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames · CPC title

• H04N21/2187 Primary

  Live feed · CPC title

• H04N21/4788 Primary

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title