Additional object display method and apparatus, computer device, and storage medium

Patent metadata

Field	Value
Publication number	US-11640235-B2
Application number	US-202015930124-A
Country	US
Kind code	B2
Filing date	May 12, 2020
Priority date	Jan 18, 2018
Publication date	May 2, 2023
Grant date	May 2, 2023

Abstract

This application provides an additional object display method, an additional object display apparatus, and a computer device, and relates to the field of computer application technologies. The method includes: displaying a trigger control in a video playback interface; pausing playback of a video in response to an activation operation on the trigger control, and displaying a reference picture frame; obtaining a target object in the reference picture frame in response to a drag operation on the trigger control; and displaying, corresponding to the target object, an additional object corresponding to the trigger control in a picture frame of the video during playback of the video, so that an additional object matches a video playback picture during playback of the video.

First claim

What is claimed is:

1. An additional object display method, performed by a terminal, the method comprising:
displaying a trigger control in a video playback interface, the video playback interface being used for playing a video comprising a plurality of picture frames;
pausing playback of the video in response to an activation operation on the trigger control, and displaying a reference picture frame of the plurality of picture frames in the video playback interface, the reference picture frame being a picture frame corresponding to a pause time point in the video;
displaying a preview picture of an additional object in the reference picture frame;
displaying a switch control configured to cause display of a plurality of candidate additional objects within an additional object selection interface in response to an activation operation on the switch control;
displaying a zoom control associated with the preview picture in the reference picture frame, wherein the trigger control, the zoom control, and the switch control are simultaneously displayed around the preview picture of the additional object;
in response to receiving a zoom operation on the zoom control, changing a display size of the additional object from an original display size to a new display size corresponding to the zoom operation;
obtaining a target object in response to a drag operation on the trigger control, the target object being a display object corresponding to an end position of the drag operation in the reference picture frame;
tracking the target object in a first set of picture frames of the plurality of pictures frames that are displayed after the reference picture frame and in a second set of picture frames of the plurality of picture frames that are displayed before the reference picture frame, wherein the tracking comprises:
tracking the target object in the first set of picture frames, frame-by-frame, in a chronological order starting from the reference picture frame corresponding to the pause time point; and
tracking the target object in the second set of picture frames, frame-by-frame, in a reverse order starting from the reference picture frame corresponding to the pause time point;
moving the preview picture of the additional object with the new display size from an initial position to a new position in the reference picture frame; and
displaying the additional object in each picture frame during the playback of the video.

2. The method according to claim 1 , wherein the drag operation comprises a first drag operation, and wherein moving the preview picture of the additional object comprises:
moving the preview picture of the additional object in the video playback interface in response to a second drag operation on the preview picture of the additional object.

3. The method according to claim 1 , wherein first display information comprises a display size of the target object in the each picture frame; the method further comprising:
calculating a zoom ratio of the additional object in the each picture frame according to the display size of the target object in the each picture frame and an original size of the target object, the original size of the target object being a display size of the target object in the reference picture frame;
obtaining the display size of the additional object in the each picture frame according to the new display size of the additional object and the zoom ratio; and
generating second display information comprising the display size of the additional object in the each picture frame.

4. The method according to claim 1 , wherein first display information comprises a display position and a display posture of the target object in the each picture frame;
the method further comprising:
obtaining a display position and a display posture of the additional object in the each picture frame according to the display position and the display posture of the target object in the each picture frame and relative position information between the additional object and a target point; and
generating second display information comprising the display position and the display posture of the additional object in the each picture frame.

5. The method according to claim 1 , wherein tracking the target object in the each picture frame of the video comprises:
tracking the target object in the each picture frame of the video by using a clustering of static-adaptive correspondences for deformable object tracking (CMT) algorithm.

6. The method according to claim 1 , further comprising:
displaying, corresponding to the trigger control, the switch control in the video playback interface;
displaying the additional object selection interface in response to an activation operation on the switch control, the additional object selection interface comprising the plurality of candidate additional objects; and
obtaining, in response to a selection operation in the additional object selection interface, a candidate object corresponding to the selection operation as a new additional object corresponding to the trigger control.

7. The method according to claim 1 , wherein the additional object is a static display object or a dynamic display object.

8. The method according to claim 1 , further comprising:
in response to the tracking, obtaining first display information indicating at least one of a display position, a display size, or a display posture of the target object in each picture frame of the first set and the second set, wherein the first display information comprises pixel coordinates of a target point in the target object in the each picture frame, the target point being a position point corresponding to the end position of the drag operation on the trigger control in the reference picture frame;
obtaining relative position information between the additional object and the target point according to a display position of the preview picture of the additional object in the reference picture frame and the corresponding end position of the drag operation in the reference picture frame; and
generating second display information according to the first display information and the relative position information, the second display information indicating at least one of a display position, the display size, or a display posture of the additional object corresponding to the target object in the each picture frame.

9. An apparatus comprising:
a memory storing at least one instruction, at least one program, a code set, or an instruction set; and
a processor configured to execute the at least one instruction, the at least one program, the code set, or the instruction set, and upon execution, to:
control a display to display a trigger control in a video playback interface, the video playback interface being used for playing a video comprising a plurality of picture frames;
pause playback of the video in response to an activation operation on the trigger control;
control the display to display a preview picture of an additional object in the reference picture frame;
control the display to display a switch control configured to cause display of a plurality of candidate additional objects within an additional object selection interface in response to an activation operation on the switch control;
control the display to display a zoom control associated with the preview picture in the reference picture frame;
control the display to simultaneously display the trigger control, the zoom control, and the switch control around the preview picture of the additional object;
in response to receipt of a zoom operation on the zoom control, change a display size of the additional object from an original display size to a new display size correspond

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Xiao Xianmin
• Zhang Zhong Bao
• Jiang Hui
• Wang wen tao
• Xiao Peng
• Li xiong zhi
• Zhang Yuanhao
• Lin Feng

Classifications

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• H04N21/472

  End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)} · CPC title

• H04N21/485

  End-user interface for client configuration · CPC title

• H04N21/431

  Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering · CPC title

• H04N21/4438

  Window management, e.g. event handling following interaction with the user interface · CPC title