Operation control method and apparatus

Patent metadata

Field	Value
Publication number	US-2024216802-A1
Application number	US-202118012610-A
Country	US
Kind code	A1
Filing date	May 27, 2021
Priority date	Jun 24, 2020
Publication date	Jul 4, 2024
Grant date	—

Abstract

An operation control method and apparatus. The method comprises: acquiring a facial image of a target user; detecting position information of a target part in the facial image; on the basis of the detected position information, and at a relative position, corresponding to the detected position information, on the facial image, displaying a target virtual prop in an initial display form; and adjusting the display form of the target virtual prop according to detected state information of the target part.

First claim

1 . An operation control method, comprising:
obtaining a face image of a target user; detecting position information of a target part in the face image; based on the detected position information, displaying a target virtual prop, in an initial display form, at a relative position corresponding to the detected position information on the face image; and adjusting a display form of the target virtual prop based on detected state information of the target part.

2 . The method according to claim 1 , wherein the display form comprises a display shape and/or a display size.

3 . The method according to claim 1 , wherein the adjusting a display form of the target virtual prop based on detected state information of the target part comprises:
adjusting the display form of the target virtual prop in a case that it is detected that a state attribute of the target part meets a preset state attribute condition and it is detected that a sound attribute meets a preset sound attribute condition.

4 . The method according to claim 3 , wherein the adjusting the display form of the target virtual prop in a case that it is detected that a state attribute of the target part meets a preset state attribute condition and it is detected that a sound attribute meets a preset sound attribute condition comprises:
in the case that the state attribute of the target part meets the preset state attribute condition and the sound attribute meets the preset sound attribute condition, determining a display form adjustment range of the target virtual prop in a time period based on detected face shape change information of the target user; and adjusting the display form of the target virtual prop based on the determined display form adjustment range.

5 . The method according to claim 1 , wherein the adjusting a display form of the target virtual prop based on detected state information of the target part comprises:
in a case that a state attribute of the target part meets a preset state attribute condition, determining a display form adjustment range of the target virtual prop in a time period based on detected face shape change information of the target user; and adjusting the display form of the target virtual prop based on the determined display form adjustment range.

6 . The method according to claim 3 , wherein in a case that the target part is a mouth and the target virtual prop is a virtual balloon, that the state attribute of the target part meets the preset state attribute condition comprises that the target part is in a mouth-pouting state.

7 . The method according to claim 3 , wherein that the sound attribute meets the preset sound attribute condition comprises that it is detected that a sound volume is greater than a preset threshold and/or it is detected that a sound type is a preset sound type.

8 . The method according to claim 1 , wherein after adjusting the display form of the target virtual prop based on the detected state information of the target part, the method further comprises:
after adjusting the display form of the target virtual prop to meet a preset condition, displaying a target animation effect corresponding to the target virtual prop.

9 . The method according to claim 8 , wherein in a case that the target part is a mouth and the target virtual prop is a virtual balloon, the displaying a target animation effect corresponding to the target virtual prop comprises:
displaying a target animation effect that the virtual balloon is blown up or blown away.

10 . The method according to claim 9 , wherein the after adjusting the display form of the target virtual prop to meet a preset condition, displaying a target animation effect corresponding to the target virtual prop comprises:
based on prop attribute information of the target virtual prop, displaying a target animation effect matching the prop attribute information.

11 . The method according to claim 1 , wherein after adjusting the display form of the target virtual prop based on the detected state information of the target part, the method further comprises:
after adjusting the display form of the target virtual prop to meet a preset condition, updating a recorded successful operation number, and displaying the target virtual prop in the initial display form.

12 . The method according to claim 1 , further comprising:
obtaining a personalized to-be-added object; and generating the target virtual prop based on the obtained personalized to-be-added object and a preset virtual prop model.

13 . The method according to claim 1 , further comprising:
displaying an auxiliary virtual prop in a preset position region on a screen displaying the face image; and in response to adjusting the display form of the target virtual prop to meet a preset condition, changing a display effect of the auxiliary virtual prop.

14 . The method according to claim 1 , wherein
the face image of the target user comprises face images of a plurality of target users; and for each of the target users, based on detected position information of a target part of the target user, a target virtual prop, in an initial display form, is displayed at a relative position corresponding to the detected position information on a face image of the target user.

15 . The method according to claim 14 , wherein the adjusting a display form of the target virtual prop based on detected state information of the target part comprises:
based on detected state information of target parts of all the target users and detected face shape change information of all the target users, determining a selected user from the target users, and adjusting a display form of a target virtual prop corresponding to the selected user.

16 . The method according to claim 14 , wherein the adjusting a display form of the target virtual prop based on detected state information of the target part comprises:
based on detected state information of target parts of all the target users, adjusting a display form of a target virtual prop corresponding to each of the target users.

17 . An operation control method, comprising:
obtaining a face image of a target user; displaying a target virtual prop in an initial form based on the obtained face image; and based on detected face expression information of the face image and detected sound information, adjusting a display form of the target virtual prop.

18 . An operation control apparatus, comprising:
at least one processor; and at least one memory communicatively coupled to the at least one processor and storing instructions that upon execution by the at least one processor cause the apparatus to: obtain a face image of a target user; detect position information of a target part in the face image; based on the detected position information, display a target virtual prop, in an initial display form, at a relative position corresponding to the detected position information on the face image; and adjust a display form of the target virtual prop based on detected state information of the target part.

19 . An operation control apparatus, comprising:
at least one memory communicatively coupled to the at least one processor and storing instructions that upon execution by the at least one processor cause the apparatus to: perform the operation control method according to claim 1 .

20 . (canceled)

21 . A computer-readable non-transitory storage medium storing a computer program, wherein the computer program, when executed by a processor, c

Assignees

• Beijing Bytedance Network Tech Co Ltd

Inventors

• Zheng Hua
• Cong Yandong
• Zhou Zexin

Classifications

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06V40/171

  Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships · CPC title

• A63F13/52 Primary

  involving aspects of the displayed game scene · CPC title

• G06V40/174

  Facial expression recognition · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title