System, method and computer-readable medium for video processing

Patent metadata

Field	Value
Publication number	US-12413685-B2
Application number	US-202217881743-A
Country	US
Kind code	B2
Filing date	Aug 5, 2022
Priority date	Sep 30, 2021
Publication date	Sep 9, 2025
Grant date	Sep 9, 2025

Abstract

The present disclosure relates to a system, a method and a computer-readable medium for video processing. The method includes displaying a live video of a first user in a first region on a user terminal and displaying a video of a second user in a second region on the user terminal. A portion of the live video of the first user extends to the second region on the user terminal. The present disclosure can improve interaction during a conference call or a group call.

First claim

What is claimed is:

1. A method for video processing related to live streaming in a mode where at least a first user and a second user simultaneously provide a first live video and a second live video, respectively, for the live streaming, the method performed by a user terminal of a third user viewing the live streaming, the method comprising:
displaying the first live video of the first user in a first region of a display on the user terminal, the first live video representing real image of the first user;
displaying, simultaneously with the display of the first video, the second live video of the second user in a second region of the display on the user terminal, the second region being apart from and lined up with the first region, the second live video representing real image of the second user;
generating a first visual virtual effect in the second region, the first visual virtual effect being associated with the first live video; and
generating a second visual virtual effect in the second region, the second visual virtual effect being generated subsequent to the first visual virtual effect, wherein the first and second visual virtual effects are displayed synchronously in the second region, and the first and second visual virtual effects are different,
wherein the second visual virtual effect is displayed in such a manner to overlap with the real image of the second user in an area where the first visual virtual effect touches the real image of the second user in the second region, and the first visual virtual effect, the second visual virtual effect, and the real image of the second user overlap with each other, and
wherein the second visual virtual effect is displayed only in the second region.

2. The method according to claim 1 , wherein the generating the first visual virtual effect includes generating the first visual virtual effect so that the first visual virtual effect moves synchronously with the first live video.

3. The method according to claim 1 , wherein the second visual virtual effect is an animated object representing hitting.

4. A method for video processing related to live streaming in a mode where at least a first user and a second user simultaneously provide a first live video and a second live video, respectively, for the live streaming, the method performed by an application program able to be installed on a user terminal of a third user viewing the live streaming, the method comprising:
displaying the first live video of the first user in a first region of a display on the user terminal, the first live video representing real image of the first user;
displaying, simultaneously with the display of the first video, the second live video of the second user in a second region of the display on the user terminal, the second region being apart from and lined up with the first region, the second live video representing real image of the second user;
generating a first visual virtual effect in the second region, the first visual virtual effect being associated with the first live video; and
generating a second visual virtual effect in the second region, the second visual virtual effect being generated subsequent to the first visual virtual effect, wherein the first and second visual virtual effects are displayed synchronously in the second region, and the first and second visual virtual effects are different,
wherein the second visual virtual effect is displayed in such a manner to overlap with the real image of the second user in an area where the first visual virtual effect touches the real image of the second user in the second region, and the first visual virtual effect, the second visual virtual effect, and the real image of the second user overlap with each other, and
wherein the second visual virtual effect is displayed only in the second region.

5. A non-transitory computer-readable medium including a program for video processing related to live streaming in a mode where at least a first user and a second user simultaneously provide a first live video and a second live video, respectively, for the live streaming, wherein the program causes one or a plurality of computers of a user terminal of a third user viewing the live streaming to execute:
displaying the first live video of the first user in a first region of a display on the user terminal, the first live video representing real image of the first user;
displaying, simultaneously with the display of the first video, the second live video of the second user in a second region of the display on the user terminal, the second region being apart from and lined up with the first region, the second live video representing real image of the second user;
generating a first visual virtual effect in the second region, the first visual virtual effect being associated with the first live video; and
generating a second visual virtual effect in the second region, the second visual virtual effect being generated subsequent to the first visual virtual effect, wherein the first and second visual virtual effects are displayed synchronously in the second region, and the first and second visual virtual effects are different,
wherein the second visual virtual effect is displayed in such a manner to overlap with the real image of the second user in an area where the first visual virtual effect touches the real image of the second user in the second region, and the first visual virtual effect, the second visual virtual effect, and the real image of the second user overlap with each other, and
wherein the second visual virtual effect is displayed only in the second region.

6. The method according to claim 1 , wherein a movement of the first visual virtual effect is controlled by a movement of the first user, and wherein the movement of the first visual virtual effect is synchronous with the movement of the first user.

7. The method according to claim 1 , wherein a first visual representation of the first visual virtual effect is shown in the first region, a second visual representation of the first visual virtual effect is shown in the second region, wherein the second visual representation is shown in the second region while the first visual representation is shown in the first region, and
wherein the first visual representation shown in the first region is identical to the second visual representation shown in the second region.

8. The method according to claim 7 , wherein the second visual virtual effect is displayed in the second region in response to the second visual representation of the first visual virtual effect coming into contact with the real image of the second user in the second region.

9. The method according to claim 1 , wherein the first visual virtual effect represents a part of the first user.

10. The method according to claim 1 , wherein the first visual virtual effect is extended from the first region to the second region.

11. The method according to claim 1 , wherein the first visual virtual effect or the second visual virtual effect is tied to an amount of gift or gift with an amount of value.

Assignees

• 17Live Japan Inc

Inventors

• Wu shao-yuan
• Cheng Ming-Che
• Chiu Po-Sheng
• Chang Yu-Chuan

Classifications

• H04N21/4312 Primary

  involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations · CPC title

• H04N21/4728

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06V40/60

  Static or dynamic means for assisting the user to position a body part for biometric acquisition · CPC title

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title