Rendering customized video call interfaces during a video call

Patent metadata

Field	Value
Publication number	US-2023368444-A1
Application number	US-202217663360-A
Country	US
Kind code	A1
Filing date	May 13, 2022
Priority date	May 13, 2022
Publication date	Nov 16, 2023
Grant date	—

Abstract

Systems, methods, client devices, and non-transitory computer-readable media are disclosed for rendering custom video call interfaces having customizable video cells and/or interactive interface objects during a video call. For example, the disclosed systems can conduct a video call with one or more participant client devices through a streaming channel established for the video call. During the video call, the disclosed systems can render a video cell that portrays a video received from a participant client device in a grid-view display format. Subsequently, upon detecting a user interaction that indicates a request to customize a video call interface, the disclosed systems can render the video cell within a custom video call interface in a self-view display format. In some cases, the client device, via the self-view display format, facilitates various customizations and/or interactions with video cells and other interactive objects displayed on the client device during the video call.

First claim

What is claimed is:

1 . A computer-implemented method comprising:
conducting, by a client device, a video call with a participant device through a streaming channel established for the video call from the participant device; rendering, within a video call interface displayed on the client device, a video cell portraying a video utilizing video data received from the participant device in a grid-view display format; and upon detecting a user interaction indicating a request to display a custom video call interface layout, rendering the video cell within a custom video call interface on the client device in a self-view display format.

2 . The computer-implemented method of claim 1 , further comprising, upon detecting the user interaction indicating the request to display the custom video call interface layout, rendering an additional video cell portraying an additional video utilizing additional video data captured by the client device within the custom video call interface in the self-view display format.

3 . The computer-implemented method of claim 1 , wherein rendering the video cell within the custom video call interface comprises modifying a visual property of the video cell based on the custom video call interface.

4 . The computer-implemented method of claim 3 , further comprising modifying the visual property of the video cell based on detecting a user interaction with the video cell or the custom video call interface.

5 . The computer-implemented method of claim 3 , wherein modifying the visual property of the video cell comprises changing a size, a shape, or a position of the video cell.

6 . The computer-implemented method of claim 1 , wherein rendering the video cell within the custom video call interface comprises dynamically moving the video cell within the custom video call interface during the video call.

7 . The computer-implemented method of claim 1 , further comprising rendering the custom video call interface by rendering an interactive object within the custom video call interface.

8 . The computer-implemented method of claim 7 , further comprising updating the interactive object upon receiving a user interaction corresponding to the interactive object.

9 . The computer-implemented method of claim 7 , wherein the interactive object comprises a material or an interactive application.

10 . The computer-implemented method of claim 9 , wherein the interactive application comprises an electronic paint application, an electronic document application, digital content streaming application, a video game application, a music development application, or a media browsing library application.

11 . A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to:
conduct, by a client device, a video call with a participant device through a streaming channel established for the video call from the participant device; render, within a video call interface displayed on the client device, a video cell portraying a video utilizing video data received from the participant device in a grid-view display format; and upon detecting a user interaction indicating a request to display a custom video call interface layout, render the video cell within a custom video call interface on the client device in a self-view display format.

12 . The non-transitory computer-readable medium of claim 11 , wherein rendering the video cell within the custom video call interface comprises:
modifying a visual property of the video cell, wherein the visual property of the video cell comprises a size, a shape, or a position corresponding to the video cell; or applying a movement property to the video cell, wherein the movement property comprises a mass value, a collision boundary, a gravity value, a friction value, or an elasticity value corresponding to the video cell.

13 . The non-transitory computer-readable medium of claim 12 , further comprising instructions that, when executed by the at least one processor, cause the at least one processor to modify the video from the video data to fit the modified visual property of the video cell.

14 . The non-transitory computer-readable medium of claim 11 , further comprising instructions that, when executed by the at least one processor, cause the at least one processor to render the custom video call interface by rendering an interactive object within the custom video call interface.

15 . The non-transitory computer-readable medium of claim 14 , further comprising instructions that, when executed by the at least one processor, cause the at least one processor to update the interactive object upon receiving a user interaction corresponding to the interactive object from the participant device through the streaming channel, wherein the streaming channel comprises a video data channel and a shared data channel.

16 . A system comprising:
at least one processor; and at least one non-transitory computer-readable medium comprising instructions that, when executed by the at least one processor, cause the system to:
conduct, by a client device, a video call with a participant device through a streaming channel established for the video call from the participant device;
render, within a video call interface displayed on the client device, a video cell portraying a video utilizing video data received from the participant device in a grid-view display format; and
upon detecting a user interaction indicating a request to display a custom video call interface layout, render the video cell within a custom video call interface on the client device in a self-view display format.

17 . The system of claim 16 , wherein rendering the video cell within the custom video call interface comprises modifying a visual property of the video cell or applying a movement property to the video cell based on the custom video call interface.

18 . The system of claim 17 , further comprising instructions that, when executed by the at least one processor, cause the system to:
generate a video texture from the video utilizing the video data received from the participant device; and fit the video texture within the modified video cell.

19 . The system of claim 16 , further comprising instructions that, when executed by the at least one processor, cause the system to:
render the custom video call interface by rendering an interactive object within the custom video call interface, wherein the interactive object comprises a material, an electronic paint application, an electronic document application, digital content streaming application, a video game application, a music development application, or a media browsing library application; and update the interactive object upon receiving a user interaction corresponding to the interactive object.

20 . The system of claim 16 , further comprising instructions that, when executed by the at least one processor, cause the system to render the custom video call interface in the self-view display format to render the video cell of the video corresponding to the participant device via a camera buffer view of the client device.

Assignees

• Meta Platforms Inc

Inventors

• Blackburne Benjamin Patrick
• Slater Michael
• Verlinde Hannes Luc Herman
• Senior Andrew James

Classifications

• G06T11/10 Primary

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• H04L65/403

  Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) · CPC title

• H04L65/1083

  In-session procedures · CPC title

• G06T11/001

  Physics · mapped topic