Information interaction method, computer-readable storage medium and communication terminal

Patent metadata

Field	Value
Publication number	US-12229893-B2
Application number	US-202117781097-A
Country	US
Kind code	B2
Filing date	Mar 30, 2021
Priority date	Mar 30, 2021
Publication date	Feb 18, 2025
Grant date	Feb 18, 2025

Abstract

An information interaction method, a computer-readable storage medium and a communication terminal are disclosed. The information interaction method is applied to a local terminal, and includes: in a process of a video call with a remote terminal, in response to a first interaction instruction, performing split-screen display on a display screen of the local terminal to form at least a first split screen for displaying an interface of the video call and a second split screen for displaying a shopping interface; in response to a first selection instruction, acquiring an image of a commodity corresponding to the first selection instruction, with the first selection instruction being an instruction of selecting the commodity from the shopping interface; and displaying a synthesized image obtained by performing image synthesis on the image of the commodity and at least a part of images in the interface of the video call.

First claim

What is claimed is:

1. An information interaction method, applied to a local terminal and comprising:
in a process of a video call with a remote terminal, in response to a first interaction instruction, performing split-screen display on a display screen of the local terminal to form at least a first split screen and a second split screen, wherein the first split screen is configured to display an interface of the video call, and the second split screen is configured to display a shopping interface;
in response to a first selection instruction, acquiring an image of a commodity corresponding to the first selection instruction; wherein the first selection instruction is an instruction of selecting the commodity from the shopping interface; and
displaying a synthesized image, wherein the synthesized image is an image obtained by performing image synthesis on the image of the commodity and at least a part of images in the interface of the video call,
wherein the interface of the video call comprises: a local video window configured to display images collected by the local terminal and a remote video window configured to display images collected by the remote terminal; and
before displaying the synthesized image, the method further comprises:
acquiring at least one human image from images displayed in the local video window as a target human image; and
synthesizing the image of the commodity and the target human image to obtain the synthesized image; or sending the target human image to a server, and receiving the synthesized image sent by the server,
wherein after synthesizing the image of the commodity and the target human image, the method further comprises:
sending the synthesized image to the remote terminal or the server.

2. The information interaction method of claim 1 , wherein the first selection instruction is an instruction generated according to a click operation applied onto the shopping interface, or an instruction generated according to a first sliding operation applied onto the shopping interface; the click operation comprises: an operation of clicking the shopping interface through touch, or an operation of clicking the shopping interface through an air gesture;
and the first sliding operation comprises: an air gesture operation of moving from the shopping interface to the interface of the video call, or a touch operation of moving from the shopping interface to the interface of the video call; and
the acquiring at least one human image from images displayed in the local video window as a target human image specifically comprises:
in response to that the first selection instruction is an instruction generated according to the click operation, detecting the number of human images in the local video window, and taking the human image as the target human image in response to that one human image exists in the local video window; in response to that the number of human images in the local video window is greater than 1, outputting an object selection request to remind a user to input object selection information; and
in response to that the object selection information input by the user is received, determining the target human image according to the object selection information; and
in response to that the first selection instruction is an instruction generated according to the first sliding operation, determining the target human image according to a path of the first sliding operation on the display screen.

3. The information interaction method of claim 1 , further comprising:
detecting the number of human images in the local video window, and in response to that a plurality of human images exist in the local video window, dividing the local video window into a plurality of local video sub-windows, each local video sub-window displaying one of the human images.

4. The information interaction method of claim 1 , further comprising:
in response to the first selection instruction, acquiring link information of the commodity corresponding to the first selection instruction; and
displaying the link information of the commodity in the local video window, and sending the link information to the remote terminal or the server.

5. The information interaction method of claim 1 , further comprising:
in response to a commodity recommendation instruction, acquiring information of a commodity corresponding to the commodity recommendation instruction;
according to the information of the commodity corresponding to the commodity recommendation instruction, sending a reminding message to the remote terminal for a user of the remote terminal to select whether to accept a commodity recommendation; and
in response to an acceptance instruction of the user of the remote terminal, synthesizing an image of the commodity corresponding to the commodity recommendation instruction and at least one human image in the remote video window.

6. The information interaction method of claim 1 , further comprising:
in response to a comparison instruction, acquiring at least two synthesized images generated in a history record of the video call, and displaying the at least two synthesized images for comparison;
wherein
the at least two synthesized images comprise at least two first synthesized images, or at least two second synthesized images, or at least one first synthesized image and at least one second synthesized image; and the first synthesized image is a synthesized image of a human image in the local video window and the image of the commodity, and the second synthesized image is a synthesized image of a human image in the remote video window and the image of the commodity.

7. The information interaction method of claim 6 , wherein the, in response to a comparison instruction, acquiring at least two synthesized images generated in a history record of the video call, and displaying the at least two synthesized images for comparison specifically comprises:
in response to a first comparison instruction, acquiring at least two first synthesized images generated in the history record of the video call, and displaying the acquired first synthesized images for comparison;
in response to a second comparison instruction, acquiring at least two second synthesized images generated in the history record of the video call, and displaying the acquired second synthesized images for comparison; and
in response to a third comparison instruction, acquiring at least one first synthesized image and at least one second synthesized image generated in the history record of the video call, and displaying the first synthesized image in a local video window of a current video call and displaying the second synthesized image in a remote video window of the current video call.

8. The information interaction method of claim 1 , further comprising:
in response to a second interaction instruction, acquiring a pre-stored three-dimensional human model diagram of a local user from the local terminal, or performing image acquisition to acquire the three-dimensional human model diagram of the local user;
in response to a second selection instruction, acquiring a three-dimensional model diagram of a commodity corresponding to the second selection instruction;
synthesizing the three-dimensional human model diagram and the three-dimensional model diagram of the commodity to generate a first synthesized model diagram; and
displaying the first synthesized model diagram in the local video window, and sending the first synthesized model diagram to the remote terminal or the server.

9. The information interaction method of claim 1 , further comprising:
in response to a window creation instruction, creating a sharing window in the interface of the video call; and

Assignees

• Beijing Boe Technology Dev Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Wen Ken
• Ma Mingyuan
• Ma Yongda
• Zhang Honglei

Classifications

• H04N5/2624

  for obtaining an image which is composed of whole input images, e.g. splitscreen · CPC title

• G06T2207/30196

  Human being; Person · CPC title

• G06T2207/20021

  Dividing image into blocks, subimages or windows · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title