Video call mediation method

Patent metadata

Field	Value
Publication number	US-11716424-B2
Application number	US-202016869983-A
Country	US
Kind code	B2
Filing date	May 8, 2020
Priority date	May 10, 2019
Publication date	Aug 1, 2023
Grant date	Aug 1, 2023

Abstract

A video call mediation method of a system may include receiving, by a server, a mediation request, from a plurality of mobiles, mediating, by the server, a first mobile and a second mobile, of the plurality of mobiles, establishing, by the first mobile and the second mobile, a video call session, receiving, by the first mobile, a video, from the second mobile, through the video call session, detecting, by the first mobile, a certain input, reporting, by the first mobile, a video received in the server, in response to the certain input, ending, by the first mobile, the video call session with the second mobile, and establishing, by the first mobile, a video call session with a third mobile, and verifying, by the server, the reporting, and rejecting, by the server, additional mediation request of the second mobile.

First claim

What is claimed is:

1. An operating method of a first mobile, the method comprising:
receiving, by the first mobile, information of connection to a second mobile, from a server;
establishing, by the first mobile, a video call session with the second mobile, using the received information of connection;
receiving, by the first mobile, a video, from the second mobile, through the video call session;
outputting, by the first mobile, the received video;
detecting, by the first mobile, a certain input based on at least one of a certain video and a certain sound, wherein the certain input corresponds to a reaction of a user of the first mobile to the output video;
when the certain input suggests a negative response from the user, analyzing, by the first mobile, the received video for obscene content; and
when obscene content is present in the received video:
reporting, by the first mobile, the received video to the server, in response to the analysis and the certain input based on at least one of the certain video and the certain sound;
receiving, by the first mobile, information of connection to a third mobile that is different from the second mobile, from the server, in response to the reporting; and
ending, by the first mobile, the video call session, and establishing, by the first mobile, a video call session with the third mobile using the received information of connection to the third mobile.

2. The operating method of the mobile, according to claim 1 , wherein the detecting of the certain input, by the first mobile, further comprises detecting, by the first mobile, a certain manipulation on the first mobile, as the certain input.

3. The operating method of the mobile, according to claim 2 , wherein the detecting of the certain manipulation, by the first mobile, involves detecting, by the first mobile, at least one of a manipulation of throwing the first mobile, a manipulation of dropping the first mobile, a manipulation of turning the first mobile over, a manipulation of shaking the first mobile, a manipulation of covering a display of the first mobile, a manipulation of repeatedly pressing a button of the first mobile, and a manipulation of repeatedly inputting a touch gesture into the first mobile, as the certain manipulation.

4. The operating method of the mobile, according to claim 1 , wherein the detecting of the certain input, by the first mobile, comprises:
photographing, by the first mobile, a video of surroundings of the first mobile; and
detecting, by the first mobile, at least one of a part that corresponds to a certain facial expression, body language, and body part, from the photographed video, as the certain input of the first mobile.

5. The operating method of the mobile, according to claim 4 , wherein the detecting of at least one of the part that corresponds to the certain facial expression, body language, and body part, by the first mobile, involves detecting, by the first mobile, at least one of the part that corresponds to a frowning facial expression, alarmed facial expression, dilated pupils, gesture to avoid gaze from the first mobile, gesture to cover eyes, and gesture to place a palm of a hand towards the first mobile, from the photographed video.

6. The operating method of the mobile, according to claim 1 , wherein the detecting of the certain input, by the first mobile, comprises:
recording, by the first mobile, a sound occurring from surroundings of the first mobile; and
detecting, by the first mobile, a part that corresponds to at least one of a certain voice and language, from the recorded sound, as the certain input.

7. The operating method of the mobile, according to claim 6 , wherein the detecting of the part that corresponds to at least one of the certain voice and the language, by the first mobile, involves detecting, by the first mobile, a part that corresponds to at least one of a scream and verbal abuse, from the recorded sound.

8. A non-transitory computer readable record medium, where a program for performing a method according to claim 1 , is recorded.

9. The operating method of the mobile, according to claim 1 , wherein the certain input comprises at least one of: a frowning facial expression, an alarmed expression, dilated pupils, a gesture to avoid gaze from the first mobile, a gesture to cover eyes, and a gesture to block the first mobile.

10. The operating method of the mobile, according to claim 1 , wherein obscene content comprises at least one of insulting gestures, sexual material, illegal behavior, and unsanitary content.

11. A mobile, comprising:
a communication interface for receiving information of connection to a second mobile, from a server, establishing a video call session with the second mobile, using the received information of connection, and receiving a video from the second mobile, through the video call session;
an output interface for outputting the received video;
an input interface for detecting a certain input, based on at least one of a certain video and a certain sound, wherein the certain input corresponds to a reaction of a user of the second mobile to the output video; and
a processor for, when the certain input suggests a negative response from the user, analyzing the received video for obscene content,
wherein the communication interface, when obscene content is present in the received video:
reports the received video to the server, in response to the certain input based on at least one of the certain video and the certain sound,
receives information of connection to a third mobile that is different from the second mobile, from the server, in response to the reporting,
ends the video call session, in response to the receiving of the information of connection to the third mobile, and
establishes a video call session with the third mobile, using the received information of connection to the third mobile.

12. The mobile, according to claim 11 , wherein the certain input comprises at least one of: a frowning facial expression, an alarmed expression, dilated pupils, a gesture to avoid gaze from the mobile, a gesture to cover eyes, and a gesture to block the mobile.

13. The mobile, according to claim 11 , wherein the detecting of the certain input comprises:
photographing a video of surroundings of the mobile; and
detecting at least one of a part that corresponds to a certain facial expression, body language, and body part, from the photographed video, as the certain input of the mobile.

14. An operating method of a server, the method comprising:
receiving, by the server, a mediation request from a plurality of mobiles;
mediating, by the server, a video call connection between a first mobile and a second mobile, of the plurality of mobiles;
in response to a certain input, based on at least one of a certain video and a certain sound showing a negative reaction of a user of the first mobile to a video received from the second mobile and output, being detected by the first mobile, receiving, by the server, a report, from the first mobile, in response to the video received from the second mobile, based on the certain input and a detection of obscene content;
in response to the report, selecting, by the server, a third mobile that is different from the second mobile, of the plurality of mobiles, and mediating a video call between the first mobile and the third mobile; and
verifying, by the server, the report, and rejecting additional mediation requests of the second mobile, depending on a result of the verification.

15. The operating method of the server, according to claim 14 , wherein the certain input comprises a

Assignees

• Hyperconnect Inc

Inventors

• Ahn Sangil
• Jung Kangsik
• Yong Hyountaek

Classifications

• H04M3/567 Primary

  Multimedia conference systems · CPC title

• G06V40/164

  using holistic features · CPC title

• G06V40/176

  Dynamic expression · CPC title

• G06V40/23

  Recognition of whole body movements, e.g. for sport training · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title