Terminal and operating method thereof

Patent metadata

Field	Value
Publication number	US-11825236-B2
Application number	US-202217813238-A
Country	US
Kind code	B2
Filing date	Jul 18, 2022
Priority date	Jan 31, 2020
Publication date	Nov 21, 2023
Grant date	Nov 21, 2023

Abstract

Provided is a terminal. The terminal may include an input and output interface configured to receive a first video capturing a first user, a communication interface configured to transmit the first video or a first sound of the first user to a terminal of a counterpart and receive a second video or second sound, which is obtained by the terminal of the counterpart, through a video call session, a display configured to display the first video and the second video, and a processor configured to detect a specific event during the video call session, determine whether an inappropriate element is included in the first video or the first sound when the specific event is detected, and stop transmitting the first video or the first sound according to a result of the determination.

First claim

What is claimed is:

1. A method of providing a service, the method comprising:
transmitting at least one of a first video and a first sound obtained by a first terminal to at least one second terminal;
detecting a specific event regarding the at least one of the first video and the first sound;
responsive to the detecting of the specific event, stopping the transmitting of the first video or the first sound;
responsive to the detecting of the specific event, inspecting whether an inappropriate element is included in the first video or the first sound, by using a classification model;
when the inappropriate element is not included in the first video or the first sound, resuming the transmitting; and
when the inappropriate element is included in the first video or the first sound, stopping a video call session between the first terminal and the at least one second terminal,
wherein the transmitting of the first video or the first sound is stopped during the inspecting.

2. The method of claim 1 , wherein the inspecting of whether the inappropriate element is included in the first video or the first sound comprises:
inspecting whether the inappropriate element is included in the first video or the first sound, by using the classification model, the classification model trained with a correlation between the video or sound and the inappropriate element.

3. The method of claim 1 , wherein the detecting the specific event comprises detecting a face of a user disappearing within a reference time from the first video obtained by the first terminal.

4. The method of claim 1 , wherein the detecting the specific event comprises detecting whether a predetermined type of object is not included in the first video obtained by the first terminal.

5. The method of claim 1 , wherein detecting the specific event comprises detecting an event in which a face of a user disappears at a velocity exceeding a threshold velocity from the first video obtained by the first terminal.

6. The method of claim 1 , further comprising causing an alternative video instead of the first video to be displayed in the at least one second terminal when stopping the transmitting of the first video or the first sound.

7. The method of claim 1 , further comprising:
monitoring whether an inappropriate element is included in a video or sound, which is obtained by the first terminal after the transmitting of the first video or the first sound stops, at a predetermined time interval; and
based on a result of the monitoring, resuming the transmitting of the video or sound obtained by the first terminal.

8. The method of claim 1 , wherein the specific event comprises an event in which the first terminal is inclined in an arbitrary direction at an angular velocity exceeding a threshold angular velocity.

9. The method of claim 1 , wherein the specific event comprises an event in which the first terminal is inclined in an arbitrary direction at an angle exceeding a threshold angle.

10. The method of claim 1 , wherein the inspecting of whether the inappropriate element is included comprises:
inspecting, before the specific event is detected, whether the inappropriate element is included in the first video or the first sound every first period; and
inspecting, in response to the detection of the specific event, whether the inappropriate element is included in the first video or the first sound every second period.

11. The method of claim 1 , wherein detecting the specific event comprises detecting a movement of the first terminal.

12. A non-transitory computer-readable recording medium on which a program for the method according to any one of claims 1 to 11 is recorded.

13. A server comprising:
a communication interface; and
a processor configured to:
obtain at least one of a first video and a first sound from a first terminal via the communication interface;
transmit the at least one of the first video and the first sound to at least one second terminal via the communication interface;
detect a specific event regarding the at least one of the first video and the first sound;
responsive to the detecting of the specific event, stop the transmitting of the first video or the first sound;
responsive to the detecting of the specific event, inspect whether an inappropriate element is included in the first video or the first sound, by using a classification model;
when the inappropriate element is not included in the first video or the first sound, resume the transmitting; and
when the inappropriate element is included in the first video or the first sound, stop a video call session between the first terminal and the at least one second terminal,
wherein the transmitting of the first video or the first sound is stopped during the inspecting.

14. The server of claim 13 , wherein the processor is configured to detect the specific event in at least one of a case in which the first terminal is inclined in an arbitrary direction at an angular velocity exceeding a threshold angular velocity and a case in which the first terminal is inclined in an arbitrary direction at an angle exceeding a threshold angle.

15. The server of claim 13 , wherein the processor is configured to inspect whether the inappropriate element is included in the first video or the first sound, by using the classification model, the classification model trained with a correlation between the video or sound and the inappropriate element.

16. The server of claim 13 , wherein the specific event comprises at least one of:
an event in which a predetermined type of object is not included on the first video obtained by the first terminal;
an event in which an event in which a face of a user disappears within a reference time from the first video obtained by the first terminal; or
an event regarding a movement of the first terminal.

17. The server of claim 13 , wherein the processor is configured to monitor whether the inappropriate element is included in the first video or sound, which is obtained after the transmitting of the first video or the first sound stops, at a predetermined time interval, and
resumes the transmitting of the video or sound based on a result of the monitoring.

18. The server of claim 13 , wherein the processor is configured to:
inspect, before the specific event is detected, whether the inappropriate element is included in the first video or the first sound every first period, and
inspect, in response to the detection of the specific event, whether the inappropriate element is included in the first video or the first sound every second period.

19. The server of claim 13 , wherein the processor is configured to inspect whether the inappropriate element is included in the first video or the first sound every second period for a specific period of time.

20. The server of claim 13 , wherein the specific event comprises an event in which a face of a user disappears at a velocity exceeding a threshold velocity from the first video obtained by the first terminal.

Assignees

• Hyperconnect Inc

Inventors

• Ahn Sang Il
• Lee Kang San

Classifications

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• H04N7/147 Primary

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• H04M1/253

  Telephone sets using digital voice transmission · CPC title

• H04N7/142

  Constructional details of the terminal equipment, e.g. arrangements of the camera and the display · CPC title

• H04M2201/50

  Telephonic communication in combination with video communication · CPC title