Display apparatus and method for performing videotelephony using the same

Patent metadata

Field	Value
Publication number	US-9749582-B2
Application number	US-201514708719-A
Country	US
Kind code	B2
Filing date	May 11, 2015
Priority date	May 9, 2014
Publication date	Aug 29, 2017
Grant date	Aug 29, 2017

Abstract

A display apparatus and method are provided. The display apparatus includes a videotelephony performer that is configured to perform a videotelephony with another display apparatus; and a controller configured to control a corresponding feedback that is output when gestures and speech of a user and the other party of the videotelephony have a preset correlation during a process in which the videotelephony is performed.

First claim

What is claimed is:

1. A display apparatus to perform videotelephony with another display apparatus comprising:
a speaker configured to output a sound of a first user of the other display apparatus;
a display configured to display an image of the first user; and
a controller configured to determine whether or not at least one of a gesture and the sound of the first user and at least one of a gesture and a sound of a second user of the display apparatus have a preset correlation and, in response to determining that the preset correlation exists between at least one of the gesture and the sound of the second user and at least one of the gesture and the sound of the first user, control the at least one of the speaker and the display to output a corresponding feedback.

2. The display apparatus as claimed in claim 1 , wherein the gesture and sound of the first user and the gesture and sound of the second user have the preset correlation, which corresponds to a gesture that has a meaning that is represented by the sound.

3. The display apparatus as claimed in claim 1 , wherein the controller is configured to output the corresponding feedback when the gestures and sound of the first user have the same meaning as the gesture and sound of the second user.

4. The display apparatus as claimed in claim 1 , further comprising:
a camera configured to photograph the second user;
a microphone configured to obtain a voice that is spoken by the second user; and
a communicating unit configured to perform communications with a server to receive an image that is obtained by photographing the first user and the sound that is spoken by the first user,
wherein the display is further configured to display an image that is obtained by photographing the second user.

5. The display apparatus as claimed in claim 4 , wherein the server is configured to determine whether or not gestures and sounds of the first user and the second user have the preset correlation, and transmit a control instruction for outputting the corresponding feedback to the display apparatus in response to the gestures and the sounds of the first user and the second user being determined as having the preset correlation.

6. The display apparatus as claimed in claim 5 , wherein the controller is configured to output the corresponding feedback based on the received control instruction.

7. The display apparatus as claimed in claim 4 , wherein the controller is configured to determine whether or not the gesture and the sound of the second user and the gesture and the sound of the first user that are received from the server have the preset correlation, and output the corresponding feedback, in response to the gesture and the sound of the second user and the gesture and the sound of the first user received from the server having the preset correlation.

8. The display apparatus as claimed in claim 1 , wherein the feedback comprises at least one of a visual effect and a sound effect that correspond to the gestures and the sounds of the first user and the second user.

9. The display apparatus as claimed in claim 1 , wherein the controller is configured to output the corresponding feedback to a position of the display at which a gaze of the second user is located, in response to the gestures and the sounds of the first user and the second user having the preset correlation.

10. The display apparatus as claimed in claim 9 , wherein the controller is configured to enlarge the image displayed at the position.

11. A controlling method of a display apparatus performing videotelephony with another display apparatus, the method comprising:
outputting, by a speaker, a sound of a first user of the other display apparatus;
displaying, by a display, an image of the first user;
determine whether or not at least one of a gesture and the sound of the first user and at least one of a gesture and a sound of a second user of the display apparatus have a preset correlation;
in response to the determining that the preset correlation exists between the at least one of the gesture and the sound of the first user and the at least one of the gesture and the sound of the second user, controlling at least one of the speaker and the display to output a corresponding feedback.

12. The method as claimed in claim 11 , wherein the gesture and sound of the first user and the gesture and the sound of the second user have the preset correlation, which is a gesture that has a meaning that is represented by the sound.

13. The method as claimed in claim 11 , wherein the feedback is output, in response to the gesture and sound of the first user have the same meaning as the gesture and the sound of the second user.

14. The method as claimed in claim 11 , wherein the display apparatus comprises:
a camera configured to photograph the second user;
a microphone configured to obtain a voice that is spoken by the second user; and
a communicating unit configured to communicate with a server and to receive an image that is obtained by photographing the first user and the sound that is spoken by the first user.

15. The method as claimed in claim 14 , further comprising:
determining whether or not the gestures and the sounds of the first user and the second user have the preset correlation; and
transmitting a control instruction for outputting the corresponding feedback to the display apparatus in response to the gestures and the sounds of the first user and the second user being determined as having the preset correlation.

16. The method as claimed in claim 15 , wherein the outputting of the corresponding feedback is performed based on the received control instruction.

17. The method as claimed in claim 14 , wherein the outputting of the corresponding feedback comprises:
determining whether or not the gesture and the sound of the second user and the gesture and the sound of the first user that are received from the server have the preset correlation, and in response to the gesture and the sound of the second user and the gesture and the sound of the first user received from the server being determined to have the preset correlation, outputting the corresponding feedback.

18. The method as claimed in claim 11 , wherein the feedback comprises at least one of a visual effect and a sound effect that correspond to the gestures and the sound of the first user and the second user.

19. The method as claimed in claim 11 , wherein, the outputting comprises outputting the corresponding feedback to a position of the display apparatus at which a gaze of the second user is located.

20. The method as claimed in claim 19 , wherein the outputting comprises enlarging the image displayed at the position.

21. A controlling method of a display apparatus performing videotelephony with another display apparatus, the method comprising:
performing the videotelephony with the other display apparatus;
determining whether a preset correlation exists between at least one of gesture and speech received by the display apparatus with at least one of gesture and speech received by the other display apparatus;
in response to the determining that the preset correlation exists, outputting the same corresponding feedback during the videotelephony;
wherein the same corresponding feedback comprises a sound indicating the at least one of the gesture and the sound received by the display apparatus.

22. The method as claimed in claim 21 , wherein the corresponding feedback is output to the display apparatus and

Assignees

• Samsung Electronics Co Ltd

Inventors

• Jeong Seong-Wook
• Kyoun Jae-Ki
• Ko Chang-Seog
• Jang Sung-Hyun
• Lee Kwan-Min
• Lee Sang-Hee

Classifications

• H04M3/567

  Multimedia conference systems · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• H04L65/1059

  End-user terminal functionalities specially adapted for real-time communication · CPC title

• H04M2201/50

  Telephonic communication in combination with video communication · CPC title

• H04N7/15

  Conference systems · CPC title