Voice recognition image feedback providing system and method

Patent metadata

Field	Value
Publication number	US-2020043488-A1
Application number	US-201716340264-A
Country	US
Kind code	A1
Filing date	Nov 29, 2017
Priority date	Aug 31, 2017
Publication date	Feb 6, 2020
Grant date	—

Abstract

Voice recognition image feedback providing system and method capable of providing conveniently various services to a user is disclosed. A voice recognition image feedback device in the system comprises a voice recognition unit configured to recognize user's voice, an image feedback unit configured to output an image corresponding to the voice in a direction where the voice is inputted and a control unit configured to control the voice recognition unit and the image feedback unit. Here, wherein the image is outputted to a user peripheral location area so that the image is shown to the user, the user peripheral location area means an area having a radius of 3 meter based on a point at which the user locates, and at least part of the image is shown in the area having the radius of 3 meter.

First claim

1 . A voice recognition image feedback device comprising:
a voice recognition unit configured to recognize user's voice; an image feedback unit configured to output an image corresponding to the voice in a direction where the voice is inputted; and a control unit configured to control the voice recognition unit and the image feedback unit, wherein the image is outputted to a user peripheral location area so that the image is shown to the user, the user peripheral location area means an area having a radius of specific distance based on a point at which the user locates, and at least part of the image is shown in the area having the radius of specific distance.

2 . The voice recognition image feedback device of claim 1 , wherein the image feedback unit is installed on the voice recognition image feedback device to be rotated.

3 . The voice recognition image feedback device of claim 1 , further comprising:
a location tracking unit configured to track a location of the user by using a camera, wherein the location tracking unit tracks accurate location of the user considering the recognized voice and a picture obtained by the camera, the location tracking unit removes an object corresponding to the other person or an external device from objects in the picture, and determines a location of an object corresponding to magnitude of the voice of remaining objects as the location of the user.

4 . The voice recognition image feedback device of claim 3 , wherein the location tracking unit detects present location of the user by tracking continuously the location of the user while the image is provided.

5 . The voice recognition image feedback device of claim 1 , wherein the voice recognition unit recognizes only voice of a person corresponding to pre-registered voice or pre-registered user of voices when the voices of multiple people are inputted,
and wherein the image is not outputted when a voice of person not the person corresponding to the pre-registered voice or the pre-registered user is inputted.

6 . The voice recognition image feedback device of claim 1 , wherein the control unit requests to the user to select one of plural results and verifies whether pre-registered result exists when the recognized voice includes the results, and requests re-input of the voice to the user when the voice is not related to image provision, request in the voice is unclear, the voice includes a forbidden word or the request in the voice can't be provided by the voice recognition image feedback device,
and wherein the image feedback unit outputs an image corresponding to the result selected by the user or the pre-registered result.

7 . The voice recognition image feedback device of claim 1 , further comprising:
a mode unit configured to control a sleep mode or an active mode, wherein in the sleep mode, the voice recognition unit for recognizing the user's voice or a sensor for sensing the user is turned on and the image feedback unit is off state, the sleep mode is changed to the active mode when the user's voice is recognized, and the image feedback unit is turned on in the active mode.

8 . The voice recognition image feedback device of claim 1 , further comprising:
a moving sensor configured to sense a moving of the user, wherein the image feedback unit outputs the image to a location corresponding to the recognized voice and the sensed moving, or outputs an image corresponding to the recognized voice and the sensed moving.

9 . (canceled)

10 . (canceled)

11 . (canceled)

12 . The voice recognition image feedback device of claim 1 , further comprising:
a video call unit, wherein the video call unit provides a picture and a voice of the other party to the user, and provides a picture and the voice of the user to the other party.

13 . (canceled)

14 . (canceled)

15 . The voice recognition image feedback device of claim 1 ,
wherein specific users are registered in advance to the voice recognition image feedback device or an external device connected to the voice recognition image feedback device, and wherein the image feedback unit does not output the image or is not activated when a voice of the other person not the registered users is inputted, and private information related to specific user of the registered users is not provided through the image though a voice of the other users is recognized as long as a voice of the specific user is not recognized.

16 . (canceled)

17 . A voice recognition image feedback device comprising:
a voice recognition unit configured to recognize user's voice; a location tracking unit configured to track a location of the user; an image feedback unit configured to output an image corresponding to the voice; and a control unit configured to control the voice recognition unit, the location tracking unit and the image feedback unit, wherein the control unit requests re-input of the voice to the user when the voice is not related to image provision, request in the voice is unclear, the voice includes a forbidden word or the request in the voice can't be provided by the voice recognition image feedback device, and the image feedback unit outputs an image corresponding to the re-inputted voice to an area corresponding to the tracked location of the user.

18 . The voice recognition image feedback device of claim 17 , wherein the image is outputted to a user peripheral location area,
and wherein the user peripheral location area means an area having a radius of specific distance based on a point at which the user locates, and at least part of the image is shown in the area having the radius of specific distance.

19 . (canceled)

20 . (canceled)

21 . (canceled)

22 . A voice recognition image feedback device of claim 17 , further comprising:
a body; and the image feedback unit formed on the body to be rotated, wherein the image feedback unit rotates in a direction corresponding to a user peripheral location area on which an image is to be outputted and then outputs the image corresponding to user's voice.

23 . The voice recognition image feedback device of claim 22 ,
wherein the image feedback unit or the location tracking unit rotates by moving along a guide formed on the body.

24 . (canceled)

25 . (canceled)

26 . (canceled)

27 . (canceled)

28 . (canceled)

29 . A voice recognition image feedback device of claim 17 ,
wherein a distance to which the image is to be outputted, an angle by which the image feedback unit outputs the image or a location at which the image is to be outputted is set to the voice recognition image feedback device, and the image feedback unit outputs the image to the set distance, the set angle or the set location in a direction where the voice is inputted.

30 . A voice recognition image feedback providing method comprising:
recognizing user's voice; and outputting an image corresponding to the voice in a direction where the voice is inputted, wherein the image is outputted to a user peripheral location area so that the image is shown to the user, the user peripheral location area means an area having a radius of specific distance based on a point at which the user locates, and at least part of the image is shown in the area having the radius of specific distance.

31 . The voice recognitio

Assignees

• Humax Co Ltd

Inventors

• Park Sung Heum

Classifications

• G03B17/54

  with projector · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G10L15/07

  to the speaker · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title