Communication robot and method for operating the same

Patent metadata

Field	Value
Publication number	US-11488592-B2
Application number	US-201916580836-A
Country	US
Kind code	B2
Filing date	Sep 24, 2019
Priority date	Jul 9, 2019
Publication date	Nov 1, 2022
Grant date	Nov 1, 2022

Abstract

A communication robot for operating a massage providing apparatus by executing an artificial intelligence algorithm (AI) and/or machine learning algorithm in a 5G environment connected for the Internet of things and a method for operating the communication robot are provided. The method for operating the communication robot may include acquiring a spoken utterance of a user positioned within a prescribed range from the massage providing apparatus, tracking a spoken utterance direction of the user from the spoken utterance of the user, orienting the communication robot towards the spoken utterance direction of the user, acquiring a voice command included in the spoken utterance in relation to operation of the massage providing apparatus, and operating the massage providing apparatus according to the voice command.

First claim

What is claimed is:

1. A method of operating a communication robot configured to interwork with a massage providing apparatus, the method comprising:
acquiring, by a controller, a spoken utterance of a user positioned within a predetermined range from the massage providing apparatus;
tracking a spoken utterance direction of the user from the spoken utterance of the user;
orienting the communication robot toward the spoken utterance direction of the user;
acquiring a voice command included in the spoken utterance in relation to an operation of the massage providing apparatus; and
operating the massage providing apparatus according to the voice command,
wherein the method further includes, after acquiring the voice command and before operating the massage providing apparatus according to the voice command:
acquiring an image of the user positioned within the predetermined range from the massage providing apparatus; and
calculating a facial direction from the image of the user,

wherein the operating the massage providing apparatus includes:
controlling the communication robot to gaze at a massage portion included in the voice command; and
operating the massage providing apparatus to massage the massage portion included in the voice command, and

wherein the controlling the communication robot includes:
determining a final direction of the communication robot's gaze based on the facial direction and a direction of the massage portion included in the voice command; and
restoring the communication robot to a previous orientation of the communication robot after an elapse of a fixed period of time during which the communication robot is oriented toward the massage portion.

2. The method of claim 1 , wherein a predetermined start word is included in a memory of the communication robot, and
wherein the acquiring the spoken utterance includes detecting the start word in the spoken utterance.

3. The method of claim 2 , wherein the acquiring the voice command occurs after detecting the start word.

4. The method of claim 1 , wherein the orienting the communication robot includes directing a gaze of the communication robot toward the spoken utterance direction of the user.

5. The method of claim 1 , further comprising:
acquiring an image of a user's gesture of massaging a massage portion in relation to the operation of the massage providing apparatus; and
operating the massage providing apparatus according to the image of the user's gesture.

6. The method of claim 5 , wherein a predetermined start word is included in a memory of the communication robot,
wherein the acquiring the spoken utterance includes detecting the start word in the spoken utterance, and
wherein acquiring the image of the user's gesture occurs after detecting the start word.

7. A communication robot configured to interwork with a massage providing apparatus, the communication robot comprising:
a memory storing one or more instructions; and
one or more processors configured to execute the one or more instructions to:
acquire a spoken utterance of a user positioned within a predetermined range from the massage providing apparatus,
track a spoken utterance direction of the user from the spoken utterance of the user,
orient the communication robot toward the spoken utterance direction of the user,
acquire a voice command included in the spoken utterance in relation to an operation of the massage providing apparatus, and
operate the massage providing apparatus according to the voice command,

wherein the one or more processors are further configured to, after acquiring the voice command and before operating the massage providing apparatus according to the voice command:
acquire an image of the user positioned within the predetermined range from the massage providing apparatus; and
calculate a facial direction from the image of the user,

wherein the operating the massage providing apparatus includes:
controlling the communication robot to gaze at a massage portion included in the voice command; and
operating the massage providing apparatus to massage the massage portion included in the voice command, and

wherein the controlling the communication robot includes:
determining a final direction of the communication robot's gaze based on the facial direction and a direction of the massage portion included in the voice command; and
restoring the communication robot to a previous orientation of the communication robot after an elapse of a fixed period of time during which the communication robot is oriented toward the massage portion.

8. The communication robot of claim 7 , further comprising a memory storing a predetermined start word,
wherein the one or more processors are further configured to detect the start word in the spoken utterance.

9. The communication robot of claim 8 , wherein the one or more processors are further is configured to acquire the voice command after detecting the start word.

10. The communication robot of claim 7 , wherein the one or more processors are further is configured to direct a gaze of the communication robot toward the spoken utterance direction of the user.

11. The communication robot of claim 7 , wherein the one or more processors are further is configured to acquire an image of a user's gesture of massaging a massage portion in relation to the operation of the massage providing apparatus, and to operate the massage providing apparatus according to the image of the user's gesture.

12. The communication robot of claim 11 , further comprising a memory storing a predetermined start word,
wherein the one or more processors are further configured to detect the start word in the spoken utterance, and to acquire the image of the user's gesture after detecting the start word.

13. A massage system comprising:
a massage providing apparatus; and
a communication robot configured to interwork with the massage providing apparatus, the communication robot including:
a memory storing one or more instructions; and
one or more processors configured to execute the one or more instructions to:
acquire a spoken utterance of a user positioned within a predetermined range from the massage providing apparatus,
track a spoken utterance direction of the user from the spoken utterance of the user,
orient the communication robot toward the spoken utterance direction of the user,
acquire a voice command included in the spoken utterance in relation to an operation of the massage providing apparatus, and
operate the massage providing apparatus according to the voice command,

wherein the one or more processors are further configured to, after acquiring the voice command and before operating the massage providing apparatus according to the voice command:
acquire an image of the user positioned within the predetermined range from the massage providing apparatus; and
calculate a facial direction from the image of the user,

wherein the operating the massage providing apparatus includes:
controlling the communication robot to gaze at a massage portion included in the voice command; and
operating the massage providing apparatus to massage the massage portion included in the voice command, and

wherein the controlling the communication robot includes:
determining a final direction of the communication robot's gaze based on the facial direction and a direction of the massage portion included in the voice command; and
restoring the communication robot to a previous orientation of the communication robot after an elapse of a fixed period of time during which the communication robot is oriented toward the massage portion.

Assignees

• Lg Electronics Inc

Inventors

• Kim Sang Won
• Park Sun Chan

Classifications

• G10L2015/088

  Word spotting · CPC title

• A61H2201/5097

  wireless · CPC title

• A61H7/007

  Kneading · CPC title

• A61H15/0078

  power-driven · CPC title

• A61H2201/5048

  Audio interfaces, e.g. voice or music controlled · CPC title