Method for operating moving robot

Patent metadata

Field	Value
Publication number	US-11325260-B2
Application number	US-201916438627-A
Country	US
Kind code	B2
Filing date	Jun 12, 2019
Priority date	Jun 14, 2018
Publication date	May 10, 2022
Grant date	May 10, 2022

Abstract

A method of operating a mobile robot includes displaying, on a display unit, a photographing menu including a first photographing item for allowing the mobile robot to perform a specific motion for photographing and a second photographing item for allowing the mobile robot to photograph a user, displaying a screen for guiding a motion setting of the mobile robot on the display unit when the first photographing item is selected, performing, by the mobile robot, a corresponding motion based on an input motion setting for a first reference time when the motion setting of the mobile robot is input, and displaying a result screen on the display unit after the first reference time has elapsed.

First claim

What is claimed is:

1. A method of operating a mobile robot, comprising:
presenting, on a display, a menu that includes a first graphical object related to controlling the mobile robot to pose for a photograph and a second graphical object related to controlling the mobile robot to photograph a user, the first graphical object corresponding to a service for photographing in which both an user and the mobile robot are subjects;
presenting, on the display, a first screen to receive an input related to selecting a pose setting of the mobile robot when the first graphical object is selected, the first screen to receive the input including a facial expression list, and the input related to selecting the pose setting including a selection from the facial expression list of a facial expression image to be present on the display of the mobile robot during a first time;
performing, by the mobile robot and during the first time, a pose based on the pose setting; and
presenting, on the display, a second screen after the first time has elapsed, the second screen including information including at least one of a photographing end graphical item or a re-photographing graphical item.

2. The method of claim 1 , wherein the input of the pose setting of the mobile robot further includes a selection of a gesture motion to be performed by the mobile robot during the first time.

3. The method of claim 1 , wherein the input of the pose setting of the mobile robot includes a selection of a traveling pattern to be performed by the mobile robot during the first time.

4. The method of claim 1 , further comprising outputting an audio guidance message to guide the input of the pose setting of the mobile robot when the first graphical object is selected.

5. The method of claim 1 , wherein the second screen includes at least one of a stored photograph associated with the mobile robot performing the pose or a third graphical object related to controlling the mobile robot to perform another pose.

6. The method of claim 1 , further comprising:
displaying a third screen to guide photographing of the user by the mobile robot when the second graphical object is selected.

7. The method of claim 1 , further comprising:
capturing an image through a camera; and
displaying a third screen that includes data associated with the captured image.

8. The method of claim 7 , wherein capturing the image through the camera includes capturing an image after a second time has elapsed.

9. The method of claim 1 , wherein the menu is displayed after the mobile robot guides the user to a destination.

10. The method of claim 1 , wherein the menu is displayed when the mobile robot enters a standby mode.

11. The method of claim 1 , further comprising:
outputting a guidance message during the first time, the guidance message including instructions to the user related to capturing an image of the mobile robot when performing the pose.

12. The method of claim 6 , wherein the third screen provides an indication of when the mobile robot will photograph the user.

13. A mobile robot comprising:
a wheel that rotates based on a received force to move the mobile robot;
a display;
a camera; and
a controller configured to:
manage the display to present a menu that includes a first graphical object related to controlling the mobile robot to pose for a photograph, and a second graphical object related to controlling the mobile robot to photograph a user, the first graphical object corresponding to a service for photographing in which both the user and the mobile robot are subjects;
manage the display to present a first screen to receive an input related to a pose setting of the mobile robot when the first graphical object is selected, wherein the mobile robot performs a pose during a first time based on input related to the pose setting, the first screen to receive the input including a facial expression list, and the input related to selecting the pose setting including a selection from the facial expression list of a facial expression image to be displayed on the display of the mobile robot during the first time; and
manage the display to present a second screen after the first time has elapsed, the second screen including at least one of a photographing end graphical item, a re-photographing graphical item, or a third graphical object related to controlling the mobile robot to perform another pose.

14. The mobile robot of claim 13 , wherein the input of the pose setting of the mobile robot includes a selection of a facial expression image to be displayed on the display of the mobile robot during the first time, and wherein the controller further manages the display to present the facial expression image.

15. The mobile robot of claim 13 , wherein the input of the pose setting of the mobile robot further includes a selection of a gesture motion to be performed by the mobile robot during the first time, and wherein the controller further manages at least one of a movement of the mobile robot or a motion of a component of the mobile robot based on the gesture motion.

16. The mobile robot of claim 13 , wherein the input of the pose setting of the mobile robot includes a selection of a traveling pattern to be performed by the mobile robot during the first time, and wherein the controller further manages the wheel to selectively rotate based on the traveling pattern.

17. The mobile robot of claim 13 , wherein the display is a first display, and wherein the mobile robot further includes a second display provided below the first display, the second display presenting information related to a guidance function performed by the mobile robot.

18. The mobile robot of claim 13 , wherein the camera includes a plurality of red, green, blue, and distance (RGBD) sensors.

19. The mobile robot of claim 13 , further comprising a speaker to output a guidance message, the guidance message including instructions to the user related to the mobile robot performing the pose when the first graphical object is selected, or an indication of when the mobile robot will photograph the user when the second graphical object is selected.

Assignees

• Lg Electronics Inc

Inventors

• Yeo Junhee
• Kim Seunghee
• Kim Yongjae

Classifications

• B25J9/1697 Primary

  Vision controlled systems · CPC title

• B25J5/007 Primary

  mounted on wheels · CPC title

• B25J11/008

  Manipulators for service tasks · CPC title

• B25J11/0005

  Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means · CPC title

• B25J13/08

  by means of sensing devices, e.g. viewing or touching devices · CPC title