Robot interaction system and method

Patent metadata

Field	Value
Publication number	US-2019366554-A1
Application number	US-201916423580-A
Country	US
Kind code	A1
Filing date	May 28, 2019
Priority date	May 29, 2018
Publication date	Dec 5, 2019
Grant date	—

Abstract

A system for generating instructions for a robot, the system including one or more cameras operable to capture images of an environment comprising the robot, an illumination identification unit operable to identify an illumination of an object in the captured images, an object identification unit operable to identify an illuminated object, and a robot control unit operable to generate instructions for a robot in dependence upon the output of the object identification unit.

First claim

1 . A system for generating instructions for a robot, the system comprising:
one or more cameras operable to capture images of an environment comprising the robot; an illumination identification unit operable to identify a predetermined illumination of an object in the captured images; an object identification unit operable to identify an illuminated object; and a robot control unit operable to generate instructions for a robot in dependence upon the output of the object identification unit.

2 . The system according to claim 1 , comprising an action identification unit operable to identify an action to be performed by the robot, wherein the robot control unit is operable to generate instructions in dependence upon the identified action.

3 . The system according to claim 1 , comprising one or more audio sensors.

4 . The system according to claim 1 , comprising one or more light emission units operable by the robot to illuminate objects.

5 . The system according to claim 1 , comprising one or more light emission units operable by a user to illuminate objects.

6 . The system according to claim 1 , wherein the robot control unit is operable to generate instructions in dependence upon the identified illumination.

7 . The system according to claim 6 , wherein the illumination comprises one or more patterns.

8 . The system according to claim 1 , wherein the object identification unit is operable to characterise an illuminated object by its size and/or shape.

9 . The system according to claim 1 , wherein the robot control unit is operable to generate instructions to cause the robot to interact with the illuminated object so as to obtain more information usable to characterise the illuminated object.

10 . The system according to claim 1 , wherein the robot control unit is operable to generate instructions to cause the robot to store information relating to the illuminated object.

11 . The system according to claim 10 , wherein the information comprises a template of the illuminated object and/or an audio command associated with the illuminated object.

12 . The system according to claim 1 , wherein the robot control unit is operable to generate instructions to cause the robot to interact with the illuminated object to perform a function.

13 . A method for generating instructions for a robot, the method comprising:
capturing images of an environment comprising the robot; identifying a predetermined illumination of an object in the captured images; identifying an illuminated object; and generating instructions for a robot in dependence upon the identification of the illuminated object.

14 . (canceled)

15 . A non-transitory machine-readable storage medium which stores computer software, which when executed by a computer, causes the computer to carry out actions for generating instructions for a robot, the actions comprising:
capturing images of an environment comprising the robot; identifying a predetermined illumination of an object in the captured images; identifying an illuminated object; and generating instructions for a robot in dependence upon the identification of the illuminated object.

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Breugelmans Mark
• Forster Richard James
• Andall Hogarth
• Sanders Matthew William

Classifications

• B25J9/1697 Primary

  Vision controlled systems · CPC title

• B25J19/021 Primary

  Optical sensing devices · CPC title

• G06T7/521

  from laser ranging, e.g. using interferometry; from the projection of structured light · CPC title

• G05D1/0231

  using optical position detecting means (position-fixing by using electromagnetic waves other than radio waves, e.g. optical position detecting means G01S5/16) · CPC title

• B25J9/163

  learning, adaptive, model based, rule based expert control · CPC title