Information processing apparatus for controlling operation pattern

Patent metadata

Field	Value
Publication number	US-11755153-B2
Application number	US-202017420284-A
Country	US
Kind code	B2
Filing date	Jan 22, 2020
Priority date	Feb 5, 2019
Publication date	Sep 12, 2023
Grant date	Sep 12, 2023

Abstract

There is provided an information processing apparatus, an information processing method, and a program for enabling improvement of operability in a case of performing a user operation on surfaces of various real objects. The information processing apparatus includes an operation pattern control unit configured to control an operation pattern in an operation area on a surface of a real object on the basis of information indicating a characteristic of the operation area. The operation pattern includes, for example, at least one of a method of inputting operation data in the operation area or a method of detecting the operation data. The present technology can be applied to, for example, a system using augmented reality (AR).

First claim

The invention claimed is:

1. An information processing apparatus comprising:
a characteristic detection unit configured to detect a characteristic of an operation area on a surface of a real object; and
an operation pattern control unit configured to control select, from among a plurality of operation patterns, an operation pattern to be applied in the operation area on a basis of information indicating the characteristic of the operation area, wherein
the operation pattern includes a method of inputting operation data in the operation area, and
the characteristic detection unit and the operation pattern control unit are each implemented via at least one processor.

2. The information processing apparatus according to claim 1 , wherein
the operation pattern further includes a method of detecting the operation data.

3. The information processing apparatus according to claim 2 , wherein
the operation pattern control unit is further configured to set the method of inputting operation data on a basis of at least one of an elasticity or a frictional force of the operation area.

4. The information processing apparatus according to claim 3 , wherein,
in a case where the operation data is represented by a direction, the operation pattern control unit is further configured to select which one of an orientation of an operation object when the operation object touches the operation area, an orientation of the operation object when the operation area is pushed by the operation object, or a moving direction of the operation object on the operation area to use when inputting the direction.

5. The information processing apparatus according to claim 2 , wherein
the operation pattern control unit is further configured to control a detection parameter to be used to detect the operation data on a basis of the information indicating the characteristic of the operation area.

6. The information processing apparatus according to claim 5 , wherein
the information indicating the characteristic of the operation area includes a frictional force, and the operation pattern control unit is further configured to set, on a basis of the frictional force of the operation area, a threshold value of a moving distance or a moving velocity of an operation object to be used to detect the operation data input by moving the operation object on the operation area.

7. The information processing apparatus according to claim 1 , wherein
the operation pattern control unit is further configured to select one of the operation pattern of operating while touching the operation area or the operation pattern of operating without touching the operation area on a basis of at least one of a dirt or a temperature of the operation area.

8. The information processing apparatus according to claim 1 , wherein
the operation pattern control unit is further configured to set the operation pattern on a basis of use of operation data input in the operation area.

9. The information processing apparatus according to claim 1 , wherein
the characteristic detection unit is further configured to detect the characteristic of the operation area on a basis of an image including the operation area.

10. The information processing apparatus according to claim 1 , further comprising:
an operation area setting unit configured to set the operation area on a basis of an image including the real object,
wherein the operation area setting unit is implemented via at least one processor.

11. The information processing apparatus according to claim 1 , further comprising:
an operation detection unit configured to detect operation data input in the operation area on a basis of a state of the operation area and a state of an operation object, and the operation pattern; and
an execution unit configured to execute processing using the operation data,
wherein the operation detection unit and the execution unit are each implemented via at least one processor.

12. The information processing apparatus according to claim 1 , further comprising:
an output control unit configured to control an output of visual information for providing notification of the operation pattern in the operation area;
wherein the output control unit is implemented via at least one processor.

13. The information processing apparatus according to claim 1 , wherein
the characteristic of the operation area includes at least one of a property or a state of the operation area.

14. The information processing apparatus according to claim 13 , wherein
the property of the operation area includes at least one of an elasticity, a frictional force, or a brittleness of the operation area, and
the state of the operation area includes at least one of a dirt or a temperature in the operation area.

15. An information processing apparatus comprising:
an operation pattern control unit configured to control an operation pattern in an operation area on a surface of a real object on a basis of information indicating a characteristic of the operation area, wherein
the operation pattern includes at least one of a method of inputting operation data in the operation area or a method of detecting the operation data,
the operation pattern control unit is further configured to set the method of inputting operation data on a basis of at least one of an elasticity or a frictional force of the operation area,
in a case where the operation data is represented by continuous values, the operation pattern control unit is further configured to select which one of an inclination of an operation object with respect to the operation area, a pushing amount of the operation area, or a moving distance of the operation object on the operation area to use when inputting the continuous values, and
the operation pattern control unit is implemented via at least one processor.

16. An information processing apparatus comprising:
an operation pattern control unit configured to control an operation pattern in an operation area on a surface of a real object on a basis of information indicating a characteristic of the operation area, wherein
the operation pattern includes at least one of a method of inputting operation data in the operation area or a method of detecting the operation data,
the operation pattern control unit is further configured to control a detection parameter to be used to detect the operation data on a basis of the information indicating the characteristic of the operation area,
the information indicating the characteristic of the operation area includes an elasticity, and the operation pattern control unit is further configured to set, on a basis of the elasticity of the operation area, a threshold value of a pushing amount to be used to detect the operation data input by pushing the operation area, and
the operation pattern control unit is implemented via at least one processor.

17. An information processing apparatus comprising:
an operation pattern control unit configured to control an operation pattern in an operation area on a surface of a real object on a basis of information indicating a characteristic of the operation area; and
a characteristic detection unit configured to
detect a characteristic of the operation area on a basis of an image including the operation area, and
detect a characteristic parameter indicating the characteristic of the operation area on a basis of a material of the operation area recognized on a basis of the image, wherein

the operation pattern control unit is further configured to set the operation pattern in the operation area on a basis

Assignees

• Sony Group Corp

Inventors

• Fujinawa Eisuke
• Ikeda Tetsuo
• Tomonaga Seishi
• Otsuka Junji
• Irie Atsushi
• Sato Yugo
• Gotoh Kenji

Classifications

• G06F3/0425 Primary

  using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386) · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/01

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0486

  Drag-and-drop · CPC title