Information processing device that projects drawing information according to ratio of distances, information processing method, and recording medium

Patent metadata

Field	Value
Publication number	US-11614835-B2
Application number	US-202017428824-A
Country	US
Kind code	B2
Filing date	Jan 10, 2020
Priority date	Feb 14, 2019
Publication date	Mar 28, 2023
Grant date	Mar 28, 2023

Abstract

An information processing device comprising a projection control unit that controls projection of drawing information, the projection being performed by a projection device, on a basis of ratio information between a first distance and a second distance, the first distance being acquired from sensing information regarding a drawing tool and being from a reference point to the drawing tool, and the second distance being from the reference point to an intersection point between a straight line connecting the reference point with the drawing tool and a calibration plane.

First claim

The invention claimed is:

1. An information processing device, comprising:
a projection control unit configured to control a projection device to project drawing information based on a three-dimensional position of a drawing tool in a drawing operation and ratio information between a first distance and a second distance, wherein
the drawing tool is at a plurality of points of an image projected on a first calibration plane and a second calibration plane located parallel to the first calibration plane,
the first distance is acquired from sensing information regarding the drawing tool,
the first distance is a distance from a reference point to the drawing tool, and
the second distance is a distance from the reference point to an intersection point between a straight line connecting the reference point with the drawing tool and the first calibration plane.

2. The information processing device according to claim 1 , wherein the ratio information is based on a ratio between the first distance and the second distance.

3. The information processing device according to claim 1 , wherein the projection control unit is further configured to control coordinates of the drawing information in the image projected by the projection device.

4. The information processing device according to claim 1 , wherein the projection control unit is further configured to control a size of the drawing information in a projected image projected by the projection device.

5. The information processing device according to claim 1 , wherein the projection control unit is further configured to control brightness of the drawing information in the image projected by the projection device.

6. The information processing device according to claim 1 , wherein the projection control unit is further configured to control a color of the drawing information in the image projected by the projection device.

7. The information processing device according to claim 1 , wherein the first calibration plane is a plane of a surface of a calibration target object and a plane obtained by virtually extending the plane of the surface of the calibration target object.

8. The information processing device according to claim 1 , wherein
the sensing information includes a captured image, and
a position of the reference point includes a position of an imaging device that captures the captured image.

9. The information processing device according to claim 8 , wherein
the projection control unit is further configured to acquire the first distance based on a size of a specific portion of the drawing tool, and
the specific portion appears in the captured image.

10. The information processing device according to claim 9 , wherein
the projection control unit is further configured to acquire the first distance based on a size of a shape of light emitted from the drawing tool, and
the shape appears in the captured image.

11. The information processing device according to claim 8 , wherein the projection control unit is further configured to:
generate a map that defines a distance from the reference point to the calibration plane with respect to each coordinate point in the captured image; and
acquire, as the second distance, a distance defined in the map with respect to a coordinate point corresponding to a coordinate point of the drawing tool included in the captured image.

12. The information processing device according to claim 11 , wherein
the map is generated based on a size of a specific portion of the drawing tool in a case where the drawing tool is at a plurality of points on the first calibration plane, and
the specific portion appears in the captured image.

13. The information processing device according to claim 11 , wherein
the map is generated based on a distance to the drawing tool in a case where the drawing tool at a plurality of points on the first calibration plane, and
a distance measuring sensor acquires the distance.

14. The information processing device according to claim 11 , wherein the projection control unit is further configured to control projection of the drawing information based on coordinates of an intersection point between an optical axis of the imaging device and each of the first calibration plane and the second calibration plane, and coordinates of an intersection point between an optical axis of the projection device and each of the first calibration plane and the second calibration plane.

15. An information processing method, comprising:
controlling a projection device to project drawing information based on a three-dimensional position of a drawing tool in a drawing operation and ratio information between a first distance and a second distance, wherein
the drawing tool is at a plurality of points of an image projected on a first calibration plane and a second calibration plane located parallel to the first calibration plane,
the first distance is acquired from sensing information regarding the drawing tool,
the first distance is a distance from a reference point to the drawing tool, and
the second distance is a distance from the reference point to an intersection point between a straight line connecting the reference point with the drawing tool and the first calibration plane.

16. The information processing device according to claim 15 , wherein the projection control unit is further configured to control projection of information for identifying the second point onto the second calibration plane.

17. The information processing device according to claim 1 , wherein
the projection control unit is further configured to generate a projective transformation matrix for converting the three-dimensional position on the calibration plane into coordinates in the image projected by the projection device, and
the projective transformation matrix is projected based on the three-dimensional position of the drawing tool in a case where the drawing tool is at the plurality of points in the image projected on the first calibration plane and the second calibration plane.

18. An information processing method, comprising:
controlling a projection device to project of drawing information based on a three-dimensional position of a drawing tool in a drawing operation and ratio information between a first distance and a second distance, wherein
the drawing tool is at a plurality of points on an image projected on a first calibration plane and a second calibration plane,
the first distance is acquired from sensing information regarding the drawing tool,
the first distance is a distance from a reference point to the drawing tool, and
the second distance is a distance from the reference point to an intersection point between a straight line connecting the reference point with the drawing tool and the first calibration plane.

19. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
controlling a projection device to project drawing information based on a three-dimensional position of a drawing tool in a drawing operation and ratio information between a first distance and a second distance, wherein
the drawing tool is at a plurality of points of an image projected on a first calibration plane and a second calibration plane located parallel to the first calibration plane,
the first distance is acquired from sensing information regarding the drawing tool,
the first distance is a distance from a reference

Assignees

• Sony Group Corp

Inventors

• Kusakabe Yuri
• Ida Kentaro
• Aoki Yu

Classifications

• G06F3/0425 Primary

  using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386) · CPC title

• H04N5/74

  Projection arrangements for image reproduction, e.g. using eidophor · CPC title

• G06F3/03545

  Pens or stylus · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G09G5/10

  Intensity circuits · CPC title