Information processing apparatus, projection method, and non-transitory computer readable medium

Patent metadata

Field	Value
Publication number	US-12464100-B2
Application number	US-202318318171-A
Country	US
Kind code	B2
Filing date	May 16, 2023
Priority date	May 17, 2022
Publication date	Nov 4, 2025
Grant date	Nov 4, 2025

Abstract

An information processing apparatus acquires a first image of a first medium including a first region in which a character is written. The information processing apparatus projects the first image onto a predetermined position of a second medium. The information processing apparatus acquires a second image of the second medium including a second region in which a line of a different color from the character depicted in the projected first image is drawn. The information processing apparatus corrects color data of an overlapping region in which the first region and the second region overlap in the second image. The information processing apparatus projects the corrected second image onto the first medium so that the position of the character matches.

First claim

The invention claimed is:

1 . An information processing apparatus comprising a controller configured to:
acquire a first image of a first medium including a first region in which a character is written, project the first image onto a predetermined position of a second medium, acquire a second image of the second medium including a second region in which a line of a different color from the character depicted in the projected first image is drawn, correct color data of an overlapping region in which the first region and the second region overlap in the second image, and project the corrected second image onto the first medium so that a position of the character matches.

2 . The information processing apparatus according to claim 1 , wherein
a color of the character is black, and when projecting the first image onto the second medium, the controller is configured to irradiate all of a mounting table on which the second medium is placed with illumination light while avoiding the first region.

3 . The information processing apparatus according to claim 2 , wherein the mounting table is shielded from light other than the illumination light and projection light that projects the first image.

4 . The information processing apparatus according to claim 1 , wherein the color data is an RGB value corresponding to a color of the overlapping region.

5 . The information processing apparatus according to claim 4 , wherein the controller is configured to correct the RGB value corresponding to the color of the overlapping region based on an RGB value corresponding to a color of the line in a region in which the first region and the second region do not overlap in the second image.

6 . The information processing apparatus according to claim 1 , wherein the first image is a first image with a predetermined number of frames, and the second image is a second image with a predetermined number of frames.

7 . The information processing apparatus according to claim 6 , wherein the controller is configured to further acquire a third image of a predetermined number of frames and a fourth image of a predetermined number of frames, the third image and the fourth image being frontal images respectively of a first user who writes the character on the first medium and a second user who draws the line on the second medium, and display, based on the third image of the predetermined number of frames and the fourth image of the predetermined number of frames, the first user and the second user to each other in real time on panels respectively arranged in front of the first user and the second user.

8 . A projection method to be executed by an information processing apparatus, the projection method comprising:
acquiring a first image of a first medium including a first region in which a character is written; projecting the first image onto a predetermined position of a second medium; acquiring a second image of the second medium including a second region in which a line of a different color from the character depicted in the projected first image is drawn; correcting color data of an overlapping region in which the first region and the second region overlap in the second image; and projecting the corrected second image onto the first medium so that a position of the character matches.

9 . The projection method according to claim 8 , wherein
a color of the character is black, the projection method further comprising irradiating, when projecting the first image onto the second medium, all of a mounting table on which the second medium is placed with illumination light while avoiding the first region.

10 . The projection method according to claim 9 , wherein the mounting table is shielded from light other than the illumination light and projection light that projects the first image.

11 . The projection method according to claim 8 , wherein the color data is an RGB value corresponding to a color of the overlapping region.

12 . The projection method according to claim 11 , further comprising correcting the RGB value corresponding to the color of the overlapping region based on an RGB value corresponding to a color of the line in a region in which the first region and the second region do not overlap in the second image.

13 . The projection method according to claim 8 , wherein the first image is a first image with a predetermined number of frames, and the second image is a second image with a predetermined number of frames.

14 . The projection method according to claim 13 , further comprising further acquiring a third image of a predetermined number of frames and a fourth image of a predetermined number of frames, the third image and the fourth image being frontal images respectively of a first user who writes the character on the first medium and a second user who draws the line on the second medium, and displaying, based on the third image of the predetermined number of frames and the fourth image of the predetermined number of frames, the first user and the second user to each other in real time on panels respectively arranged in front of the first user and the second user.

15 . A non-transitory computer readable medium storing a program configured to cause an information processing apparatus to execute operations, the operations comprising:
acquiring a first image of a first medium including a first region in which a character is written; projecting the first image onto a predetermined position of a second medium; acquiring a second image of the second medium including a second region in which a line of a different color from the character depicted in the projected first image is drawn; correcting color data of an overlapping region in which the first region and the second region overlap in the second image; and projecting the corrected second image onto the first medium so that a position of the character matches.

16 . The non-transitory computer readable medium according to claim 15 , wherein
a color of the character is black, the operations further comprising irradiating, when projecting the first image onto the second medium, all of a mounting table on which the second medium is placed with illumination light while avoiding the first region.

17 . The non-transitory computer readable medium according to claim 16 , wherein the mounting table is shielded from light other than the illumination light and projection light that projects the first image.

18 . The non-transitory computer readable medium according to claim 15 , wherein the color data is an RGB value corresponding to a color of the overlapping region.

19 . The non-transitory computer readable medium according to claim 18 , the operations further comprising correcting the RGB value corresponding to the color of the overlapping region based on an RGB value corresponding to a color of the line in a region in which the first region and the second region do not overlap in the second image.

20 . The non-transitory computer readable medium according to claim 15 , wherein the first image is a first image with a predetermined number of frames, and the second image is a second image with a predetermined number of frames.

Assignees

• Toyota Motor Co Ltd

Inventors

• Kaku Wataru

Classifications

• H04N9/315

  Modulator illumination systems (general applications of lighting devices F21V; general optical systems G02B; lamp houses for projectors not peculiar to the presence of an electronic spatial light modulator G03B21/20) · CPC title

• G09B5/02 Primary

  with visual presentation of the material to be studied, e.g. using film strip · CPC title

• G09B11/00

  Teaching hand-writing, shorthand, drawing, or painting · CPC title

• G06V30/1431

  Illumination control · CPC title

• G06V30/18095

  Summing image-intensity values; Projection and histogram analysis · CPC title