Image system and method for controlling imaging system

Patent metadata

Field	Value
Publication number	US-11962893-B2
Application number	US-202217580775-A
Country	US
Kind code	B2
Filing date	Jan 21, 2022
Priority date	Jan 27, 2021
Publication date	Apr 16, 2024
Grant date	Apr 16, 2024

Abstract

An imaging system includes a terminal device that includes an imaging sensor, and a head mounted display device that receives an image captured by the imaging sensor from the terminal device and displays the captured image. The imaging system includes at least one memory and at least one processor which function as: a detecting unit configured to detect the display device from the captured image; and a display control unit configured to control display of the captured image on the display device, based on a detection result of the display device using the detecting unit.

First claim

What is claimed is:

1. An imaging system including a terminal device that includes an imaging sensor, and a head mounted display device that receives an image captured by the imaging sensor from the terminal device and displays the captured image, the imaging system comprising at least one memory and at least one processor which function as:
a detecting unit configured to detect the head mounted display device from the captured image that is an image of a wearer of the head mounted display device; and
a display control unit configured to control display of the captured image on the head mounted display device based on a detection result of the head mounted display device using the detecting unit,
wherein, in a case where the detecting unit has detected the head mounted display device from the captured image, the display control unit is configured to control the display of the captured image such that the captured image including the head mounted display device overlaps with the terminal device, which is visually recognizable by the wearer through the head mounted display device, within a field-of-view of the head mounted display device.

2. The imaging system according to claim 1 , wherein the display control unit is configured to control the display of the captured image such that a display format of the captured image on the head mounted display device is different between a case where the detecting unit has detected the head mounted display device from the captured image and a case where the detecting unit has not detected the head mounted display device from the captured image.

3. The imaging system according to claim 1 , wherein the detecting unit is configured to acquire position information of the terminal device within a field-of-view of the head mounted display device based on the detection result, and
wherein the display control unit is configured to control the display of the captured image, based on the position information.

4. The imaging system according to claim 3 , wherein the terminal device includes at least one processor and/or at least one circuit which function as:
the detecting unit, and
a transmitting control unit configured to control transmitting of the position information acquired by the detecting unit to the head mounted display device.

5. The imaging system according to claim 3 , wherein the head mounted display device includes at least one processor and/or at least one circuit which function as the detecting unit.

6. The imaging system according to claim 1 , wherein the detection result includes at least any one of a position, a size, and an inclination of the head mounted display device in the captured image.

7. The imaging system according to claim 1 , wherein the detecting unit is configured to detect any one of a subject, a region of a face of the subject, a focused region, and a center region of the captured image, from the captured image, and
wherein the display control unit is configured to control the display of the captured image such that the subject and/or region detected by the detecting unit overlaps with the terminal device.

8. The imaging system according to claim 1 , wherein the display control unit is configured to display at least any one of the captured image, a subject of the captured image, a region of a face of the subject, a focused region, or a trimmed image of a center region of the captured image.

9. The imaging system according to claim 1 , wherein the display control unit is configured to control the display of the captured image based on an attention region of a wearer of the head mounted display device.

10. A method for controlling an imaging system including a terminal device that includes an imaging sensor, and a head mounted display device that receives an image captured by the imaging sensor from the terminal device and displays the captured image, the method comprising:
a detecting step of detecting the head mounted display device from the captured image that is an image of a wearer of the head mounted display device; and
a display control step of controlling display of the captured image on the head mounted display device based on a detection result of the head mounted display device in the detecting step,
wherein, in a case where the head mounted display device has been detected from the captured image in the detecting step, the display of the captured image is controlled such that the captured image including the head mounted display device overlaps with the terminal device, which is visually recognizable by the wearer through the head mounted display device, within a field-of-view of the head mounted display device.

11. A non-transitory computer readable medium that stores a program for use with an imaging system including a terminal device that includes an imaging sensor, and a head mounted display device that receives an image captured by the imaging sensor from the terminal device and displays the captured image, and the program causes the imaging system to execute:
a detecting step of detecting the head mounted display device from the captured image that is an image of a wearer of the head mounted display device; and
a display control step of controlling display of the captured image on the head mounted display device based on a detection result of the head mounted display device in the detecting step,
wherein, in a case where the head mounted display device has been detected from the captured image in the detecting step, the display of the captured image is controlled such that the captured image including the head mounted display device overlaps with the terminal device, which is visually recognizable by the wearer through the head mounted display device, within a field-of-view of the head mounted display device.

12. A head mounted display device comprising at least one memory and at least one processor which function as:
a receiving unit configured to receive, from a terminal device that includes an imaging sensor, an image captured by the imaging sensor;
an acquiring unit configured to acquire position information of the terminal device; and
a display control unit configured to control the display of the captured image, which is an image of a wearer of the head mounted display device, based on the position information;
wherein, in a case where the captured image includes the head mounted display device, the display control unit is configured to control the display of the captured image such that the captured image including the head mounted display device overlaps with the terminal device, which is visually recognizable by the wearer through the head mounted display device, within a field-of-view of the head mounted display device.

Assignees

• Canon Kk

Inventors

• Tanaka Ryosuke
• Ino Kazuya
• Sakaida Minoru

Classifications

• H04N23/64 Primary

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N5/2628 Primary

  Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation · CPC title

• H04N23/611

  where the recognised objects include parts of the human body · CPC title

• H04N23/635

  Region indicators; Field of view indicators · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title