Omnidirectional camera system with improved point of interest selection

Patent metadata

Field	Value
Publication number	US-11956547-B2
Application number	US-202117537483-A
Country	US
Kind code	B2
Filing date	Nov 30, 2021
Priority date	Mar 15, 2019
Publication date	Apr 9, 2024
Grant date	Apr 9, 2024

Abstract

An image capturing device includes an imaging device and circuitry. The imaging device captures an image. The circuitry defines a point of interest in the image, converts the defined point of interest in accordance with attitude information of the image capturing device, and cuts out a viewable area from the image. The viewable area includes the converted point of interest.

First claim

The invention claimed is:

1. A communication terminal at a first site, the communication terminal comprising:
circuitry configured to
transmit first video images to another communication terminal and receive second video images from the another communication terminal, wherein the another communication terminal is located at a second site remotely located from the first site;
receive a spherical image captured at the second site;
control, in a case that a point of interest is specified at the second site, a display to display a first image of a viewable area which is a part of the spherical image, the first image including the point of interest, wherein the point of interest is not changeable at the communication terminal; and
control, in a case that the point of interest is not specified at the second site, a the display to display a second image including a predetermined area of the spherical image based on a previous operation input at the first site.

2. The communication terminal of claim 1 , wherein the circuitry is further configured to control the display to display an icon based on the point of interest in the case that the point of interest is specified at the second site.

3. The communication terminal of claim 1 , wherein the point of interest is converted at an imaging device that captures the spherical image at the second site to generate a converted point of interest in accordance with attitude information of the imaging device.

4. The communication terminal of claim 3 , wherein the imaging device executes a zenith correction on the spherical image with the attitude information, and converts the point of interest with a result of the zenith correction.

5. The communication terminal of claim 4 , wherein the point of interest is defined in a three-dimensional coordinate system according to coordinate values of an imaging element corresponding to an image of an object pointed by an upper side in a longitudinal direction of the imaging device.

6. The communication terminal of claim 1 , wherein the circuitry is further configured to rotate the spherical image such that the point of interest is displayed by the display at a center of the spherical image.

7. A method for a communication terminal at a first site, the method comprising:
transmitting, by the communication terminal, first video images to another communication terminal which is located at a second site remotely located from the first site;
receiving, by the communication terminal, second video images from the another communication terminal;
receiving, by the communication terminal, a spherical image captured at the second site;
controlling, in a case that a point of interest is specified at the second site, a display to display a first image of a viewable area which is a part of the spherical image, the first image including the point of interest, wherein the point of interest is not changeable at the communication terminal; and
controlling, in a case that the point of interest is not specified at the second site, the display to display a second image including a predetermined area of the spherical image based on a previous operation input at the first site.

8. The method of claim 7 , further comprising controlling the display to display an icon based on the point of interest in the case that the point of interest is specified at the second site.

9. The method of claim 7 , further comprising converting the point of interest to generate a converted point of interest in accordance with attitude information of an imaging device that captures the spherical image.

10. The method of claim 9 , further comprising:
executing a zenith correction on the spherical image with the attitude information; and
converting the point of interest with a result of the zenith correction.

11. The method of claim 10 , wherein the point of interest is defined in a three-dimensional coordinate system according to coordinate values of an imaging element corresponding to an image of an object pointed by an upper side in a longitudinal direction of the imaging device.

12. The method of claim 7 , further comprising rotating the spherical image such that the point of interest is displayed by the display at a center of the spherical image.

13. An image communication system, comprising:
a first communication terminal at a first site; and
a second communication terminal at a second site remotely located from the first site, wherein
the first communication terminal includes first circuitry configured to
receive first video images from the second communication terminal and transmit second video images to the second communication terminal;
capture a spherical image; and
transmit the spherical image to the second communication terminal, and the second communication terminal includes second circuitry configured to
transmit the first video images to the first communication terminal and receive the second video images from the first communication terminal;
receive the spherical image from the first communication terminal;
control, in a case that a point of interest is specified at the first site, a display to display a first image of a viewable area which is a art of the spherical image, the first image including the point of interest, wherein the point of interest is not changeable at the second communication terminal; and
control, in a case that the point of interest is not specified at the first site, the display to display a second image including a predetermined area of the spherical image based on a previous operation input at the second site.

14. The image communication system of claim 13 , wherein the second circuitry is further configured to control the display to display an icon based on the point of interest in the case that the point of interest is not specified by the first communication terminal.

15. The image communication system of claim 13 , wherein the point of interest is converted at an imaging device that captures the spherical image at the first site to generate a converted point of interest in accordance with attitude information of the imaging device.

16. The image communication system of claim 15 , wherein the imaging device is configured to
execute a zenith correction on the spherical image with the attitude information; and
convert the point of interest with a result of the zenith correction.

17. The image communication system of claim 16 , wherein the point of interest is defined in a three-dimensional coordinate system according to coordinate values of an imaging element corresponding to an image of an object pointed by an upper side in a longitudinal direction the first communication terminal.

18. The image communication system of claim 13 , wherein the second circuitry is further configured to rotate the spherical image such that the point of interest is displayed by the display at a center of the spherical image.

19. A non-transitory computer readable medium storing computer executable instructions which, when executed by circuitry of a first communication terminal at a first site, cause the first communication terminal to:
transmit first video images to a second communication terminal and receive second video images from the second communication terminal, wherein the second communication terminal is located at a second site remotely located from the first site;
receive a spherical image captured at the second site;
control, in a case that a point of interest is specified at the second site, a display to display a first image of a viewable area which i

Assignees

• Shiro Hideki
• Morita Kenichiro
• Annaka Hidekuni
• Homma Takeshi
• Soneda Takuya
• Aikawa Tomonori
• Takeda Takafumi
• Ricoh Co Ltd

Inventors

• Shiro Hideki
• Morita Kenichiro
• Annaka Hidekuni
• Homma Takeshi
• Soneda Takuya
• Aikawa Tomonori
• Takeda Takafumi

Classifications

• H04N23/951

  by using two or more images to influence resolution, frame rate or aspect ratio · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G06T3/0062

  Physics · mapped topic

• H04N1/00129

  with a display device, e.g. CRT or LCD monitor (with a television apparatus H04N1/00283; arrangements for control of display devices G09G) · CPC title