Image generating device and method of generating image

Patent metadata

Field	Value
Publication number	US-11548598-B2
Application number	US-201816970306-A
Country	US
Kind code	B2
Filing date	Nov 27, 2018
Priority date	Dec 25, 2017
Publication date	Jan 10, 2023
Grant date	Jan 10, 2023

Abstract

The purpose is to provide an image generating device which generates a synthesized image from which one is able to intuitively grasp a relation between an image and a traveling position of a water-surface movable body. The image generating device includes processing circuitry. The processing circuitry acquires attitude information indicative of an attitude of a camera or a ship where the camera is installed. The processing circuitry acquires a traveling route of the ship based on a detection result of at least one of a position and a direction of the ship. The processing circuitry generates traveling route display data based on the attitude information and the traveling route. The processing circuitry generates a synthesized image in which the traveling route display data is synthesized with an image outputted from the camera.

First claim

The invention claimed is:

1. An image generating device, comprising:
processing circuitry configured to:
acquire attitude information, which is indicative of an attitude of an imaging device or a water-surface movable body where the imaging device is installed, from an attitude sensor of the water-surface movable body, wherein the attitude information includes a direction of the water-surface movable body;
acquire a position of the imaging device or water-surface movable body from a GNSS receiver of the water-surface movable body;
acquire a traveling route of the water-surface movable body based on at least one of the acquired position and the acquired direction of the water-surface movable body;
generate traveling route display data based on the attitude information and the traveling route;
generate a synthesized image in which the traveling route display data is synthesized with an image outputted from the imaging device; and
output the synthesized image to a display.

2. The image generating device of claim 1 , wherein the processing circuitry is further configured to acquire a distance from a given reference position to the water-surface movable body or the traveling route.

3. The image generating device of claim 2 , wherein the reference position is a reference point, a reference line, or a reference area.

4. The image generating device of claim 3 , wherein the processing circuitry is further configured to:
generate distance display data based on the distance, and
generate the synthesized image in which the distance display data is further synthesized at a position associated with the traveling route.

5. The image generating device of claim 3 , wherein the processing circuitry is further configured to change the traveling route display data between a state where the traveling route display data is displayed and not displayed according to the distance.

6. The image generating device of claim 1 , wherein the processing circuitry is further configured to acquire a distance from a point on the traveling route to the reference position, the point being located ahead of the position of the water-surface movable body by a given length.

7. The image generating device of claim 1 , wherein the processing circuitry is further configured to acquire a difference in a traveling direction between a setting route set by a user and the traveling route.

8. The image generating device of claim 1 , wherein the processing circuitry is further configured to:
generate setting route display data based on the setting route set by the user and the attitude information, and
generate the synthesized image in which the setting route display data is further synthesized.

9. The image generating device of claim 8 , wherein a length of the traveling route display data in the traveling direction included in the synthesized image is shorter than a length of the setting route display data in the traveling direction included in the synthesized image.

10. The image generating device of claim 8 , wherein the processing circuitry is further configured to generate the synthesized image in which a route offset from the setting route is rendered as the traveling route display data.

11. The image generating device of claim 1 , wherein the processing circuitry is further configured to generate the synthesized image in which the traveling route display data that is an extension of a bow direction of the water-surface movable body or a traveling direction calculated based on a traveling trace of the water-surface movable body is rendered.

12. The image generating device of claim 1 , wherein the processing circuitry is further configured to acquire the attitude information based on an image captured by the imaging device.

13. The image generating device of claim 1 , wherein the attitude sensor is a GNSS sensor.

14. The image generating device of claim 2 , wherein the processing circuitry is further configured to perform a warning when the distance exceeds a given threshold.

15. A method of generating an image, comprising:
acquiring attitude information, which is indicative of an attitude of an imaging device or a water-surface movable body where the imaging device is installed, from an attitude sensor of the water-surface movable body, wherein the attitude information includes a direction of the water-surface movable body;
acquiring a position of the imaging device or water-surface movable body from a GNSS receiver of the water-surface movable body;
acquiring a traveling route of the water-surface movable body based on at least one of the acquired position and the acquired direction of the water-surface movable body;
generating traveling route display data based on the attitude information and the traveling route;
generating a synthesized image in which the traveling route display data is synthesized with an image outputted from the imaging device; and
outputting the synthesized image to a display.

16. The image generating device of claim 2 , wherein the processing circuitry is further configured to acquire a distance from a point on the traveling route to the reference position, the point being located ahead of the position of the water-surface movable body by a given length.

17. The image generating device of claim 3 , wherein the processing circuitry is further configured to acquire a distance from a point on the traveling route to the reference position, the point being located ahead of the position of the water-surface movable body by a given length.

18. The image generating device of claim 4 , wherein the processing circuitry is further configured to acquire a distance from a point on the traveling route to the reference position, the point being located ahead of the position of the water-surface movable body by a given length.

19. The image generating device of claim 5 , wherein the processing circuitry is further configured to acquire a distance from a point on the traveling route to the reference position, the point being located ahead of the position of the water-surface movable body by a given length.

20. A non-transitory computer-readable recording medium storing a control program causing a processor of an image generating device to execute processing, the processor configured to control operation of the device, the processing comprising:
acquiring attitude information, which is indicative of an attitude of an imaging device or a water-surface movable body where the imaging device is installed, from an attitude sensor of the water-surface movable body, wherein the attitude information includes a direction of the water-surface movable body;
acquiring a position of the imaging device or water-surface movable body from a GNSS receiver of the water-surface movable body;
acquiring a traveling route of the water-surface movable body based on at least one of the acquired position and the acquired direction of the water-surface movable body;
generating traveling route display data based on the attitude information and the traveling route;
generating a synthesized image in which the traveling route display data is synthesized with an image outputted from the imaging device; and
outputting the synthesized image to a display.

Assignees

• Furuno Electric Co

Inventors

• Nishiyama Koji

Classifications

• G08G3/00

  Traffic control systems for marine craft (marking of navigational route B63B22/16, B63B51/00) · CPC title

• G01C21/203

  specially adapted for water-borne vessels · CPC title

• G01C21/20

  Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence) · CPC title

• H04N7/183 Primary

  for receiving images from a single remote source · CPC title

• B63B2213/00

  Navigational aids and use thereof, not otherwise provided for in this class · CPC title