Terminal device equipped with a camera and display and mounted on a vehicle that predicts an intention of the vehicle to turn left or right

Patent metadata

Field	Value
Publication number	US-12008904-B2
Application number	US-202217701740-A
Country	US
Kind code	B2
Filing date	Mar 23, 2022
Priority date	Mar 30, 2021
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

An information supply method is a method of causing a computer of a terminal device equipped with a camera and mounted in a mobile object to execute: a process of acquiring images captured at different times; a process of predicting whether the mobile object has an intention to turn right or left based on the images captured at the different times; and a process of displaying an image for an alarm about presence of a traffic participant on a display provided on a casing in which the camera of the terminal device is provided based on a result of the estimation.

First claim

What is claimed is:

1. An information supply method of causing at least one processor of a terminal device equipped with a camera and mounted in a mobile object to execute instructions stored in at least one memory of the terminal device, the instructions comprising:
acquiring images captured at different times;
rotating a first image captured at a first time at a predetermined angle in a left or right direction using a reference position as a starting point;
comparing a second image captured at a second time different than the first time with the first image rotated at the predetermined angle; and
predicting whether the mobile object has an intention to turn right or left based on a result of the comparing;
detecting a traffic participant that has a possibility of interfering with the mobile object based on a third image that is included in the images captured at different times, and
notifying an occupant of the mobile object of the traffic participant near the mobile object by displaying an image representation of an alarm representing a presence of the traffic participant on a display device provided on a casing in which the camera of the terminal device is provided based on a result of an estimation and the traffic participant that has a possibility of interfering with the mobile object.

2. The information supply method according to claim 1 , wherein the method causes the at least one processor to further execute:
predicting whether the moving object is traveling straight ahead or the moving object is turning right or left.

3. The information supply method according to claim 1 , wherein the method causes the at least one processor to further execute:
comparing the first image in a central portion of the image captured at the first time with the second image at a central portion of the image rotated at the predetermined angle.

4. The information supply method according to claim 3 , wherein the method causes the at least one processor to further execute:
acquiring the first image of a central portion of each of a plurality of images obtained by rotating the image captured at the first time at each predetermined angle in left and right directions using the reference position as the starting point;
comparing each of the first images at the central portions with the second image at the central portion of the image captured at the second time; and
predicting that the mobile object has an intention to turn right or left when a rotational angle of the first image in which a difference between the first and second images is minimized is equal to or greater than a threshold.

5. The information supply method according to claim 1 , wherein the method causes the at least one processor to further execute:
approximating a size of a cutout image in which a specific region is cut from the first image captured at the first time to a size of the second image captured at the second time, rotating the cutout image at the predetermined angle, and comparing the second image captured at the second time with the cutout image rotated at the predetermined angle.

6. The information supply method according to claim 1 , wherein the method causes the at least one processor to further execute:
a process of displaying the image representation of the alarm about an approach of the traffic participant on the display device when the mobile object is predicted to have an intention to turn right or left and the traffic participant is present or approaches in or near a route through which the mobile object passes when the mobile object turns right or left.

7. A non-transitory computer storage medium storing an application program causing a computer of a terminal device to execute a process of:
acquiring images captured at different times;
rotating a first image captured at a first time at a predetermined angle in a left or right direction using a reference position as a starting point;
comparing a second image captured at a second time different than the first time with the first image rotated at the predetermined angle; and
predicting whether the mobile object has an intention to turn right or left based on a result of the comparing;
detecting a traffic participant that has a possibility of interfering with the mobile object based on a third image that is included in the images captured at different times, and
notifying an occupant of the mobile object of the traffic participant near the mobile object by displaying an image representation of an alarm representing a presence of the traffic participant on a display device provided on a casing in which the camera of the terminal device is provided based on a result of an estimation and the traffic participant that has a possibility of interfering with the mobile object.

8. A terminal device comprising:
a camera provided in a casing;
a display provided in the casing; and
a processor configure to:
rotating a first image captured at a first time at a predetermined angle in a left or right direction using a reference position as a starting point;
comparing a second image captured at a second time different than the first time with the first image rotated at the predetermined angle; and
predicting whether the mobile object has an intention to turn right or left based on a result of the comparing;
detecting a traffic participant that has a possibility of interfering with the mobile object based on a third image that is included in the images captured at different times, and
notifying an occupant of the mobile object of the traffic participant near the mobile object by displaying an image representation of an alarm representing a presence of the traffic participant on a display device provided on a casing in which the camera of the terminal device is provided based on a result of an estimation and the traffic participant that has a possibility of interfering with the mobile object.

Assignees

• Honda Motor Co Ltd

Inventors

• Yasui Yuji

Classifications

• H04N23/695

  Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects · CPC title

• G08G1/16

  Anti-collision systems (road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08) · CPC title

• B62J50/22 Primary

  electronic, e.g. displays · CPC title

• B60Q9/008

  for anti-collision purposes · CPC title

• B60Q1/46

  for giving flashing caution signals during drive, other than signalling change of direction, e.g. flashing the headlights {or hazard lights} · CPC title