Information processing system, program, and information processing method

Patent metadata

Field	Value
Publication number	US-11748996-B2
Application number	US-202217568365-A
Country	US
Kind code	B2
Filing date	Jan 4, 2022
Priority date	Dec 14, 2018
Publication date	Sep 5, 2023
Grant date	Sep 5, 2023

Abstract

An information processing system is equipped with at least one vehicle and a server that can communicate with the at least one vehicle. The vehicle acquires an image obtained by imaging a landscape outside the vehicle, a humidity outside the vehicle, and an imaging position of the image. The vehicle or the server generates floating substance information on an atmospheric floating substance around the vehicle, based on the image and the humidity. The server stores at least one pair of the floating substance information and the imaging position corresponding thereto, and provides information to a client through the use of the at least one pair of the stored floating substance information and the stored imaging position corresponding thereto.

First claim

What is claimed is:

1. An information processing system comprising:
at least one vehicle; and
a server configured to communicate with the at least one vehicle, wherein
the at least one vehicle acquires an image obtained by imaging an outside and an imaging position of the image,
the at least one vehicle or the server generates, based on at least the image, floating substance information on an atmospheric floating substance around the imaging position,
the server is configured to determine a substance presence area based on display information that includes the floating substance information and the imaging position, and
the determined substance presence area is superimposed and displayed on a map.

2. The information processing system according to claim 1 , wherein the image is obtained by further imaging a landscape outside the at least one vehicle and a humidity outside the at least one vehicle.

3. The information processing system according to claim 1 , wherein the server stores at least one pair of the floating substance information and the imaging position corresponding thereto, and provides display information to a client, the display information including the at least one pair of the stored floating substance information and the stored imaging position corresponding thereto.

4. The information processing system according to claim 3 , wherein the at least one vehicle or the server generates the floating substance information indicating that the atmospheric floating substance around the at least one vehicle contains a substance that is different from any of water, pollen, and yellow dust, when a contrast of the image is lower than a first reference value, a tint of the image is different from a reference color, and the humidity is lower than a second reference value.

5. The information processing system according to claim 4 , wherein the at least one vehicle or the server generates the floating substance information indicating that the atmospheric floating substance around the at least one vehicle contains water, when the contrast of the image is lower than the first reference value and the humidity is equal to or higher than the second reference value.

6. The information processing system according to claim 4 , wherein the at least one vehicle or the server generates the floating substance information indicating that the atmospheric floating substance around the at least one vehicle contains pollen or yellow dust, when the contrast of the image is lower than the first reference value and the tint of the image is the reference color.

7. The information processing system according to claim 4 , wherein the at least one vehicle or the server generates the floating substance information indicating that there is no atmospheric floating substance around the at least one vehicle, when the contrast of the image is equal to or higher than the first reference value.

8. The information processing system according to claim 3 , wherein the at least one vehicle or the server acquires a position of a generation source of the atmospheric floating substance based on a position of the at least one vehicle and the image, upon detecting the generation source from the image reflecting the generation source, and
the server provides the display information including the position of the generation source.

9. The information processing system according to claim 8 , wherein the server acquires a wind direction at the generation source, and provides the display information including the position of the generation source and the wind direction.

10. The information processing system according to claim 3 , wherein the server acquires a wind direction and wind speed, and
the server determines a shape and a size of the substance presence area based on the wind direction and the wind speed.

11. A non-transitory computer-readable medium having instructions stored therein, which when executed by a processor in an information processing device that is mounted in a vehicle cause the processor to:
acquire an image obtained by imaging an outside and an imaging position of the image; and
generate, based on at least the image, floating substance information on an atmospheric floating substance around the imaging position,
wherein a server that is configured to communicate with the vehicle is further configured to determine a substance presence area based on display information that includes the floating substance information and the imaging position, and
wherein the determined substance presence area is superimposed and displayed on a map.

12. The non-transitory computer-readable medium according to claim 11 , wherein the image is obtained by further imaging a landscape outside the vehicle and a humidity outside the vehicle.

13. The non-transitory computer-readable medium according to claim 11 , wherein the instructions further cause the processor to store at least one pair of the floating substance information and the imaging position corresponding thereto, and provide display information to a client, the display information including the at least one pair of the stored floating substance information and the stored imaging position corresponding thereto.

14. The non-transitory computer-readable medium according to claim 13 , wherein the instructions further cause the processor to generate the floating substance information indicating that the atmospheric floating substance around the vehicle contains a substance that is different from any of water, pollen, and yellow dust, when a contrast of the image is lower than a first reference value, a tint of the image is different from a reference color, and the humidity is lower than a second reference value.

15. The non-transitory computer-readable medium according to claim 14 , wherein the instructions further cause the processor to generate the floating substance information indicating that the atmospheric floating substance around the vehicle contains water, when the contrast of the image is lower than the first reference value and the humidity is equal to or higher than the second reference value.

16. An information processing method that is carried out by an information processing system that is equipped with at least one vehicle and a server that can communicate with the at least one vehicle, the method comprising:
acquiring an image obtained by imaging an outside and an imaging position of the image; and
generating, based on at least the image, floating substance information on an atmospheric floating substance around the imaging position,
wherein the server is configured to determine a substance presence area based on display information that includes the floating substance information and the imaging position, and
wherein the determined substance presence area is superimposed and displayed on a map.

17. The information processing method according to claim 16 , wherein the image is obtained by further imaging a landscape outside the at least one vehicle and a humidity outside the at least one vehicle.

18. The information processing method according to claim 16 , wherein the method further comprises storing at least one pair of the floating substance information and the imaging position corresponding thereto, and providing display information to a client, the display information including the at least one pair of the stored floating substance information and the stored imaging position corresponding thereto.

19. The information processing method according to claim 18 , wherein the method further comprises generatin

Assignees

• Toyota Motor Co Ltd

Inventors

• Kusama Eiichi
• Hayashi Masatoshi
• MITSUMOTO Hisanori
• Jinnai Kuniaki
• Akahane Makoto
• Yamaguchi Yuriko
• Kato Daisuke

Classifications

• G06V20/56 Primary

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• G01W1/04

  giving only separate indications of the variables measured · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title

• G06T2207/30192

  Weather; Meteorology · CPC title

• G06T2207/30252

  Vehicle exterior; Vicinity of vehicle · CPC title