Information processing system, method of information processing, and program

Patent metadata

Field	Value
Publication number	US-11093758-B2
Application number	US-201916595982-A
Country	US
Kind code	B2
Filing date	Oct 8, 2019
Priority date	Nov 29, 2018
Publication date	Aug 17, 2021
Grant date	Aug 17, 2021

Abstract

An information processing system S includes a server device, and an information processing device communicable with the server device. The information processing device is configured to acquire a plurality of images imaged by an imaging device included in a vehicle, and output to the server device, when detecting a change from a non-rainfall state to a rainfall state, or a change from the rainfall state to the non-rainfall state based on the acquired images, location information regarding the vehicle when the change is detected.

First claim

What is claimed is:

1. An information processing system comprising:
a server device; and
an information processing device communicable with the server device, wherein
the information processing device is configured to
acquire a plurality of images imaged by an imaging device included in a vehicle,
determine a rain gear usage rate from the acquired plurality of images,
output to the server device, when a determination is made that the rain gear usage rate increases by a prescribed value within a prescribed time interval, a notification that indicates an increase in intensity of rainfall, and
output to the server device, when detecting a change from a non-rainfall state to a rainfall state, or a change from the rainfall state to the non-rainfall state based on the acquired plurality of images, location information regarding the vehicle when the change is detected.

2. The information processing system according to claim 1 , wherein the information processing device is configured to
detect, in the images, a number of persons and rain gear used by one or more persons in the detected number of persons, the rain gear usage rate being determined from a ratio of a number of rain gear users to the detected number of persons, and
determine that the non-rainfall state changes to the rainfall state when the rain gear usage rate reaches the prescribed value.

3. The information processing system according to claim 1 , wherein the server device is configured to
acquire the location information from the information processing device,
map locations corresponding to the location information on a map, and
output the map after mapping.

4. The information processing system according to claim 1 , wherein the server device is configured to
acquire the location information from the information processing device,
detect a past transition of an area having a rainfall, the area being specified based on the location information, and
predict, based on the past transition, an area where the change occurs within a prescribed future time.

5. The information processing system according to claim 4 , wherein the server device is configured to notify occurrence of the change within the prescribed future time to user terminals that are present in the area where the change is predicted to occur within the prescribed future time.

6. The information processing system according to claim 5 , wherein the server device is further configured to notify, to the user terminals that are present in the area where the change is predicted to occur within the prescribed future time, information on facilities that are present in a prescribed distance from the user terminals.

7. A method of information processing executed in an information processing system, including a server device, and an information processing device communicable with the server device, the method comprising steps, executed by the information processing device, of:
acquiring a plurality of images imaged by an imaging device included in a vehicle;
determine a rain gear usage rate from the acquired plurality of images;
outputting to the server device, when a determination is made that the rain gear usage rate increases by a prescribed value within a prescribed time interval, a notification that indicates an increase in intensity of rainfall; and
outputting to the server device, when detecting a change from a non-rainfall state to a rainfall state, or a change from the rainfall state to the non-rainfall state based on the acquired plurality of images, location information regarding the vehicle when the change is detected.

8. A non-transitory computer readable medium having instructions stored therein, which when executed by a processor in an information processing device communicable with a server device in an information processing system, causes the processor to execute the steps of:
acquiring a plurality of images imaged by an imaging device included in a vehicle;
determine a rain gear usage rate from the acquired plurality of images;
outputting to the server device, when a determination is made that the rain gear usage rate increases by a prescribed value within a prescribed time interval, a notification that indicates an increase in intensity of rainfall; and
outputting to the server device, when detecting a change from a non-rainfall state to a rainfall state, or a change from the rainfall state to the non-rainfall state based on the acquired plurality of images, location information regarding the vehicle when the change is detected.

Assignees

• Toyota Motor Co Ltd

Inventors

• Hasegawa Hideo
• Kameda Keiko
• Ejiri Misa
• Naruse Shintaro
• Kashiwai Tadahiro
• Oka Naoya
• Koike Kensuke
• Monji Hiroyuki

Classifications

• G06V20/00

  Scenes; Scene-specific elements (control of digital cameras H04N23/60) · CPC title

• G06V40/103

  Static body considered as a whole, e.g. static pedestrian or occupant recognition · CPC title

• G06V20/56 Primary

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• G06V20/49

  Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes · CPC title

• G06V20/53

  Recognition of crowd images, e.g. recognition of crowd congestion · CPC title