Information processing device, information processing system, and information processing method

Patent metadata

Field	Value
Publication number	US-2023356720-A1
Application number	US-202318186201-A
Country	US
Kind code	A1
Filing date	Mar 20, 2023
Priority date	May 9, 2022
Publication date	Nov 9, 2023
Grant date	—

Abstract

An acquisition unit acquires vehicle information and a moving image frame as image information captured by an imaging unit from a database. A recognition unit recognizes opening and closing of an eye of a driver, a direction of a face, and a gaze point. An extraction unit extracts, from among the captured images acquired by the acquisition unit, a captured image in which the eye is closed and the face is facing forward in a predetermined range.

First claim

What is claimed is:

1 . An information processing device comprising:
an acquisition unit that acquires a captured image of a moving image of a face of an occupant; and an extraction unit that extracts, from among the captured images acquired by the acquisition unit, a captured image in which an eye is closed and the face is facing forward in a predetermined range.

2 . The information processing device according to claim 1 , further comprising
a recognition unit that recognizes a direction of the face of the occupant and an open-closed state of the eye of the occupant by image recognition in the captured images acquired by the acquisition unit.

3 . The information processing device according to claim 1 , wherein:
the acquisition unit further acquires vehicle speed information; and the extraction unit extracts a captured image when a vehicle speed is equal to or higher than a predetermined threshold value.

4 . The information processing device according to claim 3 , wherein
the extraction unit terminates extraction of the captured image when the vehicle speed is less than the threshold value or duration of a closed-eye state is less than a predetermined time.

5 . The information processing device according to claim 2 , wherein:
the recognition unit further recognizes a gaze point of the occupant by the image recognition; and the extraction unit invalidates a recognition result of the open-closed state with respect to a captured image of the gaze point outside the predetermined range set by the recognition unit.

6 . The information processing device according to claim 1 , wherein
the extraction unit preferentially extracts a captured image in which the occupant is facing forward in a right-left direction over a captured image in which the occupant is facing forward in an up-down direction.

7 . An information processing system comprising:
a vehicle including an imaging unit that captures an image of a face of an occupant and that generates a captured image of a moving image; and an information processing device including an acquisition unit that acquires the captured image from the vehicle, and an extraction unit that extracts a captured image in which an eye of the occupant is closed and the face is facing forward in a predetermined range from among the captured images acquired by the acquisition unit.

8 . An information processing method in which a computer executes processes comprising:
acquiring a captured image of a moving image of a face of an occupant; and extracting, from among the captured images that have been acquired, a captured image in which an eye is closed and the face is facing forward in a predetermined range.

Assignees

• Toyota Motor Co Ltd

Inventors

• Washio Kota

Classifications

• B60W40/08 Primary

  related to drivers or passengers · CPC title

• B60W40/105

  Speed · CPC title

• G06V20/597 Primary

  Recognising the driver's state or behaviour, e.g. attention or drowsiness · CPC title

• G06V40/18

  Eye characteristics, e.g. of the iris · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title