Physique estimation device and posture estimation device

Patent metadata

Field	Value
Publication number	US-11380009-B2
Application number	US-202017070050-A
Country	US
Kind code	B2
Filing date	Oct 14, 2020
Priority date	Nov 15, 2019
Publication date	Jul 5, 2022
Grant date	Jul 5, 2022

Abstract

A physique estimation device includes: a camera capturing an image of an inside of a vehicle; a skeleton point coordinate acquisition unit acquiring positions of skeleton points of a body image of an occupant included in a captured image of the inside as skeleton point coordinates in a two-dimensional coordinate system of the captured image; a front coordinate estimation unit machine learned such that, by receiving a distance between preset skeleton points and an angle of a skeleton line obtained by connecting the skeleton points with respect to a reference line, a front coordinate that is an arrangement of the skeleton points when the occupant is viewed from front is estimated and output; and a physique determination unit determining a physique of the occupant based on the front coordinate.

First claim

What is claimed is:

1. A physique estimation device comprising:
a camera configured to capture an image of an inside of a vehicle; and
circuitry configured to:
acquire positions of a plurality of skeleton points of a body image of an occupant included in a captured image obtained by capturing an image of the inside by the camera as skeleton point coordinates in a two-dimensional coordinate system of the captured image;
apply a machine learned parameter to distance information that is a distance between a plurality of preset skeleton points among the plurality of skeleton points specified by the skeleton point coordinates and angle information that is an angle of a skeleton line obtained by connecting the plurality of the skeleton points specified by the skeleton point coordinates with respect to a reference line to estimate a front coordinate in the two-dimensional coordinate system that is an arrangement of the plurality of skeleton points whose positions were acquired by capturing the image when the occupant is viewed from front; and
determine a physique of the occupant based on the estimated front coordinate.

2. The physique estimation device according to claim 1 , wherein the distance information is a distance between skeleton points on left and right shoulders of the occupant and a distance between skeleton points on left and right portions of a waist of the occupant.

3. The physique estimation device according to claim 1 wherein the angle information is an angle of a spine line along a spine of the occupant with respect to a reference spine line.

4. The physique estimation device according to claim 1 , wherein the angle information is an angle of a shoulder line obtained by connecting skeleton points on left and right shoulders of the occupant with respect to a reference shoulder line.

5. The physique estimation device according to claim 1 , wherein the angle information is an angle of a spine line along a spine of the occupant with respect to a waist line obtained by connecting skeleton points of left and right portions of a waist of the occupant.

6. The physique estimation device according to claim 1 , wherein the circuitry is configured to:
store physiques divided into a plurality of types of physiques; and
determine which of the plurality of types of physiques the physique of the occupant belongs to.

7. The physique estimation device according to claim 1 , wherein the circuitry is configured to:
acquire a position of a seat base and a leaning posture of a seat back of a seat in the vehicle; and
correct the skeleton point coordinates based on the position of the seat base and the leaning posture of the seat back.

8. The physique estimation device according to claim 1 , wherein the circuitry is configured to determine, based on the angle information, a posture of an upper body of the occupant seated in a seat in the vehicle.

9. The physique estimation device according to claim 1 , wherein the circuitry is configured to:
acquire the skeleton point coordinates of an upper body of the occupant seated in a seat in the vehicle; and
estimate the front coordinate based on the skeleton point coordinates of the upper body.

10. A posture estimation device comprising:
a camera configured to capture an image of an inside of a vehicle; and
circuitry configured to:
acquire positions of a plurality of skeleton points of a body image of an occupant included in a captured image obtained by capturing an image of the inside by the camera as skeleton point coordinates in a two-dimensional coordinate system of the captured image;
acquire a position of a seat base and a leaning posture of a seat back of a seat in the vehicle;
correct the skeleton point coordinates in the two-dimensional coordinate system of the captured image based on the position of the seat base and the leaning posture of the seat back; and
estimate, with reference to machine learned data, a posture of the occupant based on distance information that is a distance between a plurality of preset skeleton points among the plurality of skeleton points specified by the skeleton point coordinates and angle information that is an angle of a skeleton line obtained by connecting the plurality of the skeleton points specified by the corrected skeleton point coordinates with respect to a reference line.

11. The posture estimation device according to claim 10 , wherein the circuitry is configured to determine a physique of the occupant based on the estimated posture.

Assignees

• Aisin Corp

Inventors

• Tanaka Godai
• Tomatsu Yoshiaki
• Nakagome Takayuki

Classifications

• G06V10/34

  Smoothing or thinning of the pattern; Morphological operations; Skeletonisation · CPC title

• G06V20/593

  Recognising seat occupancy · CPC title

• G06T7/75 Primary

  involving models · CPC title

• G06T7/73 Primary

  using feature-based methods · CPC title

• G06V20/59

  inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions · CPC title