Image recognition device, image recognition method, image recognition program, and recording medium

Patent metadata

Field	Value
Publication number	US-9489052-B2
Application number	US-201214387549-A
Country	US
Kind code	B2
Filing date	Mar 29, 2012
Priority date	Mar 29, 2012
Publication date	Nov 8, 2016
Grant date	Nov 8, 2016

Abstract

A secondary coupled vibration occurs between a hand portion of the user and a vehicle due to an influence of a direct vibration of the vehicle. The coupled vibration differs in a deflection width, and generation timing and peak timing of a vibration depending on user's various individual conditions. A difference amount calculation unit and a user-based characteristic learning unit analyze and store a correspondence relation of an acceleration and the coupled vibration, and thereby learn a characteristic of the coupled vibration corresponding to the user. The coupled vibration corresponding to the user can be detected with high accuracy by checking the detected acceleration against a learning result. A position of an indication point indicated by the hand of the user can be recognized with high accuracy by correcting a position of a captured image itself by element of the detected coupled vibration.

First claim

What is claimed is:

1. An image recognition device comprising:
an imaging unit disposed in a moving body, that captures an image of a user riding on the moving body;
an acceleration detection unit that detects an acceleration added to said imaging unit;
a device vibration detection unit that detects a relative device vibration between said moving body and said imaging unit wherein the relative device vibration occurs due to the vibration of said moving body based on said acceleration;
a coupled vibration detection unit that detects a coupled vibration as a relative vibration of a predetermined body portion of the user that is an object to be captured by said imaging unit wherein the coupled vibration occurs due to a vibration of said moving body; and
a recognition unit that recognizes a position of the predetermined body portion of said user based on said image captured by said imaging unit, the device vibration detected by said device vibration detection unit, and said coupled vibration detected by said coupled vibration detection unit.

2. The image recognition device according to claim 1 , further comprising
a correction unit that corrects a position of the whole of said image with respect to an imaging coordinate of said imaging unit based on said image and said coupled vibration, wherein
said recognition unit recognizes the position of said predetermined body portion of the user by said image of the position corrected by said correction unit.

3. The image recognition device according to claim 1 , wherein:
said imaging unit images said predetermined body portion with an image in a video format including a plurality of time-sequentially captured image frames,
said recognition unit recognizes also a position of a predetermined portion of said moving body by said image frames, and
said device vibration detection unit detects said device vibration based on deviation between the position of said predetermined portion in image frames before the detection of said acceleration and the position of said predetermined portion in image frames after the detection of said acceleration.

4. The image recognition device according to claim 1 , further comprising a vibration detection unit that detects a vibration of said moving body, wherein
said coupled vibration detection unit detects the coupled vibration as the relative vibration of the predetermined body portion of the user that is the object to be captured by said imaging unit wherein the coupled vibration occurs due to the vibration of said moving body, in accordance with the vibration of said moving body detected by said vibration detection unit.

5. The image recognition device according to claim 4 , further comprising a memory that stores correspondence relation between a vibration of said moving body and a vibration of the predetermined body portion of the user that is the object to be captured by said imaging unit, wherein
said coupled vibration detection unit detects the coupled vibration as the relative vibration of the predetermined body portion of the user that is the object to be captured by said imaging unit wherein the coupled vibration occurs due to the vibration of said moving body, in accordance with the vibration of said moving body and said correspondence relation stored in said memory.

6. The image recognition device according to claim 5 , further comprising a setting unit that sets a user intending to practice a gesture input, wherein
said memory stores said correspondence relation by individual users, and said coupled vibration detection unit detects the coupled vibration of the user set by said setting unit in accordance with the vibration of said moving body and said correspondence relation corresponding to the user.

7. The image recognition device according to claim 5 , wherein
said vibration detection unit detects the vibration of said moving body in accordance with said acceleration detected by said acceleration detection unit.

8. An image recognition method executing the steps of:
an imaging step for capturing an image of a user riding on a moving body by an imaging unit disposed in the moving body;
an acceleration detection step for detecting an acceleration added to said imaging unit;
a vibration detection step that detects a relative device vibration between said moving body and said imaging unit wherein the relative device vibration occurs due to the vibration of said moving body based on said acceleration;
a coupled vibration detection step for detecting a coupled vibration as a relative vibration of a predetermined body portion of the user that is an object to be captured by said imaging unit wherein the coupled vibration occurs due to a vibration of said moving body; and
a recognition step for recognizing a position of a predetermined body portion of said user based on said image captured in said imaging step, the device vibration detected in the vibration detection step and said coupled vibration detected in the coupled vibration detection step.

9. An image recognition device comprising:
a camera disposed in a moving body, that captures an image of a user riding on the moving body;
an acceleration detector that detects an acceleration added to said camera;
a device vibration detector that detects a relative device vibration between said moving body and said camera wherein the relative device vibration occurs due to the vibration of said moving body based on said acceleration;
a coupled vibration detector that detects a coupled vibration as a relative vibration of a predetermined body portion of the user that is an object to be captured by said camera wherein the coupled vibration occurs due to a vibration of said moving body; and
a recognizer that recognizes a position of the predetermined body portion of said user based on said image captured by said camera, the device vibration detected by said device vibration detector, and said coupled vibration detected by said coupled vibration detector.

Assignees

• Saka Tsuyoshi
• Pioneer Corp

Inventors

• Saka Tsuyoshi

Classifications

• G06F3/0425

  using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386) · CPC title

• B60K2350/2013

  Operations & Transport · mapped topic

• B60K2350/1052

  Operations & Transport · mapped topic

• G06T7/0048

  Physics · mapped topic

• G06F2203/04108

  Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction · CPC title