Signal processing device, signal processing method, and signal processing system

Patent metadata

Field	Value
Publication number	US-12468397-B2
Application number	US-202218569242-A
Country	US
Kind code	B2
Filing date	Feb 9, 2022
Priority date	Jun 22, 2021
Publication date	Nov 11, 2025
Grant date	Nov 11, 2025

Abstract

Provided is a signal processing device that includes a setting unit to set a recognition method for recognizing an operation using a gesture on the basis of first vibration data indicating vibrations predicted to occur in the future, and an operation recognition unit to recognize the operation indicated by the gesture performed by a user in accordance with the recognition method set by the setting unit. The operation recognition unit recognizes the operation indicated by the gesture performed by the user in a vehicle equipped with the signal processing device. The present technology is applicable to, for example, a signal processing device that controls a display device provided in a vehicle.

First claim

The invention claimed is:

1 . A signal processing device, comprising:
a setting unit configured to set, based on first vibration data, a recognition method to recognize an operation using a gesture of a user, wherein
the user is in a first vehicle equipped with the signal processing device,
the first vibration data indicates vibrations predicted to occur in the first vehicle in the future,
the first vibration data further indicates the vibrations detected by a second vehicle that has travelled ahead of the first vehicle, through a predicted position where the first vehicle is predicted to travel in the future, and
a vehicle type of the second vehicle corresponds to a vehicle type of the first vehicle; and
an operation recognition unit configured to recognize, based on the set recognition method, the operation indicated by the gesture of the user.

2 . The signal processing device according to claim 1 , wherein
the setting unit is further configured to correct the recognition method based on correction data, and the correction data indicates a specific recognition method set for the second vehicle.

3 . The signal processing device according to claim 1 , further comprising:
a vibration detection unit configured to:
detect vibrations of the first vehicle; and
generate second vibration data indicating a result of the detection of the vibrations of the first vehicle; and
a transmission unit configured to transmit the generated second vibration data to at least one of
a third vehicle that travels through the predicted position behind the first vehicle, or
a server that transmits the second vibration data to the third vehicle.

4 . The signal processing device according to claim 3 , wherein the transmission unit is further configured to transmit, together with the second vibration data, vehicle information indicating the vehicle type of the first vehicle to at least one of
the third vehicle, or the server.

5 . The signal processing device according to claim 3 , wherein the transmission unit is further configured to transmit, together with the second vibration data, correction data indicating the recognition method set by the setting unit to
the third vehicle, or the server.

6 . The signal processing device according to claim 1 , further comprising
an acquisition unit configured to acquire the first vibration data based on a moving image captured of the second vehicle.

7 . The signal processing device according to claim 1 , wherein
the setting unit is further configured to set, as the recognition method, at least one of
a type of the gesture to be a recognition target,
a range in which the gesture is recognized as the operation, or
a recognition determination time taken for the gesture to be recognized as the operation.

8 . The signal processing device according to claim 7 , wherein the setting unit is further configured to set the recognition method based on at least one of
randomness of the vibrations predicted to occur in the future, a frequency of the vibrations predicted to occur in the future, an amplitude of the vibrations predicted to occur in the future, or continuity of the vibrations predicted to occur in the future.

9 . The signal processing device according to claim 8 , wherein
the operation recognition unit is further configured to recognize the operation by comparison of a duration of the gesture in a period with the recognition determination time, and the period excludes a period in which vibrations with an amplitude larger than a specific threshold occur.

10 . The signal processing device according to claim 8 , wherein
the setting unit is further configured to restrict the type of the gesture to be the recognition target in a case where vibrations with an amplitude larger than a specific threshold are predicted to continuously occur.

11 . The signal processing device according to claim 8 , wherein
the setting unit is further configured to extend the range in which the gesture is recognized as the operation in a case where vibrations with an amplitude larger than a specific threshold are predicted to continuously occur.

12 . The signal processing device according to claim 1 , wherein
the operation recognition unit is further configured to recognize the gesture of the user based on a moving image captured of the user.

13 . The signal processing device according to claim 1 , further comprising:
a determination unit configured to determine validity of the recognition method set by the setting unit, wherein
the setting unit is further configured to corrects the recognition method based on a result of the determination of the validity of the recognition method.

14 . A signal processing method, comprising:
causing a signal processing device to perform:
setting, based on vibration data, a recognition method for recognizing an operation using a gesture of a user, wherein
the user is in a first vehicle equipped with the signal processing device,
the vibration data indicates vibrations predicted to occur in the first vehicle in the future,
the vibration data further indicates the vibrations detected by a second vehicle that has travelled ahead of the first vehicle, through a predicted position where the first vehicle is predicted to travel in the future, and
a vehicle type of the second vehicle corresponds to a vehicle type of the first vehicle; and

recognizing, based on the set recognition method, the operation indicated by the gesture of the user.

15 . A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer of a signal processing device, cause the computer to execute operations, the operations comprising:
setting, based on vibration data, a recognition method for recognizing an operation using a gesture of a user, wherein
the user is in a first vehicle equipped with the signal processing device,
the vibration data indicates vibrations predicted to occur in the first vehicle in the future,
the vibration data further indicates the vibrations detected by a second vehicle that has travelled ahead of the first vehicle, through a predicted position where the first vehicle is predicted to travel in the future, and
a vehicle type of the second vehicle corresponds to a vehicle type of the first vehicle; and
recognizing, based on the set recognition method, the operation indicated by the gesture of the user.

16 . A signal processing system, comprising:
a signal processing device including:
a setting unit configured to set, based on vibration data, a recognition method to recognize an operation using a gesture of a user, wherein
the user is in a first vehicle equipped with the signal processing device,
the vibration data indicates vibrations predicted to occur in the first vehicle in the future,
the vibration data further indicates the vibrations detected by a second vehicle that has travelled ahead of the first vehicle, through a predicted position where the first vehicle is predicted to travel in the future, and
a vehicle type of the second vehicle corresponds to a vehicle type of the first vehicle; and

an operation recognition unit configured to recognize, based on the set recognition method, the operation indicated by the gesture of the user; and
a display device including a display unit configured to display an image on which the operation using the gesture is performed.

17 . The signal processing system according to claim 16 , further comprising:
a server, wherein
the se

Assignees

• Sony Group Corp

Inventors

• Imamura Hiroshi
• Nagara Toru
• Tomonaga Seishi
• Takamatsu Takashi
• Nagata Koji
• Takeuchi Hiroshi

Classifications

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G01C21/36

  Input/output arrangements for on-board computers · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G08G1/09

  Arrangements for giving variable traffic instructions ({railroad crossing signals B61L; reflectors E01F, G08B}; indicating arrangements for variable information by selection or combination of individual elements G09F9/00) · CPC title

• B60K2360/146

  Instrument input by gesture · CPC title