Signal processing apparatus and method

Patent metadata

Field	Value
Publication number	US-2025000383-A1
Application number	US-202218709610-A
Country	US
Kind code	A1
Filing date	Nov 4, 2022
Priority date	Nov 19, 2021
Publication date	Jan 2, 2025
Grant date	—

Abstract

The present technology relates to a signal processing apparatus and a method capable of improving the integration accuracy of estimation of a user state using a multimodal sensor. The signal processing apparatus estimates signal qualities for respective modals each representing a type of a biological signal of a user, detects at least one of the modals having variation heterogeneity representing that variation of the biological signal is different from a plurality of the modals, estimates a sensitivity to biological reaction of the modal based on a detection result of the modal having the variation heterogeneity, and integrally estimates a state of the user on the basis of the signal qualities and the sensitivities to the biological reaction. The present technology can be applied to a user state estimation processing system.

First claim

1 . A signal processing apparatus comprising:
a signal processing unit that estimates signal qualities for respective modals each representing a type of a biological signal of a user; a sensitivity estimation unit that detects at least one of the modals having variation heterogeneity representing that variation of the biological signal is different from a plurality of the modals, and estimates a sensitivity to biological reaction of the modal based on a detection result of the modal having the variation heterogeneity; and an integration estimation unit that integrally estimates a state of the user on a basis of the signal qualities and the sensitivities to the biological reaction.

2 . The signal processing apparatus according to claim 1 , further comprising:
a single-modal state estimation unit that estimates states of the user for the respective modals, wherein the sensitivity estimation unit detects the modal having the variation heterogeneity on a basis of variation amounts of the states of the user for the respective modals, and the integration estimation unit integrally estimates the state of the user by integrating the states of the user for the respective modals on a basis of the signal qualities and the sensitivities to the biological reaction.

3 . The signal processing apparatus according to claim 2 , wherein
the sensitivity estimation unit detects a baseline section indicating a section where a state of the user is stable from among states of the user for each modal, and detects the modal having the variation heterogeneity on a basis of the variation amount of the state of the user for each modal calculated with the state of the user in the baseline section as a base.

4 . The signal processing apparatus according to claim 3 , wherein
when calculating the variation amount of the state of the user for each modal, on a basis of a type of application or physiological knowledge, the sensitivity estimation unit uses a value obtained by multiplying a reliability of the state of the user for the corresponding modal by a preset correction coefficient.

5 . The signal processing apparatus according to claim 2 , wherein
the integration estimation unit integrally estimates the state of the user by integrating the states of the user for the respective modals on a basis of reliabilities of the states of the user for the respective modals using the signal qualities and the sensitivities to the biological reaction as indexes.

6 . The signal processing apparatus according to claim 5 , further comprising:
a sensor control unit that controls stop of sensing of the biological signal of at least one of the modals for which the reliability of the state of the user for the corresponding modal is estimated to be lower than a threshold.

7 . The signal processing apparatus according to claim 1 , further comprising:
a single-modal feature amount calculation unit that calculates feature amounts of the biological signals of the respective modals, wherein the sensitivity estimation unit detects the modal having the variation heterogeneity on a basis of variation amounts of the feature amounts for the respective modals, and the integration estimation unit integrally estimates the state of the user using the feature amounts for the respective modals on a basis of the signal qualities and the sensitivities to the biological reaction.

8 . The signal processing apparatus according to claim 7 , wherein
the sensitivity estimation unit detects a baseline section indicating a section where a feature amount of the user is in a stable state from among feature amounts of the user for each modal, and detects the modal having the variation heterogeneity on a basis of the variation amount of the feature amount of the user for each modal calculated with the feature amount of the user in the baseline section as a base.

9 . The signal processing apparatus according to claim 8 , wherein
when calculating the variation amount of the feature amount for each modal, on a basis of a type of application or physiological knowledge, the sensitivity estimation unit uses a value obtained by multiplying the feature amount for the corresponding modal by a coefficient of sign correction of a preset variation direction.

10 . The signal processing apparatus according to claim 7 , wherein
the integration estimation unit integrally estimates the state of the user by adjusting contribution degrees of the feature amounts for the respective modals on a basis of reliabilities of the feature amounts for the respective modals using the signal qualities and the sensitivities to the biological reaction as indexes.

11 . The signal processing apparatus according to claim 10 , further comprising:
a sensor control unit that controls stop of sensing of the biological signal of at least one of the modals for which the reliability of the state of the user for the corresponding modal is estimated to be lower than a threshold.

12 . The signal processing apparatus according to claim 1 , wherein
the sensitivity estimation unit registers information indicating estimated sensitivities to the biological reaction of the modals in a database, and the integration estimation unit integrally estimates the state of the user on a basis of the signal qualities and the sensitivities to the biological reaction indicated by information registered in the database.

13 . The signal processing apparatus according to claim 1 , wherein
the variation heterogeneity represents that at least one of a property or a degree of the variation of the biological signal is different.

14 . The signal processing apparatus according to claim 1 , further comprising:
a sensor control unit that controls stop of sensing of the biological signal of at least one of the modals for which the signal quality is estimated to be worse than a threshold.

15 . A signal processing method performed by a signal processing apparatus, comprising:
estimating signal qualities for respective modals each representing a type of a biological signal of a user; detecting at least one of the modals having variation heterogeneity representing that variation of the biological signal is different from a plurality of the modals, and estimating a sensitivity to biological reaction of the modal based on a detection result of the modal having the variation heterogeneity; and integrally estimating a state of the user on a basis of the signal qualities and the sensitivities to the biological reaction.

Assignees

• Sony Group Corp

Inventors

• Yoshikawa Kiyoshi
• Hyodo Yasuhide

Classifications

• A61B5/369

  Electroencephalography [EEG] · CPC title

• A61B5/165

  Evaluating the state of mind, e.g. depression, anxiety · CPC title

• A61B5/0533 Primary

  Measuring galvanic skin response · CPC title

• A61B5/372

  Analysis of electroencephalograms · CPC title

• A61B5/16

  Devices for psychotechnics (using teaching or educational appliances G09B1/00 - G09B7/00); Testing reaction times {; Devices for evaluating the psychological state} · CPC title