Electronic apparatus and imaging system

Patent metadata

Field	Value
Publication number	US-12401882-B2
Application number	US-202017440334-A
Country	US
Kind code	B2
Filing date	Feb 20, 2020
Priority date	Mar 29, 2019
Publication date	Aug 26, 2025
Grant date	Aug 26, 2025

Abstract

An electronic apparatus according to an embodiment of the disclosure includes: an imaging section that acquires imaging data; a data generator that generates emotion data on a basis of acquisition data; a data processor that associates the imaging data and the emotion data with each other in chronological order; and a controller that causes a setting of the imaging section to be changed in chronological order on a basis of the emotion data.

First claim

The invention claimed is:

1. An electronic apparatus comprising:
a storage that stores a delay time;
imaging circuitry configured to receive incident light and generate imaging data based on the incident light that is received;
an electronic processor configured to
generate emotion data on a basis of acquisition data, and
temporally synchronize the imaging data and the emotion data with each other to generate synchronized emotion data by temporally synchronizing the imaging data acquired at a first time point and the emotion data acquired at a second time point with each other, the second time point being later than the first time point by the delay time; and

a controller configured to control one or more imaging parameters of the imaging circuitry on a basis of the synchronized emotion data.

2. The electronic apparatus according to claim 1 , wherein the acquisition data includes measurement data related to at least one of a pulse, a heart rate, an electrocardiogram, an electromyography, a respiration, a perspiration, a GSR, a blood pressure, a degree of blood oxygen saturation, a skin surface temperature, an electroencephalogram, a blood flow change, a body temperature, a motion of a body, a motion of a head, a center of gravity, a rhythm of walking or running, an eye condition, or a surrounding sound.

3. The electronic apparatus according to claim 1 , wherein the controller is further configured to
perform an evaluation on the imaging data on the basis of the synchronized emotion data, and
control the imaging circuitry on a basis of a result of the evaluation.

4. An electronic apparatus comprising:
imaging circuitry configured to receive incident light and generate imaging data based on the incident light that is received;
an electronic processor configured to
generate emotion data on a basis of acquisition data, and
temporally synchronize the imaging data and the emotion data with each other to

generate synchronized emotion data; and

a controller configured to control the imaging circuitry on a basis of the synchronized emotion data,
wherein the controller is further configured to
calculate intensity data of at least pleasure/discomfort or activeness/inactiveness on the basis of the synchronized emotion data, and
control the imaging circuitry on a basis of the intensity data obtained by the calculation.

5. The electronic apparatus according to claim 1 ,
wherein the one or more imaging parameters is one or more of a resolution, a frame rate, a bit length, an effect, an active pixel region in the imaging circuitry, or a combination thereof.

6. The electronic apparatus according to claim 1 , wherein the controller is further configured to set the imaging circuitry to one of a standby state and an imaging state on the basis of the synchronized emotion data.

7. The electronic apparatus according to claim 1 , further comprising:
a storage that stores the imaging data, wherein
the controller is further configured to
determine whether storing of the imaging data is necessary on the basis of the synchronized emotion data, and
control the storage to store the imaging data on a basis of the determination.

8. The electronic apparatus according to claim 1 , further comprising:
a storage that stores the imaging data, wherein
the controller is further configured to
control the storage to store the imaging data, and
perform data deletion or overwriting with the imaging data to be newly stored, on the imaging data stored in the storage for a portion in which a period being stored in the storage exceeds a predetermined period.

9. The electronic apparatus according to claim 1 , wherein the controller is further configured to
detect an amount and a direction of camera shake of a camera in the imaging data,
determine a cut-out region in the imaging data in accordance with the amount and the direction of the camera shake that have been detected, and
generate, on a basis of the determination, corrected imaging data in which the camera shake has been corrected.

10. The electronic apparatus according to claim 1 , further comprising:
an attachment part configured to attach the electronic apparatus to a body.

11. The electronic apparatus according to claim 1 , wherein
the imaging circuitry includes a plurality of imaging elements in which respective directions of optical axes are different from each other and which acquire respective pieces of specific-direction imaging data, and
the electronic processor is further configured to temporally synchronize, as the imaging data, the pieces of specific-direction imaging data obtained by the plurality of imaging elements with the emotion data.

12. The electronic apparatus according to claim 1 , further comprising:
a wide angle lens, or
a fisheye lens,
wherein the incident light passes through the wide angle lens or the fisheye lens.

13. The electronic apparatus according to claim 1 , further comprising:
a storage that stores reference data related to a subject, wherein
the controller is further configured to control the imaging circuitry on a basis of a matching result between the reference data and the imaging data.

14. The electronic apparatus according to claim 13 , wherein the control of the imaging circuitry is performed on at least one of resolution, a frame rate, a bit length, an effect, or an active pixel region in the imaging circuitry.

15. The electronic apparatus according to claim 1 , further comprising:
a storage that stores reference data related to an emotion, wherein
the controller is further configured to control the imaging circuitry on a basis of the reference data and the synchronized emotion data.

16. An imaging system comprising:
a storage that stores a delay time;
imaging circuitry configured to receive incident light and generate imaging data based on the incident light that is received;
an electronic processor configured to
generate emotion data on a basis of acquisition data, and
temporally synchronize the imaging data and the emotion data with each other to generate synchronized emotion data by temporally synchronizing the imaging data acquired at a first time point and the emotion data acquired at a second time point with each other, the second time point being later than the first time point by the delay time; and

a controller configured to control one or more imaging parameters of the imaging circuitry on a basis of the synchronized emotion data.

17. The imaging system according to claim 16 , further comprising:
a storage that stores reference data related to a subject, wherein
the controller is further configured to control the imaging circuitry on a basis of a matching result between the reference data and the imaging data.

18. The imaging system according to claim 16 , wherein the acquisition data includes measurement data related to at least one of a pulse, a heart rate, an electrocardiogram, an electromyography, a respiration, a perspiration, a GSR, a blood pressure, a degree of blood oxygen saturation, a skin surface temperature, an electroencephalogram, a blood flow change, a body temperature, a motion of a body, a motion of a head, a center of gravity, a rhythm of walking or running, an eye condition, or a surrounding sound.

19. The imaging system according to claim 16 , wherein the controller is further configured to
perform an evaluation on the imaging data on the basis of the synchronized emotion data, and
control the imaging circuitry on a basis of a result of the evaluation.

Assignees

• Sony Group Corp

Inventors

• Tadano Ryuichi
• Komoriya Yoto

Classifications

• H04N23/6811

  based on the image signal · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/683

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• H04N23/633

  for displaying additional information relating to control or operation of the camera · CPC title