Electronic device, wearable device, and method of providing content-based somatic senses using ultrasound

Patent metadata

Field	Value
Publication number	US-11149243-B2
Application number	US-201715647370-A
Country	US
Kind code	B2
Filing date	Jul 12, 2017
Priority date	Nov 14, 2016
Publication date	Oct 19, 2021
Grant date	Oct 19, 2021

Abstract

Provided is an electronic device for providing somatic senses based on content. The electronic device includes: a processor configured to generate an ultrasound driving signal for evoking somatic senses corresponding to somatosensory data by stimulating a certain region of the brain of a user; and a communication interface configured to transmit the generated ultrasound driving signal to an external device, wherein the somatosensory data corresponds to the content.

First claim

What is claimed is:

1. An electronic device for providing somatic senses based on content, the electronic device comprising:
a communication interface;
a user interface; and
a processor configured to:
generate an ultrasound driving signal for evoking somatic senses corresponding to somatosensory data by stimulating a certain region of the brain of a user,
control the communication interface to transmit the generated ultrasound driving signal to an external device, the somatosensory data corresponding to the content,
correct a timing to drive the ultrasound driving signal based on a delay time taken for sound pressure of an ultrasound wave of an ultrasound signal output by the ultrasound driving signal to stimulate the brain and a delay time taken for the user to recognize somatic sense evoked by simulating the brain
control the user interface to display a first item of a sense filtering and a second item of a sense augmentation setting,
based on a first input on the first item of the sense filtering being received, generate the ultrasound driving signal for evoking somatic senses in which a somatic sense corresponding to the first input is removed, and
based on a second input on the second item of the sense augmentation setting being received, generate the ultrasound driving signal for evoking somatic senses in which a somatic sense corresponding to the second input is augmented.

2. The electronic device of claim 1 , wherein the content comprises somatosensory elements, and
the somatosensory data comprises at least one of types of somatic senses, locations where the somatic senses are evoked, points in time when the somatic senses are evoked, intensities of the somatic senses, and frequencies of the somatic senses corresponding to the somatosensory elements, the somatosensory data being synchronized with the somatosensory elements of the content.

3. The electronic device of claim 1 , wherein the content comprises somatosensory elements, and
the processor is further configured to generate the somatosensory data by analyzing the somatosensory elements.

4. The electronic device of claim 1 , wherein the content comprises somatosensory elements,
the electronic device further comprises a user input interface configured to receive an input of generating the somatosensory data corresponding to the somatosensory elements, and
the processor is further configured to generate the somatosensory data based on the input received by the user input interface.

5. The electronic device of claim 1 , wherein the processor is further configured to generate the ultrasound driving signal based on the somatosensory data and content feature information indicating features of the content, the features comprising at least one of a content type, brightness of a screen to which the content is output, and volume of output audio of the content.

6. The electronic device of claim 1 , wherein the processor is further configured to generate the ultrasound driving signal based on the somatosensory data and user characteristic information indicating characteristics of the user, the characteristics comprising at least one of a threshold value regarding a certain stimulus to the user, a recognition time, preference for a certain somatic sense, and age of the user.

7. A wearable device for providing somatic senses based on content, the wearable device comprising:
an ultrasound transducer;
a user interface; and
a processor configured to:
obtain an ultrasound driving signal for evoking somatic senses corresponding to somatosensory data by stimulating a certain region of the brain of a user, and
control the ultrasound transducer to output an ultrasound signal based on the obtained ultrasound driving signal,
wherein the somatosensory data corresponds to the content,
wherein a timing to drive the ultrasound driving signal is corrected based on a delay time taken for sound pressure of an ultrasound wave of the ultrasound signal output by the ultrasound driving signal to stimulate the brain and a delay time taken for the user to recognize somatic sense evoked by stimulating the brain, and
wherein the processor is further configured to:
control the user interface to display a first item of a sense filtering and a second item of a sense augmentation setting,
based on a first input on the first item of the sense filtering being received, generate the ultrasound driving signal for evoking somatic senses in which a somatic sense corresponding to the first input is removed, and
based on a second input on the second item of the sense augmentation setting being received, generate the ultrasound driving signal for evoking somatic senses in which a somatic sense corresponding to the second input is augmented.

8. The wearable device of claim 7 , wherein the content comprises somatosensory elements, and
the somatosensory data comprises at least one of types of somatic senses, locations where the somatic senses are evoked, points in time when the somatic senses are evoked, intensities of the somatic senses, and frequencies of the somatic senses corresponding to the somatosensory elements, the somatosensory data being synchronized with the somatosensory elements of the content.

9. The wearable device of claim 7 , wherein the content comprises somatosensory elements, and
the processor is further configured to analyze the somatosensory elements and generate the somatosensory data.

10. The wearable device of claim 7 , wherein the processor is further configured to determine an initial mounting location of the wearable device and determine, based on the determined initial mounting location, whether a variation in a mounting location of the wearable device is greater than a certain threshold value, and
the wearable device further comprises an output interface configured to output at least one of a sound alarm and a visual alarm for guiding the wearable device to the mounting location of the wearable device when the variation is greater than the certain threshold value.

11. A method of providing somatic senses based on content, the method comprising:
generating an ultrasound driving signal for evoking somatic senses corresponding to somatosensory data by stimulating a certain region of the brain of a user;
transmitting the generated ultrasound driving signal to an external device, wherein the somatosensory data corresponds to the content;
correcting a timing to drive the ultrasound driving signal based on a delay time taken for sound pressure of an ultrasound wave of an ultrasound signal output by the ultrasound driving signal to stimulate the brain and a delay time taken for the user to recognize somatic sense evoked by stimulating the brain;
displaying a first item of a sense filtering and a second item of a sense augmentation setting;
based on a first input on the first item of the sense filtering being received, generating the ultrasound driving signal for evoking somatic senses in which a somatic sense corresponding to the first input is removed; and
based on a second input on the second item of the sense augmentation setting being received, generating the ultrasound driving signal for evoking somatic senses in which a somatic sense corresponding to the second input is augmented.

12. The method of claim 11 , wherein the content comprises somatosensory elements, and
the somatosensory data comprises at least one of types of somatic senses, locations where the somatic senses are evoked, points in time when the somatic senses are evoked, intensities of the somatic senses, and frequencies of the somatic senses corresponding to the somatosensory elements, the somatosensory data being synchronized with t

Assignees

• Samsung Electronics Co Ltd

Inventors

• Jeon Seung-Ryong
• Kim Ki-Hyun
• Kim Taek-Soo
• Lee Eun-Jung
• Jang Gyeong-Cheol

Classifications

• H04M1/72403 Primary

  with means for local support of applications that increase the functionality · CPC title

• C12M1/02

  with agitation means; with heat exchange means · CPC title

• C12M3/00

  Tissue, human, animal or plant cell, or virus culture apparatus · CPC title

• C12M1/00

  Apparatus for enzymology or microbiology · CPC title

• C12M23/58 Primary

  Reaction vessels connected in series or in parallel (combinations of bioreactors with other apparatus, C12M43/00) · CPC title