Method for playing virtual musical instrument and electronic device for supporting the same

Patent metadata

Field	Value
Publication number	US-9666173-B2
Application number	US-201615228615-A
Country	US
Kind code	B2
Filing date	Aug 4, 2016
Priority date	Aug 12, 2015
Publication date	May 30, 2017
Grant date	May 30, 2017

Abstract

An electronic device is provided. The electronic device includes a touch screen display, at least one of a speaker and a sound interface, a processor configured to electrically connect to the touch screen display, the speaker, and the sound interface, and a memory configured to electrically connect to the processor. The memory stores instructions for, when executed, causing the processor to display at least one item comprising a musical instrument shape on the touch screen display, receive a touch input through the touch screen display, load sound data corresponding to the at least one item based on the touch input, process the sound data based at least in part on information associated with the touch input, and output the processed sound data through the speaker or the sound interface.

First claim

What is claimed is:

1. An electronic device comprising:
a touch screen display;
at least one of a speaker or a sound interface;
at least one processor configured to electrically connect to the touch screen display, the speaker, and the sound interface; and
a memory configured to electrically connect to the at least one processor,
wherein the memory stores instructions for, when executed, causing the at least one processor to:
display at least one item comprising a musical instrument shape on the touch screen display,
receive a touch input through the touch screen display,
load sound data corresponding to the at least one item based on the touch input,
process the sound data based at least in part on information associated with the touch input, and
output the processed sound data through the speaker or the sound interface, and

wherein the memory is further configured to store instructions for, when executed, further causing the at least one processor to display a region corresponding to at least one sound of the item based at least in part on properties of a gesture, when the region receives an input.

2. The electronic device of claim 1 , wherein the information associated with the touch input comprises at least one of a location, a strength, a time, a direction, an area, a speed, or a pressure of the touch input.

3. The electronic device of claim 1 , wherein the instructions are configured to further cause the at least one processor to:
change the at least one displayed item based at least in part on the information associated with the touch input; and
display the at least one changed item on the touch screen display.

4. An electronic device comprising:
a display;
at least one of a speaker or a sound interface;
at least one processor configured to electrically connect to the display, the speaker, and the sound interface; and
a memory configured to electrically connect to the at least one processor,
wherein the memory stores instructions for, when executed, causing the at least one processor to:
obtain a gesture of a user of the electronic device through at least one sensor operatively connected with the electronic device,
output sound data corresponding to at least one musical instrument through an output device operatively connected with the electronic device, if the gesture is a gesture corresponding to at least one musical instrument, and
not output the sound data, if the gesture is not the gesture corresponding to the at least one musical instrument, and

wherein the instructions are configured to further cause the at least one processor to display a region corresponding to at least one sound of the item based at least in part on properties of the gesture, when the region receives an input.

5. The electronic device of claim 4 , wherein the at least one processor is further configured by the instructions to output the sound data while changing at least part of properties of the sound data based at least in part on properties of the gesture.

6. The electronic device of claim 4 , wherein the at least one processor is further configured by the instructions to:
display an item corresponding to the at least one musical instrument through another display operatively connected with the electronic device.

7. The electronic device of claim 6 ,
wherein the at least one musical instrument comprises a first musical instrument and a second musical instrument,
wherein the at least one sound comprises a first sound and a second sound,
wherein the gesture corresponds to the first musical instrument, and
wherein the at least one processor is further configured by the instructions to obtain another gesture and output the second sound, if the other gesture is a gesture corresponding to the second musical instrument.

8. The electronic device of claim 7 , wherein the second sound is output concurrently with at least part of the first sound.

9. The electronic device of claim 7 , wherein the at least one processor is further configured by the instructions to display a first item corresponding to the first musical instrument concurrently with a second item corresponding to the second musical instrument during at least part of a time.

10. The electronic device of claim 9 , further comprising:
a second display,
wherein the at least one processor is further configured by the instructions to display the first item through the display and display the second item through the second display.

11. A method for playing a virtual musical instrument in an electronic device including a memory for storing at least one sound data corresponding to at least one musical instrument, the method comprising:
obtaining a gesture of a user of the electronic device through at least one sensor operatively connected with the electronic device;
outputting the at least one sound data through an output device operatively connected with the electronic device, if the gesture is a gesture corresponding to the at least one musical instrument; and
not outputting the at least one sound data, if the gesture is not the gesture corresponding to the at least one musical instrument,
wherein the outputting comprises displaying a region corresponding to at least one sound of an item based at least in part on properties of a gesture, when the region receives an input.

12. The method of claim 11 , wherein the outputting of the sound data comprises outputting the sound data while changing at least part of properties of the sound data based at least in part on properties of the gesture.

13. The method of claim 11 , wherein the outputting of the sound data comprises displaying an item corresponding to the at least one musical instrument through a display operatively connected with the electronic device.

14. The method of claim 13 , wherein the not outputting of the sound data comprises performing another function or an application in response to the gesture.

15. The method of claim 14 ,
wherein the at least one musical instrument comprises a first musical instrument and a second musical instrument,
wherein the at least one sound comprises a first sound and a second sound, and
wherein the outputting of the sound data comprises:
outputting the first sound, if the gesture is the gesture corresponding to the first musical instrument, and
outputting the second sound, if the gesture is a gesture corresponding to the second musical instrument.

16. The method of claim 15 , further comprising:
obtaining another gesture; and
outputting the second sound, if the other gesture is the gesture corresponding to the second musical instrument,
wherein the gesture corresponds to the first musical instrument.

17. The method of claim 16 , wherein the second sound is output concurrently with at least part of the first sound.

18. The method of claim 16 , further comprising outputting a musical instrument corresponding to an external device connected with the electronic device.

19. The method of claim 18 , further comprising:
receiving another user gesture from the external device; and
outputting a musical instrument performance sound in response to the other user gesture received from the external device.

20. A non-transitory computer-readable recording medium storing thereon instructions executed by at least one processor to perform a method, the method comprising:
obtaining a gesture of a user of an electronic device through at least one sensor operatively connected with the electronic device, the electronic device including a memory for

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Jae Hak
• Park Doo Yong
• Lee Young Gyun
• Lee Young Dae
• Seo Eun Jung
• Hong Dong Guen
• Bang Lae Hyuk
• Lee Eun Yeung
• Lee Cheong Jae

Classifications

• G10H2220/096

  using a touch screen · CPC title

• G10H2220/106

  using icons, e.g. selecting, moving or linking icons, on-screen symbols, screen regions or segments representing musical elements or parameters · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G10H2230/015

  PDA [personal digital assistant] or palmtop computing devices used for musical purposes, e.g. portable music players, tablet computers, e-readers or smart phones in which mobile telephony functions need not be used · CPC title

• G10H2220/201

  for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument · CPC title