Learning progression for intelligence based music generation and creation

Patent metadata

Field	Value
Publication number	US-11257471-B2
Application number	US-202016872277-A
Country	US
Kind code	B2
Filing date	May 11, 2020
Priority date	May 11, 2020
Publication date	Feb 22, 2022
Grant date	Feb 22, 2022

Abstract

An artificial intelligence (AI) method includes generating a first musical interaction behavioral model. The first musical interaction behavioral model causes an interactive electronic device to perform a first set of musical operations and a first set of motional operations. The AI method further includes receiving user inputs received in response to the performance of the first set of musical operations and the first set of motional operations and determining a user learning progression level based on the user inputs. In response to determining that the user learning progression level is above a threshold, the AI method includes generating a second musical interaction behavioral model. The second musical interaction behavioral model causes the interactive electronic device to perform a second set of musical operations and a second set of motional operations. The AI method further includes performing the second set of musical operations and the second set of motional operations.

First claim

What is claimed is:

1. A method implemented by a computing system, the method comprising:
generating a first musical interaction behavioral model, wherein the first musical interaction behavioral model is configured to cause an interactive electronic device to perform a first set of musical operations and a first set of motional operations;
while performing the first set of musical operations and the first set of motional operations, receiving one or more user inputs in response to the performance of the first set of musical operations and the first set of motional operations;
determining a user learning progression level based at least in part on the one or more user inputs;
in response to determining that the user learning progression level is above a threshold, generating a second musical interaction behavioral model, wherein the second musical interaction behavioral model is configured to cause the interactive electronic device to perform a second set of musical operations and a second set of motional operations; and
performing the second set of musical operations and the second set of motional operations in accordance with the second musical interaction behavioral model.

2. The method of claim 1 , wherein performing the first set of musical operations and the first set of motional operations comprises performing a set of musical operations and a set of motional operations in accordance with a predetermined baseline user learning progression level.

3. The method of claim 1 , wherein the first set of musical operations comprises a set of musical conducting operations or a set of musical composing operations.

4. The method of claim 1 , wherein the first set of motional operations comprises a set of head motions, a set of body motions, or a combination thereof.

5. The method of claim 1 , wherein the one or more user inputs received in response to the performance comprises one or more of a visual user input, an audible user input, or a gesture user input.

6. The method of claim 1 , further comprising storing the one or more user inputs received in response to the performance as historical user interaction data over a period of time.

7. The method of claim 1 , wherein determining the user learning progression level comprises determining a user engagement level.

8. The method of claim 7 , wherein determining the user engagement level comprises determining an emotional response of a user while performing the first set of musical operations and the first set of motional operations.

9. The method of claim 1 , wherein the second musical interaction behavioral model is associated with a first user of a plurality of users, the method further comprising:
determining that a second user of the plurality of users is interacting with the interactive electronic device; and
generating a third musical interaction behavioral model associated with the second user, wherein the third musical interaction behavioral model is configured to cause the interactive electronic device to perform a third set of musical operations and a third set of motional operations.

10. The method of claim 1 , wherein performing the second set of musical operations and the second set of motional operations comprises performing a set of musical operations and a set of motional operations in accordance with an advanced user learning progression level.

11. A system comprising:
one or more non-transitory computer-readable storage media including instructions; and
one or more processors coupled to the storage media, the one or more processors configured to execute the instructions to:
generate a first musical interaction behavioral model, wherein the first musical interaction behavioral model is configured to cause an interactive electronic device to perform a first set of musical operations and a first set of motional operations;
while performing the first set of musical operations and the first set of physical operations, receive one or more user inputs in response to the performance of the first set of musical operations and the first set of motional operations;
determine a user learning progression level based at least in part on the one or more user inputs;
in response to determining that the user learning progression level is above a threshold, generate a second musical interaction behavioral model, wherein the second musical interaction behavioral model is configured to cause the interactive electronic device to perform a second set of musical operations and a second set of motional operations; and
perform the second set of musical operations and the second set of motional operations in accordance with the second musical interaction behavioral model.

12. The system of claim 11 , wherein the one or more processors are further configured to execute the instructions to perform a predetermined baseline set of musical operations and a predetermined baseline set of motional operations as the first set of musical operations and the first set of motional operations, respectively.

13. The system of claim 11 , wherein the one or more processors are further configured to execute the instructions to generate a set of musical conducting operations or a set of musical composing operations as the first set of musical operations.

14. The system of claim 11 , wherein the one or more processors are further configured to execute the instructions to generate a set of head motions, a set of body motions, or a combination thereof, as the first set of motional operations.

15. The system of claim 11 , wherein the one or more processors are further configured to execute the instructions to determine a user engagement level as the user learning progression level.

16. The system of claim 15 , wherein the one or more processors are further configured to execute the instructions to determine an emotional response of a user while performing the first set of musical operations and the first set of motional operations as the user engagement level.

17. The system of claim 11 , wherein the one or more processors are further configured to execute the instructions to:
in response to determining that the user learning progression level is below the threshold, generate a third musical interaction behavioral model, wherein the third musical interaction behavioral model is configured to cause the interactive electronic device to perform a third set of musical operations and a third set of motional operations.

18. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a computing system, cause the one or more processors to:
generate a first musical interaction behavioral model, wherein the first musical interaction behavioral model is configured to cause an interactive electronic device to perform a first set of musical operations and a first set of motional operations;
while performing the first set of musical operations and the first set of physical operations, receive one or more user inputs in response to the performance of the first set of musical operations and the first set of motional operations;
determine a user learning progression level based at least in part on the one or more user inputs; and
in response to determining that the user learning progression level is above a threshold, generate a second musical interaction behavioral model, wherein the second musical interaction behavioral model is configured to cause the interactive electronic device to perform a second set of musical operations and a second set of motional operations; and
perform the secon

Assignees

• Samsung Electronics Co Ltd

Inventors

• O'Brien Sean
• Wong Erick
• Wong Julia

Classifications

• G06N3/08

  Learning methods · CPC title

• G10H2220/201

  for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument · CPC title

• B25J11/0035

  Dancing, executing a choreography · CPC title

• G10H2210/031

  Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal · CPC title

• G10H2210/056

  for extraction or identification of individual instrumental parts, e.g. melody, chords, bass; Identification or separation of instrumental parts by their characteristic voices or timbres · CPC title