Amusement system

Patent metadata

Field	Value
Publication number	US-9601118-B2
Application number	US-201113877029-A
Country	US
Kind code	B2
Filing date	Oct 6, 2011
Priority date	Oct 20, 2010
Publication date	Mar 21, 2017
Grant date	Mar 21, 2017

Abstract

A technique for allowing a virtual experience of more realistic live performance. A main apparatus reproduces music data and audience video data recording a video image of audience. A user holds a microphone and makes a live performance for the audience displayed on a monitor. The microphone sends voice data and motion information of the microphone to the main apparatus. The main apparatus determines that the user makes a live performance when the user calls on the audience with a specific phrase and performs an action corresponding to the specific phrase. The main apparatus reproduces reaction data recording a video image and sound indicating a reaction of the audience to the live performance.

First claim

The invention claimed is:

1. An amusement system, comprising:
a main apparatus;
a voice input device held by a user, for outputting voice inputted by the user as voice data; and
a voice recognition device for performing a voice recognition process on the voice data, to thereby generate phrase information indicating a phrase that the user says, wherein
the voice input device includes
a first motion information output part for outputting first motion information indicating a motion of the voice input device, and

the main apparatus includes
a reproduction part for reproducing music data selected by the user and audience condition data recording at least one of a video image and sound which indicate the condition of an audience;
a performance specifying part for specifying a performance of the user on the basis of at least one of the phrase information and the first motion information; and
a reaction instruction part for determining a reaction level of the audience for the specified performance on the basis of a time difference between a timing when the phrase information is detected and a timing when the first motion information is detected, selecting reproduced reaction data corresponding to the specified performance and the determined reaction level out of a plurality of pieces of reaction data each indicating a reaction of the audience and instructing the reproduction part to reproduce the reproduced reaction data.

2. The amusement system according to claim 1 , wherein
the reaction instruction part determines a reproduction condition of the reproduced reaction data on the basis of the reaction level of the audience and instructs the reproduction part of the reproduction condition.

3. The amusement system according to claim 1 , wherein
the reproduction part reproduces the audience condition data corresponding to an audience group set by the user, and
the reaction instruction part determines the reaction level of the audience on the basis of the audience group.

4. The amusement system according to claim 1 , wherein
the performance specifying part determines that the user makes a performance for exciting the audience when the performance specifying part determines, on the basis of the phrase information, that the user calls on the audience with a specific phrase in a question form and determines, on the basis of the first motion information, that a direction of the voice input device is reversed, and
the reaction instruction part selects reaction data recording a video image and sound of the audience who answers the specific phrase in unison, as the reproduced reaction data.

5. The amusement system according to claim 1 , wherein
the performance specifying part determines that the user makes a performance for requesting the audience to sing along when the performance specifying part determines, on the basis of the phrase information, that the user calls on the audience with a specific phrase requesting the audience to sing along and determines, on the basis of the first motion information, that a direction of the voice input device is reversed, and
the reaction instruction part selects reaction data recording a video image and sound of the audience who sings along, as the reproduced reaction data.

6. The amusement system according to claim 1 , wherein
the performance specifying part determines that the user makes a performance for leading the audience to clap when the performance specifying part determines, on the basis of the motion information, that the user claps, and
the reaction instruction part selects reaction data recording a video image and sound of the audience who claps, as the reproduced reaction data.

7. The amusement system according to claim 1 , wherein
the performance specifying part determines that the user makes a performance for requesting the audience to wave both arms when the performance specifying part determines, on the basis of the motion information, that the user waves both arms, and
the reaction instruction part selects reaction data recording a video image and sound of the audience who waves both arms, as the reproduced reaction data.

8. The amusement system according to claim 1 , further comprising:
a controller held by the user in one hand, with the other hand holding the voice input device,
wherein the controller includes
a second motion information output part for outputting second motion information indicating a motion of the controller, and
the performance specifying part specifies a performance of the user on the basis of the second motion information.

9. The amusement system according to claim 1 , wherein
the reaction instruction part scores each of performances made in a first part of the music data on the basis of the reaction level of the audience for the performance, and scores each of performances made in a second part of the music data on the basis of the reaction level of the audience for the performance.

10. A voice input device used in the amusement system as defined in claim 1 .

11. An amusement system, comprising:
a main apparatus;
a voice input device held by a user, for outputting voice inputted by the user as voice data;
an image pickup device for picking up an image of the user to output video data; and
a voice recognition device for performing a voice recognition process on the voice data, to thereby generate phrase information indicating a phrase that the user says, wherein
the main apparatus includes
a reproduction part for reproducing music data selected by the user and audience condition data recording at least one of a video image and sound which indicate the condition of an audience;
a video analysis part for analyzing the video data to generate first motion information indicating a motion of the user;
a performance specifying part for specifying a performance of the user on the basis of at least one of the phrase information and the first motion information; and
a reaction instruction part for determining a reaction level of the audience for the specified performance on the basis of a time difference between a timing when the phrase information is detected and a timing when the first motion information is detected, selecting reproduced reaction data corresponding to the specified performance and the determined reaction level out of a plurality of pieces of reaction data each indicating a reaction of the audience and instructing the reproduction part to reproduce the reproduced reaction data.

12. The amusement system according to claim 11 , wherein
the reaction instruction part determines a reproduction condition of the reproduced reaction data on the basis of the reaction level of the audience and instructs the reproduction part of the reproduction condition.

13. The amusement system according to claim 11 , wherein
the reproduction part reproduces the audience condition data corresponding to an audience group set by the user, and
the reaction instruction part determines the reaction level of the audience on the basis of the audience group.

14. The amusement system according to claim 11 , wherein
the performance specifying part determines that the user makes a performance for exciting the audience when the performance specifying part determines, on the basis of the phrase information, that the user calls on the audience with a specific phrase in a question form and determines, on the basis of the first motion information, that a direction of the voice input device is reversed, and
the reaction instruction part selects reaction data recording a video image and sound of the audience who answers the specific phrase in unison,

Assignees

• Tanaka Motoyasu
• Megachips Corp

Inventors

• Tanaka Motoyasu

Classifications

• G10L15/26 Primary

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G10H1/0083

  using wireless transmission, e.g. radio, light, infrared · CPC title

• G10H1/368

  displaying animated or moving pictures synchronized with the music or audio part · CPC title

• A63F2300/6063

  for sound processing · CPC title

• G10H2210/091

  for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance · CPC title