Data structure for computer graphics, information processing device, information processing method and information processing system

Patent metadata

Field	Value
Publication number	US-10410392-B2
Application number	US-201615545512-A
Country	US
Kind code	B2
Filing date	Jan 29, 2016
Priority date	Jan 30, 2015
Publication date	Sep 10, 2019
Grant date	Sep 10, 2019

Abstract

The present invention is designed to allow easy synchronization of the movement of a computer graphics (CG) model with sound data. The data structure according to an embodiment of the present invention presents a data structure that relates to a computer graphics (CG) model, including first time-series information for designating the coordinates of the components of the CG model on a per beat basis, and the first time-series information is used on a computer to process the CG model.

First claim

The invention claimed is:

1. A non-transitory computer-readable storage medium stored thereon a computer program to process a computer graphics (CG) model using a data structure, the computer program, when executed causes a processor to perform the following:
acquiring data that contains first time-series information for designating coordinates of components of a computer graphics (CG) model, in chronological order, on a per beat basis, and that conforms to SMF (Standard MIDI File) format; and
processing the CG model based on the first time-series information and displaying the processed CG model onto a display circuit,
wherein the CG model is constituted by a skeleton, which is comprised of two joint points and bones connecting between these,
wherein, with respect to the coordinates of the components of the CG model, the first time-series information includes information related to a speed system, and
wherein the speed system-related information is an offset based on an average value of temporally neighboring data included in the first time-series information.

2. The non-transitory computer-readable storage medium according to claim 1 , wherein a channel of the SMF format corresponds to one or a plurality of pieces of the first time-series information.

3. The non-transitory computer-readable storage medium according to claim 1 , wherein a note number and a velocity of a note-on signal in the SMF format are used by the processor as information about the coordinates of the components of the CG model.

4. The non-transitory computer-readable storage medium according to claim 1 , wherein a delta time in the SMF format is used by the processor as information about a duration of a beat where coordinates of a component of the CG model change.

5. The non-transitory computer-readable storage medium according to claim 1 , wherein the first time-series information includes information about a relative angle of a bone of the CG model.

6. The non-transitory computer-readable storage medium according to claim 1 , wherein the first time-series information includes information about a relative distance from at least one of an initial position of the CG model and information about a rotation angle of a reference point of the CG model.

7. The non-transitory computer-readable storage medium according to claim 1 , wherein a velocity of a note-off signal in the SMF format is used by the processor as the speed system-related information.

8. The non-transitory computer-readable storage medium according to claim 1 , wherein the computer program, when executed causes the processor to further perform the following:
converting the first time-series information into second time-series information for designating the coordinates of the components of the CG model, in chronological order, on a per frame basis; and
processing the CG model based on the second time-series information.

9. The non-transitory computer-readable storage medium according to claim 1 , further comprising information for setting a tempo.

10. A display device comprising:
an acquisition circuit that acquires data that contains first time-series information for designating coordinates of components of a computer graphics (CG) model, in chronological order, on a per beat basis, and that conforms to SMF (Standard MIDI File) format; and
a display circuit that displays the CG model based on the first time-series information,
wherein the CG model is constituted by a skeleton, which is comprised of two joint points and bones connecting between these,
wherein, with respect to the coordinates of the components of the CG model, the first time-series information includes information related to a speed system, and
wherein the speed system-related information is an offset based on an average value of temporally neighboring data included in the first time-series information.

11. The display device according to claim 10 , wherein the display circuit displays the CG model based on a result of applying an exponential moving average to the first time-series information.

12. The display device according to claim 10 , further comprising a playback circuit that plays given data,
wherein the display circuit displays the CG model in synchronization with the given data played by the playback circuit.

13. The display device according to claim 12 , wherein the display circuit displays the CG model so that a maximum speed at which the coordinates of each component transition is equal to when the CG model is displayed at a tempo related to the data containing the first time-series information.

14. An information processing method for a computer graphics (CG) model, the method comprising:
acquiring data that contains first time-series information for designating coordinates of components of a computer graphics (CG) model, in chronological order, on a per beat basis, and that conforms to SMF (Standard MIDI File) format; and
processing the CG model based on the first time-series information and displaying the processed CG model onto a display circuit,
wherein the CG model is constituted by a skeleton, which is comprised of two joint points and bones connecting between these,
wherein, with respect to the coordinates of the components of the CG model, the first time-series information includes information related to a speed system, and
wherein the speed system-related information is an offset based on an average value of temporally neighboring data included in the first time-series information.

Assignees

• Dentsu Inc

Inventors

• Kishi Yuki
• Higa Yasuo
• Iijima Akio
• Tatara Tatsuki

Classifications

• G10H2240/056

  MIDI or other note-oriented file format · CPC title

• G10H2220/455

  Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data · CPC title

• G10H2210/091

  for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance · CPC title

• G10H1/368

  displaying animated or moving pictures synchronized with the music or audio part · CPC title

• G10H1/0058

  Transmission between separate instruments or between individual components of a musical system (G10H1/0083 takes precedence) · CPC title