Method of competition scoring, non-transitory computer readable recording medium, and competition scoring apparatus

Patent metadata

Field	Value
Publication number	US-12582894-B2
Application number	US-202217582084-A
Country	US
Kind code	B2
Filing date	Jan 24, 2022
Priority date	Jul 29, 2019
Publication date	Mar 24, 2026
Grant date	Mar 24, 2026

Abstract

A display method for outputting a result of scoring for a performance of a scoring competition, the display method includes obtaining input information regarding to the scoring competition, obtaining a recognition result of a plurality of elements included in the performance, determining a difficulty level of each of the plurality of elements based on the recognition result and a first rule, limiting a target to be used for the scoring to a part of the plurality of elements according to the difficulty level of each of the plurality of elements, and outputting a scoring screen that includes a first display area displaying the plurality of elements and the difficulty level, a second display area for an aggregate result, third display area for a score of the performance directed to the limited part of the elements, and a fourth display area for a 3D model of the athlete.

First claim

What is claimed is:

1 . A display method for outputting a result of scoring for a performance of a scoring competition, the display method comprising:
obtaining sensing data comprising time-series three-dimensional coordinates of a plurality of joints of an athlete; generating skeletal motion data from the time-series three-dimensional coordinates; obtaining input information including an event, gender, and class classification of the scoring competition; determining a first rule among the plurality of types of scoring rules based on the input information; identifying a plurality of elements included in the performance by comparing the generated skeletal motion data with a plurality of pre-defined element motion patterns; applying the first rule to the identified plurality of elements to determine a final difficulty level for each of the plurality of elements by determining an upgrade or a downgrade of difficulty level; selecting a part of the plurality of elements to be used for the scoring in descending order of the final difficulty level; calculating a score of the performance based on the selected part of the elements; generating an interactive scoring screen that includes a first display area, a second display area, a third display area, and a fourth display area, the first display area displaying the identified plurality of elements and the final difficulty level of each of the elements in chronological order and highlighting the selected part of the plurality of elements in different style from other elements, the second display area being an area for an aggregate result of a number of elements of each difficulty level for the selected part of the elements, the third display area being an area for a score of the performance directed to the selected part of the elements, the fourth display area being area for a 3D model of the athlete generated on the basis of the sensing data; and in response to a user selection of an element in the first display area or a position on a timeline of the performance, cause the fourth display area to play back the 3D model corresponding to the user selected element or position on the timeline.

2 . The display method according to claim 1 , further comprising:
calculating the score of the performance based on the final difficulty level of the target element to be used for the scoring.

3 . The display method according to claim 2 , wherein
the calculating includes calculating, when a combination of predetermined elements is included based on the recognition result and the first rule, the score of the performance by adding a score corresponding to the combination.

4 . The display method according to claim 3 , comprising:
performing, when a plurality of identical elements is included based on the recognition result and the first rule, a process, wherein the process includes: setting one element among the plurality of identical elements as the target to be used for the scoring, and excluding other identical elements from the target to be used for the scoring.

5 . The display method according to claim 1 , wherein
in the first display area, the final difficulty level of the target element to be used for the scoring in a manner of being emphasized more than display of a difficulty level of an element other than the target element to be used for the scoring.

6 . The display method according to claim 1 , wherein
the selecting includes limiting, when the first rule is determined based on the input information including a senior as the class classification, top N elements at a highest difficulty level among the plurality of elements, and the selecting includes limiting, when the first rule is determined based on the input information including a junior as the class classification, top M (M is smaller than N) elements at the highest difficulty level among the plurality of elements.

7 . The display method according to claim 1 , wherein
the determining includes classifying, when the first rule is determined based on the input information including a female as the gender, the element of the determined difficulty level into an acrobatics-type element and a dance-type element, and the outputting includes outputting a number of the acrobatics-type elements and a number of the dance-type elements among the number of elements of each difficulty level for the selected part of the elements for the second display area.

8 . The display method according to claim 7 , wherein
the first screen area displays, in a case of displaying the plurality of elements and the difficulty level of each of the elements for the first display area, the plurality of elements and the difficulty level by distinguishing a color of a difficulty level of the acrobatics-type element and a color of a difficulty level of the dance-type element.

9 . The display method according to claim 1 , wherein
an element that is included in the plurality of elements included in the recognition result is associated with time information, and outputting, when selection of any of the plurality of elements displayed in the first display area is received, the 3D model of the athlete corresponding to time of the selected element in the fourth display area.

10 . The display method according to claim 1 ,
the fourth display area fixed in a case where the event of the scoring competition included in the input information is any event of rings, pommel horse, horizontal bar, and uneven parallel bars, and displays the space to be displayed in the fourth display area in synchronization with a position of the 3D model when the event of the scoring competition included in the input information is any event of vault, balance beam, parallel bars, and floor.

11 . The display method according to claim 1 , further comprising:
displaying, when selection of a difficulty level is received, an element corresponding to the difficulty level for which the selection is received in the first display area.

12 . The display method according to claim 1 , wherein
when an instruction for display switching is received, screen information of the interactive scoring screen includes the 3D model and a reference plane superimposed.

13 . The display method according to claim 1 , further comprising:
storing, when an instruction to confirm a scoring result is received from a user, the sensing data and information displayed in each of the first display area, the second display area, and the third display area.

14 . A non-transitory computer-readable storage medium storing a display program that causes a processor included in an information processing apparatus that outputs a result of scoring for a performance of a scoring competition to execute a process, the process comprising:
obtaining sensing data comprising time-series three-dimensional coordinates of a plurality of joints of an athlete; generating skeletal motion data from the time-series three-dimensional coordinates; obtaining input information including an event, gender, and class classification of the scoring competition; determining a first rule among the plurality of types of scoring rules based on the input information; identifying a plurality of elements included in the performance by comparing the generated skeletal motion data with a plurality of pre-defined element motion patterns; applying the first rule to the identified plurality of elements to determine a final difficulty level for each of the plurality of elements by determining an upgrade or a downgrade of difficulty level; selecting a part of the plurality of elements to be used for the scoring in descending

Assignees

• Fujitsu Ltd

Inventors

• Naito Hirohisa
• Ozaki Junko

Classifications

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• A63B2244/22

  Dancing · CPC title

• A63B2244/12

  Acrobats · CPC title

• A63B7/02

  Swinging rings; Trapezes · CPC title

• A63B5/12

  Bolster vaulting apparatus, e.g. horses, bucks, tables · CPC title