Skill evaluation device, skill evaluation method, and storage medium

Patent metadata

Field	Value
Publication number	US-11776419-B2
Application number	US-202017013834-A
Country	US
Kind code	B2
Filing date	Sep 7, 2020
Priority date	Oct 29, 2019
Publication date	Oct 3, 2023
Grant date	Oct 3, 2023

Abstract

The disclosure provides a skill evaluation device, a skill evaluation method, and a storage medium capable of appropriately evaluating the skill of an operator by changing a time range for evaluating the skill of the operator. The skill evaluation device includes an acquisition part, an extraction part, a calculation part, and an output part. The acquisition part acquires time range information indicating an arbitrary time range. The extraction part extracts data of a specific time range determined based on the time range information from operation status data indicating an operation status of the operator in a time series. The calculation part calculates an index value of the skill of the operator for one or more evaluation items based on the data of the specific time range. The output part outputs index information indicating the index value.

First claim

What is claimed is:

1. A skill evaluation device comprising:
a display device;
an image capturing device, capturing a moving image recording a series of motions in time for producing a product or a component; and
a processor, coupled to the display device and configured to:
display, on the display device, a graphical interface including a first input field for inputting an arbitrary time range, a second input field for inputting a first evaluation unit among a plurality of evaluation units as an evaluation unit information;
acquire the arbitrary time range and the first evaluation unit input through the graphical interface, wherein the evaluation units further include a second evaluation unit different from the first evaluation unit;

generating operation status data by executing motion analysis process that analyzes the moving image to obtain coordinate values in the moving image that indicates operations of an operator, wherein, in the motion analysis process, the series of motions captured by the image capturing device are classified into a plurality of operation statuses with a plurality of time stamps associated to the plurality of motions by using the coordinate values obtained from the moving image, wherein the plurality of operation statuses include a first operation status associated with the first evaluation unit and a second operation status associated with the second evaluation unit, and wherein the first operation status is determined to have a first time range based on the coordinate value associated with the first operation status in the moving image, and the second operation status is determined to have a second time range based on coordinate value associated with the second operation status in the moving image;
determine a specific time range which is different from and partially overlapping with the arbitrary time range based on the time range information and the evaluation unit information by extracting the first time range associated with the first evaluation unit and excluding the second time range associated with the second evaluation unit from the arbitrary time range based on the time stamps corresponding to the first and second operation statuses, wherein the specific time range is only associated with the first evaluation unit corresponding to the time stamp of the first operation status in the moving image, and the arbitrary time range is associated with the first evaluation unit and the second evaluation unit and includes the time stamp corresponding to the first operation status and the time stamp corresponding to the second operation status;
extract data within the specific time range from the operation status data, wherein the data within the specific time range includes the first operation status associated with the first evaluation unit and a third operation status different from the first operation status and the second operation status, wherein the first and third operation statuses are only associated to the first evaluation unit;
calculate an index value of skill of the operator for one or more evaluation items based on the data within the specific time range;
output index information indicating the index value; and
display a chart illustrating each of the one or more evaluation items and the corresponding index value based on the index information.

2. The skill evaluation device according to claim 1 , wherein the third operation statues corresponds to a third time range that is associated with the evaluation unit within a predetermined period adjacent to the arbitrary time range.

3. The skill evaluation device according to claim 1 , wherein the graphical interface further includes a section displaying the operation status data corresponding to an entire time range of the moving image.

4. The skill evaluation device according to claim 3 , wherein the graphical interface further displays the operation status data for each of a right hand and a left hand of the operator.

5. A skill evaluation method comprising:
capturing a moving image recording a series of motions in time for producing a product or a component;
displaying, on a display device, a graphical interface including a first input field for inputting an arbitrary time range, a second input field for inputting a first evaluation unit among a plurality of evaluation units as an evaluation unit information;
acquiring the arbitrary time range and the first evaluation unit input though the graphical interface, wherein the evaluation units further include a second evaluation unit different from the first evaluation unit;
generating operation status data by executing motion analysis process that analyzes the moving image to obtain coordinate values in the moving image that indicates operations of an operator, wherein, in the motion analysis process, the series of motions captured by the image capturing device are classified into a plurality of operation statuses with a plurality of time stamps associated to the plurality of motions by using the coordinate values obtained from the moving image, wherein the plurality of operation statuses include a first operation status associated with the first evaluation unit and a second operation status associated with the second evaluation unit, and wherein the first operation status is determined to have a first time range based on the coordinate value associated with the first operation status in the moving image, and the second operation status is determined to have a second time range based on coordinate value associated with the second operation status in the moving image;
determining a specific time range which is different from and partially overlapping with the arbitrary time range based on the time range information and the evaluation unit information by extracting the first time range associated with the first evaluation unit and excluding the second time range associated with the second evaluation unit from the arbitrary time range based on the time stamps corresponding to the first and second operation statuses, wherein the specific time range is only associated with the first evaluation unit corresponding to the time stamp of the first operation status in the moving image, and the arbitrary time range is associated with the first evaluation unit and the second evaluation unit and includes the time stamp corresponding to the first operation status and the time stamp corresponding to the second operation status;
extracting data within the specific time range from the operation status data, wherein data within the specific time range includes the first operation status associated with the first evaluation unit and a third operation status different from the first operation status and the second operation status, wherein the first and third operation statuses are only associated to the first evaluation unit;
calculating an index value of a skill of the operator for one or more evaluation items based on the data of the specific time range;
outputting index information indicating the index value; and
displaying a chart illustrating each within the one or more evaluation items and the corresponding index value based on the index information.

6. A non-transitory computer readable storage medium, storing a skill evaluation program, causing a computer provided in a skill evaluation device, comprising:
acquiring a moving image captured by an image capturing device, the moving image recording a series of motions in time for producing a product or a component;
displaying, on a display device, a graphical interface including a first input field for inputting an arbitrary time range, a second input field for inputting a first evaluation unit among a plurality of evaluation units as an evaluation unit information;
acquiring the arbitrary time range the first evaluat

Assignees

• Omron Tateisi Electronics Co

Inventors

• Wada Hirotaka
• Nakajima Hiroshi
• Wang Danni

Classifications

• G09B19/00 Primary

  Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26) · CPC title

• G06Q10/06398 Primary

  Performance of employee with respect to a job function · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06V40/20 Primary

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06F18/24

  Classification techniques · CPC title