Content creation system

Patent metadata

Field	Value
Publication number	US-12051340-B2
Application number	US-201816626014-A
Country	US
Kind code	B2
Filing date	Aug 24, 2018
Priority date	Jun 29, 2018
Publication date	Jul 30, 2024
Grant date	Jul 30, 2024

Abstract

The content creation system comprises: an operation measurement device 1 that acquires, as measurement information, a three-dimensional work operation of a model worker R 1 that performs the work of the work procedure; an evaluation criterion creation device 2 that creates evaluation criterion information on the work of the work procedure, based on the measurement information of the three-dimensional work operation; and a content creation device 3 that creates and updates the training content, based on the measurement information of the three-dimensional work operation, the evaluation criterion information and the three-dimensional shape information of the work target device. The work management server 2 creates the evaluation criterion information, based on distance information of the three-dimensional work operation with respect to the three-dimensional shape in specific stage of the work procedure, on the condition that a predetermined body motion of the model worker R 1 is detected.

First claim

The invention claimed is:

1. A content creation system that creates training content to be presented to a trainee based on a three-dimensional shape of a work target device and a work procedure to have executed a simulated work of virtual reality or augmented reality, the content creation system comprising:
a measurement information collection terminal having installed therein sensors to acquire measurement information including sound information and video information on a three-dimensional work operation of a model worker during the simulated work of the work procedure, wherein the work procedure comprises a plurality of stages;
a control unit having stored in a memory a plurality of control programs functioning as an evaluation criterion creation device that creates evaluation criterion information on the simulated work of the work procedure, based on the measurement information of the three-dimensional work operation of the model worker from the measurement information collection terminal; and
a content creation device that creates and updates the training content, based on the measurement information of the three-dimensional work operation of the model worker, the evaluation criterion information and three-dimensional shape information of the work target device,
wherein the evaluation criterion creation device detects a predetermined body motion of the model worker accompanying words and voices as a signal for entering a specific stage of the work procedure in which a know-how and method for avoiding risk possessed by the model worker appear,
wherein upon detection of the predetermined body motion of the model worker to preset a required work time of the three-dimensional work operation the evaluation criterion creation device further detects a variation in voice information or video information or a variation in three-dimensional measurement information in the specific stage of the work procedure,
wherein the evaluation criterion creation device creates the evaluation criterion information for each equally divided time during the required work time of the three-dimensional work operation in the specific stage of the work procedure based on the three-dimensional work operation of the model worker in the specific stage of the work procedure accompanying the variation in voice information or video information or the variation in three-dimensional measurement information in the specific stage of the work procedure, upon detection of the predetermined body motion of the model worker,
wherein the evaluation criterion creation device monitors the three-dimensional work operation of the model worker in the specific stage as measurement information including a three-dimensional variation of a specific portion of interest of the model worker and time,
wherein the evaluation criterion creation device updates the evaluation criterion information on the simulated work in the specific stage so as to evaluate the simulated work of the trainee in the specific stage of the work procedure by the evaluation criterion information updated when the predetermined body motion of the model worker is detected, and
wherein the model worker and the trainee are different persons.

2. A content presentation system that presents training content based on three-dimensional shape of a work target device and a work procedure to a trainee, and has executed a simulated work in accordance with the work procedure in a simulated work space of virtual reality or augmented reality, the content presentation system comprising:
a wearable terminal having stored in a memory a plurality of input and output programs functioning as content input sensors that input the training content including sound information, video information and three-dimensional shape information, and a content output device that outputs a signal of the training content to be transmitted and the training content to be presentable to the trainee;
a control unit having stored in a memory a plurality of control programs functioning as an evaluation criterion creation device that acquires a three-dimensional work operation of the simulated work of a model worker as measurement information including sound information and video information during the simulated work of the work procedure, the work procedure comprising a plurality of stages, and detects a predetermined body motion of the model worker accompanying words and voices as a signal for entering a specific stage of the work procedure in which a know-how and method for avoiding risk possessed by the model worker appear, and further detects a variation in voice information or video information or a variation in three-dimensional measurement information upon detection of the predetermined body motion of the model worker to preset a required work time of the three-dimensional work operation, and creates evaluation criterion information for each equally divided time during the required work time of the three-dimensional work operation in the specific stage of the work procedure based on the three-dimensional work operation of the simulated work of the model worker in the specific stage of the work procedure accompanying the variation in voice information or video information or the variation in three-dimensional measurement information of the three-dimensional work operation of the simulated work of the model worker with respect to the three-dimensional shape in the specific stage of the work procedure, the control unit having stored in an additional memory a plurality of additional control programs functioning as a content creation device that creates and updates the training content, based on the measurement information of the three-dimensional work operation of the simulated work of the model worker, the evaluation criterion information and three-dimensional shape information of the work target device; and
a training support server having a plurality of support programs stored therein and functioning as a work evaluation device that acquires the three-dimensional work operation in the simulated work of the trainee as measurement information based on the signal of the training content transmitted from the wearable terminal, evaluates the three-dimensional work operation of the trainee in the specific stage of the simulated work based on the evaluation criterion information, and outputs a result of the evaluation,
wherein the evaluation criterion creation device monitors the model three-dimensional work operation of the simulated work of the model worker in the specific stage as measurement information including a three-dimensional variation of a specific portion of interest of the model worker and time,
wherein the evaluation criterion creation device updates the evaluation criterion information on the simulated work in the specific stage so as to evaluate the simulated work of the trainee in the specific stage of the work procedure by the evaluation criterion information updated when the predetermined body motion of the model worker is detected, and
wherein the model worker and the trainee are different persons.

3. The content creation system according to claim 1 , wherein the measurement information collection terminal is composed of a wearable information terminal capable of presenting information to a worker who performs simulated maintenance work on a predetermined system or device to be maintained and managed.

4. The content creation system according to claim 3 , wherein the wearable information terminal is a head mount display, and the predetermined body motion of the model worker includes a variation in line of sight of the model worker.

5. The content creation system according to claim 1 , wherein the sensors comprise at least one of a three-dimensional camera, a motion sensor, a biometric sensor and a microphone.

Assignees

• Hitachi Systems Ltd

Inventors

• Fujiwara Takayuki
• Tsuchiya Shintaro
• Oonishi Kentarou
• Kikuchi Katsuro
• Narita Yoshihito

Classifications

• G09B19/24

  Use of tools · CPC title

• G09B19/003

  Repetitive work cycles; Sequence of movements · CPC title

• G06Q10/067 Primary

  Enterprise or organisation modelling · CPC title

• G09B7/04

  characterised by modifying the teaching program in response to a wrong answer, e.g. repeating the question or supplying a further explanation · CPC title

• G09B5/14

  with provision for individual teacher-student communication · CPC title