Motion learning support apparatus

Patent metadata

Field	Value
Publication number	US-10360814-B2
Application number	US-201315104385-A
Country	US
Kind code	B2
Filing date	Dec 26, 2013
Priority date	Dec 26, 2013
Publication date	Jul 23, 2019
Grant date	Jul 23, 2019

Abstract

A motion learning support apparatus displays a teaching-aid video segment and a segment of practice video of a learner alternately on a monitor, the practice video being of the learner who is imitating a motion of the teaching-aid video segment and being taken with an imaging unit. The motion learning support apparatus includes: motion detection unit to detect a motion of the learner and a motion information acquisition unit; an evaluation unit to evaluate similarity of a motion of the learner to a motion in the teaching-aid video segment; and first learning support processing unit to, when the evaluation unit evaluates that the motions are similar, switch the monitor from video taken with the imaging unit to a following teaching-aid video segment. Thereby, vividness of an image due to the illusion effect induced to the learner can be improved, and so the learning effect can be improved for supporting.

First claim

The invention claimed is:

1. A motion learning support apparatus for laparoscopic surgery training, comprising:
a dry box that imitates a patient's body;
a base on which the dry box is placed;
a motion detection unit;
a monitor that displays an image; and
an information processing device,
wherein the dry box comprises:
a tubular body imitating an abdomen of the patient's body;
a laparoscopic camera; and
a forceps,
wherein, on the upper surface of the tubular body, a plurality of circular holes are provided on membranes having cross-shaped cuttings for inserting and removing the forceps and the laparoscopic camera;
wherein the laparoscopic camera is fixed to the dry box and captures movement of a tip of the forceps of a model person and a learner for suturing;
wherein the motion detection unit comprises:
a magnetic generator attached to the base; and
magnetic sensors attached in three axial directions at predetermined positions of the forceps;
wherein the motion detection unit detects motion information including a position, orientation, and displacement speed of the tip of the forceps;
wherein the information processing device comprises:
an operation unit;
a RAM;
a ROM; and
a control unit;
wherein the operation unit accepts instructions including teaching-aid display mode switching input by the learner;
wherein the RAM comprises:
a learning-by-following teaching-aid storage unit for storing an image of movement of a tip of the forceps of the model person; and
a procedure learning teaching-aid storage unit for storing segments of a teaching-aid video obtained by dividing the image of the movement of the tip of the forceps of the model person;
wherein the control unit, when a program stored in the ROM is executed, functions as an evaluation unit, a procedure learning video display processing unit, and a learning-by-following video display processing unit;
wherein the evaluating unit calculates a difference between the motion information of the tip of the forceps of the learner detected by the motion detection unit at a time point corresponding to just before an end of one segment of the teaching-aid video and the motion information of the tip of the forceps of the model person at a time point immediately after a start of a next segment of the teaching-aid video, and evaluates as to whether or not the difference is within a predetermined threshold value;
wherein the procedure learning video display processing unit replays one segment of the teaching-aid video in response to an instruction from the learner in procedural learning mode, and whenever the replay is completed, switches an image on the monitor to an image of the laparoscopic camera capturing the movement of the tip of the forceps of the learner; then, if evaluation result by the evaluation unit is within the predetermined threshold value, automatically switches the image on the monitor to the next segment of the teaching-aid video; and, if the evaluation result is larger than the predetermined threshold value, waits for an instruction from the learner to display the next segment of the teaching-aid video; and
wherein the learning-by-following video display processing unit, in response to an instruction from the learner in learning-by-following mode, time-divisionally displays the teaching-aid video of the learning-by-following teaching-aid storage unit and the image of the laparoscopic camera of the learner, from a same viewpoint and in frequency of approximately 2 Hz to 4 Hz and in the learner-to-the model person ratio from 1:1 to 1:3 alternately.

2. The motion learning support apparatus according to claim 1 , wherein, in place of the magnetic generator and the magnetic sensors of the motion detection unit, a three-dimensional acceleration sensor is provided at the tip of the forceps.

3. The motion learning support apparatus according to claim 1 , wherein, in place of the motion information including a position, orientation, and displacement speed of the tip of the forceps detected by the magnetic generator and the magnetic sensors of the motion detection unit, a motion information including a position, orientation, and displacement speed of the tip of the forceps calculated from an image captured by the laparoscopic camera are used.

4. The motion learning support apparatus according to claim 2 , wherein the motion detection unit detects displacement acceleration in addition to the position, the orientation, and the displacement speed of the tip of the forceps.

5. The motion learning support apparatus according to claim 3 , wherein the motion detection unit detects displacement acceleration in addition to the position, the orientation, and the displacement speed of the tip of the forceps.

Assignees

• Japan Science & Tech Agency

Inventors

• Ando Hideyuki
• Maeda Taro
• Kondo Daisuke
• Obama Kazutaka
• Izuka Hiroyuki

Classifications

• A61B5/4082

  Diagnosing or monitoring movement diseases, e.g. Parkinson, Huntington or Tourette · CPC title

• G09B5/02

  with visual presentation of the material to be studied, e.g. using film strip · CPC title

• G09B23/285 Primary

  for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas · CPC title

• A61B5/1124

  Determining motor skills · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title