Gesture detection supporting system for X-ray diagnosis

Patent metadata

Field	Value
Publication number	US-10684691-B2
Application number	US-201514717380-A
Country	US
Kind code	B2
Filing date	May 20, 2015
Priority date	Nov 25, 2012
Publication date	Jun 16, 2020
Grant date	Jun 16, 2020

Abstract

According to one embodiment, a gesture detection supporting system for an X-ray diagnosis includes memory circuitry, a sensor, processing circuitry and an attaching instrument. The memory circuitry stores an operation content of an X-ray diagnostic apparatus. The operation content is related to a gesture by a user. The sensor senses a gesture. The processing circuitry detects the gesture, based on an output from the sensor; acquire the operation content of the X-ray diagnostic apparatus, from the memory circuitry, based on a detection result of the gesture; and output operation information to the X-ray diagnostic apparatus, based on the operation content. The attaching instrument attaches the sensor to a ceiling of an examination room, an arm for driving an X-ray tube and an X-ray detector, an intravenous drip stand, an injector of a contrast agent, an X-ray protective board and/or a display for displaying an X-ray image.

First claim

What is claimed is:

1. A gesture detection supporting system for an X-ray diagnosis comprising:
at least one sensor configured to sense a gesture by an actual user and a catheter, the gesture and the catheter being sensed by an image processing of at least one image acquired by at least one camera;
memory circuitry configured to store an operation content of an X-ray diagnostic apparatus, the operation content being related to a gesture by an assumed user; and
processing circuitry configured to
detect the gesture by the actual user, based on an output from the at least one sensor,
acquire the operation content of the X-ray diagnostic apparatus, from said memory circuitry, based on a detecting result of the gesture by the actual user,
output operation information to the X-ray diagnostic apparatus, based on the acquired operation content,
detect the catheter, based on another output from the at least one sensor or another sensor, and
stop at least one of detecting a following gesture by the actual user and outputting following operation information when the catheter is determined to be held with a hand of the actual user.

2. A gesture detection supporting system for an X-ray diagnosis comprising:
at least one sensor configured to sense candidates of an actual user, the candidates being sensed by image processing of an image acquired by a camera;
memory circuitry configured to store an operation content of an X-ray diagnostic apparatus, the operation content being related to a gesture by an assumed user; and
processing circuitry configured to
specify an actual user from the candidates, based on an output from the at least one sensor,
detect a gesture by the specified actual user, based on another output from the at least one sensor or another sensor,
acquire the operation content of the X-ray diagnostic apparatus, from said memory circuitry, based on a detection result of the gesture by the actual user, and
output operation information to the X-ray diagnostic apparatus, based on the acquired operation content,

wherein said processing circuitry is configured to specify the actual user as a user who is determined to have held a catheter last, a user who is determined to be in front of a display for displaying an X-ray image acquired by the X-ray diagnostic apparatus, or a user who is determined to be in front of a console for operating the X-ray diagnostic apparatus.

3. The gesture detection supporting system for an X-ray diagnosis of claim 1 , wherein said processing circuitry is configured to detect a gesture by only a forearm of the actual user or a gesture by a part, including a shoulder and a wrist and excluding an elbow, of the actual user.

4. The gesture detection supporting system for an X-ray diagnosis of claim 1 , wherein said processing circuitry is configured to specify the actual user from candidates, based on another output from the at least one sensor or another sensor.

5. The gesture detection supporting system for an X-ray diagnosis of claim 1 , wherein said processing circuitry is configured to output the operation information to the X-ray diagnostic apparatus when the gesture by the actual user has been detected from a range higher than a predetermined height.

6. The gesture detection supporting system for an X-ray diagnosis of claim 2 , wherein said processing circuitry is configured to detect a gesture by only a forearm of the actual user or a gesture by a part, including a shoulder and a wrist and excluding an elbow, of the actual user.

7. The gesture detection supporting system for an X-ray diagnosis of claim 2 , wherein said processing circuitry is configured to output the operation information to the X-ray diagnostic apparatus when the gesture by the actual user has been detected from a range higher than a predetermined height.

8. An X-ray diagnostic system comprising:
an X-ray diagnostic apparatus;
at least one camera;
at least one sensor configured to sense a gesture by an actual user and a catheter, the gesture and the catheter being sensed by an image processing of at least one image acquired by the at least one camera;
memory circuitry configured to store an operation content of the X-ray diagnostic apparatus, the operation content being related to a gesture by an assumed user; and
processing circuitry configured to
detect the gesture by the actual user, based on an output from the at least one sensor,
acquire the operation content of the X-ray diagnostic apparatus, from said memory circuitry, based on a detecting result of the gesture by the actual user,
output operation information to the X-ray diagnostic apparatus, based on the acquired operation content,
detect the catheter, based on another output from the at least one sensor or another sensor, and
stop at least one of detecting a following gesture by the actual user and outputting following operation information when the catheter is determined to be held with a hand of the actual user.

9. An X-ray diagnostic system comprising:
an X-ray diagnostic apparatus;
a camera;
at least one sensor configured to sense candidates of an actual user, the candidates being sensed by image processing of an image acquired by the camera;
memory circuitry configured to store an operation content of the X-ray diagnostic apparatus, the operation content being related to a gesture by an assumed user; and
processing circuitry configured to
specify an actual user from the candidates, based on an output from the at least one sensor,
detect a gesture by the specified actual user, based on another output from the at least one sensor or another sensor,
acquire the operation content of the X-ray diagnostic apparatus, from said memory circuitry, based on a detection result of the gesture by the actual user, and
output operation information to the X-ray diagnostic apparatus, based on the acquired operation content,

wherein said processing circuitry is configured to specify the actual user as a user who is determined to have held a catheter last, a user who is determined to be in front of a display for displaying an X-ray image acquired by the X-ray diagnostic apparatus, or a user who is determined to be in front of a console for operating the X-ray diagnostic apparatus.

10. A gesture detection method for an X-ray diagnosis comprising:
sensing, using at least one sensor, a gesture by an actual user and a catheter, the gesture and the catheter being sensed by an image processing of at least one image acquired by at least one camera;
storing in memory circuitry an operation content of an X-ray diagnostic apparatus, the operation content being related to a gesture by an assumed user;
detecting the gesture by the actual user, based on an output from the at least one sensor;
acquiring the operation content of the X-ray diagnostic apparatus, from said memory circuitry, based on a detecting result of the gesture by the actual user;
outputting operation information to the X-ray diagnostic apparatus, based on the acquired operation content;
detecting the catheter, based on another output from the at least one sensor or another sensor; and
stopping at least one of detecting a following gesture by the actual user and outputting following operation information when the catheter is determined to be held with a hand of the actual user.

11. A gesture detection method for an X-ray diagnosis comprising:
sensing, using at least one sensor, candidates of an actual user, the candidates being sensed by image processing of an image acquired by a camera;
storing in memory circuitry an operation content of an X-ray diagnostic apparatus, the operation content being related to a gesture by an assumed user;
specify

Assignees

• Toshiba Medical Sys Corp
• Canon Medical Systems Corp

Inventors

• Hayashi Yoshiyasu
• Watanabe Yuichiro
• Sakakibara Jun
• Fuchigami Ko
• Kanno Yusuke
• Akiyama Masaki

Classifications

• A61B6/54

  Control of apparatus or devices for radiation diagnosis · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• A61B6/467

  characterised by special input means · CPC title

• A61B6/481

  involving the use of contrast agents · CPC title