Generating images for at least two displays in image-guided surgery

Patent metadata

Field	Value
Publication number	US-2017281284-A1
Application number	US-201715623299-A
Country	US
Kind code	A1
Filing date	Jun 14, 2017
Priority date	Jun 28, 2010
Publication date	Oct 5, 2017
Grant date	—

Abstract

A system, in particular for image-guided surgery, comprising: at least two display devices; a position determinator for determining the relative position of the display devices; and an image generator for generating images, which are to be displayed by the display devices, in accordance with the determined relative position.

First claim

1 . A system ( 1 ) for use in an associated image-guided procedure, the system ( 1 ) comprising:
a first display device ( 2 ); a second display device ( 3 ) different than the first display device ( 2 ); a position determinator ( 8 ), the position determinator ( 8 ) determining a relative position between the first and second display devices ( 2 , 3 ); an image generator ( 9 ), the image generator being configured to generate a first image to be displayed by the first display device ( 2 ) in accordance with the determined relative position between the first and second display devices ( 2 , 3 ), and the image generator being configured to generate a second image to be displayed by the second display device ( 3 ) in accordance with the determined relative position between the first and second display devices ( 2 , 3 ); a viewer detector, the viewer detector detecting an associated person viewing at least one of the first display device ( 2 ) and/or the second display device ( 3 ); and a viewing tracker, the viewing tracker determining as a viewed display device which of the first and/or second display devices is being viewed by the associated person, wherein the image generator ( 9 ) generates a particular first image for the viewed display device of the at least one of the first and/or second display devices ( 2 , 3 ) in accordance with the relative position between the first and second display devices ( 2 , 3 ), wherein the viewed display device of the at least one of the first and/or second display devices ( 2 , 3 ) persistently displays at least some of the particular first image.

2 . The system ( 1 ) according to claim 1 , wherein:
the viewer detector comprises a camera detecting the associated person viewing the at least one of the first and/or second display devices ( 2 , 3 ); the viewing tracker comprises an eye tracker determining as the viewed display device which of the first and/or second display devices is being viewed by the associated person by tracking an eye position of the associated person.

3 . The system ( 1 ) according to claim 2 , further comprising:
a first adjustable mounting ( 5 ) supporting the first display device ( 2 ) relative to an associated base ( 4 ), the first adjustable mounting ( 5 ) comprising a plurality of first support elements ( 5 a, 5 b ) mutually connected via a set of first adjustable joints ( 5 d, 5 e ); a second adjustable mounting ( 6 ) supporting the second display device ( 3 ) relative to the associated base ( 4 ), the second adjustable mounting ( 6 ) comprising a plurality of second support elements ( 6 a, 6 b ) mutually connected via a set of second adjustable joints ( 6 d, 6 e ); and at least one sensor operably connected with the position determinator ( 8 ), the at least one sensor detecting a state of at least one of the first and/or second adjustable mountings ( 5 , 6 ), wherein the position determinator ( 8 ) determines the relative position between the first and second display devices ( 2 , 3 ) in accordance with the state of the at least one of the first and/or second adjustable mountings ( 5 , 6 ) detected by the at least one sensor.

4 . The system ( 1 ) according to claim 3 , wherein:
the at least one sensor detects the state of the at least one of the first and/or second adjustable mountings ( 5 , 6 ) by detecting a state of one or more joints of the set of first adjustable joints ( 5 d, 5 d ) and/or the one or more of the set of second adjustable joints ( 6 d, 6 e ), the position determinator ( 8 ) determines the relative position between the first and second display devices ( 2 , 3 ) in accordance with the state of the one or more joints of the set of first adjustable joints ( 5 d, 5 d ) and/or the one or more of the set of second adjustable joints ( 6 d, 6 e ) detected by the at least one sensor.

5 . The system ( 1 ) according to claim 2 , further comprising:
a marker device operatively coupled with at least one of the first and/or second display devices ( 2 , 3 ), wherein the position determinator ( 8 ) is configured to determine the relative position between the first and second display devices ( 2 , 3 ) in accordance with a determined position of the marker device.

6 . The system ( 1 ) according to claim 2 , further comprising:
at least one camera adapted to observe at least one of the first and/or second display devices ( 2 , 3 ), and to generate an output image of the observed at least one of the first and/or second display devices ( 2 , 3 ), wherein the position determinator ( 8 ) is configured to determine the relative position between the first and second display devices ( 2 , 3 ) in accordance with the output image of the observed at least one of the first and/or second display devices ( 2 , 3 ) generated by the at least one camera.

7 . The system ( 1 ) according to claim 2 , further comprising:
a camera operatively coupled with at least one of the first and/or second display devices ( 2 , 3 ), the camera being adapted to generate an output image of an observed field of view of the camera, wherein the position determinator ( 8 ) determines the relative position between the first and second display devices ( 2 , 3 ) in accordance with the output image of the observed field of view of the camera generated by the camera.

8 . The system ( 1 ) according to claim 2 , further comprising:
a first adjustable mounting ( 5 ) supporting the first display device ( 2 ) relative to an associated base ( 4 ), the first adjustable mounting ( 5 ) comprising a plurality of first support elements ( 5 a, 5 b ) mutually connected via one or more first adjustable joints ( 5 d , 5 e ); a second adjustable mounting ( 6 ) supporting the second display device ( 3 ) relative to the associated base ( 4 ), the second adjustable mounting ( 6 ) comprising a plurality of second support elements ( 6 a, 6 b ) mutually connected via one or more second adjustable joints ( 6 d, 6 e ); and at least one actuator, the at least one actuator being operative to adjust a state and/or position of at least one of the first and/or second adjustable joints ( 5 d, 5 e, 6 d , 6 e ).

9 . The system ( 1 ) according to claim 2 , wherein:
the viewer detector identifies the associated person who is viewing the at least one of the first and/or second display devices ( 2 , 3 ) as an identified viewer; and the image generator ( 9 ) generates the particular first image for the viewed display device of the at least one of the first and/or second display devices ( 2 , 3 ) in accordance with: the relative position between the first and second display devices ( 2 , 3 ); and the identified viewer.

10 . A method of generating images developed in an associated image-guided procedure for first and second display devices ( 2 , 3 ) of an associated system ( 1 ), the method comprising:
determining by a position determinator ( 8 ) of the associated system ( 1 ) a relative position between the first and second display devices ( 2 , 3 ); generating by an image generator ( 9 ) of the associated system ( 1 ) a first image to be displayed by the first display device ( 2 ) of the associated system ( 1 ) in accordance with the determined relative position between the first and second display devices ( 2 , 3 ), and a second image to be displayed by the second display device ( 3 ) of the associated system ( 1 ) in accordance with the determined relative position between the first and second display devices ( 2 , 3 ); detecting by a viewer detector an associated person viewing at least one of the first display device ( 2 ) and/or the second display device ( 3 ); d

Assignees

• Brainlab Ag

Inventors

• Tuma Gregor
• Bartenstein Markus
• Manus Johannes
• Gschwandtner Michael
• Vollmer Fritz

Classifications

• A61B90/37 Primary

  Surgical systems with images on a monitor during operation · CPC title

• G09G5/32

  with means for controlling the display position {(see provisionally G09G5/42)} · CPC title

• G09G2380/08

  Biomedical applications · CPC title

• A61B2090/372

  Details of monitor hardware · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title