System with 3D user interface integration

Patent metadata

Field	Value
Publication number	US-9329675-B2
Application number	US-201113991513-A
Country	US
Kind code	B2
Filing date	Dec 5, 2011
Priority date	Dec 6, 2010
Publication date	May 3, 2016
Grant date	May 3, 2016

Abstract

Disclosed is a system comprising a handheld device and at least one display. The handheld device is adapted for performing at least one action in a physical 3D environment; wherein the at least one display is adapted for visually representing the physical 3D environment; and where the handheld device is adapted for remotely controlling the view with which the 3D environment is represented on the display.

First claim

The invention claimed is:

1. A scanning system for scanning a 3D environment, the scanning system comprising:
a handheld device including an optical scanner, wherein the 3D environment to be scanned is selected by pointing the optical scanner at the 3D environment; and
at least one display remotely connected to the handheld device,
wherein the handheld device is adapted for performing at least one scanning action in a physical 3D environment, and the at least one display is adapted for visually representing the physical 3D environment; and
the handheld device includes a user interface for remotely controlling the display to adjust the view with which the 3D environment is represented on the display.

2. A system according to claim 1 , wherein the handheld device is adapted to record the 3D geometry of the 3D environment.

3. A system according to claim 1 , wherein the user interface includes means for manually switching between performing the at least one scanning action and remotely controlling the view.

4. The system according to claim 1 , wherein the handheld device comprises at least one motion sensor.

5. The system according to claim 4 , wherein the view of the 3D environment represented in the at least one display is at least partly determined by the at least one motion sensor.

6. The system according to claim 4 , wherein functionality of the user interface comprises a use of gestures.

7. The system according to claim 6 , wherein the gestures are detected by the at least one motion sensor.

8. The system according to claim 4 , wherein the user-interface is other than the at least one motion sensor.

9. The system according to claim 1 , wherein the handheld device is adapted to change a viewing angle with which the 3D environment is represented on the at least one display.

10. The system according to claim 1 , wherein the handheld device is adapted to change a magnification factor with which the 3D environment is represented on the at least one display.

11. The system according to claim 1 , wherein the handheld device is an intra-oral 3D scanner.

12. The system according to claim 1 , wherein the handheld device includes a surgical instrument.

13. The system according to claim 1 , wherein the handheld device includes a mechanical tool.

14. The system according to claim 1 , wherein the handheld device is an in-ear 3D scanner.

15. The system according to claim 1 , wherein the at least one display is defined as a first display, and where the system further comprises a second display.

16. The system according to claim 15 , wherein the second display indicates where the handheld device is positioned relative to the 3D environment.

17. The system according to claim 15 , wherein the first display and/or the second display provides instructions for the operator.

18. The system according to claim 1 , wherein audible information is provided to the operator.

19. A system comprising:
a handheld device and at least one display;
wherein the handheld device is adapted for switching between performing at least one action in a physical 3D environment, wherein the at least one display is adapted for visually representing the physical 3D environment; and remotely controlling the display to adjust the view with which the 3D environment is represented on the display;
wherein the handheld device is an intra-oral 3D scanner and the at least one action performed in the physical 3D environment is scanning and that the view is remotely controlled by at least one motion sensor arranged in the handheld device, and wherein an actuator provided on the handheld device switches between performing the at least one action and remotely controlling the view.

Assignees

• Öjelund Henrik
• Fischer David
• Hollenbeck Karl-Josef
• 3Shape As

Inventors

• Öjelund Henrik
• Fischer David
• Hollenbeck Karl-Josef

Classifications

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/01 Primary

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• G01B11/24

  for measuring contours or curvatures · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title