Haptic feedback on the density of virtual 3d objects

Patent metadata

Field	Value
Publication number	US-2016147304-A1
Application number	US-201414552071-A
Country	US
Kind code	A1
Filing date	Nov 24, 2014
Priority date	Nov 24, 2014
Publication date	May 26, 2016
Grant date	—

Abstract

Systems and methods are presented for visualizing a 3-dimensional (3-D) image and providing haptic feedback to a user when the user interacts with the 3-D image. In some embodiments, a method is presented. The method may include accessing, in a wearable visualization device, density data of a physical structure. The method may further include generating a three-dimensional image of the physical structure based on the density data, displaying the three-dimensional image in the wearable visualization device, receiving manipulation data associated with the three-dimensional image from a haptic device, and providing haptic feedback data associated with the three-dimensional image, to the haptic device, based on the manipulation data.

First claim

What is claimed is:

1 . A method comprising:
accessing anatomical data corresponding to a three-dimensional image of a physical structure; causing display of the three-dimensional image of the physical structure using a wearable visualization device based on the anatomical data; monitoring a position of a body member of a user of the wearable visualization device relative to a corresponding location on the physical structure displayed to the user in the three-dimensional image, the position of the body member being associated with a haptic device; accessing density data corresponding to the location on the physical structure; identifying haptic feedback data corresponding to the density data; and causing the haptic device to provide haptic feedback corresponding to the location on the physical structure.

2 . The method of claim 1 , further comprising calibrating a position of the haptic device based on a position of the three-dimensional image displayed in the wearable visualization device.

3 . The method of claim 1 , further comprising receiving an indication from the haptic device to modify the three-dimensional image.

4 . The method of claim 3 , further comprising displaying a modified three-dimensional image in the wearable visualization device, based on the indication to modify the three-dimensional image.

5 . The method of claim 4 , wherein the modified three-dimensional image includes a subset of the physical structure being simulated by the three-dimensional image.

6 . The method of claim 1 , wherein the density data includes measurements of density based on magnetic resonance imaging (MRI) or computerized tomography (CT) scans of the physical structure, and the three-dimensional image of the physical structure is based on cross-sections of the MRI or CT scans of the physical structure.

7 . The method of claim 1 , wherein the haptic feedback data includes data indicative of a plurality of haptic sensations corresponding to varying degrees of density in the three-dimensional image.

8 . A wearable visualization device comprising:
a memory configured to store density data of a physical structure; one or more processors coupled to the memory and configured to:
generate a three-dimensional image of the physical structure based on the density data;
access manipulation data associated with the three-dimensional image, from a haptic device; and
provide haptic feedback data associated with the three-dimensional image, to the haptic device, based on the manipulation data; and
a display module coupled to the one or more processors and configured to display the three-dimensional image in the wearable visualization device.

9 . The wearable visualization device of claim 8 , wherein the one or more processors is further configured to calibrate a position of the haptic device based on a position of the three-dimensional image displayed in the wearable visualization device.

10 . The wearable visualization device of claim 8 , wherein the one or more processors is further configured to receive an indication from the haptic device to modify the three-dimensional image.

11 . The wearable visualization device of claim 10 , wherein the display module is further configured to display a modified three-dimensional image in the wearable visualization device, based on the indication to modify the three-dimensional image.

12 . The wearable visualization device of claim 11 , wherein the modified three-dimensional image includes a subset of the physical structure being simulated by the three-dimensional image.

13 . The wearable visualization device of claim 8 , wherein the density data includes measurements of density based on magnetic resonance imaging (MRI) or computerized tomography (CT) scans of the physical structure, and the three-dimensional image of the physical structure is based on cross-sections of the MRI or CT scans of the physical structure.

14 . The wearable visualization device of claim 8 , wherein the haptic feedback data includes data indicative of a plurality of haptic sensations corresponding to varying degrees of density in the three-dimensional image.

15 . A computer-readable medium embodying instructions that, when executed by a processor, perform operations comprising:
accessing density data of a physical structure; generating a three-dimensional image of the physical structure based on the density data; displaying the three-dimensional image in a wearable visualization device; receiving manipulation data associated with the three-dimensional image, from a haptic device; and providing haptic feedback data associated with the three-dimensional image, to the haptic device, based on the manipulation data.

16 . The computer-readable medium of claim 15 , the operations further comprising calibrating a position of the haptic device based on a position of the three-dimensional image displayed in the wearable visualization device.

17 . The computer-readable medium of claim 15 , the operations further comprising receiving an indication from the haptic device to modify the three-dimensional image.

18 . The computer-readable medium of claim 17 , the operations further comprising displaying a modified three-dimensional image in the wearable visualization device, based on the indication to modify the three-dimensional image.

19 . The computer-readable medium of claim 18 , wherein the modified three-dimensional image includes a subset of the physical structure being simulated by the three-dimensional image.

20 . The computer-readable medium of claim 15 , wherein the density data includes measurements of density based on magnetic resonance imaging (MRI) or computerized tomography (CT) scans of the physical structure, and the three-dimensional image of the physical structure is based on cross-sections of the MRI or CT scans of the physical structure.

Assignees

• Gen Electric

Inventors

• Lund Arnold
• Lin Jeng-Weei

Classifications

• G06F19/321

  Physics · mapped topic

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/014

  Hand-worn input/output arrangements, e.g. data gloves · CPC title

• G06T2207/10081

  Computed x-ray tomography [CT] · CPC title

• G06T15/00

  Three-dimensional [3D] image rendering · CPC title