Haptic movable display for spatial correlation

Patent metadata

Field	Value
Publication number	US-11029759-B2
Application number	US-201816135011-A
Country	US
Kind code	B2
Filing date	Sep 19, 2018
Priority date	Sep 19, 2018
Publication date	Jun 8, 2021
Grant date	Jun 8, 2021

Abstract

Embodiments of the present invention provides methods, computer program products, and a system for determining and displaying an image selected from a plurality of images based on a physical displacement of a device. Embodiments of the present invention can be used to generate a composite model based on a collected plurality of images. Embodiments of the present invention can be used to determine an image for display selected from the generated composite model based on a physical displacement of a device.

First claim

What is claimed is:

1. A computer-implemented method comprising:
generating a composite model comprising a collected plurality of images, wherein each image among the collected plurality of images has an image that spans across a first and a second and an assigned value associated with a third dimension; and
determining an image of the generated composite model that serves as the image displayed in a starting position of a device based on a physical displacement of the device with respect to a reference position of the device and the generated composite model, wherein determining the image further comprises:
determining a range of displacement of the device;
mapping the generated composite model to the determined range of displacement;
identifying a location of the device within the range of displacement; and
identifying an image among the collected plurality of images corresponding to the identified location of the device within the range of displacement based on the mapped composite model.

2. The computer-implemented method of claim 1 , further comprising:
displaying the determined image of the generated composite model corresponding to the starting position for the device; and
generating haptic feedback based on metadata associated with the displayed image.

3. The computer-implemented method of claim 2 , wherein the determined image is displayed on a display interface integrated with the device, wherein a haptic device receives the generated haptic feedback that is integrated with the device.

4. The computer-implemented method of claim 2 wherein the determined image is displayed on a display interface integrated with the device, the device is attached to a cantilever arm comprising:
a first servomechanism connected to a foundation,
a strut having a first end and a second end, wherein the first end is operatively connected to the first servomechanism and the second end is operatively connected to a second servomechanism, wherein the second servomechanism includes an attachment point for the device,
wherein the first and the second servomechanism includes force-feedback mechanisms, generate haptic feedback, and measure joint angles of the cantilever arm.

5. The computer-implemented method of claim 1 , wherein a third dimension is selected from a group consisting of time, distance, and wavelength.

6. The computer-implemented method of claim 1 , wherein determining a range of displacement of the device and identifying a location of the device within the range of displacement is based on video footage of the device or a user.

7. A computer program product comprising:
one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising:
program instructions to generate a composite model comprising a collected plurality of images, wherein each image among the collected plurality of images has an image that spans across a first and a second and an assigned value associated with a third dimension; and

program instructions to determine an image of the generated composite model that serves as the image displayed in a starting position of a device based on a physical displacement of the device with respect to a reference position of the device and the generated composite model wherein the program instructions to determine the image further comprise instructions to:
determine a range of displacement of the device;
map the generated composite model to the determined range of displacement;
identify a location of the device within the range of displacement; and
identify an image among the collected plurality of images corresponding to the identified location of the device within the range of displacement based on the mapped composite model.

8. The computer program product of claim 7 , further comprising:
program instructions to display the determined image of the generated composite model corresponding to the starting position for the device; and
program instructions to generate haptic feedback based on metadata associated with the displayed image.

9. The computer program product of claim 8 , wherein the determined image is displayed on a display interface integrated with the device, wherein a haptic device receives the generated haptic feedback that is integrated with the device.

10. The computer program product of claim 8 wherein the determined image is displayed on a display interface integrated with the device, the device is attached to a cantilever arm comprising:
a first servomechanism connected to a foundation,
a strut having a first end and a second end, wherein the first end is operatively connected to the first servomechanism and the second end is operatively connected to a second servomechanism, wherein the second servomechanism includes an attachment point for the device,
wherein the first and the second servomechanism includes force-feedback mechanisms, generate haptic feedback, and measure joint angles of the cantilever arm.

11. The computer program product of claim 7 , wherein a third dimension is selected from a group consisting of time, distance, and wavelength.

12. The computer program product of claim 7 , wherein the program instructions to determine a range of displacement of the device and identifying a location of the device within the range of displacement is based on video footage of the device or a user.

13. A computer system comprising:
one or more computer processors;
one or more computer readable storage media; and
program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising:
program instructions to generate a composite model comprising a collected plurality of images, wherein each image among the collected plurality of images has an image that spans across a first and a second and an assigned value associated with a third dimension; and

program instructions to determine an image of the generated composite model that serves as the image displayed in a starting position of a device based on a physical displacement of the device with respect to a reference position of the device and the generated composite model wherein the program instructions to determine the image further comprise instructions to:
determine a range of displacement of the device;
map the generated composite model to the determined range of displacement;
identify a location of the device within the range of displacement; and
identify an image among the collected plurality of images corresponding to the identified location of the device within the range of displacement based on the mapped composite model.

14. The computer system of claim 13 , further comprising:
program instructions to display the determined image of the generated composite model corresponding to the starting position for the device; and
program instructions to generate haptic feedback based on metadata associated with the displayed image.

15. The computer system of claim 14 , wherein the determined image is displayed on a display interface integrated with the device, wherein a haptic device receives the generated haptic feedback that is integrated with the device.

16. The computer system of claim 14 wherein the determined image is displayed on a display interface integrated with the device, the device is attached to a cantilever arm comprising:
a first servomechanism connected to a foundation,
a strut having a first end and a second end, wherein the first end is operatively connected to th

Assignees

• IBM

Inventors

• Seo Hyun Kyu
• Podlaseck Mark E
• Connell Ii Jonathan H

Classifications

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F2200/1637

  Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/04812

  Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects · CPC title

• G06F3/03

  Arrangements for converting the position or the displacement of a member into a coded form · CPC title