Ultrasonic collision management in virtual, augmented, and mixed reality (xR) applications

Patent metadata

Field	Value
Publication number	US-10740973-B2
Application number	US-201715631963-A
Country	US
Kind code	B2
Filing date	Jun 23, 2017
Priority date	Jun 23, 2017
Publication date	Aug 11, 2020
Grant date	Aug 11, 2020

Abstract

Systems and methods for ultrasonic collision management in virtual, augmented, and mixed reality (xR) applications are described. In some embodiments, an Information Handling System (IHS) may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the IHS to: execute an xR application to display an xR image to a user of the IHS; and detect, via an ultrasonic sensor coupled to the processor, a potential physical interaction between the user and a physical object during execution of the xR application.

First claim

The invention claimed is:

1. An Information Handling System (IHS), comprising:
a processor; and
a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the IHS to:
execute a virtual reality, augmented reality, or mixed reality (xR) application to display an xR image to a user of the IHS;
detect, via an ultrasonic sensor coupled to the processor, a potential collision between the user and a physical object during execution of the xR application by comparing a position, a velocity, and an acceleration of the user with a position, a velocity, and an acceleration of the physical object; and
in response to the ultrasonic detection, instruct the user to lay down or stand up to cause the collision using haptic system coupled to a user's vest or backpack, wherein the haptic system comprises haptic circuitry configured to control four haptic actuators located in the front, back, left, and right of the user using a set of digital-to-analog converters (DACs), piezo-driving circuitry coupled to the DACs, and flyback circuitry coupled to the piezo-driving circuitry that controls a vibration of at least one of the haptic actuators, and wherein (a) if a distance between the user and the physical object is above a threshold value, decrease at least one of: an intensity of the vibration or a frequency of the vibration, and (b) if the distance is below the threshold value, increase at least one of: the intensity of the vibration or the frequency of the vibration.

2. The IHS of claim 1 , wherein the IHS includes a headset worn by the user during execution of the xR application.

3. The IHS of claim 2 , wherein the ultrasonic sensor includes an ultrasonic transducer array.

4. The IHS of claim 1 , wherein the physical object is transparent or translucent, and wherein the collision is a collision between the user and the physical object.

5. The IHS of claim 1 , wherein the physical object is another user of another IHS executing another instance of the xR application.

6. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to provide feedback to the user regarding the potential collision.

7. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to, in response to the ultrasonic detection, render an aspect of the physical object as a digitally-generated entity in the xR image, and wherein the aspect includes at least one of: a color, a shape, or a size of the physical object.

8. The IHS of claim 7 , wherein the program instructions, upon execution, further cause the IHS to indicate, using the digitally-generated entity, whether the physical object is stationary or in motion.

9. The IHS of claim 7 , wherein the digitally-generated entity is superimposed or displayed alongside at least a portion of the physical object or a digital representation of the physical object in the xR image.

10. The IHS of claim 7 , wherein the physical object is another user of another IHS participating in the xR application, and wherein the digitally-generated entity identifies a role of the user in the xR application.

11. The IHS of claim 10 , wherein the xR application is a video game.

12. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to identify an aspect of the physical object using the ultrasonic sensor.

13. The IHS of claim 12 , wherein the aspect includes at least one of: identity, size, or shape of the physical object.

14. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to calculate the distance between the user and the physical object.

15. The IHS of claim 14 , wherein the program instructions, upon execution, further cause the IHS to:
identify, using a depth camera coupled to the processor, a feature selected from the group consisting of: a user's arm's length, or a user's height; and
adjust the distance according to the feature.

16. A method, comprising:
executing a virtual reality, augmented reality, or mixed reality (xR) application that displays an xR image to a user wearing a headset;
detecting, using an ultrasonic sensor, a potential collision between the user and a physical object during execution of the xR application by comparing a position, a velocity, and an acceleration of the user with a position, a velocity, and an acceleration of the physical object; and
in response to the ultrasonic detection, instructing the user to lay down or stand up to cause the collision using a haptic system coupled to a user's vest or backpack, wherein the haptic system comprises haptic circuitry configured to control four haptic actuators located in the front, back, left, and right of the user using a set of digital-to-analog converters (DACs), piezo-driving circuitry coupled to the DACs, and flyback circuitry coupled to the piezo-driving circuitry that controls a vibration of at least one of the haptic actuators, and wherein (a) if a distance between the user and the physical object is above a threshold value, decrease at least one of: an intensity of the vibration or a frequency of the vibration, and (b) if the distance is below the threshold value, increase at least one of: the intensity of the vibration or the frequency of the vibration.

17. A hardware memory storage device having program instructions stored thereon that, upon execution by a processor, cause the processor to:
execute a virtual reality, augmented reality, or mixed reality (xR) application that displays an xR image to a user wearing a headset;
detect, using an ultrasonic sensor, a potential collision between the user and a physical object during execution of the xR application by comparing a position, a velocity, and an acceleration of the user with a position, a velocity, and an acceleration of the physical object; and
in response to the ultrasonic detection, instruct the user to lay down or stand up to cause the collision using a haptic system coupled to a user's vest or backpack, wherein the haptic system comprises haptic circuitry configured to control four haptic actuators located in the front, back, left, and right of the user using a set of digital-to-analog converters (DACs), piezo-driving circuitry coupled to the DACs, and flyback circuitry coupled to the piezo-driving circuitry that controls a vibration of at least one of the haptic actuators, and wherein (a) if a distance between the user and the physical object is above a threshold value, decrease at least one of: an intensity of the vibration or a frequency of the vibration, and (b) if the distance is below the threshold value, increase at least one of: the intensity of the vibration or the frequency of the vibration.

Assignees

• Dell Products Lp

Inventors

• Gatson Michael S
• Casparian Mark Allan
• Tran Thanh T

Classifications

• G01S1/752 Primary

  Collocated with electrical equipment other than beacons · CPC title

• G01S2201/01

  adapted for specific applications or environments · CPC title

• G01S15/86

  Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection · CPC title

• G01S15/42

  Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S15/46) · CPC title

• G01S15/89

  for mapping or imaging · CPC title