Augmented reality and/or virtual reality based e-vaping device vapor simulation systems and methods

Patent metadata

Field	Value
Publication number	US-11284646-B2
Application number	US-201815928711-A
Country	US
Kind code	B2
Filing date	Mar 22, 2018
Priority date	Mar 22, 2018
Publication date	Mar 29, 2022
Grant date	Mar 29, 2022

Abstract

A method, system, device, and/or non-transitory computer readable medium for generating an augmented reality (AR) and/or virtual reality (VR) vapor simulation application, the device including a memory having stored thereon computer readable instructions, and at least one processor configured to execute the computer readable instructions to receive audio signals related to vaping of an e-vaping device from a microphone, determine the vaping characteristics of the vaping based on the audio signals, generate a vaping simulation based on the analyzed characteristics, and transmit the generated vaping simulation to the headset to be displayed on the display panel.

First claim

What is claimed is:

1. A device for generating a vaping simulation, the device comprising:
a memory having stored thereon computer readable instructions; and
at least one processor configured to execute the computer readable instructions to,
receive audio signals related to vaping of an e-vaping device by an adult vaper from a microphone,
determine vaping characteristics of the vaping based on the received audio signals and a plurality of audio spectrums associated with the adult vaper, the determining including,
generating an audio spectrum of the received audio signals,
normalizing the audio spectrum of the received audio signals,
correlating the normalized audio spectrum to at least one template audio spectrum of the plurality of audio spectrums associated with the adult vaper, and
determining the vaping characteristics of the vaping based on the correlated normalized audio spectrum,
generate a vaping simulation based on the determined vaping characteristics, and
transmit the generated vaping simulation to a headset to be displayed on a display panel included in the headset.

2. The device of claim 1 , wherein the at least one processor is further configured to execute the computer readable instructions to:
receive sensor information related to the vaping of the e-vaping device from sensors of the e-vaping device; and
wherein the determining the vaping characteristics of the vaping is further based on the sensor information.

3. The device of claim 1 , wherein the at least one processor is further configured to execute the computer readable instructions to:
determine spatial position information of the headset, the spatial position information including field of view information associated with the headset; and
wherein the generating the vaping simulation is further based on the determined spatial position information.

4. The device of claim 3 , wherein the display panel is a screen installed in the headset.

5. The device of claim 3 , wherein the display panel is a screen of a smart device.

6. The device of claim 3 , wherein the display panel includes at least one lens.

7. The device of claim 1 , wherein
the headset includes a smart device; and
the at least one processor and a memory are included in the smart device.

8. The device of claim 2 , wherein
the received sensor information includes sensor information corresponding to a drawing of vapor from the e-vaping device; and
the received audio signals includes audio signals corresponding to ejection of the drawn vapor recorded by the microphone.

9. The device of claim 1 , wherein the determined vaping characteristics include at least one of vaping duration, vapor ejection velocity, vapor direction, vapor density, or vapor particle life.

10. The device of claim 1 , wherein the at least one processor is further configured to execute the computer readable instructions to:
determine vapor volume information and strength of ejection information based on the determined vaping characteristics.

11. The device of claim 3 , wherein the at least one processor is further configured to execute the computer readable instructions to generate the vaping simulation by:
calculating a vapor model for the vaping simulation based on a determination of vapor volume information, a determination of strength of ejection information, and the determined vaping characteristics;
calculating virtual coordinate information of the calculated vapor model based on the determined vaping characteristics and the determined spatial position information of the headset,
the determined spatial position information including spatial position information corresponding to a time when ejection of drawn vapor occurred and spatial position information corresponding to a time subsequent to the ejection of the drawn vapor; and

generating the vaping simulation based on the calculated vapor model and the calculated virtual coordinate information.

12. The device of claim 1 , wherein the at least one processor is further configured to execute the computer readable instructions to transmit the generated vaping simulation to the headset such that the generated vaping simulation is displayed in an augmented reality (AR) mode, the AR mode including superimposing the generated vaping simulation over the headset's environment.

13. The device of claim 1 , wherein the at least one processor is further configured to execute the computer readable instructions to transmit the generated vaping simulation to the headset such that the generated vaping simulation is displayed in a virtual reality (VR) mode, the VR mode including displaying the generated vaping simulation in a generated virtual environment.

14. The device of claim 2 , wherein
the sensors of the e-vaping device includes at least one of a Bluetooth sensor, a light sensor, a flow sensor, or a pressure sensor;
the at least one processor is further configured to execute the computer readable instructions to receive the sensor information related to the vaping of the e-vaping device such that data is received from the at least one of the Bluetooth sensor, the light sensor, the flow sensor, or the pressure sensor, the received data indicating a duration of time that the e-vaping device is engaged; and
the determined vaping characteristics includes the received data.

15. The device of claim 1 , further comprising:
a camera configured to obtain an image of the adult vaper; and
wherein the at least one processor is further configured to execute the computer readable instructions to,
receive the image of the adult vaper from the camera,
determine an identity of the adult vaper based on the received image, and
load personalized vaping parameters based on the determined identity.

16. The device of claim 1 , further comprising:
an olfactory stimulation device configured to produce an aroma or fragrance.

17. The device of claim 16 , wherein the olfactory stimulation device is further configured to produce the aroma or fragrance based on personalized vaping parameters.

18. A system for generating a vaping simulation, the system comprising:
a headset including at least one display panel;
a memory having stored thereon computer readable instructions; and
at least one processor configured to execute the computer readable instructions to,
receive audio signals related to vaping of an e-vaping device by an adult vaper from a microphone,
determine vaping characteristics of the vaping based on the received audio signals and a plurality of audio spectrums associated with the adult vaper, the determining including,
generating an audio spectrum of the received audio signals,
normalizing the audio spectrum of the received audio signals,
correlating the normalized audio spectrum to at least one template audio spectrum of the plurality of audio spectrums associated with the adult vaper, and
determining the vaping characteristics of the vaping based on the correlated normalized audio spectrum,

generate a vaping simulation based on the determined vaping characteristics, and
transmit the generated vaping simulation to the headset to be displayed on the at least one display panel.

19. The system of claim 18 , wherein the at least one processor is further configured to execute the computer readable instructions to:
receive sensor information related to the vaping of the e-vaping device from sensors of the e-vaping device; and
wherein the determining the vaping characteristics of the vaping is further based on the sensor information.

Assignees

• Janardhan Srinivasan
• Kobal Gerd
• Pithawalla Yezdi B
• Engelke Timo
• Bockholt Ulrich
• Altria Client Services Llc

Inventors

• Janardhan Srinivasan
• Kobal Gerd
• Pithawalla Yezdi B
• Engelke Timo
• Bockholt Ulrich

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• A24F40/10

  Devices using liquid inhalable precursors · CPC title

• A24F40/53 Primary

  Monitoring, e.g. fault detection · CPC title

• G10L25/51

  for comparison or discrimination · CPC title

• A24F40/65

  Devices with integrated communication means, e.g. wireless communication means · CPC title