Methods and systems for providing interface components for respiratory therapy

Patent metadata

Field	Value
Publication number	US-10220172-B2
Application number	US-201615344761-A
Country	US
Kind code	B2
Filing date	Nov 7, 2016
Priority date	Nov 25, 2015
Publication date	Mar 5, 2019
Grant date	Mar 5, 2019

Abstract

Systems and methods permit generation of a digital scan of a user's face such as for obtaining of a patient respiratory mask, or component(s) thereof, based on the digital scan. The method may include: receiving video data comprising a plurality of video frames of the user's face taken from a plurality of angles relative to the user's face, generating a three-dimensional representation of a surface of the user's face based on the plurality of video frames, receiving scale estimation data associated with the received video data, the scale estimation data indicative of a relative size of the user's face, and scaling the digital three-dimensional representation of the user's face based on the scale estimation data. In some aspects, the scale estimation data may be derived from motion information collected by the same device that collects the scan of the user's face.

First claim

The invention claimed is:

1. An apparatus for acquiring data for generation of a three-dimensional facial scan of a user for obtaining a patient respiratory interface component, the apparatus comprising:
an image sensor and lens for capturing two dimensional image data of the user's face;
a motion sensor configured to sense movement data of at least one of a movement of the apparatus and a change in orientation of the apparatus;
a processor configured to receive image data from the image sensor and to receive movement data from the motion sensor, to generate a video file based on the image data received from the image sensor, and to generate a motion data file based on the movement data received from the motion sensor, and to associate each of the video file and the motion data file with one another, wherein the video file and the motion data file are generated to include a temporal map that correlates the motion data file with the video file; and
a transmitter, coupled with the processor, to transmit the associated video and motion data files to a system comprising a surface engine at a remote destination for generation of a scaled three-dimensional representation of the user's face based on the received image data and the received movement data.

2. A method for acquiring data with a mobile computing device for generation of a three-dimensional facial scan of a user for obtaining a patient respiratory interface component, the method comprising:
controlling an image sensor having a lens to capture two dimensional image data of the user's face;
sensing with a motion sensor configured to sense movement data of at least one of a movement of the image sensor and a change in orientation of the image sensor;
controlling, in a processor configured to receive image data from the image sensor and to receive movement data from the motion sensor, generation of a video file based on the image data received from the image sensor, and generation of a motion data file based on the movement data received from the motion sensor, and associating each of the video file and data file with one another wherein the video file and the motion data file are generated with a temporal map that correlates the motion data file with the video file; and
controlling, via a transmitter coupled with the processor, transmission of the associated video and data files to a system comprising a surface engine at a remote destination for generation of a scaled three-dimensional representation of the user's face based on the received image data and the received movement data.

3. A non-transitory computer-readable data storage medium having program instructions encoded thereon configured to cause a processor to perform the method of claim 2 .

4. A server having the non-transitory computer-readable data storage medium of claim 3 , wherein the server is configured to receive requests for downloading the program instructions of the computer-readable data storage medium to a remote mobile computing device over a network.

5. An electronic system for enrolling an end-user for obtaining a patient respiratory interface component, the system comprising:
a customer information subsystem for receiving an enrolment request from an end-user device for obtaining a patient respiratory interface component, the enrolment request comprising a unique identifier of the end-user and for receiving from the end-user device a video file and a motion data file that are generated with a temporal map that correlates the motion data file with the video file;
a three-dimensional surface rendering engine, including at least one processor, the three-dimensional surface rendering engine configured to render and scale a three-dimensional representation of the end-user's face based on end-user video frame data and movement data from the video file and the motion data file and using the temporal map; and
a first database for storing said rendered and scaled three-dimensional representation, or an identification of the rendered and scaled three-dimensional representation, in association with said unique identifier.

6. The electronic system of claim 5 , wherein the customer information subsystem and customer reference database operate on one or more servers in a network, and wherein the enrolment request and end-user video frame data and movement data are received over the network.

7. The electronic system of claim 5 , wherein the temporal map comprises timestamp information, wherein the end-user video frame data and movement data are combined at the three-dimensional surface rendering engine based on the timestamp information.

8. The electronic system of claim 5 , wherein the three dimensional surface rendering engine is configured to receive frame selection information designating a pre-selected subset of the end-user video frame data for use in rendering the three-dimensional representation of the end-user's face.

9. The electronic system of claim 8 , wherein the frame selection information further comprises a number of frames selected.

10. The electronic system of claim 5 , further comprising a second database,
wherein the first database stores an identification of the rendered and scaled three-dimensional representation in association with said unique identifier, and
wherein the three-dimensional surface rendering engine generates an object file containing said rendered and scaled three-dimensional representation and stores the object file, or a reference to the object file, in the second database, and
wherein the object file, or reference thereto, is retrieved from the second database based on the identification of said rendered and scaled three-dimensional representation in association with said unique identifier.

11. The electronic system of claim 5 wherein one or more processors are configured to determine one or more dimensions from the rendered and scaled three-dimensional representation for obtaining the patient respiratory interface component.

12. The electronic system of claim 11 wherein the one or more processors are configured to compare the one or more dimensions from the rendered and scaled three-dimensional representation with one or more dimensions from one or more respiratory masks.

13. The system of claim 5 wherein the temporal map correlates inertial measurements in the motion data file over a duration of a plurality of video frames of the video file.

14. The system of claim 13 wherein the temporal map comprises timestamps in both of the video file and in the motion data file.

15. A method of generating a three-dimensional surface scan of a user's face for obtaining a patient respiratory interface component, the method using a mobile device, the method comprising:
receiving video data in a video file, the video data comprising a plurality of video frames of the user's face taken from a plurality of angles relative to the user's face;
generating a digital three-dimensional representation of the user's face based on the plurality of video frames;
receiving scale estimation data associated with the received video data, scale estimation data comprising inertial movement data in a motion data file, the inertial movement data capturing movement of the plurality of angles, wherein the video file and the motion data file are generated with a temporal map that correlates the motion data file with the video file, the scale estimation data indicative of a relative size of the user's face; and
scaling the digital three-dimensional representation of the user's face based on the scale estimation data.

16. The method of claim 15 , wherein the plurality of

Assignees

• Resmed Ltd

Inventors

• Lucey Simon Michael
• Gupta Priyanshu
• Johnston Benjamin Peter
• Yu Tzu-Chin

Classifications

• G16H40/60 Primary

  for the operation of medical equipment or devices · CPC title

• A61M16/0605 Primary

  Means for improving the adaptation of the mask to the patient · CPC title

• G06V10/32

  Normalisation of the pattern dimensions · CPC title

• G06K9/00248

  Physics · mapped topic

• A61M16/0816

  Joints or connectors · CPC title