Intelligent assistance (IA) ecosystem

Patent metadata

Field	Value
Publication number	US-12070362-B2
Application number	US-202117334487-A
Country	US
Kind code	B2
Filing date	May 28, 2021
Priority date	May 29, 2020
Publication date	Aug 27, 2024
Grant date	Aug 27, 2024

Abstract

Novel tools and techniques are provided for implementing intelligent assistance (“IA”) ecosystem. In various embodiments, a computing system might receive device data associated with a device(s) configured to perform a task(s), might receive sensor data associated with sensors configured to monitor at least one of biometric, biological, genetic, cellular, or procedure-related data of a subject, and might receive imaging data associated with an imaging device(s) configured to generate images of a portion(s) of the subject. The computing system might analyze the received device data, sensor data, and imaging data (collectively “received data”), might map two or more of the received data to a 3D or 4D representation of the portion(s) of the subject based on the analysis, might generate and present (using a user experience (“UX”) device) one or more extended reality (“XR”) images or experiences based on the mapping.

First claim

What is claimed is:

1. A method for presenting patient information to a user, the method comprising:
receiving, with a computing system, one or more device data associated with each of one or more devices configured to perform one or more first tasks, wherein the one or more devices comprise one or more implant devices, and the one or more device data comprise implant device data associated with the one or more implant devices;
receiving, with the computing system, one or more sensor data associated with one or more sensors configured to monitor at least one of biometric data, biological data, genetic data, cellular data, or procedure-related data of a subject;
receiving, with the computing system, one or more imaging data associated with each of one or more imaging devices configured to generate images of at least one or more portions of the subject;
analyzing, with the computing system, the received one or more device data, the received one or more sensor data, and the received one or more imaging data;
mapping, with the computing system, two or more of the received one or more device data, the received one or more sensor data, or the received one or more imaging data to a multi-dimensional representation of the at least one or more portions of the subject, based at least in part on the analysis, wherein the multi-dimensional representation comprises data corresponding to three dimensions, four dimensions, or more than four dimensions;
generating, with the computing system, one or more image-based outputs, based at least in part on the mapping; and
presenting, with the computing system and using a user experience (“UX”) device, the generated one or more image-based outputs.

2. The method of claim 1 , wherein the computing system comprises at least one of an XR computing system, a medical procedure computing system, a hub computing system, a three-dimensional (“3D”) graphical processing unit, a cluster computing system, a four-dimensional (“4D”) graphics computing system, a server computer, a cloud computing system, or a distributed computing system.

3. The method of claim 1 , wherein the one or more devices further comprise at least one of one or more catheters, one or more catheter interconnect cables, one or more valves, one or more balloons, one or more leads, one or more pacemakers, one or more defibrillators, one or more rigid robotic devices, one or more soft robotic devices, one or more stents, one or more needles, one or more grafts, one or more occluders, one or more shunts, one or more orthopedic screws, one or more orthopedic plates, one or more orthopedic rods, one or more vertebral sponges, one or more therapeutic delivery devices, one or more implant delivery devices, one or more diagnostic devices, one or more diagnostic catheters, one or more surgical tools, one or more biologics, one or more drug pumps, one or more genes, one or more cells, one or more organs, one or more organelles, one or more delivery pharmaceuticals, one or more biopsy tools, one or more excision tools, one or more ablation tools, one or more monitoring devices, one or more cameras, one or more imaging tools, one or more fiducials, one or more staples, one or more anchors, one or more meshes, one or more vascular cannulae, one or more circulatory pumps, one or more valve repair devices, one or more embolic protection devices, one or more cardiomyoplasty tools, one or more vascular closure tools, one or more septal closure tools, one or more ventricular closure tools, one or more lasers, one or more plaque removal tools, one or more guide wires, one or more introducers, one or more sheaths, one or more pillcams, one or more clips, one or more capsules, one or more microbiomes, one or more microbes of bacterial vectors, one or more microbes of viral vectors, one or more microbes of prion vectors, one or more energy delivery tools, a pulmonary vein ablation catheter (“PVAC”), a catheter electrode distribution system (“CEDS”), a pulsed field ablation (“PFA”) system, a PFA console, an electroporation system, an electroporation control console, a cryoballoon or a cryoablation catheter, a cryoablation console, a radio frequency (“RF”) ablation-based system, an RF ablation control console, a laser ablation-based system, a laser ablation control console, a radiation ablation-based system, a radiation ablation control console, a microwave ablation-based system, a high intensity focused ultrasound (“HIFU”) system, a HIFU control console, an implantable cardioverter defibrillator (“ICD”) device, an extravascular ICD (“EV-ICD”), or a miniature leadless implant.

4. The method of claim 1 , wherein the one or more sensors comprise at least one of one or more chronically implanted sensors, one or more diagnostic sensors, one or more surgical sensors, one or more wearable sensors, one or more gas sensors, one or more optical sensors, one or more contactless optical sensors, one or more fiducial alignment sensors, one or more tool recognition sensors, one or more collision detection sensors, one or more room traffic flow sensors, one or more ultrasound sensors, one or more flow sensors, one or more blood velocity sensors, one or more blood volume sensors, one or more electrical sensors, one or more voltage sensors, one or more amperage sensors, one or more wattage sensors, one or more impedance sensors, one or more chemical sensors, one or more pH sensors, one or more motion sensors, one or more proximity sensors, one or more light sensors, one or more sound sensors, one or more laser sensors, one or more blood pressure sensors, one or more heart rate sensors, one or more pulse sensors, one or more respiratory rate sensors, one or more oxygen sensors, one or more carbon dioxide (“CO 2 ”) sensors, one or more hormonal sensors, one or more fluid levels, one or more doppler sensors, one or more biomarker sensors, one or more genetic sensors, one or more blood chemistry sensors, one or more tissue matrix sensors, one or more bacteria sensors, one or more respiration sensors, one or more mechanical sensors, one or more infrared (“IR”) sensors, one or more IR-based temperature sensors, one or more ultraviolet (“UV”) sensors, one or more digital image correlation (“DIC”) sensors, one or more cameras, one or more surgeon fatigue sensors, one or more cognitive overload sensors, one or more moisture sensors, one or more perfusion sensors, one or more electromyography (“EMG”) sensors, one or more emotional stress sensors, one or more sleep sensors, one or more humidity sensors, one or more cardiac hemodynamics sensors, one or more ischemia sensors, one or more hematocrit (“HCT”) level sensors, one or more temperature sensors, one or more pressure sensors, one or more force sensors, one or more strain sensors, one or more stress sensors, one or more olfactory sensors, one or more tissue contractility sensors, one or more compliance sensors, one or more immobilized biocatalyst sensors, one or more enzyme sensors, one or more immunoglobulin sensors, one or more bacterial sensors, one or more mammalian tissue sensors, one or more plant tissue sensors, one or more cell sensors, one or more subcellular sensors, one or more specific peptide sensors, one or more specific protein sensors, one or more specific enzyme sensors, one or more specific gas sensors, one or more specific ion sensors, one or more metabolic process sensors, one or more viscosity sensors, one or more electromagnetic interference (“EMI”) sensors, one or more photographic plate sensors, one or more polymer-metal sensors, one or more charge coupled devices (“CCDs”), one or more photo diode arrays, one or more electrochemical sensors, one or more vibration sensors, one or more sound wave sensors, one or more magnetic sensors, one or more visible light sensors, one or more radiation sensors, one or more biometric sensors, one or more electr

Assignees

• Medtronic Inc

Inventors

• Braido Peter N
• Fahim Mina S
• Hinrichsen Ross D
• Takayama Shinichi J
• Bolin Monica M

Classifications

• A61B5/055

  involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging · CPC title

• A61B5/343

  Potential distribution indication · CPC title

• G16H30/20

  for handling medical images, e.g. DICOM, HL7 or PACS · CPC title

• A61B18/1492

  having a flexible, catheter-like structure, e.g. for heart ablation (A61B18/1477 takes precedence) · CPC title

• A61B5/068

  using impedance sensors · CPC title