Manipulation of 3-D RF imagery and on-wall marking of detected structure

Patent metadata

Field	Value
Publication number	US-11635509-B2
Application number	US-202017080452-A
Country	US
Kind code	B2
Filing date	Oct 26, 2020
Priority date	Apr 28, 2016
Publication date	Apr 25, 2023
Grant date	Apr 25, 2023

Abstract

A radio frequency (RF) imaging device comprising a display receives a three-dimensional (3D) image that is a superposition of two or more images having different image types, which may include at least a 3D RF image of a space disposed behind a surface. A plurality of input control devices receive a user input for manipulating the display of the 3D image. Alternatively or additionally, the radio frequency (RF) imaging device may receive a three-dimensional (3D) image that is a weighted combination of a plurality of images, which may include a 3D RF image of a space disposed behind a surface, an infrared (IR) image of the surface, and a visible light image of the surface. A user input may specify changes to the weighted combination. In another embodiment, the RF imaging device may include an output device that produces a physical output indicating a detected type of material of an object in the space.

First claim

What is claimed is:

1. An imaging device comprising:
a display configured to:
receive a first data portion representing a first three-dimensional (3D) image that is a weighted combination of a plurality of images including a 3D radio frequency (RF) image of a space disposed behind a surface, an infrared (IR) image of the surface and a visible light image of the surface, the plurality of images being combined in accordance with a plurality of weights respectively corresponding to the plurality of images, wherein a weight of the plurality of weights represents a contribution of a respective image of the plurality of images to the first 3D image; and
display the first 3D image in accordance with the received first data portion;

a plurality of input control devices configured to receive a first user input for manipulating the display of the first 3D image and a second user input for specifying one or more changes to the plurality of weights; and
a processor operatively coupled to the display and the plurality of input control devices and configured to:
receive data representing the first user input and data representing the second user input;
determine that the data representing the first user input specifies at least one of a pan command, a rotate command, a zoom in command or a zoom out command;
generate a second data portion representing a second 3D image, the second 3D image being derived from the first 3D image as manipulated in accordance with the first user input and the second user input; and
output the second data portion to the display.

2. The imaging device of claim 1 , wherein the plurality of input control devices include a first button for receiving the zoom in command as the first user input and a second button for receiving the zoom out command as the first user input.

3. The imaging device of claim 1 , wherein:
in response to the first user input specifying the pan command, a point of view of the first 3D image is translated linearly to the right or left, or up or down, to produce the second 3D image;
in response to the first user input specifying the rotate command, the point of view of the first 3D image is rotated about an arc centered within the point of view to produce the second 3D image;
in response to the first user input specifying the zoom in command, an area of the first 3D image is enlarged to produce the second 3D image; or
in response to the first user input specifying the zoom out command, the area of the first 3D image is shrunk to produce the second 3D image.

4. The imaging device of claim 3 , wherein the plurality of input control devices include a first joystick for receiving the pan command as the first user input and a second joystick for receiving the rotate command as the first user input.

5. The imaging device of claim 4 , wherein a horizontal actuation of the first joystick dictates linear translation of the point of view to the right or left, and wherein a vertical actuation of the first joystick dictates linear translation of the point of view up or down.

6. The imaging device of claim 4 , wherein an angle of actuation of the second joystick dictates an angle between a plane of the arc with a horizontal plane.

7. A method, comprising:
receiving, by a display, a first data portion representing a first three-dimensional (3D) image that is a weighted combination of a plurality of images including a 3D radio frequency (RF) image of a space disposed behind a surface, an infrared (IR) image of the surface and a visible light image of the surface, the plurality of images being combined in accordance with a plurality of weights respectively corresponding to the plurality of images, wherein a weight of the plurality of weights represents a contribution of a respective image of the plurality of images to the first 3D image; and
displaying, by the display, the first 3D image in accordance with the received first data portion;
receiving, by a plurality of input control devices, a first user input for manipulating display of the first 3D image and a second user input for specifying one or more changes to the plurality of weights;
receiving, by a processor, data representing the first user input and data representing the second user input;
determining, by the processor, that the data representing the first user input specifies at least one of a pan command, a rotate command, a zoom in command or a zoom out command;
generating, by the processor, a second data portion representing a second 3D image, the second 3D image being derived from the first 3D image as manipulated in accordance with the first user input and the second user input; and
outputting, by the processor, the second data portion to the display.

8. The method of claim 7 , wherein the plurality of input control devices include a first button for receiving the zoom in command as the first user input and a second button for receiving the zoom out command as the first user input.

9. The method of claim 7 , wherein:
in response to the first user input specifying the pan command, a point of view of the first 3D image is translated linearly to the right or left, or up or down, to produce the second 3D image;
in response to the first user input specifying the rotate command, the point of view of the first 3D image is rotated about an arc centered within the point of view to produce the second 3D image;
in response to the first user input specifying the zoom in command, an area of the first 3D image is enlarged to produce the second 3D image; or
in response to the first user input specifying the zoom out command, the area of the first 3D image is shrunk to produce the second 3D image.

10. The method of claim 9 , wherein the plurality of input control devices include a first joystick for receiving the pan command as the first user input and a second joystick for receiving the rotate command as the first user input.

11. The method of claim 10 , wherein a horizontal actuation of the first joystick dictates linear translation of the point of view to the right or left, and wherein a vertical actuation of the first joystick dictates linear translation of the point of view up or down.

12. The method of claim 10 , wherein an angle of actuation of the second joystick dictates an angle between a plane of the arc with a horizontal plane.

13. A non-transitory computer-readable storage media having stored thereon executable instructions that, when executed by a processor, cause the processor to:
output, to a display, a first data portion representing a first three-dimensional (3D) image that is a weighted combination of a plurality of images including a 3D radio frequency (RF) image of a space disposed behind a surface, an infrared (IR) image of the surface and a visible light image of the surface, the plurality of images being combined in accordance with a plurality of weights respectively corresponding to the plurality of images, wherein a weight of the plurality of weights represents a contribution of a respective image of the plurality of images to the first 3D image;
receive, from a plurality of input control devices, data representing a first user input for manipulating the display of the first 3D image and data representing a second user input for specifying one or more changes to the plurality of weights;
determine that the data representing the first user input specifies at least one of a pan command, a rotate command, a zoom in command or a zoom out command;
generate a second data portion representing a second 3D image, the second 3D image being derived from the first 3D image as manipulated in accordance with the first user input and the second user inp

Assignees

• Fluke Corp

Inventors

• Ghazanfarpour Mabood
• Knight Brian

Classifications

• G06T19/00

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• G01S13/867

  Combination of radar systems with cameras · CPC title

• G01S13/89

  for mapping or imaging · CPC title

• G01S7/24

  the display being orientated or displaced in accordance with movement of object carrying the transmitting and receiving apparatus, e.g. true-motion radar · CPC title

• G01S13/888 Primary

  through wall detection · CPC title