System and method of capturing and generating panoramic three-dimensional images

Patent metadata

Field	Value
Publication number	US-12498488-B2
Application number	US-202017137958-A
Country	US
Kind code	B2
Filing date	Dec 30, 2020
Priority date	Dec 30, 2019
Publication date	Dec 16, 2025
Grant date	Dec 16, 2025

Abstract

An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.

First claim

The invention claimed is:

1 . A system comprising:
a housing having a front side and a back side; a first motor disposed within the housing, the first motor configured to rotate the housing about a vertical axis of rotation; a wide-angle lens fixedly positioned at least partially at the front side of the housing, a portion of the wide-angle lens intersecting the vertical axis of rotation, the wide-angle lens being directed in a first direction; an image sensor disposed within the housing and configured to capture image signals from electromagnetic energy received by the wide-angle lens; a LiDAR disposed within the housing, the LiDAR configured to generate laser pulses and generate depth signals, the LiDAR being positioned to emit the laser pulses in a second direction; a second motor disposed within the housing; and a mirror coupled to the second motor, the second motor configured to rotate the mirror, the mirror including an angled surface configured to receive the laser pulses from the LiDAR and direct the laser pulses in third directions.

2 . The system of claim 1 , wherein the first direction is opposite to the second direction.

3 . The system of claim 1 , wherein none of the third directions are the first direction.

4 . The system of claim 1 , further comprising a mount coupled to the housing at a first position.

5 . The system of claim 1 , wherein the vertical axis of rotation is a first axis and the second motor is configured to rotate the mirror about a second axis, the first axis being in a different direction than the second axis.

6 . The system of claim 5 , wherein the first axis is perpendicular to the second axis.

7 . The system of claim 1 , the system being configured to capture, by the image sensor, a first plurality of images only when the system is stationary.

8 . The system of claim 7 , the system being configured to rotate, by the first motor, the housing about the vertical axis of rotation after the first plurality of images are captured.

9 . The system of claim 8 , the system being configured to generate the depth signals by the LiDAR based on the laser pulses only while the first motor is rotating the housing.

10 . The system of claim 9 , the system being configured to:
capture a second plurality of images using the image sensor after the first motor completes rotating the housing and the wide-angle lens is directed to a new direction different than the first direction; and rotate, by the first motor, the housing about the vertical axis of rotation after the second plurality of images are captured.

11 . A method comprising:
receiving electromagnetic energy from a wide-angle lens fixedly positioned at least partially at a front side of a housing of an image capture device, the wide-angle lens being directed in a first direction, the image capture device having a vertical axis of rotation, a portion of the wide-angle lens intersecting the vertical axis of rotation; capturing, by an image sensor, a first plurality of images based on the electromagnetic energy from the wide-angle lens, the image sensor being disposed within the housing; turning, by a first motor, the housing about the vertical axis of rotation, the first motor being disposed within the housing; generating, by a LiDAR, laser pulses, the LiDAR being disposed within the housing, the laser pulses being emitted in a second direction; rotating, by a second motor, a mirror including an angled surface, the second motor being disposed within the housing, the angled surface of the mirror configured to reflect the laser pulses from the LiDAR in third directions; and generating, by the LiDAR, depth signals based on the laser pulses.

12 . The method of claim 11 , wherein the first direction is opposite to the second direction.

13 . The method of claim 11 , wherein none of the third directions are the first direction.

14 . The method of claim 11 , wherein the vertical axis of rotation is a first axis and the second motor is configured to rotate the mirror about a second axis, the first axis being in a different direction than the second axis.

15 . The method of claim 14 , wherein the first axis is perpendicular to the second axis.

16 . The method of claim 11 , wherein the first plurality of images is captured only when the image sensor is stationary.

17 . The method of claim 16 , further comprising:
rotating, by the first motor, the housing about the vertical axis of rotation after the first plurality of images is captured.

18 . The method of claim 17 , wherein generating the laser pulses occurs only while the first motor is rotating the housing.

19 . The method of claim 18 , further comprising:
capturing, by the image sensor, a second plurality of images after the first motor completes rotating the housing and the wide-angle lens is directed to a new direction different than the first direction; and rotating, by the first motor, the housing about the vertical axis of rotation after the second plurality of images is captured.

20 . The system of claim 1 wherein the laser pulses directed in the third directions are unobstructed by the wide-angle lens fixedly positioned at least partially at the front side of the housing.

21 . The method of claim 11 wherein the laser pulses reflected in the third directions are unobstructed by the wide-angle lens fixedly positioned at least partially at the front side of the housing.

Assignees

• Matterport Inc
• Costar Realty Information Inc

Inventors

• Gausebeck David Alan
• Stromberg Kirk
• Marzano Louis D
• Proctor David
• Sakakibara Naoto
• Trieu Simeon
• Kane Kevin
• Wynn Simon

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G01S7/4815

  using multiple transmitters · CPC title

• G03B37/00

  Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe · CPC title

• G01S7/4813

  Housing arrangements · CPC title

• G01S17/89 Primary

  for mapping or imaging · CPC title