Systems and methods for coordinated collection of street-level image data

Patent metadata

Field	Value
Publication number	US-12581040-B2
Application number	US-202217846577-A
Country	US
Kind code	B2
Filing date	Jun 22, 2022
Priority date	Mar 13, 2018
Publication date	Mar 17, 2026
Grant date	Mar 17, 2026

Abstract

The disclosed computer-implemented method may include (i) identifying, by a server computer system, a provider computing device for use in capturing street-level image data, where the provider computing device controls a camera positioned to capture street-level imagery outside the vehicle, (ii) determining, by the server computer system, a configuration that controls use of the provider computing device to provide street-level image data captured by the camera to the server computer system, (iii) sending, by the server computer system, the configuration to the computing device, and (iv) receiving, from the computing device, street-level image data captured by the computing device using the camera responsive to the configuration. Various other methods, systems, and computer-readable media are also disclosed.

First claim

What is claimed is:

1 . A computer-implemented method comprising:
identifying, by a server computer system, a provider computing device for use in capturing street-level imagery, wherein the provider computing device controls a camera positioned to capture street-level imagery outside a vehicle associated with the provider computing device; sending, by the server computer system, instructions to the provider computing device indicating that the camera of the provider computing device is to capture street-level image data; receiving, by the server computer system, street-level image data captured by the provider computing device using the camera responsive to the instructions, the received street-level image data including one or more features extracted from the street-level image data, the street-level image data including at least one subsequent image of a map feature that has changed, wherein the camera, in further response to the instructions, captures a minimum threshold number of images of the changed map feature; accessing, by the server computer system, a map for a specified region that includes one or more map features for the region; and updating, by the server computer system, the map features based on at least one of the extracted features from the street-level image data,
wherein the updating is performed upon determining that at least one of the map features has changed from an initial state to a subsequent, different state, and
wherein the changed map features are updated after a specified time delay has passed, the specified time delay being varied based on a number of secondary provider computing devices that are capturing the changed map features.

2 . The computer-implemented method of claim 1 , wherein the updating is performed upon reaching the minimum threshold number of images of the changed map feature.

3 . The computer-implemented method of claim 1 , wherein the changed map feature comprises a temporary change for the map feature that, at a subsequent point in time, returns from the subsequent, different state to the initial state.

4 . The computer-implemented method of claim 3 , further comprising, upon determining that the temporary change for the map feature has returned to the initial state, updating, by the server computer system, the changed map feature in the map.

5 . The computer-implemented method of claim 1 , further comprising instructing, by the server computer system, one or more of the secondary provider computing devices to capture secondary street-level image data of the changed map features.

6 . A system comprising:
at least one provider computing device, associated with a vehicle, with at least one hardware processor; and a server computer system, wherein the server computer system:
identifies a provider computing device for use in capturing street-level imagery, wherein the provider computing device controls a camera positioned to capture street-level imagery outside a vehicle associated with the provider computing device;
sends instructions to the provider computing device indicating that the camera of the provider computing device is to capture street-level image data;
receives street-level image data captured by the provider computing device using the camera responsive to the instructions, the received street-level image data including one or more features extracted from the street-level image data, the street-level image data including at least one subsequent image of a map feature that has changed, wherein the camera, in further response to the instructions, captures a minimum threshold number of images of the changed map feature;
accesses a map for a specific region that includes one or more map features for the region; and
updates the map features based on at least one of the extracted features from the street-level image data,
wherein the updating is performed upon determining that at least one of the map features has changed from an initial state to a subsequent, different state, and
wherein the changed map features are updated after a specified time delay has passed, the specified time delay being varied based on a number of secondary provider computing devices that are capturing the changed map features.

7 . The system of claim 6 , wherein the updating is performed upon reaching the minimum threshold number of images of the changed map feature.

8 . The system of claim 6 , wherein the changed map feature comprises a temporary change for the map feature that, at a subsequent point in time, returns from the subsequent, different state to the initial state.

9 . The system of claim 8 , further comprising, upon determining that the temporary change for the map feature has returned to the initial state, updating, by the server computer system, the changed map feature in the map.

10 . The system of claim 6 , wherein one or more of the secondary provider computing devices is instructed to capture secondary street-level image data of the changed map features.

11 . A non-transitory computer-readable medium comprising one or more computer-readable instructions that, when executed by at least one processor of a computing device, cause the computing device to:
identify a provider computing device for use in capturing street-level imagery, wherein the provider computing device controls a camera positioned to capture street-level imagery outside a vehicle associated with the provider computing device; send instructions to the provider computing device indicating that the camera of the provider computing device is to capture street-level image data; receive street-level image data captured by the provider computing device using the camera responsive to the instructions, the received street-level image data including one or more features extracted from the street-level image data, the street-level image data including at least one subsequent image of a map feature that has changed, wherein the camera, in further response to the instructions, captures a minimum threshold number of images of the changed map feature; access a map for a specific region that includes one or more map features for the region; and update the map features based on at least one of the extracted features from the street-level image data, wherein the updating is performed upon determining that at least one of the map features has changed from an initial state to a subsequent, different state, and wherein the changed map features are updated after a specified time delay has passed, the specified time delay being varied based on a number of secondary provider computing devices that are capturing the changed map features.

Assignees

• Lyft Inc

Inventors

• Park Renee
• Saraf Saurabh
• Sarukkai Ramesh Rangarajan
• Shet Vinay

Classifications

• H04N23/661

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06V20/56

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• H04N1/00

  Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof · CPC title

• H04W4/50

  Service provisioning or reconfiguring · CPC title