Methods and apparatus for collecting image data

Patent metadata

Field	Value
Publication number	US-9509867-B2
Application number	US-16914308-A
Country	US
Kind code	B2
Filing date	Jul 8, 2008
Priority date	Jul 8, 2008
Publication date	Nov 29, 2016
Grant date	Nov 29, 2016

Abstract

An image processing system identifies desired views of a particular subject and triggers a mobile camera device in proximity to the subject to capture a digital image, thus collecting new image data to augment an existing database. In an exemplary method, location data for a camera-equipped mobile communication device in visual proximity to a subject of interest is received at an image collection server. Upon determining whether the location data corresponds to a desired view of the subject of interest, the image collection server sends an image capture request to the mobile device, triggering the user of the device to capture an image of the subject. Finally, digital image data is received from the mobile communication device in response to the image capture request. The digital image data may then be used for assembling a composite representation of the subject of interest, such as a 3D model of the subject.

First claim

What is claimed is:

1. A method of modifying a three-dimensional model of a real-world subject of interest, comprising:
determining that a database of digital image data used for building the three-dimensional model of the real-world subject of interest sparsely represents a desired view of the real-world subject of interest;
receiving location data by an image collection server for a mobile communication device in visual proximity to the real-world subject of interest;
determining that the location data corresponds to the desired view of the real-world subject of interest;
sending an image capture request from the image collection server to the mobile communication device responsive to said determining, said image capture request requesting the mobile communication device to capture an image of the desired view; and
receiving digital image data that corresponds to the image of the desired view of the real-world subject of interest from the mobile communication device in response to the image capture request;
modifying the three-dimensional model of the real-world subject of interest based on the received digital image data;
wherein the image collection server is a master device configured to coordinate collection of images by one or more slave devices including the mobile communication device in response to the image collection server being within radio communication range of the real-world subject of interest, the mobile communication device, or both.

2. The method of claim 1 , further comprising:
receiving camera position data corresponding to the digital image data; and
storing the camera position data in association with the digital image data for use in assembling the three-dimensional model of the real-world subject of interest.

3. The method of claim 2 , wherein the camera position data comprises camera location data, indicating a location for the mobile communication device at the time the digital image data was captured, or camera orientation data, indicating an orientation for the mobile communication device at the time the digital image data was captured, or both.

4. The method of claim 1 , further comprising:
determining a desired reference position with respect to the real-world subject of interest;
forming a positioning instruction by the image collection server based on the desired reference position; and
sending the positioning instruction from the image collection server to the mobile communication device.

5. The method of claim 4 , wherein the positioning instruction comprises reference location data, reference orientation data, or both, for use in capturing the digital image data.

6. The method of claim 1 , wherein the image collection server:
is configured to coordinate the collection of images in further response to the image collection server being in visual proximity to the real-world subject of interest; and
comprises a camera configured to capture images.

7. An image collection server comprising:
a communication network interface configured to exchange signals with a network; and
one or more processing circuits communicatively coupled to the communication network interface and configured to:
determine that a database of digital image data used for building a three-dimensional model of the real-world subject of interest sparsely represents a desired view of the real-world subject of interest;
receive, via the communication network interface, location data for a mobile communication device in visual proximity to the real-world subject of interest;
determine that the location data corresponds to the desired view of the real-world subject of interest;
send, using the communication network interface, an image capture request to the mobile communication device responsive to said determining, said image capture request requesting the mobile communication device to capture an image of the desired view; and
receive, via the communication network interface, digital image data that corresponds to the image of the desired view of the real-world subject of interest from the mobile communication device in response to the image capture request;
modifying the three-dimensional model of the real-world subject of interest based on the received digital image data;

wherein the image collection server is a master device that coordinates collection of images by one or more slave devices including the mobile communication device in response to the image collection server being within radio communication range of the real-world subject of interest, the mobile communication device, or both.

8. The image collection server of claim 7 , wherein the one or more processing circuits are further configured to:
receive camera position data corresponding to the digital image data; and
store the camera position data in association with the digital image data for use in assembling the three-dimensional model of the real-world subject of interest.

9. The image collection server of claim 8 , wherein the camera position data comprises camera location data, indicating a location for the mobile communication device at the time the digital image data was captured, or camera orientation data, indicating an orientation for the mobile communication device at the time the digital image data was captured, or both.

10. The image collection server of claim 7 , wherein the one or more processing circuits are further configured to:
determine a desired reference position with respect to the real-world subject of interest;
form a positioning instruction based on the desired reference position; and
send the positioning instruction to the mobile communication device, using the communication network interface.

11. The image collection server of claim 10 , wherein the positioning instruction comprises reference location data, reference orientation data, or both, for use in capturing the digital image data.

12. The image collection server of claim 7 , wherein the image collection server:
is configured to coordinate the collection of images in further response to the image collection server being in visual proximity to the real-world subject of interest; and
comprises a camera configured to capture images.

Assignees

• Camp Jr William O
• Kokes Mark Gavin
• Bowen Toby John
• Marcinkiewicz Walter M
• Sony Corp
• Sony Mobile Communications Inc

Inventors

• Camp Jr William O
• Kokes Mark Gavin
• Bowen Toby John
• Marcinkiewicz Walter M

Classifications

• H04M2250/52

  including functional features of a camera · CPC title

• H04M1/72572

  Electricity · mapped topic

• H04N1/00307 Primary

  with a mobile telephone apparatus (constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00) · CPC title

• H04M2250/10

  including a GPS signal receiver · CPC title

• H04N1/00244

  with a server, e.g. an internet server (fax-servers or the like for store and forward H04N1/324) · CPC title