Preview image acquisition user interface for linear panoramic image stitching

Patent metadata

Field	Value
Publication number	US-9961260-B2
Application number	US-201715715081-A
Country	US
Kind code	B2
Filing date	Sep 25, 2017
Priority date	Jan 19, 2015
Publication date	May 1, 2018
Grant date	May 1, 2018

Abstract

A system and method that allows the capture of a series of images to create a single linear panoramic image is disclosed. The method includes capturing an image, dynamically comparing a previously captured image with a preview image on a display of a capture device until a predetermined overlap threshold is satisfied, generating a user interface to provide feedback on the display of the capture device to guide a movement of the capture device, and capturing the preview image with enough overlap with the previously captured image with little to no tilt for creating a linear panorama.

First claim

What is claimed is:

1. A computer-implemented method comprising:
identifying a first image of a first portion of an object of interest;
receiving a request for a realignment between the first image and a first preview image on a client device;
acquiring the first preview image;
generating a user interface including the first preview image and an overlay of a semi-transparent image mask of the first image on the first preview image;
comparing the first preview image with the first image;
adding a first visually distinct indicator to the user interface based on comparing the first preview image with the first image, the first visually distinct indicator guiding a movement of the client device to achieve the realignment;
determining whether the realignment is successful; and
responsive to determining that the realignment is successful, updating the user interface to indicate that the realignment is successful.

2. The computer-implemented method of claim 1 , wherein comparing the first preview image with the first image further comprises:
determining features of the first image and the first preview image;
comparing the features of the first image and the first preview image; and
determining a similarity measure function based on comparing the features of the first image and the first preview image.

3. The computer-implemented method of claim 2 , wherein adding the first visually distinct indicator to the user interface further comprises:
updating a position of the first visually distinct indicator relative to a target outline at a center of the user interface based on the similarity measure function.

4. The computer-implemented method of claim 2 , wherein determining whether the realignment is successful comprises determining whether the similarity measure function satisfies an alignment threshold.

5. The computer-implemented method of claim 3 , wherein determining whether the realignment is successful comprises determining whether the position of the first visually distinct indicator is within a boundary of the target outline at the center of the user interface.

6. The computer-implemented method of claim 1 , wherein responsive to determining that the realignment is successful, removing the overlay of the semitransparent image mask of the first image.

7. The computer-implemented method of claim 1 , further comprising:
determining a pattern for guiding a movement of the client device to capture a series of images of the object of interest;
adding a second visually distinct indicator to the user interface, the second visually distinct indicator identifying a first direction for guiding the movement of the client device based on the pattern;
acquiring a second preview image of a second portion of the object of interest;
comparing the first image with the second preview image to determine whether an overlap between the first image and the second preview image satisfies an overlap threshold; and
responsive to the overlap between the first image and the second preview image satisfying the overlap threshold, receiving a second image corresponding to the second preview image.

8. A system comprising:
one or more processors; and
a memory, the memory storing instructions, which when executed cause the one or more processors to:
identify a first image of a first portion of an object of interest;
receive a request for a realignment between the first image and a first preview image on a client device;
acquire the first preview image;
generate a user interface including the first preview image and an overlay of a semi-transparent image mask of the first image on the first preview image;
compare the first preview image with the first image;
add a first visually distinct indicator to the user interface based on comparing the first preview image with the first image, the first visually distinct indicator guiding a movement of the client device to achieve the realignment;
determine whether the realignment is successful; and
responsive to determining that the realignment is successful, update the user interface to indicate that the realignment is successful.

9. The system of claim 8 , wherein to compare the first preview image with the first image, the instructions further cause the one or more processors to:
determine features of the first image and the first preview image;
compare the features of the first image and the first preview image; and
determine a similarity measure function based on comparing the features of the first image and the first preview image.

10. The system of claim 9 , wherein to add the first visually distinct indicator to the user interface, the instructions further cause the one or more processors to:
update a position of the first visually distinct indicator relative to a target outline at a center of the user interface based on the similarity measure function.

11. The system of claim 9 , wherein to determine whether the realignment is successful, the instructions further cause the one or more processors to determine whether the similarity measure function satisfies an alignment threshold.

12. The system of claim 10 , wherein to determine whether the realignment is successful, the instructions further cause the one or more processors to determine whether the position of the first visually distinct indicator is within a boundary of the target outline at the center of the user interface.

13. The system of claim 8 , wherein to responsive to determining that the realignment is successful, the instructions further cause the one or more processors to remove the overlay of the semitransparent image mask of the first image.

14. The system of claim 8 , wherein the instructions further cause the one or more processors to:
determine a pattern for guiding a movement of the client device to capture a series of images of the object of interest;
add a second visually distinct indicator to the user interface, the second visually distinct indicator identifying a first direction for guiding the movement of the client device based on the pattern;
acquire a second preview image of a second portion of the object of interest;
compare the first image with the second preview image to determine whether an overlap between the first image and the second preview image satisfies an overlap threshold; and
responsive to the overlap between the first image and the second preview image satisfying the overlap threshold, receive a second image corresponding to the second preview image.

15. A computer program product comprising a non-transitory computer readable medium storing a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:
identify a first image of a first portion of an object of interest;
receive a request for a realignment between the first image and a first preview image on a client device;
acquire the first preview image;
generate a user interface including the first preview image and an overlay of a semi-transparent image mask of the first image on the first preview image;
compare the first preview image with the first image;
add a first visually distinct indicator to the user interface based on comparing the first preview image with the first image, the first visually distinct indicator guiding a movement of the client device to achieve the realignment;
determine whether the realignment is successful; and
responsive to determining that the realignment is successful, update the user interface to indicate that the realignment is successful.

16. The computer program product of claim 15 ,

Assignees

• Graham Jamey
• Van Olst Daniel G
• Ricoh Co Ltd

Inventors

• Graham Jamey
• Van Olst Daniel G

Classifications

• G06T7/30

  Determination of transform parameters for the alignment of images, i.e. image registration · CPC title

• G06T3/4038 Primary

  Image mosaicing, e.g. composing plane images from plane sub-images · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/635

  Region indicators; Field of view indicators · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title