Signal processors and methods for estimating geometric transformations of images for digital data extraction

Patent metadata

Field	Value
Publication number	US-9959587-B2
Application number	US-201615211944-A
Country	US
Kind code	B2
Filing date	Jul 15, 2016
Priority date	Jul 16, 2015
Publication date	May 1, 2018
Grant date	May 1, 2018

Abstract

Signal processing devices and methods estimate a geometric transform of an image signal. From a seed set of transform candidates, a method applies a seed transform candidate to a reference signal. For each candidate, update coordinates of reference signal features are identified in the image signal and provided as input to a least squares method to compute an update to the transform candidate. At the end of the process, the method identifies a geometric transform or set of top transforms based on a further analysis of correlation, as well as other results. Phase characteristics are exploited in the process of updating coordinates. The geometric transform is used to facilitate extracting embedded digital messages from the image.

First claim

The invention claimed is:

1. A method of determining a geometric transform of a reference signal in an image for extracting digital data, the method comprising:
with a programmed processor or digital logic circuit:
transforming the image into a frequency domain to produce a discrete frequency domain representation of the image at integer coordinates;
estimating phase at non-integer coordinates within the discrete frequency domain representation of the image according to a point spread function;
for plural reference signal components of a reference signal:
transforming coordinates of a reference signal component according to a candidate geometric transform;
updating the coordinates of the reference signal component to a location within a neighborhood of the discrete frequency domain representation around the coordinates of the transformed reference signal component, the location corresponding to a highest frequency magnitude value of frequency magnitude values within the neighborhood, wherein frequency magnitude values at non-integer locations in the neighborhood are computed using the phase estimated at non-integer locations;

determining a new geometric transform that transforms the reference signal components to the updated coordinates; and

applying the new geometric transform to extract encoded digital data from the image.

2. The method of claim 1 wherein estimating phase at non-integer coordinates comprises estimating complex frequency components at the non-integer coordinates by applying weights obtained from the point spread function to neighboring complex frequency components at integer locations;
and wherein the frequency magnitude values within the neighborhood are magnitude values of the complex frequency components in the neighborhood.

3. The method of claim 1 wherein the reference signal components comprise peaks in the frequency domain.

4. The method of claim 1 wherein the reference signal components comprise sinusoids.

5. The method of claim 1 including:
determining a signal confidence metric for a reference signal in an image block based on applying the new geometric transform to approximate geometric distortion of the image block; and
weighting digital message elements extracted from the image block by the signal confidence metric.

6. The method of claim 1 further comprising:
measuring correlation between the transformed reference signal component and the image;
for geometric transform candidates, performing the transforming of coordinates and the measuring of correlation with a lower frequency subset of the plural reference signal components to determine a subset of the geometric transform candidates for further refinement; and
in plural refinement stages, performing the transforming of coordinates, the measuring of correlation, the updating of coordinates and the determining of a new geometric transform on the subset of the geometric transform candidates.

7. The method of claim 1 further comprising:
measuring correlation between the transformed reference signal component and the image; and
executing instructions on one or more programmed processors to execute the acts of transforming coordinates, measuring, updating, determining the new geometric transform, and applying the new geometric transform.

8. The method of claim 1 further comprising:
measuring correlation between the transformed reference signal component and the image; and
performing the acts of transforming coordinates, measuring, updating, determining the new geometric transform, and applying the new geometric transform in special purpose digital logic circuitry.

9. The method of claim 1 , further comprising:
with the programmed processor or digital logic circuit:

for plural reference signal components of a reference signal,
transforming coordinates of a reference signal component according to a candidate geometric transform;
measuring correlation between the transformed reference signal component and the image, the correlation comprising a combination of complex components of the frequency domain transform of the image at neighboring integer coordinates around the coordinates of the transformed reference signal component, wherein the complex combination combines complex components according to a phase relationship at the neighboring coordinates; and

assessing the candidate geometric transform based on the correlation.

10. The method of claim 9 wherein the phase relationship comprises matching phase at upper right and lower left neighbors, and matching phase at upper left and lower right neighbors, and phase at the upper right and upper left neighbors differ by 180 degrees.

11. The method of claim 9 comprising:
for geometric transform candidates, performing the transforming coordinates and the measuring of correlation with a lower frequency subset of the plural reference signal components to determine a subset of the geometric transform candidates to refine; and
in plural refinement stages, performing the transforming coordinates, the measuring of correlation, the updating of coordinates and the determining of a new geometric transform on the subset of the geometric transform candidates.

12. The method of claim 1 , comprising:
from electronic memory, obtaining image samples from an image block and geometric transform parameters that approximate a geometric transform of embedding locations of the digital data encoded in the image samples of the image block;
executing instructions in a processor to:
obtain a measure of signal confidence of a reference signal in a sub-block of the image block where the geometric transform parameters are applied to provide a geometric transform between the embedding locations and the sub-block;
extract message estimates from embedding locations of the sub-block of the image block;
weight the message estimates by the signal confidence of the sub-block from which the message estimates are extracted; and
decode a message from the weighted message estimates.

13. A non-transitory computer readable medium, on which is stored instructions, which when executed by a processor, perform a method of determining a geometric transform of a reference signal in an image for extracting digital data, the method comprising:
transforming the image into a frequency domain to produce a discrete frequency domain representation of the image at integer coordinates;
estimating phase at non-integer coordinates within the discrete frequency domain representation of the image according to a point spread function;
for plural reference signal components of a reference signal:
transforming coordinates of a reference signal component according to a candidate geometric transform;
updating the coordinates of the reference signal component to a location within a neighborhood of the discrete frequency domain representation around the coordinates of the transformed reference signal component, the location corresponding to a highest frequency magnitude value of frequency magnitude values within the neighborhood, wherein frequency magnitude values at non-integer locations in the neighborhood are computed using the phase estimated at non-integer locations;

determining a new geometric transform that transforms the reference signal components to the updated coordinates; and
applying the new geometric transform to extract encoded digital data from the image.

14. The non-transitory computer readable medium of claim 13 , on which is stored instructions, which when executed by the processor, estimate complex frequency components at the non-integer coordinates by applying weights obtained from the point

Assignees

• Digimarc Corp

Inventors

• Sharma Ravi K
• Lord John D
• Lyons Robert G
• Alattar Osama M
• Boles Jacob L

Classifications

• G06T2201/0065

  Extraction of an embedded watermark; Reliable detection · CPC title

• G06T2201/0081

  whereby both original and watermarked images are required at decoder, e.g. destination-based, non-blind, non-oblivious · CPC title

• G06T1/0064 Primary

  Geometric transfor invariant watermarking, e.g. affine transform invariant · CPC title

• G06T2201/0052

  Embedding of the watermark in the frequency domain · CPC title

• G06T3/0006

  Physics · mapped topic