Apparatus, method, and computer-readable storage medium for expanding an image database for evaluation of eyewear compatibility

Patent metadata

Field	Value
Publication number	US-11748929-B2
Application number	US-202017786472-A
Country	US
Kind code	B2
Filing date	Dec 11, 2020
Priority date	Dec 19, 2019
Publication date	Sep 5, 2023
Grant date	Sep 5, 2023

Abstract

The present disclosure relates to a method for expanding an image database for evaluation of eyewear compatibility. In particular, the present disclosure relates to a method, comprising receiving a user image, receiving a frame image, processing the received frame image by setting, as transparent, pixels of the received frame image except for an anterior face of the frame, defining, within the processed frame image, a left boundary and a right boundary of the anterior face of the frame, the left boundary and the right boundary corresponding to the left eye and the right eye, respectively, receiving a filter image, processing the received filter image by setting, as transparent, pixels in the received filter image outside the frame based on the left boundary and the right boundary, merging the processed frame image and the processed filter image, and overlaying the merged image onto the received user image.

First claim

The invention claimed is:

1. A method for expanding an image database for evaluation of eyewear compatibility, comprising:
receiving a user image of a face of a user;
receiving a frame image of a frame of eyewear from a plurality of images of frames of eyewear;
processing, by processing circuitry, the received frame image by setting, as transparent, pixels of the received frame image except for an anterior face of the frame of the eyewear;
defining, within the processed frame image, a left boundary and a right boundary of the anterior face of the frame of the eyewear, the defined left boundary and the defined right boundary corresponding to the left eye and the right eye, respectively;
receiving a filter image of a filter modeling a lens coating of the eyewear;
processing, by the processing circuitry, the received filter image by setting, as transparent, pixels in the received filter image outside the frame of the eyewear based on the defined left boundary and the defined right boundary of the anterior face of the frame of the eyewear;
merging the processed frame image and the processed filter image; and
overlaying, by the processing circuitry, the merged processed frame image and the processed filter image onto the received user image of the face of user.

2. The method of claim 1 , wherein the receiving includes receiving the frame image of the frame of the eyewear and two or more images of temples of the frame of the eyewear, the two or more images of the temples of the frame of the eyewear being utilized during the overlaying.

3. The method of claim 1 , wherein the processing includes processing the received frame image by centering the received frame image based on the received user image and fit models defining mounting the frame of the eyewear on the face of the user.

4. The method of claim 3 , wherein the centering includes centering the received frame image according to an orientation of the face of the user in the received user image.

5. The method according to claim 1 , wherein the processing includes processing the received frame image by
scaling the received frame image based on the received user image and one or more scaling factors, the one or more scaling factors including a pupillary factor, the pupillary factor being a relationship between a real pupillary distance and a digital pupillary distance, the digital pupillary distance being measured on the received frame image.

6. The method of claim 5 , wherein the digital pupillary distance is determined by calculating a distance between pupils of eyes of the user, the pupils of the eyes of the user being defined as gravity centers of palpebral fissures of the face of the user.

7. The method of claim 1 , further comprising processing the received user image of the face of the user based on the defined left boundary and the defined right boundary of the anterior face of the frame of the eyewear, pixels in the received user image outside the defined left boundary and the defined right boundary being set as transparent.

8. The method of claim 7 , further comprising applying a corrective factor to the processed received user image based on a vision prescription of the user.

9. The method of claim 7 , further comprising applying a corrective factor to the processed received user image based on a material of the frame of the eyewear of the processed frame image and the filter of the processed filter image.

10. The method according to claim 1 , wherein the received filter image is centered and scale according to the processed frame image.

11. An apparatus for expanding an image database for evaluation of eyewear compatibility, comprising:
processing circuitry configured to
receive a user image of a face of a user,
receive a frame image of a frame of eyewear from a plurality of images of frames of eyewear,

process the received frame image by setting, as transparent, pixels of the received frame image except for an anterior face of the frame of the eyewear,
define, within the processed frame image, a left boundary and a right boundary of the anterior face of the frame of the eyewear, the defined left boundary and the defined right boundary corresponding to the left eye and the right eye, respectively,
receive a filter image of a filter modeling a lens coating of the eyewear,
process the received filter image by setting, as transparent, pixels in the received filter image outside the frame of the eyewear based on the defined left boundary and the defined right boundary of the anterior face of the frame of the eyewear,
merge the processed frame image and the processed filter image, and
overlay the merged processed frame image and the processed filter image onto the received user image of the face of user.

12. The apparatus of claim 11 , wherein the processing circuitry is further configured to process the received frame image by centering the received frame image based on the received user image and fit models defining mounting the frame of the eyewear on the face of the user.

13. The apparatus of claim 11 , wherein the processing circuitry is further
configured to process the received frame image by scaling the received frame image based on the received user image and one or more scaling factors, the one or more scaling factors including a pupillary factor, the pupillary factor being a relationship between a real pupillary distance and a digital pupillary distance, the digital pupillary distance being measured on the received frame image.

14. The apparatus according to claim 11 , wherein the processing circuitry is further configured to process the received user image of the face of the user based on the defined left boundary and the defined right boundary of the anterior face of the frame of the eyewear, pixels in the received user image outside the defined left boundary and the defined right boundary being set as transparent.

15. The apparatus of claim 14 , wherein the processing circuitry is further configured to apply a corrective factor to the processed received user image based on a vision prescription of the user.

16. The apparatus according to claim 11 , wherein the processing circuitry is further configured to center and scale the received filter image according to the processed frame image.

17. A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by a computer, cause the computer to perform a method for expanding an image database for evaluation of eyewear compatibility, comprising:
receiving a user image of a face of a user;
receiving a frame image of a frame of eyewear from a plurality of images of frames of eyewear;
processing the received frame image by setting, as transparent, pixels of the received frame image except for an anterior face of the frame of the eyewear;
defining, within the processed frame image, a left boundary and a right boundary of the anterior face of the frame of the eyewear, the defined left boundary and the defined right boundary corresponding to the left eye and the right eye, respectively;
receiving a filter image of a filter modeling a lens coating of the eyewear;
processing the received filter image by setting, as transparent, pixels in the received filter image outside the frame of the eyewear based on the defined left boundary and the defined right boundary of the anterior face of the frame of the eyewear;
merging the processed frame image and the processed filter image; and
overlaying the merged processed frame image and the processed filter image onto the received user image of the face of user.

Assignees

• Essilor Int

Inventors

• Allione Pascal
• Bonnin Thierry

Classifications

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• G06F16/535

  Filtering based on additional data, e.g. user or group profiles · CPC title

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06T7/12

  Edge-based segmentation · CPC title

• G06T7/66

  of image moments or centre of gravity · CPC title