Body information analysis apparatus with augmented reality and eyebrow shape preview method thereof

Patent metadata

Field	Value
Publication number	US-10528796-B2
Application number	US-201815870987-A
Country	US
Kind code	B2
Filing date	Jan 14, 2018
Priority date	Sep 28, 2017
Publication date	Jan 7, 2020
Grant date	Jan 7, 2020

Abstract

A body information analysis apparatus (1) with augmented reality and an eyebrow shape preview method thereof are provided. The method includes following steps of: capturing a face image (51); recognizing an eye image from the face image (51); calculating a projection position (73) according to a position of the eye image and an eyebrow offset; displaying the face image (51) and a sample eyebrow image (81,82) at the projection position (73) in a preview mode; and, displaying the face image (51) and an outline eyebrow shape pattern (71,72) at the projection position (73) in an auxiliary mode. Therefore, the dissatisfaction for the shaped eyebrow shape from the user can be prevented, and the technical threshold of eyebrow-shaping can be reduced significantly, and a probability of shaping eyebrows successfully can be increased as well.

First claim

What is claimed is:

1. An eyebrow shape preview method with augmented reality applied to a body information analysis apparatus, comprising following steps of:
a) controlling an image capture module of the body information analysis apparatus to capture a face image;
b) controlling a process unit of the body information analysis apparatus to recognize an eye image in the face image;
c) recognizing a plurality of eyebrow feature points of an eyebrow image in the face image, wherein the eyebrow feature points respectively correspond to a plurality of different features of an eyebrow;
d) selecting one of a plurality of sample eyebrow images, wherein there are a plurality of sample feature points configured on each sample eyebrow image, the sample feature points respectively correspond to the different features of the eyebrow;
e) calculating a projection position for the selected sample eyebrow image according to a position of the eye image and an eyebrow offset to the eye image;
f) calculating an adjustment parameter set according to each of the eyebrow feature points and each of the sample feature points of the selected sample eyebrow image corresponding to the same feature of the eyebrow, wherein the adjustment parameter set comprises a translation parameter, a rotation parameter and a scaling parameter;
g) adjusting a plurality of positions of the sample feature points according to the adjustment parameter set for adjusting the sample eyebrow image being selected;
h) synthesizing the face image and the sample eyebrow image being adjusted into a synthetic image used to completely express appearance of the sample eyebrow image being adjusted on the face image according to the projection position, and controlling a display module of the body information analysis apparatus to display the synthetic image in a preview mode; and
i) rendering an outline eyebrow shape pattern according to the adjusted positions of the sample feature points, and controlling the display module to display the face image, and display the outline eyebrow shape pattern used to instruct outline or range of the sample eyebrow image being adjusted at the projection position in an auxiliary mode.

2. The eyebrow shape preview method according to claim 1 , wherein the step b) comprises a step b1) recognizing a plurality of eye feature points of the eye image, wherein the eye feature points respectively correspond to a plurality of different features of an eye and are used indicate a position of the eye.

3. The eyebrow shape preview method according to claim 2 , wherein the eye feature points comprise an eye tail feature point corresponding to an eye tail, and the step c) comprises:
e1) retrieving the eyebrow offset; and
e2 obtaining the projection position via moving vertically upwards the eyebrow offset form a position of the eye tail feature point.

4. The eyebrow shape preview method according to claim 3 , wherein the different eyebrow offsets and the sample eyebrow images ( 81 , 82 ) are prestored in a memory ( 17 ) of body information analysis apparatus ( 1 ), the different eyebrow offsets respectively correspond to the sample eyebrow images ( 81 , 82 ), the step d) is configured to select one of the sample eyebrow images ( 81 , 82 ) according to a selection command or a selection operation, the step e1) is configured to retrieve the eyebrow offset corresponding to the selected sample eyebrow image ( 81 , 82 ) from the different eyebrow offsets.

5. The eyebrow shape preview method according to claim 1 , wherein the eyebrow feature points comprise an eyebrow tail feature point corresponding to an eyebrow tail, the step e1) comprises a step e11) calculating a distance between the eyebrow tail feature point and the eye tail feature point, and configuring the distance as the eyebrow offset.

6. The eyebrow shape preview method according to claim 5 , wherein the step e11) is configured to calculate a vertical distance between the eyebrow tail feature point and the eye tail feature point, and configure the vertical distance as the eyebrow offset.

7. The eyebrow shape preview method according to claim 1 , wherein three of the eyebrow feature points and three of the sample feature points respectively correspond to an eyebrow head, an eyebrow peak and an eyebrow tail of the eyebrow.

8. A body information analysis apparatus with augmented reality, comprising:
an image capture module used to capture a face image;
a process unit electrically connected to the image capture module, comprising a face analysis module, a synthesis module, an adjustment module and a rendering module, the process unit recognizing an eye image in the face image, the process unit recognizing by the face analysis module a plurality of eyebrow feature points of an eyebrow image in the face image and a plurality of eye feature points of the eye image, the eye feature points respectively corresponding to a plurality of different features of an eye, the eyebrow feature points respectively corresponding to a plurality of different features of an eyebrow, the process unit selecting one of a plurality of sample eyebrow images, there are a plurality of sample feature points configured on each sample eyebrow image, the sample feature points respectively correspond to the different features of the eyebrow, the process unit calculating a projection position for the sample eyebrow image being selected according to a position of the eye image and an eyebrow offset to the eye image, the process unit, by the adjustment module, calculating an adjustment parameter set according to each of the eyebrow feature point and each of the sample feature point corresponding to the same feature of the eyebrow,
adjusting a plurality of positions of the sample feature points according to the adjustment parameter set for adjusting the sample eyebrow image, the adjustment parameter set comprising a translation parameter, a rotation parameter and a scaling parameter, the process unit synthesizing by the synthesis module the face image and the sample eyebrow image being adjusted into the synthetic image used to completely express appearance of the sample eyebrow image being adjusted on the face image according to the projection position in a preview mode, the process unit rendering by the rendering module an outline eyebrow shape pattern according to the adjusted positions of the sample feature points; and
a display module, displaying a synthetic image in the preview mode, the display module displaying the face image and displaying the outline eyebrow shape pattern used to instruct outline or range of the sample eyebrow image being adjusted at the projection position in an auxiliary mode.

9. The body information analysis apparatus according to claim 8 , wherein the eye feature points comprise an eye tail feature point corresponding to an eye tail, the process unit further comprises a calculation module, the calculation module calculates the projection position via moving vertically upwards the eyebrow offset form a position of the eye tail feature point.

10. The body information analysis apparatus according to claim 8 , wherein the body information analysis apparatus further comprises:
a memory electrically connected to the process unit, the memory storing the sample eyebrow images and the different eyebrow offsets, wherein the sample eyebrow images respectively corresponding to the different eyebrow offsets;
an input interface electrically connected to the process unit, the input interface being used to receive a selection operation of selecting one of the sample eyebrow images; and
a wireless transmission module connected to an electronic device, the wireless transmission module being used to receive a selection comman

Assignees

• Cal Comp Big Data Inc

Inventors

• Shen Shyh-Yong
• Chi Min-Chang
• Gosno Eric Budiman

Classifications

• E04G21/3204

  against falling down · CPC title

• A62B35/0025

  Details and accessories · CPC title

• A62B35/0012 Primary

  Sit harnesses · CPC title

• A41F9/00

  Belts, girdles, or waistbands for trousers or skirts · CPC title

• A41F3/04

  Means for joining the strips, tongues, or the like, to the body of the braces · CPC title