Information processing apparatus, information processing method, and computer-readable storage medium

Patent metadata

Field	Value
Publication number	US-2016128450-A1
Application number	US-201514980630-A
Country	US
Kind code	A1
Filing date	Dec 28, 2015
Priority date	Mar 1, 2011
Publication date	May 12, 2016
Grant date	—

Abstract

A method is provided for generating output image data. The method comprises receiving image data representing an input image, the input image containing at least one facial image. The method further comprises recognizing the facial image in the image data, and recognizing facial features of the facial image. The method further comprises generating data representing a makeup image based on the recognized facial features, the makeup image providing information assisting in the application of makeup. The method also comprises generating output image data representing the makeup image superimposed on the facial image.

First claim

What is claimed is:

1 . An augmented reality makeup support technology apparatus comprising:
circuitry configured to
retrieve a makeup scheme information from a database which stores the makeup scheme information, a makeup artist providing the makeup scheme information, and cosmetics and makeup tools the makeup artist uses for the makeup scheme information based on a desirable selection of a user; and
control a display to display an AR makeup image corresponding to the makeup scheme information of the makeup artist selected by the user on the user's face image.

2 . The augmented reality makeup support technology apparatus according to claim 1 , wherein the database further stores a makeup procedure which is acquired by a camera and an action sensor attached to the makeup artist.

3 . The augmented reality makeup support technology apparatus according to claim 2 , wherein the action sensor is attached to an arm or hand of the makeup artist.

4 . The augmented reality makeup support technology apparatus according to claim 2 , wherein the action sensor acquires pressure information based on contact by makeup tools upon cosmetics or skin.

5 . The augmented reality makeup support technology apparatus according to claim 1 , wherein the database further stores a makeup procedure which is acquired by one or more sensors attached to a mannequin.

6 . The augmented reality makeup support technology apparatus according to claim 1 , wherein the database further stores a makeup procedure which is acquired by one or more sensors attached to makeup tools.

7 . The augmented reality makeup support technology apparatus according to claim 1 , wherein the AR makeup image is displayed to be overlaid on the user's face and refers to a makeup procedure done by the makeup artist.

8 . The augmented reality makeup support technology apparatus according to claim 1 , wherein the circuitry is further configured to control the display to display cosmetics information.

9 . The augmented reality makeup support technology apparatus according to claim 8 , wherein the cosmetics information comprises at least one of a maker, a brand name, a product name, a price, and a product explanation.

10 . The augmented reality makeup support technology apparatus according to claim 8 , wherein the cosmetics information provides information of appropriate cosmetics to be used when makeup based on the makeup scheme information is applied by the user.

11 . The augmented reality makeup support technology apparatus according to claim 8 , wherein the circuitry is further configured to control the display to display a buy button in conjunction with the displayed cosmetics information, the buy button provided for making a purchase of corresponding cosmetics.

12 . The augmented reality makeup support technology apparatus according to claim 1 , wherein the circuitry is further configured to control the display to display cosmetics information.

13 . The augmented reality makeup support technology apparatus according to claim 1 , further comprising:
a camera configured to capture an image of a new makeup scheme of the user.

14 . The augmented reality makeup support technology apparatus according to claim 13 , wherein the circuitry is further configured to initiate transmission of the captured image of the new makeup scheme of the user to a server storing the database.

15 . An augmented reality makeup support technology method comprising:
retrieving a makeup scheme information from a database which stores the makeup scheme information, a makeup artist providing the makeup scheme information, and cosmetics and makeup tools the makeup artist uses for the makeup scheme information based on a desirable selection of a user, and displaying an AR makeup image corresponding to the makeup scheme information of the makeup artist selected by the user on the user's face image.

16 . A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:
retrieving a makeup scheme information from a database which stores the makeup scheme information, a makeup artist providing the makeup scheme information, and cosmetics and makeup tools the makeup artist uses for the makeup scheme information based on a desirable selection of a user, and controlling a display to display an AR makeup image corresponding to the makeup scheme information of the makeup artist selected by the user on the user's face image.

Assignees

• Sony Corp

Inventors

• Saito Mari
• Kashitani Tatsuki

Classifications

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• A45D44/005 Primary

  for selecting or displaying personal cosmetic colours or hairstyle · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title