Method, system and electronic device for diet management

Patent metadata

Field	Value
Publication number	US-9971876-B2
Application number	US-201615232829-A
Country	US
Kind code	B2
Filing date	Aug 10, 2016
Priority date	Dec 14, 2012
Publication date	May 15, 2018
Grant date	May 15, 2018

Abstract

An electronic device, a system and a method for diet management based on image analysis are provided. The system includes a computer and a database. The computer comprises a processor for performing the following operations: capturing at least one diet image via an image capture device; pre-processing the at least one diet image so as to obtain at least one diet region from the at least one diet image and obtain at least one detailed food segment from the diet region; extracting at least one diet image feature from the at least one detailed food segment; determining a diet type of the at least one detailed food segment based on the at least one diet image feature; and providing a personal diet characteristic analysis based on the diet type and an area of the at least one detailed food segment.

First claim

What is claimed is:

1. A computer-implemented method for diet management, adapted to a diet management system comprising a computer and a memory device used as a database, the computer comprises a processor and a plurality of program instructions, wherein the plurality of program instructions are loaded into the processor to perform the computer-implemented method, and the computer-implemented method comprising:
capturing at least one diet image via an image capture device;
pre-processing the at least one diet image so as to obtain at least one diet region from the at least one diet image and obtain at least one detailed food segment from the diet region;
extracting at least one diet image feature from the at least one detailed food segment;
generating a supervector based on the at least one diet image feature;
performing similarity comparison between the supervector and at least one feature vectors in the database to determine a diet type of the at least one detailed food segment and to determine at least one similar population;
providing information related to the similar population; and
providing a personal diet characteristic analysis based on the diet type and an area of the at least one detailed food segment,
wherein the providing the information related to the similar population comprises:
calculating at least one statistic of the similar population by using at least one multidimensional data of the similar population; and
providing the information related to the similar population based on the statistic of the similar population.

2. The method for diet management of claim 1 , wherein the pre-processing the at least one diet image comprises:
transforming the at least one diet image to a normalized space.

3. The method for diet management of claim 1 , wherein the pre-processing the at least one diet image comprises:
performing color correction, bright correction, or white balance correction on the at least one diet image;
performing background removal on the at least one diet image so as to obtain the at least one diet region; and
performing detailed food segment segmentation on the at least one diet region so as to segment out the at least one detailed food segment from the diet region.

4. The method for diet management of claim 1 , wherein the at least one image feature comprises image capturing time, image capturing location, color, texture complexity, or reflectivity.

5. The method for diet management of claim 1 , wherein the performing similarity comparison comprises:
calculating an Euclidean distance, an angle, a correlation coefficient, or mutual information between the supervector and one of the feature vectors in the database.

6. The method for diet management of claim 1 , wherein the determining the diet type of the at least one detailed food segment comprises:
performing the similarity comparison in the database or via a diet type classifier.

7. A system for diet management comprising a computer and a memory device used as a database, the computer comprises a processor and a plurality of program instructions, wherein the plurality of program instructions are loaded into the processor to perform the following operations:
capturing at least one diet image via an image capture device;
pre-processing the at least one diet image so as to obtain at least one diet region from the at least one diet image and obtain at least one detailed food segment from the diet region;
extracting at least one diet image feature from the at least one detailed food segment;
generating a supervector based on the at least one diet image feature;
performing similarity comparison between the supervector and at least one feature vectors in the database to determine a diet type of the at least one detailed food segment and to determine at least one similar population;
providing information related to the similar population; and
providing a personal diet characteristic analysis based on the diet type and an area of the at least one detailed food segment,
wherein the providing the information related to the similar population comprises:
calculating at least one statistic of the similar population by using at least one multidimensional data of the similar population; and
providing the information related to the similar population based on the statistic of the similar population.

8. The system for diet management of claim 7 , wherein the operation of pre-processing the at least one diet image comprises:
transforming the at least one diet image to a normalized space.

9. The system for diet management of claim 7 , wherein the operation of pre-processing the at least one diet image comprises:
performing color correction, bright correction, or white balance correction on the at least one diet image;
performing background removal on the at least one diet image so as to obtain the at least one diet region; and
performing detailed food segment segmentation on the at least one diet region so as to segment out the at least one detailed food segment from the diet region.

10. The system for diet management of claim 7 , wherein the at least one image feature comprises image capturing time, image capturing location, color, texture complexity, or reflectivity.

11. The system for diet management of claim 7 , wherein the performing similarity comparison comprises:
calculating an Euclidean distance, an angle, a correlation coefficient, or mutual information between the supervector and one of the feature vectors in the database.

12. The system for diet management of claim 7 , wherein the operation of determining the diet type of the at least one detailed food segment comprises:
performing the similarity comparison in the database or via a diet type classifier.

13. An electronic device comprising:
a database; and
a processing circuit, electrically coupled to the database, for capturing at least one diet image via an image capture device, pre-processing the at least one diet image so as to obtain at least one diet region from the at least one diet image and obtain at least one detailed food segment from the diet region, extracting at least one diet image feature from the at least one detailed food segment, generating a supervector based on the at least one diet image feature, performing similarity comparison between the supervector and at least one feature vectors in the database to determine a diet type of the at least one detailed food segment, providing information related to the similar population, and providing a personal diet characteristic analysis based on the diet type and an area of the at least one detailed food segment,
wherein processing circuit calculates at least one statistic of the similar population by using at least one multidimensional data of the similar population, and provides the information related to the similar population based on the statistic of the similar population.

14. The electronic device of claim 13 , wherein the processing circuit transforms the at least one diet image to a normalized space.

15. The electronic device of claim 13 , wherein the processing circuit performs color correction, bright correction, or white balance correction on the at least one diet image, the processing circuit performs background removal on the at least one diet image so as to obtain the at least one diet region, and the processing circuit performs detailed food segment segmentation on the at least one diet region so as to segment out the at least one detailed food segment from the diet region.

16. The electronic device of claim 13 , wherein the at least one image featu

Assignees

• Ind Tech Res Inst

Inventors

• Ting Chuan-Wei
• Wang Ching-Yao
• Chen Ju-Chin

Classifications

• G06V20/68

  Food, e.g. fruit or vegetables · CPC title

• G06V10/507

  Summing image-intensity values; Histogram projection analysis · CPC title

• G16H20/60

  relating to nutrition control, e.g. diets · CPC title

• G16H30/40

  for processing medical images, e.g. editing · CPC title

• G09B19/0092

  Nutrition · CPC title