Imaging system and monitoring system with training data that includes a color picture image and a color animation image

Patent metadata

Field	Value
Publication number	US-11863728-B2
Application number	US-202017764622-A
Country	US
Kind code	B2
Filing date	Sep 29, 2020
Priority date	Oct 11, 2019
Publication date	Jan 2, 2024
Grant date	Jan 2, 2024

Abstract

Color filters are used for color images obtained using imaging devices such as conventional image sensors. Imaging elements with color filters are sold, and an appropriate combination of the imaging element and a lens or the like is incorporated in an electronic device. Only providing a color filter to overlap a light-receiving region of an image sensor reduces the amount of light reaching the light-receiving region. An imaging system of the present invention includes a solid-state imaging element without a color filter, a storage device, and a learning device. Since the color filter is not included, colorization is performed on obtained monochrome image data (analog data), and coloring is performed using an AI system.

First claim

The invention claimed is:

1. An imaging system comprising:
a solid-state imaging element without a color filter;
a storage device; and
a learning device,
wherein the solid-state imaging element acquires monochrome image data,
wherein the learning device performs colorization of the monochrome image data using training data stored in the storage device to create colored image data, and
wherein the training data used in the learning device includes a color picture image and a color animation image.

2. The imaging system according to claim 1 , wherein super-resolution processing is performed on the monochrome image data at least once.

3. The imaging system according to claim 1 , wherein super-resolution processing is performed on the training data at least once.

4. The imaging system according to claim 1 , wherein the monochrome image data is analog data and the colored image data is digital data.

5. A monitoring system comprising a security camera,
wherein the security camera includes a solid-state imaging element without a color filter, a learning device, and a storage device,
wherein the solid-state imaging element performs imaging while the security camera senses a person, and a software program for creating colored image data by inference of the learning device is executed using training data of the storage device, and
wherein the training data used in the learning device includes a color picture image and a color animation image.

6. The monitoring system according to claim, 5 , wherein the colored image data is digital data.

Assignees

• Semiconductor Energy Lab

Inventors

• Akimoto Kengo
• Inoue Seiko
• Mishima Daichi

Classifications

• H04N25/46

  by combining or binning pixels · CPC title

• H04N1/6086 Primary

  by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature · CPC title

• H04N1/465 Primary

  Conversion of monochrome to colour · CPC title

• G06T1/00

  General purpose image data processing · CPC title

• G06V10/82

  using neural networks · CPC title