Label-free non-reference image quality assessment via deep neural network

Patent metadata

Field	Value
Publication number	US-9734567-B2
Application number	US-201514931843-A
Country	US
Kind code	B2
Filing date	Nov 3, 2015
Priority date	Jun 24, 2015
Publication date	Aug 15, 2017
Grant date	Aug 15, 2017

Abstract

A method for training a neural network to perform assessments of image quality is provided. The method includes: inputting into the neural network at least one set of images, each set including an image and at least one degraded version of the image; performing comparative ranking of each image in the at least one set of images; and training the neural network with the ranking information. A neural network and image signal processing tuning system are disclosed.

First claim

What is claimed is:

1. A method for training a neural network to perform assessments of image quality, the method comprising:
inputting into the neural network at least one set of images, each set comprising an image and at least one degraded version of the image;
performing in a comparative layer a comparative ranking of each image in the at least one set of images by implementing a sigmoid function to provide pairwise ranking of the images within each set of images, the sigmoid function comprising:

h
⁡

(

y
i

,

y
j

)

=

1

1
+

ⅇ

l

i
·
j

⁡

(

y
i

-

y
j

)

wherein, y i and y j represent output quality scores associated with input images, x i and x j , respectively; and l i,j represents prior information for pairwise ranking of y i and y j output by the comparative layer; and
training the neural network with the ranking information.

2. The method as in claim 1 , wherein learning rules for the comparative layer comprise:

∂

∂

y
i

=

-

l

i
·
j

⁢

1

1
+

ⅇ

l

i
·
j

⁡

(

y
i

-

y
j

)

⁢

(

1
-

1

1
+

ⅇ

l

i
·
j

⁡

(

y
i

-

y
j

)

)

;

∂

∂

y
j

=

l

i
·
j

⁢

1

1
+

ⅇ

l

i
·
j

⁡

(

y
i

-

y
j

)

⁢

(

1
-

1

1
+

ⅇ

l

i
·
j

⁡

(

y
i

Assignees

• Samsung Electronics Co Ltd

Inventors

• Zhang Qiang
• Ji Zhengping
• Shi Lilong
• Ovsiannikov Ilia

Classifications

• G06N3/084 Primary

  Backpropagation, e.g. using gradient descent · CPC title

• G06T2207/20084

  Artificial neural networks [ANN] · CPC title

• G06N3/045

  Combinations of networks · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06T2207/20081

  Training; Learning · CPC title