Mobile search-ready smart display technology utilizing optimized content fingerprint coding and delivery

Patent metadata

Field	Value
Publication number	US-9807453-B2
Application number	US-201514984668-A
Country	US
Kind code	B2
Filing date	Dec 30, 2015
Priority date	Dec 30, 2015
Publication date	Oct 31, 2017
Grant date	Oct 31, 2017

Abstract

A method for a mobile search-ready smart display system containing a smart display having a screen and at least one mobile device having a camera including extracting a plurality of video fingerprints from an ongoing content displayed on the screen. The ongoing content has video frames corresponding to the video fingerprints; determining one or more representative video fingerprints of the video frames from the plurality of video fingerprints; generating one or more encoded representative video fingerprints through encoding the one or more representative video fingerprints into a pixel translucency change; and delivering the one or more encoded representative video fingerprints via a screen-camera communication. The method also includes optimizing the encoding of the one or more representative video fingerprints and the delivering of the one or more encoded representative video fingerprints to find a balance between an error resilience and transmission time.

First claim

What is claimed is:

1. A method for a mobile search-ready smart display system containing a smart display having a screen and at least one mobile device having a camera, the method comprising:
extracting, by a hardware processor, a plurality of video fingerprints from an ongoing content displayed on the screen, the ongoing content having video frames corresponding to the video fingerprints;
determining, by the hardware processor, one or more representative video fingerprints of the video frames from the plurality of video fingerprints;
generating, by the hardware processor, one or more encoded representative video fingerprints through encoding the one or more representative video fingerprints into a pixel translucency change;
delivering, by the hardware processor, the one or more encoded representative video fingerprints via a screen-camera communication; and
performing, by the hardware processor, the encoding of the one or more representative video fingerprints and the delivering of the one or more encoded representative video fingerprints by solving a polynomial time dynamic problem to find a value indicating a video retrieval accuracy between an error resilience and a transmission time.

2. The mobile search-ready smart display method according to claim 1 , further comprising:
decoding, by the hardware processor, the one or more encoded representative video fingerprints to uncoded video fingerprints;
searching, by the hardware processor, for a matching video having video frames corresponding to the uncoded video fingerprints in a content database; and
returning, by the hardware processor, searching results to a user.

3. The mobile search-ready smart display method according to claim 1 , further comprising:
solving, by the hardware processor, the polynomial time dynamic problem using a Lagrange multiplier method.

4. The mobile search-ready smart display method according to claim 1 , wherein:
the pixel translucency change is an alpha value change.

5. The mobile search-ready smart display method according to claim 4 , wherein:
the alpha value change of each pixel is based on color distribution of the video frames and frame transition.

6. The mobile search-ready smart display method according to claim 1 , wherein:
the smart display is an online display or an offline display.

7. The mobile search-ready smart display method according to claim 1 , wherein performing the encoding of the representative video fingerprints and the delivering of the encoded representative video fingerprints further includes:
finding, by the hardware processor, a probability value that the fingerprint is able to be transmitted when given limited bits are used by the fingerprint.

8. The mobile search-ready smart display method according to claim 7 , wherein:
finding the probability value is represented by finding:

E
⁡

(
P
)

=

max
⁢

⁢

{

max
⁡

[

∏

k
=
1

K

⁢

⁢

(

1
-
e

)

l
2

+
Δ

]

,

s
.
t
.

⁢
F

+

Δ
·
K

+
∇

≤

B
max

max
⁢

{

E
⁡

(

P

i
-
1

)

·

∏

k
=

Assignees

• Tcl Res America Inc

Inventors

• Wang Haohong
• Zhang Zhi
• Ning Guanghan
• Ren Xiaobo

Classifications

• H04N21/6587

  Control parameters, e.g. trick play commands, viewpoint selection · CPC title

• H04N21/6379

  directed to encoder {, e.g. for requesting a lower encoding rate} · CPC title

• H04N21/440236

  by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text · CPC title

• H04N21/44008 Primary

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• H04N21/234336

  by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text · CPC title