Device and method for inserting advertisement by using frame clustering

Patent metadata

Field	Value
Publication number	US-2016142792-A1
Application number	US-201414898450-A
Country	US
Kind code	A1
Filing date	Dec 10, 2014
Priority date	Jan 24, 2014
Publication date	May 19, 2016
Grant date	—

Abstract

The present invention is directed to a device and method for inserting an advertisement using frame clustering. According to the present invention, when an advertisement insertion region is set in at least one of the frames of a video, advertisement insertion target frames including advertisement insertion regions are searched for and clustered, and an advertisement is inserted for all the clustered frames in a uniform manner, thereby enabling the natural insertion of the advertisement.

First claim

1 . A device for inserting an advertisement, comprising:
a frame search unit configured to, when an advertisement insertion region is set in at least one of frames of a video, search for advertisement insertion target frames including advertisement insertion regions; a clustering unit configured to group the advertisement insertion target frames, select any one of the advertisement insertion target frames as a reference frame, compare an advertisement insertion region in the reference frame with advertisement insertion regions in advertisement insertion target frames other than the reference frame, calculate a value of a difference with the reference frame as a clustering factor, and perform clustering; and an advertisement insertion unit configured to, when an advertisement is inserted into at least one of the clustered frames, insert the advertisement for all the clustered frames in a uniform manner.

2 . The device of claim 1 , wherein the clustering unit comprises:
a scene structure analysis unit configured to acquire any one or more of a location, size, rotation and perspective of the advertisement insertion region and analyze a scene structure; a camera motion analysis unit configured to acquire any one or more of a focus and shaking of the advertisement insertion region and analyze a camera motion of the advertisement insertion region; and a clustering factor calculation unit configured to select a frame in which the advertisement insertion region has been set as the reference frame, compare an advertisement insertion region in the reference frame with advertisement insertion regions in advertisement insertion target frames other than the reference frame, and calculate a value of a difference with the reference frame as the clustering factor.

3 . The device of claim 2 , wherein the clustering factor calculation unit compares the scene structure with the camera motion in the reference frame and scene structures and camera motions in the advertisement insertion target frames other than the reference frame.

4 . The device of claim 3 , wherein the clustering factor calculation unit determines global movement between successive frames with respect to the clustered frames, and calculates the clustering factor based on a result of the determination of the global movement.

5 . The device of claim 4 , wherein the clustering unit extracts only portions including the advertisement insertion regions from the respective advertisement insertion target frames, and clusters the extracted portions.

6 . The device of claim 5 , wherein the clustering unit clusters frames successive from the reference frame.

7 . The device of claim 6 , wherein the frame search unit determines global movement of the successive frames, and searches for the advertisement insertion target frames based on a result of the determination of the global movement.

8 . The device of claim 7 , wherein the frame search unit predicts the location of the advertisement insertion region in any one or more of previous and subsequent frames using the result of the determination of the global movement, and searches for the advertisement insertion target frames.

9 - 19 . (canceled)

20 . A device for inserting an advertisement, comprising:
a candidate region determination unit configured to determine a candidate region into which a virtual indirect advertisement will be inserted in video image content; an advertisement insertion unit configured to process the virtual indirect advertisement and insert the processed virtual indirect advertisement into the candidate region; an exposure measurement unit configured to measure an exposure level of the virtual indirect advertisement based on exposure characteristics in which the virtual indirect advertisement is exposed in the video image content; and an information provision unit configured to provide insertion region guide information including the exposure level of the virtual indirect advertisement to a user.

21 . The device of claim 20 , wherein the information provision unit determines whether the exposure level of the virtual indirect advertisement exceeds a preset reference exposure level, and provides the insertion region guide information including the exposure level of the virtual indirect advertisement to the user if the exposure level of the virtual indirect advertisement exceeds the preset reference exposure level.

22 . The device of claim 21 , wherein the information provision unit displays any one or more of a candidate region into which the virtual indirect advertisement has been inserted and a candidate region which is present before insertion of the virtual indirect advertisement.

23 . The device of claim 22 , wherein the device for inserting an advertisement, further comprising:
an advertising expense calculation unit configured to calculate the advertising expenses of the virtual indirect advertisement based on the exposure level.

24 . The device of claim 20 , wherein the advertisement insertion unit comprising:
an advertisement selection unit configured to select the virtual indirect advertisement which will be inserted into the candidate region; an advertisement processing unit configured to process the virtual indirect advertisement based on a preliminary processing characteristic so that the virtual indirect advertisement can be inserted into the candidate region; and a processed advertisement insertion unit configured to insert the processed virtual indirect advertisement into the candidate region.

25 . The device of claim 20 , wherein the exposure characteristics include a real-time characteristic which is measured in real time while the virtual indirect advertisement is being exposed in the video image content, and the preliminary processing characteristic.

26 . The device of claim 20 , wherein the exposure measurement unit includes a size measurement unit configured to measure the exposure level in proportion to the ratio of the size of the exposed region of the virtual indirect advertisement which is exposed in the video image content to the size of the overall screen.

27 . The device of claim 20 , the exposure measurement unit includes a time measurement unit configured to measure the exposure level in proportion to the time for which the virtual indirect advertisement is exposed in the video image content.

28 . The device of claim 20 , the exposure measurement unit includes a deformation measurement unit configured to measure the exposure level in inverse proportion to the difference between the angle at which the virtual indirect advertisement is exposed in the video image content and a preset reference angle.

29 . A device for inserting an advertisement, comprising:
an advertisement selection unit configured to select a virtual indirect advertisement which will be inserted into video image content; an inpainting region generation unit configured to generate an inpainting region and a non-inpainting region by comparing the virtual indirect advertisement with an existing advertisement included in the video image content; an inpainting unit configured to perform inpainting on only the inpainting region; and an advertisement insertion unit configured to insert the virtual indirect advertisement into the video image content after the inpainting of the inpainting region.

30 . The device of claim 29 , wherein the inpainting region generation unit generates a target region including a region of the existing advertisement, and generates the inpainting region and the

Assignees

• Sk Planet Co Ltd

Inventors

• Lee Su-Bin
• Shin Hyoung-Chul
• Han Ju-Hyeun
• Jeon Byoung-Ki

Classifications

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06F18/23

  Clustering techniques · CPC title

• H04N21/235

  Processing of additional data, e.g. scrambling of additional data or processing content descriptors · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• H04N21/812 Primary

  involving advertisement data (advertising per se G06Q30/02) · CPC title