Methods and systems for adding content to images based on negative space recognition

Patent metadata

Field	Value
Publication number	US-10957085-B2
Application number	US-201916541761-A
Country	US
Kind code	B2
Filing date	Aug 15, 2019
Priority date	Aug 15, 2019
Publication date	Mar 23, 2021
Grant date	Mar 23, 2021

Abstract

Embodiments for adding content to images are provided. A plurality of images are received. Each of the plurality of images includes a plurality of image portions. A negative space score is calculated for each of the plurality of image portions. At least some of the plurality of image portions are selected to display content based on the calculated negative space scores. The plurality of images are caused to be rendered with the content displayed over the selected at least some of the plurality of image portions.

First claim

The invention claimed is:

1. A method for adding content to images comprising:
receiving a plurality of images, wherein each of the plurality of images comprises a plurality of image portions;
calculating a negative space score for each of the plurality of image portions, the negative space score indicative of identified negative space within each of the plurality of image portions, wherein the negative space is representative of empty space within sub-portions of each of the plurality of image portions around which a primary subject of the plurality of image portions does not occupy when rendered;
selecting at least some of the plurality of image portions to display content based on said calculated negative space scores; and
causing the plurality of images to be rendered with the content displayed over said selected at least some of the plurality of image portions.

2. The method of claim 1 , wherein the plurality of images includes a plurality of video frames.

3. The method of claim 1 , wherein the causing of the plurality of images to be rendered includes:
causing a first of the plurality of images to be rendered with the content displayed over a first of the plurality of image portions; and
after the rendering of the first of the plurality of images, causing a second of the plurality of images to be rendered with the content displayed over a second of the plurality of image portions.

4. The method of claim 3 , further comprising limiting a distance between a position of the content on the first of the plurality of images and a position of the content on the second of the plurality of images.

5. The method of claim 1 , wherein the content includes at least one of captions associated with the plurality of images and an advertisement associated with the plurality of images.

6. The method of claim 1 , further comprising:
analyzing a color tone of said selected at least some of the plurality of image portions; and
adjusting at least one of a brightness and a color of the content based on the analyzing of the color tone of said selected at least some of the plurality of image portions.

7. The method of claim 1 , wherein the calculating of the negative space score for each of the plurality of image portions is performed utilizing a cognitive analysis.

8. A system for adding content to images comprising:
a processor executing instructions stored in a memory device, wherein the processor:
receives a plurality of images, wherein each of the plurality of images comprises a plurality of image portions;
calculates a negative space score for each of the plurality of image portions, the negative space score indicative of identified negative space within each of the plurality of image portions, wherein the negative space is representative of empty space within sub-portions of each of the plurality of image portions around which a primary subject of the plurality of image portions does not occupy when rendered;
selects at least some of the plurality of image portions to display content based on said calculated negative space scores; and
causes the plurality of images to be rendered with the content displayed over said selected at least some of the plurality of image portions.

9. The system of claim 8 , wherein the plurality of images includes a plurality of video frames.

10. The system of claim 8 , wherein the causing of the plurality of images to be rendered includes:
causing a first of the plurality of images to be rendered with the content displayed over a first of the plurality of image portions; and
after the rendering of the first of the plurality of images, causing a second of the plurality of images to be rendered with the content displayed over a second of the plurality of image portions.

11. The system of claim 10 , wherein the processor further limits a distance between a position of the content on the first of the plurality of images and a position of the content on the second of the plurality of images.

12. The system of claim 8 , wherein the content includes at least one of captions associated with the plurality of images and an advertisement associated with the plurality of images.

13. The system of claim 8 , wherein the processor further:
analyzes a color tone of said selected at least some of the plurality of image portions; and
adjusts at least one of a brightness and a color of the content based on the analyzing of the color tone of said selected at least some of the plurality of image portions.

14. The system of claim 8 , wherein the calculating of the negative space score for each of the plurality of image portions is performed utilizing a cognitive analysis.

15. A computer program product for adding content to images, by a processor, the computer program product embodied on a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:
an executable portion that receives a plurality of images, wherein each of the plurality of images comprises a plurality of image portions;
an executable portion that calculates a negative space score for each of the plurality of image portions, the negative space score indicative of identified negative space within each of the plurality of image portions, wherein the negative space is representative of empty space within sub-portions of each of the plurality of image portions around which a primary subject of the plurality of image portions does not occupy when rendered;
an executable portion that selects at least some of the plurality of image portions to display content based on said calculated negative space scores; and
an executable portion that causes the plurality of images to be rendered with the content displayed over said selected at least some of the plurality of image portions.

16. The computer program product of claim 15 , wherein the plurality of images includes a plurality of video frames.

17. The computer program product of claim 15 , wherein the causing of the plurality of images to be rendered includes:
causing a first of the plurality of images to be rendered with the content displayed over a first of the plurality of image portions; and
after the rendering of the first of the plurality of images, causing a second of the plurality of images to be rendered with the content displayed over a second of the plurality of image portions.

18. The computer program product of claim 17 , wherein the computer-readable program code portions further include an executable portion that limits a distance between a position of the content on the first of the plurality of images and a position of the content on the second of the plurality of images.

19. The computer program product of claim 15 , wherein the content includes at least one of captions associated with the plurality of images and an advertisement associated with the plurality of images.

20. The computer program product of claim 15 , wherein the computer-readable program code portions further include:
an executable portion that analyzes a color tone of said selected at least some of the plurality of image portions; and
an executable portion that adjusts at least one of a brightness and a color of the content based on the analyzing of the color tone of said selected at least some of the plurality of image portions.

21. The computer program product of claim 15 , wherein the calculating of the negative space score for each of the plurality of image portions is perf

Assignees

• IBM

Inventors

• Nash Julia
• Osaigbovo Osakpamwan
• Patel Sumit
• Shekhar Chandra

Classifications

• H04N21/4884 Primary

  for displaying subtitles · CPC title

• H04N5/278

  Subtitling · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• H04N21/4858

  for modifying screen layout parameters, e.g. fonts, size of the windows · CPC title

• H04N21/4312

  involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations · CPC title