Generating congruous metadata for multimedia

Patent metadata

Field	Value
Publication number	US-12222980-B2
Application number	US-202318362482-A
Country	US
Kind code	B2
Filing date	Jul 31, 2023
Priority date	Mar 4, 2008
Publication date	Feb 11, 2025
Grant date	Feb 11, 2025

Abstract

A method of generating congruous metadata is provided. The method includes receiving a similarity measure between at least two multimedia objects. Each multimedia object has associated metadata. If the at least two multimedia objects are similar based on the similarity measure and a similarity threshold, the associated metadata of each of the multimedia objects are compared. Then, based on the comparison of the associated metadata of each of the at least two multimedia objects, the method further includes generating congruous metadata. Metadata may be tags, for example.

First claim

What is claimed is:

1. A method comprising:
using, by a computing device, information indicating an absence of user verification of computer-generated congruous metadata to dynamically adjust an adjustable similarity threshold from less restrictive to more restrictive;
analyzing, by the computing device, digital data of first and second content items and determining a similarity between the first and second content items based on the digital data analysis;
determining, by the computing device, that the similarity determined for the first and second content items satisfies the more restrictive adjustable similarity threshold that is set based on the absence of user verification;
responsive to determining that the similarity satisfies the more restrictive adjustable similarity threshold, analyzing, by the computing device, a first set of metadata associated with the first content item and a second set of metadata associated with the second content item, and generating, absent user verification, a third set of metadata found in both the first and second sets of metadata based on the analysis;
storing, by the computing device, the third set of metadata generated absent user verification in a data store, the storing comprising associating the third set of metadata with the first content item and the second content item; and
identifying, by the computing device, one or both of the first and second content items using the third set of metadata.

2. The method of claim 1 , the storing further comprising labeling the third set of metadata as computer-generated congruous metadata indicating that the third set of metadata accurately describes the first content item and the second content item.

3. The method of claim 1 , further comprising using the third set of metadata in a content item search and retrieval operation.

4. The method of claim 1 , wherein the first and second content items are images.

5. The method of claim 1 , wherein the first and second content items are audio objects.

6. The method of claim 1 , wherein the first and second content items are videos.

7. The method of claim 1 , wherein the first, second and third sets of metadata are tag annotations.

8. The method of claim 7 , wherein the first and second sets of metadata are user-supplied tag annotations, and the third set of metadata comprises those user-supplied tag annotations from the first and second sets of metadata determined, based on the analysis of the first and second sets of metadata, to be accurately descriptive of the first and second content items.

9. The method of claim 1 , wherein the first and second content items belong to a set of content items comprising at least one other content item whose similarity with the first and second content items satisfies the more restrictive adjustable similarity threshold, and the third set of metadata is associated with each content item in the set of content items.

10. The method of claim 1 , wherein the first and second sets of metadata each comprise time and location indications that are analyzed and used in generating the third set of metadata based on the analysis.

11. A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions that when executed by a processor associated with a computing device perform a method comprising:
using information indicating an absence of user verification of computer-generated congruous metadata to dynamically adjust an adjustable similarity threshold from less restrictive to more restrictive;
analyzing digital data of first and second content items and determining a similarity between the first and second content items based on the digital data analysis;
determining that the similarity determined for the first and second content items satisfies the more restrictive adjustable similarity threshold that is set based on the absence of user verification;
responsive to determining that the similarity satisfies the more restrictive adjustable similarity threshold, analyzing a first set of metadata associated with the first content item and a second set of metadata associated with the second content item and generating, absent user verification, a third set of metadata found in both the first and second sets of metadata based on the analysis;
storing the third set of metadata in a data store, the storing comprising associating the third set of metadata generated absent user verification with the first content item and the second content item; and
identifying one or both of the first and second content items using the third set of metadata.

12. The non-transitory computer-readable storage medium of claim 11 , the storing further comprising labeling the third set of metadata as computer-generated congruous metadata indicating that the third set of metadata accurately describes the first content item and the second content item.

13. The non-transitory computer-readable storage medium of claim 11 , the method further comprising using the third set of metadata in a content item search and retrieval operation.

14. The non-transitory computer-readable storage medium of claim 11 , wherein the first and second content items are images.

15. The non-transitory computer-readable storage medium of claim 11 , wherein the first and second content items are audio objects.

16. The non-transitory computer-readable storage medium of claim 11 , wherein the first and second content items are videos.

17. The non-transitory computer-readable storage medium of claim 11 , wherein the first, second and third sets of metadata are user-supplied tag annotations, and wherein the third set of metadata comprises those user-supplied tag annotations from the first and second sets of metadata determined, based on the analysis of the first and second sets of metadata, to be accurately descriptive of the first and second content items.

18. The non-transitory computer-readable storage medium of claim 11 , wherein the first and second content items belong to a set of content items comprising at least one other content item whose similarity with the first and second content items satisfies the more restrictive adjustable similarity threshold, and the third set of metadata is associated with each content item in the set of content items.

19. The non-transitory computer-readable storage medium of claim 11 , wherein the first and second sets of metadata each comprise time and location indications that are analyzed and used in generating the third set of metadata based on the analysis.

20. A computing device comprising:
a processor; and
a non-transitory storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:
using logic executed by the processor for using information indicating an absence of user verification of computer-generated congruous metadata to dynamically adjust an adjustable similarity threshold from less restrictive to more restrictive;
analyzing logic executed by the processor for analyzing digital data of first and second content items and determining a similarity between the first and second content items based on the digital data analysis;
determining logic executed by the processor for determining that the similarity determined for the first and second content items satisfies the more restrictive adjustable similarity threshold that is set based on the absence of user verification;
analyzing logic executed by the processor for, responsive to determining that the similarity satisfies the more res

Assignees

• Yahoo Assets Llc

Inventors

• Slaney Malcolm
• Weinberger Kilian

Classifications

• G06F16/58 Primary

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06F16/587

  using geographical or spatial information, e.g. location · CPC title

• G06F16/687

  using geographical or spatial information, e.g. location · CPC title

• G06F16/787

  using geographical or spatial information, e.g. location · CPC title

• G06F16/683

  using metadata automatically derived from the content · CPC title