Identifying related videos based on relatedness of elements tagged in the videos

Patent metadata

Field	Value
Publication number	US-12413818-B2
Application number	US-202418647566-A
Country	US
Kind code	B2
Filing date	Apr 26, 2024
Priority date	Jan 28, 2014
Publication date	Sep 9, 2025
Grant date	Sep 9, 2025

Abstract

Systems and methods for identifying related videos based on elements tagged in the videos are presented. In an aspect, a system includes an identification component configured to identify tagged elements in a video, a matching component configured to identify other videos that include one or more of the tagged elements, and a recommendation component configured to recommend the other videos for viewing based on a current or past request to play the video.

First claim

What is claimed is:

1. A method, comprising:
receiving a request from a user to present a first video content item on a user device associated with the user;
determining, during presentation of a particular scene of the first video content item on an output component of the user device, one or more tagged elements that are each associated with an object appearing in the first video content item during the particular scene, wherein the particular scene corresponds to a particular segment of a plurality of segments of the first video content item;
determining a degree of interest of the user in each video content item of a plurality of video content items that include at least one tagged element from the one or more tagged elements;
causing a recommendation that includes at least a portion of the plurality of video content items to be presented to the user during the presentation of the particular scene on the output component of the user device; and
causing a new recommendation that includes one or more different video content items to be presented to the user during playback of a new particular scene that corresponds to another segment of the plurality of segments of the first video content item.

2. The method of claim 1 , wherein the one or more tagged elements include a plurality of tagged elements, the method further comprising:
identifying that playback of the video was stopped during playback of the new particular scene on the output component of the user device;
determining that playback of the particular scene occurred prior to playback of the new particular scene on the output component of the user device;
determining, based on identifying that playback of the first video content item was stopped during playback of the new particular scene and based on determining that playback of the particular scene occurred prior to playback of the new particular scene, a subset of the plurality of tagged elements associated with the objects appearing in the first video content item during playback of the particular scene on the output component of the user device;
determining a degree of interest of the user in other media content items that are associated with the subset of the plurality of tagged elements; and
causing a different recommendation that includes one or more different media content items to be presented to the user on the output component of the user device.

3. The method of claim 2 , further comprising:
monitoring a current playback position associated with the presentation of the first video content item, wherein identifying that playback of the video was stopped during playback of the new particular scene is performed based on determining that the current playback position occurred during playback of the new particular scene of the first video content item.

4. The method of claim 1 , further comprising:
receiving a subsequent request from the user to present a particular different video content item from the one or more different video content items presented on the output component of the user device;
inferring a degree of interest of the user in one or more different tagged elements associated with different objects appearing during playback of the particular different video content item on the output component of the user device, wherein the degree of interest is inferred based at least in part on user engagement with previously viewed video content items in which the different objects appear;
determining, based on the degree of interest in the one or more different tagged elements, that the user has lost interest in the particular different video content item based on determining that the different objects associated with the one or more different tagged elements appear at a current playback position during playback of the particular different video content item on the output component of the user device; and
in response to determining that the user has lost interest in the particular video content item at the current playback position, causing a new video content item that associated with the previously viewed first video content item to be presented to the user on the output component of the user device.

5. The method of claim 1 , further comprising:
selecting the portion of the plurality of video content items to be presented to the user during the presentation of the particular scene based at least in part on:
determining that a given tagged element of the one or more tagged elements corresponds with a user account of a content creator; and
determining that the portion of the plurality of video content items are associated with the user account of the content creator.

6. The method of claim 5 , wherein the portion of the plurality of video content items that are associated with the user account of the content creator include at least one of: a video liked by the content creator, a video watched by the content creator, a video uploaded by the content creator, a video endorsed by the content creator, a video shared by the content creator, a video commented on by the content creator, and a video in which the content creator appears.

7. A system, comprising:
a memory;
a hardware processor that, when executing computer-executable instructions stored in the memory, is configured to:
receive a request from a user to present a first video content item on a user device associated with the user;
determine, during presentation of a particular scene of the first video content item on an output component of the user device, one or more tagged elements that are each associated with an object appearing in the first video content item during the particular scene, wherein the particular scene corresponds to a particular segment of a plurality of segments of the first video content item;
determine a degree of interest of the user in each video content item of a plurality of video content items that include at least one tagged element from the one or more tagged elements;
cause a recommendation that includes at least a portion of the plurality of video content items to be presented to the user during the presentation of the particular scene on the output component of the user device; and
cause a new recommendation that includes one or more different video content items to be presented to the user during playback of a new particular scene that corresponds to another segment of the plurality of segments of the first video content item.

8. The system of claim 7 , wherein the one or more tagged elements include a plurality of tagged elements, and wherein the hardware processor is further configured to:
identify that playback of the video was stopped during playback of the new particular scene on the output component of the user device;
determine that playback of the particular scene occurred prior to playback of the new particular scene on the output component of the user device;
determine, based on identifying that playback of the first video content item was stopped during playback of the new particular scene and based on determining that playback of the particular scene occurred prior to playback of the new particular scene, a subset of the plurality of tagged elements associated with the objects appearing in the first video content item during playback of the particular scene on the output component of the user device;
determine a degree of interest of the user in other media content items that are associated with the subset of the plurality of tagged elements; and
cause a different recommendation that includes one or more different media content items to be presented to the user on the output component of the user device.

9. The system of claim 8 , wherein the hardware processor is further configured t

Assignees

• Google Llc

Inventors

• Greene Kevin
• Lewis Justin

Classifications

• G06F16/7837

  using objects detected or recognised in the video content · CPC title

• G06F16/784 Primary

  the detected or recognised objects being people · CPC title

• G06F16/90328

  using search space presentation or visualization, e.g. category or range presentation and selection · CPC title

• G06F16/4387

  by the use of playlists · CPC title

• H04N21/47217

  for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312) · CPC title