Dynamically generated interactive video content

Patent metadata

Field	Value
Publication number	US-12495190-B2
Application number	US-202217736348-A
Country	US
Kind code	B2
Filing date	May 4, 2022
Priority date	May 4, 2022
Publication date	Dec 9, 2025
Grant date	Dec 9, 2025

Abstract

Systems, methods and/or computer program products for dynamically generating interactive content at an edge node of an edge network. For each set of video frames received, altered frames cached by the edge network can be fetched (when available) and reused to deliver interactive content to users. Where cached content is not present or distinctly different content from previously delivered content is intended for delivery to user(s), edge node identifies hotspots within video frames to insert interactive content, defining a timing and location for insertion, selects content consistent with user insights and/or preferences as well as an interaction types and placements known to be preferred by the user requesting the video frames. The edge node uses video creation services to alter the incoming video frames into altered video frames, inserts selected content at corresponding hotspots within the video and applies the interaction types for presenting the content to the user.

First claim

What is claimed is:

1 . A computer-implemented method for dynamically generating interactive video content at an edge node of an edge network, the computer-implemented method comprising:
receiving, by a processor of the edge node, a set of incoming video frames; identifying, by the processor, one or more hotspots within the incoming video frames to insert an interactive content, wherein each of the one or more hotspots are defined within a set of instructions including a timing within the incoming video frames and location within the incoming frames for inserting the interactive content and wherein the interactive content does not contain promotional content material; selecting, by the processor, content from a repository configured to be inserted within the incoming video frames at each of the one or more hotspots defined by the set of instructions, wherein the content from selected from the repository is defined within the set of instructions; selecting, by the processor, an interaction type defining within the set of instructions how the content is shown at each of the one or more hotspots; executing, by the processor the set of instructions, altering the incoming video frames to an altered set of video frames containing the content selected that is configured to be presented to a user at each of the one or more hotspots using the interaction type defined within the set of instructions; caching, by the processor, the altered video frames to an interactive content cache of the edge network; outputting, by the processor, the altered video frames to an end user device placed in communication with the edge network; learning, by the processor, consumer insights and preferences of each user as a result of the user interactions with the interactive content outputted by the edge network to each corresponding user; and in response to receiving incoming video frames by each corresponding user, applying, by the processor, the consumer insights and preferences of the corresponding user to influence hotspot identification, content selection and the interaction type or placement of the interactive content within the altered frames.

2 . The computer-implemented method of claim 1 , further comprising:
in response to receiving a request to provide the incoming frames to a second end user device, searching, by the processor, the interactive content cache of the edge network for previously generated interactive content comprising the altered video frames; fetching, by the processor, the altered frames from the interactive content cache of the edge network; and outputting, by the processor, the set of altered frames from the edge network to the second user device.

3 . The computer-implemented method of claim 2 , wherein, the request to provide the incoming frames to the second end user device is received by a second edge node of the edge network, and the altered frames stored by the interactive content cache is shared by the edge node with the second edge node of the edge network.

4 . The computer-implemented method of claim 1 , wherein identifying the one or more hotspots further comprises:
detecting, by the processor, a set of one or more objects displayed within the incoming video frames; and setting, by the processor, the timing and the location of the one or more hotspots as defined by the set of instructions to a time and location within the incoming frames where a detected object is displayed as part of the set of one or more objects within the incoming video frames.

5 . The computer-implemented method of claim 1 , wherein identifying one or more hotspots further comprises:
converting, by the processor, speech-to-text of the incoming video frames; detecting, by the processor, based on a conversion of speech-to-text of the incoming video frames, one or more concepts discussed within the incoming video frames; and setting, by the processor, the timing and the location of the one or more hotspots as defined by the set of instructions to a time and location within the incoming frames where the one or more concepts is detected based on the conversion of the speech-to-text of the incoming video frames.

6 . The computer-implemented method of claim 1 , wherein the content being inserted into the incoming frames at each of the one or more hotspots is selected from the group consisting of supplemental educational videos, web pages, chat services, video conferencing, one or more video feeds, and combinations thereof.

7 . The computer-implemented method of claim 1 , wherein the consumer insights and preferences can include, educational topic of interest to the user, particular object of interest to the user, other separate video footage associated with a video surveillance system that is of interest to the user and content of a video that is suitable to an age of the user.

8 . A computer system for dynamically generating interactive video content at an edge node of an edge network comprising:
a processor; an interactive content cache coupled to the processor; and a computer-readable storage media coupled to the processor, wherein the computer-readable storage media contains program instructions executing, via the processor, a computer-implemented method comprising:
receiving, by the processor of the edge node, a set of incoming set of video frames;
identifying, by the processor, one or more hotspots within the incoming video frames to insert an interactive content, wherein each of the one or more hotspots are defined within a set of instructions including a timing within the incoming video frames and location within the incoming frames for inserting the interactive content and wherein the interactive content does not contain promotional content material;
selecting, by the processor, content from a repository configured to be inserted within the incoming video frames at each of the one or more hotspots defined by the set of instructions, wherein the content from selected from the repository is defined within the set of instructions;
selecting, by the processor, an interaction type defining within the set of instructions how the content is shown at each of the one or more hotspots;
executing, by the processor the set of instructions, altering the incoming video frames to an altered set of video frames containing the content selected that is configured to be presented to a user at each of the one or more hotspots using the interaction type defined within the set of instructions;
caching, by the processor, the altered video frames to the interactive content cache of the edge network;
outputting, by the processor the altered video frames to an end user device placed in communication with the edge network;
learning, by the processor, consumer insights and preferences of each user as a result of the user interactions with the interactive content outputted by the edge network to each corresponding user; and
in response to receiving incoming video frames by each corresponding user, applying, by the processor, the consumer insights and preferences of the corresponding user to influence hotspot identification, content selection and the interaction type or placement of the interactive content within the altered frames.

9 . The computer system of claim 8 , further comprising:
in response to receiving a request to provide the incoming frames to a second end user device, searching, by the processor, the interactive content cache of the edge network for previously generated interactive content comprising the altered video frames; fetching, by the processor, the altered frames from the interactive content cache of the edge network; and outputting, by the processor, the set of altered frames from the edge network to the seco

Assignees

• IBM

Inventors

• Jayachandran Praveen
• Thomas Mathews
• Behl Dushyant K
• Verma Mudit
• Mangla Utpal

Classifications

• G06V20/40

  in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44) · CPC title

• H04N21/251

  Learning process for intelligent management, e.g. learning user preferences for recommending movies (details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08) · CPC title

• H04N21/2393

  involving handling client requests (scheduling or organising the servicing of application requests H04L67/60) · CPC title

• H04N21/23106

  involving caching operations (prefetching while addressing of a memory level in which the access to the desired data or data block requires associative addressing means within memory systems or architectures G06F12/0862; caching at an intermediate stage in a data network H04L67/568) · CPC title

• H04N21/25891

  being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18) · CPC title