Methods and Apparatus for Metadata-Based Processing of Media Content

Patent metadata

Field	Value
Publication number	US-2023144635-A1
Application number	US-202218059827-A
Country	US
Kind code	A1
Filing date	Nov 29, 2022
Priority date	Jul 21, 2020
Publication date	May 11, 2023
Grant date	—

Abstract

Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

First claim

What is claimed is:

1 . A method of processing media, comprising:
categorizing first media within a library of media content based on cinematic elements in the first media; generating metadata templates based on the first media within the library of media content; receiving second media content and sensor data; and providing a shot advisory based on the second media content, the sensor data, and the metadata templates.

2 . The method of claim 1 , where the cinematic elements comprise at least one of: a style of a film auteur, a film genre, a media source, a subject, and an intended audience.

3 . The method of claim 1 , further comprising determining a relevant metadata template based on receiving the second media content and the sensor data.

4 . The method of claim 1 , further comprising forming a data connection to a camera device and a sensor device, where:
receiving the second media content comprises receiving the second media content from the camera device, and receiving the sensor data comprises receiving the sensor data from the sensor device.

5 . The method of claim 1 , further comprising parsing the second media content based on the shot advisory.

6 . The method of claim 1 , further comprising translating the second media content based on the shot advisory.

7 . The method of claim 6 , where translating the second media content comprises altering the second media content to mimic capture conditions of a cinematic element of the cinematic elements associated with a category.

8 . The method of claim 1 , where receiving the second media content and the sensor data comprises:
receiving the second media content within a first data structure comprising a first synchronization data; and receiving the sensor data within a second data structure comprising a second synchronization data, where the first synchronization data and the second synchronization data enable synchronization of the second media content and the sensor data.

9 . A media-processing apparatus, comprising:
a network interface; a user interface; digital processor apparatus in data communication with the network interface; and storage apparatus in data communication with the digital processor apparatus and having a non-transitory computer-readable media comprising one or more instructions which when executed by the digital processor apparatus, causes the media-processing apparatus to:
categorize media within a library of media content based on one or more elements of cinematic language;
generate metadata templates based on the categorizing the media;
obtain media data and instantaneous metadata, the media data comprising audio data and video data; and
provide a shot advisory based on the media data, the instantaneous metadata, and the metadata templates.

10 . The media-processing apparatus of claim 9 , where the one or more elements of cinematic language comprise visual or other effects in the media to achieve a distinctive effect of a particular type of one or more of genre and cinematographer.

11 . The media-processing apparatus of claim 9 , where categorizing the library of media content comprises categorizing a filming style of the media within the library of media content.

12 . The media-processing apparatus of claim 9 , where the shot advisory comprises one or more of combinations of additional media data and additional sensor data to capture.

13 . The media-processing apparatus of claim 9 , where categorizing the media comprises performing subject detection on at least a portion of the library of media content.

14 . The media-processing apparatus of claim 9 , where the one or more instructions which when executed by the digital processor apparatus further causes the media-processing apparatus to identify cinematic elements in the media within the library of media content, where categorizing the media is further based on identifying the cinematic elements.

15 . A media capture apparatus, comprising:
a first sensor configured to capture media data; a second sensor comprising an inertial measurement unit and configured to record capture conditions of the first sensor; digital processor apparatus; and storage apparatus in data communication with the digital processor apparatus and having a non-transitory computer-readable media comprising one or more instructions which when executed by the digital processor apparatus, causes the media capture apparatus to:
capture the media data;
record the capture conditions of the first sensor;
send the media data and the capture conditions; and
obtain a status of the media data and the capture conditions meeting predetermined criteria.

16 . The media capture apparatus of claim 15 , where the one or more instructions when executed by the digital processor apparatus further causes the media capture apparatus to obtain a listing of unmet criteria of the predetermined criteria.

17 . The media capture apparatus of claim 16 , where the listing of unmet criteria comprises one or more of media to capture and capture conditions to capture.

18 . The media capture apparatus of claim 15 , where the one or more instructions when executed by the digital processor apparatus further causes the media capture apparatus to obtain input from a user, the input comprising a scene capture style, where the predetermined criteria is based on the scene capture style.

19 . The media capture apparatus of claim 15 , where sending the media data and the capture conditions comprise:
encoding the media data within a media data structure; and encoding the capture conditions within an instantaneous metadata data structure comprising in-camera stabilization data.

20 . The media capture apparatus of claim 15 , where the one or more instructions when executed by the digital processor apparatus further causes the media capture apparatus to send an alert of the status.

Assignees

• Gopro Inc

Inventors

• Newman David A

Classifications

• H04N23/6812

  based on additional sensors, e.g. acceleration sensors · CPC title

• H04N5/2621 Primary

  Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability · CPC title

• G11B27/034

  on discs (G11B27/036, G11B27/038 take precedence) · CPC title

• H04N23/683

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• G11B27/031 Primary

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title