Video parsing and audio pairing

The system addresses the inefficiency of manual audio and text pairing with video by using a model trained on image and text representations to generate recommendations, enhancing content creation efficiency and accuracy across multimedia platforms.

WO2025008778A1 Publication Date: 2025-01-09EPIDEMIC SOUND AB
2 Cites 0 Cited by

Patent Information

Application Number
PCT/IB2024/056529
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-03
Filing Date
2024-07-04
Publication Date
2025-01-09

AI Technical Summary

Technical Problem

The process of pairing audio segments and text with video clips and frames is time-consuming and labor-intensive, requiring significant effort and opportunity costs for content creators, with existing methods relying on manual or machine-learning-based tag generation that is not easily integrated into video production processes.

Method used

A system that uses a model trained on image and text representations to generate recommended audio segments and text, allowing for automated pairing by embedding video components in a vector space and employing machine learning algorithms to match these representations with database audio segments, thereby reducing the time and effort required for content creation.

Benefits of technology

This solution enables quicker and more accurate pairing of video with audio and text, allowing creators to focus on other tasks while improving the efficiency and accuracy of content generation across various multimedia platforms.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

A method includes obtaining a video including multiple frames. The method may also include identifying a particular frame of the multiple frames. The method may further include obtaining one or more representations associated with the particular frame from a model. The method may also include generating one or more recommended audio segments associated with the particular frame by the model. The method may further include causing a graphical user interface (GUI) to display the one or more recommended audio segments associated with the particular frame. The method may also include causing the GUI to display the updated one or more recommended audio segments associated with the particular frame. The method may further include obtaining a selection of a particular audio segment from the updated one or more recommended audio segments. The method may also include combining the particular audio segment with the particular frame.
Need to check novelty before this filing date? Find Prior Art