AI-based interpretation and translation audio subtitle video content production system

Abstract

The present invention is an innovative system that integrates AI-based speech recognition, machine translation, subtitle generation, and video content production systems to recognize and translate various languages ​​in real time, generate subtitles, and provide them on various platforms.

Description

Technology Field

[0001] The following examples relate to a video content production system for AI-based voice subtitles. Background Technology

[0002] Traditional video content production has relied on manual processing of subtitles and translations, or on technology that supports only specific languages. Manual work is time-consuming and costly, and translation accuracy can vary depending on the context. Furthermore, speech recognition systems are susceptible to various intonations, pronunciations, and noise, making it difficult to guarantee the accuracy of subtitle generation.

[0003] While these speech recognition systems are used in various application fields, they face limitations in recognition accuracy and real-time processing performance, particularly when applied to real-time video content. For example, the accuracy of speech recognition is significantly affected by intonation, pronunciation, dialect, and background noise. Furthermore, although machine translation systems are effective in specific contexts, they often fail to consider context or reflect cultural differences due to the limitations of natural language processing technology; conversely, existing subtitle generation systems produce subtitles using manual methods or specific algorithms, which can lead to errors during real-time conversion and synchronization.

[0004] There is a need for a system that overcomes the limitations of existing technology and automatically produces video content by generating multilingual subtitles in real time. The problem to be solved

[0005] The present invention aims to provide video content with translational voice subtitles that helps users naturally and efficiently understand content in different languages ​​through speech recognition, high-speed translation, and the provision of accurate subtitles.

[0006] This system innovatively enhances the user experience by integrating real-time speech recognition, automatic translation, and subtitle generation processes, and provides high-precision translations and subtitles suitable for various languages ​​and contexts. means of solving the problem

[0007] The present invention according to one embodiment is a video content production system for AI-based interpretation and translation voice subtitles,

[0008] It is composed of a user terminal (100) that receives translation information for voice information including user's requirements for English composition production, a data collection unit (210) that collects data of country-specific language information for the voice information, a data processing unit (220) that identifies the collected data using a set data processing method, and a data analysis unit (230) that extracts country-specific language and voice subtitles based on big data based on the identified data, and may include a control unit (200) that controls the operation of the collection unit, processing unit, and analysis unit.

[0009] In addition, the AI-based voice subtitle video content production system according to one embodiment of the present invention may be characterized by comprising: a data collection step (S1) for collecting voice information from a user; a data analysis step (S2) for evaluating and classifying languages ​​by country based on the collected voice information; a curation step (S3) for recommending a language by country suitable for the user after going through the data collection step and the data analysis step; and a video content production step (S4) for providing the selected language by country and voice subtitles. Effects of the invention

[0010] According to one embodiment of the present invention, by recognizing various languages ​​in real time, translating them, and providing subtitles to users, there is an effect that allows multinational users to easily understand and communicate with content. Brief explanation of the drawing

[0011] Figure 1 and Figure 2 are block diagrams illustrating a video content production system for AI-based interpretation and translation voice subtitles according to an embodiment. Specific details for implementing the invention

[0012] As illustrated in FIGS. 1 and 2, the AI-based translation and voice subtitle video content production system according to an embodiment of the present invention is a big data-based platform system that collects and analyzes voice information to recommend personalized, customized country-specific language translation and voice subtitles, and may be configured to include a user terminal (100), a control unit (200), a data collection unit (210), a data processing unit (220), and an analysis unit (230).

[0013] The above user terminal (100) receives voice information through an input module and sends it to a server

[0014] It performs the role of transmitting and receiving country-specific language information for the voice from the server, and outputting it to provide the user with the corresponding country's language.

[0015] According to one embodiment of the present invention, the user terminal (100) may be a smartphone, tablet, laptop, or desktop capable of wired / wireless communication, but should be interpreted as a concept that includes all devices capable of transmitting and receiving data that are currently developed and commercialized or will be developed in the future, in addition to the examples described above.

[0016] In addition, one or more applications may be installed on the user terminal (100), and the applications may include an application that provides a service for recommending country-specific languages ​​or voice subtitles, or an application program interface related to such a service, embedded software, or a software development kit, which may be pre-installed for the implementation of the present invention.

[0017] According to one embodiment of the present invention, data or signals related to voice information and country-specific language information can be transmitted or received to and from a control unit (200) through one or more applications installed on the user terminal (100).

[0018] The above control unit (200) is a device that controls the operation of the data collection unit (210), the data processing unit (220), and the data analysis unit (230), and has built-in driving programs, machine learning, and recommendation algorithms for analyzing big data related to voice information and country-specific language information to select country-specific language and voice subtitles suitable for the user.

[0019] The data collection unit (210) plays the role of collecting voice information and country-specific language information collected from the user through the user terminal (100).

[0020] According to an embodiment of the present invention, the voice information may include noise filtering and pronunciation correction functions by constructing a voice recognition model, and may include data or signals related to the voice signal trained with various language models.

[0021] The above data collection unit (210) performs the role of collecting voice information by crawling each information from APIs related to the interpretation and translation of languages ​​of each country.

[0022] According to one embodiment of the present invention, the data processing unit (220) has a preset data model

[0023] Identify or de-identify collected or stored data using a ring method, and recommend

[0024] Calculate data.

[0025] In this case, the recommendation data mart may include a preference DM that considers preference scores based on preference calculation conditions for the basic data. Additionally, the recommendation data mart may include an association DM that considers association scores based on keyword-based association for each data point, based on the preference DM.

[0026] The data analysis unit (230) identifies and processes data and voice information through the processing unit (220) and

[0027] It performs the role of mapping country-specific language information and, based on this, producing video content of AI-based interpretation and translation voice subtitles through a pre-set algorithm.

[0028] According to one embodiment of the present invention, the data analysis unit (230) is based on a cloud service.

[0029] With the application of artificial intelligence technology, users can access the latest machine learning analysis systems and high-speed processing

[0030] Through the collected data, it is possible to produce video content with country-specific language recommendations and customized voice subtitles.

Claims

Claim 1 A system for producing video content of AI-based translation and interpretation voice subtitles, comprising a user terminal (100) that receives translation and interpretation information for voice information including user requirements for English production, a data collection unit (210) that collects data of country-specific language information for the voice information, a data processing unit (220) that identifies the collected data using a set data processing method, and a data analysis unit (230) that extracts country-specific language and voice subtitles based on big data based on the identified data, and a control unit (200) that controls the operation of the collection unit, processing unit, and analysis unit. Claim 2 A video content production system for AI-based translation and interpretation voice subtitles, characterized by comprising: a data collection step (S1) for collecting voice information from a user; a data analysis step (S2) for evaluating and classifying languages ​​by country based on the collected voice information; a curation step (S3) for recommending a language by country suitable for the user after going through the data collection step and the data analysis step; and a video content production step (S4) for providing the selected language by country and voice subtitles.

Images