Character generating plug-in system

Abstract

A character generation plugin system is provided to presentation software in the form of a plugin and includes an editing module that generates a target image for overlaying on a target screen, a character generation module that processes the target image to include transparency information to generate an intermediate product in the form of an image or video, a storage module that stores the intermediate product in an image / video file format or a video signal format, and / or a communication module that transmits the intermediate product in said format to external equipment.

Description

Technology Field

[0001] The present invention relates to a character generation plug-in system, and more specifically, to a character generation plug-in system for presentation software with improved accessibility and user convenience. Background Technology

[0003] Character generating (CG) technology refers to a technique that overlays text, numbers, graphics, and other elements onto background images to enhance the explanation, readability, and interest of the video. CG plays a pivotal role in most modern digital media production fields, including video, broadcasting, computer games, web design, and advertising. For example, CG can be used to display news headlines, subtitles, sports scores, and weather information on screen during broadcasts; more broadly, it is utilized in various fields such as film, video games, simulations, and virtual reality.

[0004] Character generation technology implemented in the form of dedicated hardware equipment offers high reliability and real-time processing capabilities, but it has the disadvantages of high costs and difficult maintenance. To compensate for this, there is a trend toward transitioning character generation technology into software-based solutions; however, these solutions are also complex to use or require advanced technical knowledge, making it difficult for general users to utilize CG technology. Furthermore, some software has compatibility issues for use in real-time live broadcasting, making it difficult to utilize CG technology in real-time within a live broadcasting environment. The problem to be solved

[0006] The objective of the present invention is to provide a character generation plugin system provided in the form of a plugin for presentation software. Specifically, the objective of the present invention is to provide a character generation plugin system that reduces dependence on high-cost equipment and software and enhances user convenience by providing a user-friendly interface. Furthermore, the objective is to provide a character generation plugin system that enables the modification and transmission of real-time content more easily and quickly. means of solving the problem

[0008] A character generation plugin system according to an embodiment of the present invention comprises: an editing module that generates a target image for overlaying on a target screen, provided in the form of a plugin to presentation software; a character generation module that processes the target image to include transparency information to generate an intermediate processed product in the form of an image or video; a storage module that stores the intermediate processed product in an image / video file format or a video signal format; and / or a communication module that transmits the intermediate processed product in the said format to external equipment.

[0009] The character generation module includes an object extraction unit that generates a first intermediate product by extracting a background and an object defining the target image, and an alpha value processing unit that generates a second intermediate product by adding transparency information to the pixels of the first intermediate product.

[0010] The target images are generated in plurality from the above editing module, and the first intermediate processed materials generated from the object extraction unit are generated in plurality corresponding to the plurality of target images; the character generation module further includes a background conversion unit that generates a plurality of first preprocessed materials by converting the background color extracted from each of the plurality of first intermediate processed materials into a first color, and an image generation unit that generates a second preprocessed material in the form of an image by executing a slideshow on the plurality of first preprocessed materials generated corresponding to the first intermediate processed materials; and the alpha value processing unit generates a third intermediate processed material by adding transparency information to the pixels included in the second preprocessed material.

[0011] The above first intermediate workpiece and second pre-processed workpiece are subjected to an RGB color model or a YUV color model, and the above second intermediate workpiece and third intermediate workpiece are subjected to an RGBA color model or a YUV+A color model.

[0012] The storage module above stores the second intermediate workpiece or the third intermediate workpiece generated from the alpha value processing unit in a file format or an image signal format.

[0013] The character generation module further includes a signal conversion unit that converts the second intermediate workpiece and the third intermediate workpiece generated from the alpha value processing unit into the image signal.

[0014] The above video signal can be transmitted to broadcasting equipment and broadcasting software, and the broadcasting software includes live streaming software, video editing software, graphic design software, and streaming platform software.

[0015] The above video generation unit generates the second preprocessed material by recording the screen in which the slideshow is being performed.

[0016] The above editing module includes an editing tool compatible with the presentation software to create and edit the target image, an editing guide that provides guidelines for editing the target image on a slide of the presentation software, a unit converter that converts units used in the presentation software into pixel units, and a database storing the target image and a plurality of templates.

[0017] The above editing module includes a shortcut generator that generates shortcuts usable in the presentation software by hooking (Global Key Hook) shortcuts used in external character generation equipment.

[0018] The above editing module includes a text loader that imports multiple texts or images stored externally and automatically places them on multiple slides of the presentation software according to specific rules.

[0019] The presentation software mentioned above is one of Microsoft PowerPoint, Google Slide, Apple Keynote, Prezi, Libreoffice Impress, and Zoho Show. Effects of the invention

[0021] According to the present invention, images or videos generated in presentation software can not only be utilized as presentation content but can also be integrated as backgrounds and other visual elements in broadcasting or video production, thereby enhancing the usability and diversity of the presentation content.

[0022] In addition, by applying a plugin-type character generation system to existing presentation software, character generation technology can be used directly within the presentation software, thereby maintaining work continuity and increasing user convenience and efficiency.

[0023] In addition, by applying a highly compatible plug-in system, dependence on expensive equipment and software is reduced, which can increase economic efficiency.

[0024] In addition, real-time modification and transmission are possible during live broadcasts, which can increase user accessibility and work speed. Brief explanation of the drawing

[0026] FIG. 1 is a diagram briefly illustrating the configuration of presentation software to which a character generation plugin system according to an embodiment of the present invention is applied. FIG. 2 is a block diagram briefly illustrating the configuration of a character generation plugin system according to an embodiment of the present invention. Figure 3 is a block diagram briefly illustrating the configuration of the editing module shown in Figure 2. FIG. 4a is a drawing showing an example of the first intermediate workpiece shown in FIG. 2. FIG. 4b is a drawing showing an example of a second intermediate workpiece generated in the alpha value processing unit. FIG. 5a is a drawing showing another example of the first intermediate workpiece. FIG. 5b is a diagram showing an example of a first preprocessor generated in the background conversion unit. FIG. 5c is a drawing showing an example of a third intermediate workpiece generated in the alpha value processing unit. Specific details for implementing the invention

[0027] Before describing the present invention in detail below, it should be understood that the terms used in this specification are intended only to describe specific embodiments and are not intended to limit the scope of the invention, which is defined solely by the appended claims. Unless otherwise stated, all technical and scientific terms used in this specification have the same meaning as generally understood by those skilled in the art.

[0028] Throughout this specification and claims, unless otherwise noted, the terms "comprise," "comprising," and "comprising" mean including the mentioned article, step, or group of articles and steps, and are not used to mean excluding any other article, step, or group of articles or groups of steps.

[0029] Additionally, in the drawings, the width, length, thickness, angle, etc., of the components may be exaggerated for convenience. The drawings have been described from the observer's perspective, and when one component is described as being "above / below" or "on / below" another component, this includes not only the case where it is "immediately above / immediately below" the other component, but also the case where there is another component in between.

[0030] Meanwhile, various embodiments of the present invention may be combined with any other embodiments unless explicitly stated otherwise. Any feature indicated as particularly desirable or advantageous may be combined with any other features and features indicated as desirable or advantageous.

[0031] Hereinafter, a character generation plug-in system according to an embodiment of the present invention will be described in more detail with reference to the drawings.

[0032] FIG. 1 is a diagram briefly illustrating the configuration of presentation software to which a character generation plugin system according to an embodiment of the present invention is applied.

[0033] Referring to FIG. 1, a character generation plug-in system (1000) according to an embodiment of the present invention is a plug-in system applied to presentation software (PP). That is, the character generation plug-in system (1000) is provided in the form of a plug-in and provides a character generation function that can be used in presentation software (PP). Presentation software (PP) to which the character generation plug-in system (1000) is applied can be executed through a presentation software execution device (TM1), such as a PC, laptop, tablet, or other terminal.

[0034] In the present invention, the type of presentation software (PP) is not particularly limited, but in a preferred embodiment, the presentation software (PP) may be Microsoft PowerPoint. In addition, the presentation software (PP) may be one of Google Slide, Apple Keynote, Prezi, Libreoffice Impress, and Zoho Show.

[0035] In the present invention, the term "character" in the "character generation plug-in system" is used as a broad term encompassing images or videos, including characters, numbers, graphics, etc., that are overlaid on a specific screen. For convenience of explanation, in the specification and drawings described below, the term "character" is described as the "workpiece (OP1, OP2)" which is the final product of the "character generation plug-in system."

[0036] The character generation plugin system (1000) generates artifacts (OP1, OP2) to be overlaid on a target screen. The target screen is defined as an image screen or video screen that the user intends to display. The artifacts (OP1, OP2) overlaid on the target screen may be in the form of an image or video containing characters, numbers, and graphics. When the artifacts (OP1, OP2) are overlaid on the target screen, the description, readability, and interest of the target screen may be enhanced.

[0037] The above-mentioned processed materials (OP1, OP2) may be output in the form of a file or video signal and transmitted to external equipment such as editing equipment (TM2) or broadcasting equipment (TM3). If the execution equipment (TM1) includes a communication module (not shown), the file may be transmitted or the video signal may be transmitted through the communication module (not shown). If the execution equipment (TM1) does not include a communication module, the file may be transmitted or the video signal may be transmitted through a separately provided transmission board (Decklink) or other network equipment.

[0038] In FIG. 1, a case is illustrated in which presentation software execution equipment (TM1), editing equipment (TM2), and broadcasting equipment (TM3) are provided separately, but the present invention is not limited thereto. In another embodiment of the present invention, the editing equipment (TM2) or broadcasting equipment (TM3) may be omitted, and in this case, the equipment (TM2, TM3) may be replaced with editing software (not shown) or broadcasting software (not shown) and executed on the presentation software execution equipment (TM1). For example, the editing software (not shown) may be Adobe Premiere, Grassvalley Edius, Sony Vegas Pro, Avid Media Composer, etc., and the broadcasting software (not shown) may be live streaming software, video editing software, graphic design software, and streaming platform software, etc.

[0039] FIG. 2 is a block diagram briefly illustrating the configuration of a character generation plugin system according to an embodiment of the present invention.

[0040] Referring to FIG. 2, the character generation plugin system (1000) includes an editing module (100), a character generation module (200), and a storage module (300).

[0041] The editing module (100) generates a target image (IP) for overlay. The target image (IP) may be generated in a UX / UI environment provided by presentation software (PP). The target image (IP) may not include transparency information. For example, the target image (IP) may have an RGB color model or a YUV color model applied. However, the present invention is not particularly limited to the color model applied to the target image (IP). According to the present invention, the target image (IP) may be applied only to a color model such that the target image (IP) before processing does not include transparency information, but the target image (IP) after processing can include transparency information (alpha channel). The character generation module (200) processes the target image (IP) to generate an intermediate processed product (IM2, IM2', IM3, IM3') in the form of an image or video.

[0042] Specifically, the character generation module (200) includes an object extraction unit (210), a background conversion unit (220), an image generation unit (230), an alpha value processing unit (240), and a signal conversion unit (250).

[0043] The object extraction unit (210) distinguishes the background and objects defining the target image (IP) and extracts each to generate a first intermediate product (IM1). That is, the first intermediate product (IM1) includes background information and object information in pixel units.

[0044] In an embodiment of the present invention, when the workpiece (OP1, OP2) targeted by the user is in the form of a video, the editing module (100) can generate a plurality of target images (IP). The object extraction unit (210) generates a plurality of first intermediate workpieces (IM1) corresponding to the plurality of target images (IP).

[0045] The background conversion unit (220) converts the background color of each of the plurality of first intermediate materials (IM1) to a first color to generate a plurality of first preprocessed materials (VD1). For example, the first color may be green or blue. If the first color is green or blue, the color contrast with the object is vivid, so the distinction between the background of each of the first preprocessed materials (VD1) and the object may be clearer.

[0046] The image generation unit (230) generates a second preprocessed material (VD2) in the form of an image by running a slideshow on a plurality of first preprocessed materials (VD1) generated in correspondence with the first intermediate materials (IM1). In this embodiment, the image generation unit (230) may generate the second preprocessed material (VD2) by recording the screen on which the slideshow is running. However, the present invention is not limited thereto. In another embodiment of the present invention, if the image generation unit (230) does not have a recording function, the second preprocessed material (VD2) may be generated by recording the slideshow execution screen through external software or equipment having a recording function and transmitting the recorded image to the image generation unit (230).

[0047] In an embodiment of the present invention, when the target object (OP1, OP2) is in the form of an image, the background conversion unit (220) and the image generation unit (230) do not function. The alpha value processing unit (240) can generate a second intermediate object (IM2) by adding transparency information to the pixels of the first intermediate object (IM1) generated by the object extraction unit (210). For example, the second intermediate object (IM2) may have an RGBA color model or a YUV+A color model applied. In this case, the RGBA color model is defined as a model in which transparency information (alpha channel) is added to the RGB color model, and the YUV+A color model is defined as a model in which transparency information (alpha channel) is added to the YUV color model.

[0048] When the transparency of the pixels forming the background of the second intermediate workpiece (IM2) is set high, the second intermediate workpiece (IM2) may be an object image with a transparent background.

[0049] When the target artifact (OP1, OP2) is in the form of a video, the alpha value processing unit (240) adds transparency information to the pixels included in the second preprocessed artifact (VD2) generated by the image generation unit (230) to generate a third intermediate artifact (IM3) to which an RGBA color model or a YUV+A color model is applied. For example, the alpha value processing unit (240) may perform chroma key processing on the second preprocessed artifact (VD2). When the transparency of pixels having a first color among the pixels included in the second preprocessed artifact (VD2) is increased, the third intermediate artifact (IM3) may be a video composed of objects with a transparent background.

[0050] The signal conversion unit (250) converts the second intermediate workpiece (IM2) and the third intermediate workpiece (IM3) generated from the alpha value processing unit (240) into video signals (IM2', IM3'). In this embodiment, the video signals (IM2', IM3') may be SDI signals. The video signals (IM2', IM3') are stored in a storage module (300).

[0051] When the second intermediate workpiece (IM2) and the third intermediate workpiece (IM3) are provided as workpieces (OP1, OP2) in the form of video signals (IM2', IM3'), the workpieces (OP1, OP2) can be transmitted in real time to the editing equipment (TM2) and the broadcasting equipment (TM3), thereby improving the speed of the operation. In particular, since the workpieces (OP1, OP2) can be overlaid in real time on a target screen displayed in a real-time live broadcast, user convenience can also be greatly improved.

[0052] Meanwhile, the second intermediate workpiece (IM2) and the third intermediate workpiece (IM3) may be stored in the storage module (300) in file format. In this case, the signal conversion unit (250) does not function. In this embodiment, the second intermediate workpiece (IM2) may be in TIFF or PNG format, and the third intermediate workpiece (IM3) may be in the format of ProRes Series, HAP Alpha Codec, DNxHD, DNxHR, etc.

[0053] Figure 3 is a block diagram briefly illustrating the configuration of the editing module shown in Figure 2.

[0054] Referring to FIG. 3, the editing module (100) provided by the character generation plugin system (1000) according to the present invention may include a plurality of customized tools (T1, T3~T6) and a database (T2) to enable more convenient creation of processed objects (OP1, OP2) in an environment provided by presentation software (PP, FIG. 1). Specifically, the editing module (100) may include an editing tool (T1), a database (T2), an editing guide (T3), a unit converter (T4), a shortcut generator (T5), and a text loader (T6).

[0055] The editing tool (T1) is compatible with the presentation software (PP, FIG. 1) and has the function of creating and editing target images (IP).

[0056] The database (T2) may store a target image (IP, FIG. 1) created by the user using an editing tool (T1) and a plurality of templates (not shown) to facilitate editing by the user.

[0057] The editing guide (T3) provides a guide for editing a target image (IP) on a slide of presentation software (PP, FIG. 1). For example, the editing guide (T3) may display guide lines on the slide or have a function to fix the object so that it does not move during editing.

[0058] The unit converter (T4) has the function of converting units used in presentation software (PP, FIG. 1) into pixel units.

[0059] The shortcut generator (T5) has the function of generating a shortcut that can be used in presentation software (PP, FIG. 1) by hooking (Global Key Hook) a shortcut used in an external character generation device (not shown).

[0060] The text loader (T6) has the function of importing multiple texts or images stored externally and placing them on multiple slides of presentation software (PP, FIG. 1). When the text loader (T6) is activated, the texts or images can be automatically placed on the slides according to specific rules. In this embodiment, when the text loader (T6) is activated, a macro function may be utilized, and the specific rules may be pre-set by the user.

[0061] FIG. 4a is a drawing showing an example of the first intermediate workpiece shown in FIG. 2, and FIG. 4b is a drawing showing an example of the second intermediate workpiece generated in the alpha value processing unit.

[0062] As illustrated in FIG. 4a, the object extraction unit (210) distinguishes between a background (BG) and an object (OB) that define a target image (IP) generated from an editing module (100), and generates a first intermediate processed object (IM1) containing background information and object information in pixel units. Specifically, the object extraction unit (210) uses an editing tool (T1) to arbitrarily define a processing area containing at least one object (OB1, OB2), and sets the remaining area excluding the object area defined as the area where the object (OB1, OB2) is placed within the processing area as the background area. Pixels placed in the object area have object information, and pixels placed in the background area have background information.

[0063] As illustrated in FIG. 4b, when the target workpiece (OP1, OP2) is in the form of an image, the alpha value processing unit (240) generates a second intermediate workpiece (IM2) by adding transparency information to the pixels of the first intermediate workpiece (IM1). When the transparency of the pixels in the background area is set high, the second intermediate workpiece (IM2) may be an object image (OB1', OB2') in which the background (BG') is transparent.

[0064] FIG. 5a is a drawing showing another example of a first intermediate workpiece, FIG. 5b is a drawing showing an example of a first preprocessed workpiece generated in a background conversion unit, FIG. 5c is a drawing showing an example of a third intermediate workpiece generated in an alpha value processing unit. FIG. 5a to 5c are examples of a process for generating workpieces (OP1, OP2) in the form of video, and for convenience of explanation, one of a plurality of first intermediate workpieces (IM1), one of a plurality of first preprocessed workpieces (VD1), and one of a plurality of streams forming a third intermediate workpiece (IM3) are illustrated as examples.

[0065] As illustrated in FIG. 5a, the first intermediate product (IM1) includes pixel-level background information and object information. The background conversion unit (220) converts the color of the background (BG) of the first intermediate product (IM1) to generate the first preprocessed product (VD1). Referring to FIG. 5b, the background (BGG) of the first preprocessed product (VD1) displays the first color.

[0066] The image generation unit (230) generates a second preprocessed material (VD2) by running and recording a slideshow on a plurality of first preprocessed materials (VD1), and the alpha value processing unit (240) chroma keyes the second preprocessed material (VD2) to make the first color of the background (BGG, FIG. 5b) transparent. Referring to FIG. 5b, the background (BG') of the third intermediate processed material (IM3) may be transparent.

[0067] The second intermediate workpiece (IM2) and the third intermediate workpiece (IM3) are stored in the storage module (300) in the form of a file or in the storage module (300) in the form of an image signal (IM2', IM3').

[0068] According to an embodiment of the present invention, the artifacts (OP1, OP2, FIG. 1) generated in the presentation software (PP, FIG. 1) can be utilized as presentation content, and can also be integrated as backgrounds and other visual elements in broadcasting or video production, thereby improving the usability and diversity of the presentation content.

[0069] In addition, by applying a plug-in type character generation system (1000) to existing presentation software (PP, FIG. 1), character generation technology can be used directly within the presentation software (PP, FIG. 1), thereby maintaining work continuity and increasing user convenience and efficiency.

[0070] In addition, by applying a plug-in system (1000) equipped with a highly compatible editing module (100), the dependency on expensive equipment and software is reduced, thereby increasing economic efficiency.

[0071] In addition, real-time modification and transmission are possible during live broadcasts, which can increase user accessibility and work speed.

[0072] The features, structures, effects, etc. exemplified in each of the aforementioned embodiments may be combined or modified and implemented in other embodiments by a person skilled in the art to which the embodiments belong. Therefore, details regarding such combinations and modifications should be interpreted as being included within the scope of the present invention. Explanation of the symbols

[0074] 1000: Character generation plugin system PP: Presentation Software TM1~TM3: Terminals IP: Target Image OP1, OP2: Workpiece 100: Edit Module 200: Character generation module 210: Object Extraction Unit 220: Background Transition Section 230: Image generation unit 240: Alpha value processing unit 250: Signal converter 300: Storage module VD: Pre-treated material IM: Intermediate product T1: Editing tools T2: Database T3: Editing Guide T4: Unit converter T5: Shortcut generator T6: Text Loader OB: Object BG: Background

Claims

Claim 1 A character generation plugin system provided in the form of a plugin to presentation software for generating subtitles and graphics for broadcasting, comprising: an editing module that generates a target image in which subtitles and graphics are placed on a transparent background without a background image; a character generation module that captures a slide screen containing the target image and generates a fill signal, which is an actual image signal containing color information of the subtitles and graphics within the target image, and a key signal, which is black and white mask information that distinguishes between an opaque area where the subtitles and graphics within the target image are located and a transparent area which is the background; and a signal conversion unit that converts the generated fill signal and key signal into a standard broadcasting video signal recognizable by external broadcasting equipment and transmits it to an external broadcasting switcher through an output port; wherein the signal conversion unit converts and outputs the signal so that the transmitted standard broadcasting video signal is completed as a final broadcast screen by overlaying the fill signal based on the key signal onto a main camera video signal separately input from the external broadcasting switcher. Claim 2 In claim 1, the character generation module comprises: an object extraction unit that extracts an object region and a background region defining the target image to generate data that forms the basis of the fill signal; and an alpha value processing unit that generates transparency information for processing the background region transparently as the key signal; a character generation plugin system. Claim 3 In claim 2, the editing module generates a plurality of target images including slide animation effects, and the character generation module further comprises: a background conversion unit that converts the color of the background area of ​​the plurality of generated target images to a first color, which is a specific color for chroma key processing; and an image generation unit that executes a slideshow on the target images whose backgrounds have been converted to the first color and records it to generate a signal in the form of a video; and the alpha value processing unit recognizes the first color area as a transparent area in the signal in the form of a video generated by the image generation unit and generates the key signal in the form of a video, thereby forming a character generation plugin system. Claim 4 A character generation plugin system according to claim 3, wherein the fill signal is applied to an RGB color model or a YUV color model, and the key signal is processed to include alpha channel information to finally form an RGBA color model or a YUV+A color model. Claim 5 A character generation plugin system according to claim 1, further comprising a storage module that stores the generated fill signal and key signal in an image file format, a video file format, or a video signal recording file format. Claim 6 In claim 1, the standard video signal for broadcasting is a character generation plug-in system including an SDI (Serial Digital Interface) signal or an NDI (Network Device Interface) signal. Claim 7 In claim 1, the external broadcast switcher is a character generation plug-in system that is a switching system comprising at least one of hardware switcher equipment, live streaming software, video editing software, and streaming platform software. Claim 8 In claim 3, the image generation unit is a character generation plugin system that generates a video-type signal by capturing or recording the screen in which the slideshow is being performed frame by frame. Claim 9 In claim 1, the editing module comprises: an editing tool compatible with the presentation software capable of generating and editing the target image; an editing guide providing guidelines for editing the target image on a slide of the presentation software; a unit converter converting units used in the presentation software into pixel units; and a database storing the target image and a plurality of templates; a character generation plugin system. Claim 10 In claim 1, the editing module is a character generation plugin system comprising a shortcut key generator that generates shortcut keys usable in the presentation software by hooking (Global Key Hook) shortcut keys used in an external character generation device. Claim 11 In claim 1, the editing module is a character generation plugin system comprising a text loader that imports a plurality of texts or images stored externally and automatically places them on a plurality of slides of the presentation software according to specific rules. Claim 12 In claim 1, the presentation software is a character generation plugin system comprising at least one of Microsoft PowerPoint, Google Slide, Apple Keynote, Prezi, Libreoffice Impress, and Zoho Show.

Images