Preview device, preview program

The described system allows for cost-effective, location-independent preview of broadcast materials by decoding and synthesizing data in real-time, addressing the limitations of dedicated hardware and time-consuming encoding in conventional methods.

JP7577487B2Active Publication Date: 2024-11-05TOSHIBA DIGITAL SOLUTIONS CORP +1
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2020152710
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-09-11
Publication Date
2024-11-05
Estimated Expiration
2040-09-11

AI Technical Summary

Technical Problem

Conventional preview methods require dedicated hardware for previewing, increasing equipment costs and limiting preview locations, and web-based methods are time-consuming due to the need for encoding and storing media files in advance.

Method used

A preview device and program that utilize a server and terminal configuration to decode and synthesize broadcast material data in real-time, eliminating the need for dedicated hardware and prior encoding, allowing preview on any connected terminal.

Benefits of technology

Enables cost-effective and location-independent preview of broadcast materials without the need for additional hardware or pre-encoding, reducing time and effort required for setup.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007577487000001
    Figure 0007577487000001
  • Figure 0007577487000002
    Figure 0007577487000002
  • Figure 0007577487000003
    Figure 0007577487000003
Patent Text Reader

Abstract

To provide a preview device that enables previewing broadcast materials without dedicated hardware or a prior encoding process.SOLUTION: According to an embodiment, a preview device includes a recording unit, a material analysis unit, a decoding unit, and a video composition unit. The preview device stores a file for storing data of a broadcast material in a format for a broadcasting station and reproduction information for controlling reproduction of the broadcast material. The material analysis unit analyzes the broadcast material on the basis of the reproduction information of the broadcast material to be previewed and extracts the data of the broadcast material required for previewing. The decoding unit decodes the data of the broadcast material extracted by the material analysis unit. The video composition unit composes a decoded result of the broadcast material decoded by the decoding unit in a format that can be reproduced by a browser.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a preview device and a preview program. [Background technology]

[0002] A preview device is used to check broadcast materials before they are sent out for broadcast. Conventional preview devices, as described in Patent Document 1 for example, use a first method in which hardware such as a video server, decoder, and switcher are controlled by a server based on program on-air information to display the materials on a monitor for preview.

[0003] Furthermore, as described in Patent Document 2, there is a second method in which, rather than previewing by controlling hardware, broadcast material data is converted (encoded) in advance into a format that can be played on a Web browser to generate a media file for Web preview, and this media file is stored on a server, allowing Web material to be previewed based on the media file. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2005-244713 A [Patent Document 2] JP 2010-183264 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the first method described in Patent Document 1 requires preparation of dedicated hardware for previewing, which increases capital investment costs, and has the drawback that previewing can only be performed in places where dedicated hardware is installed.

[0006] Moreover, the second method described in Patent Document 2 is a method for performing a preview on the Web, and therefore can be played on a terminal connected via a network, but it is time-consuming because it is necessary to encode the broadcast material data in advance to generate a media file and store it on a server. Also, when the broadcast material data is encoded, it is converted into a media file in a format different from that of the broadcast material data, so it cannot be said that the preview based on the media file is the same as the preview for the broadcast material data.

[0007] An object of the present invention is to provide a preview device and a preview program that enable previewing of broadcast materials without the need for dedicated hardware or prior encoding processing. [Means for solving the problem]

[0008] According to the embodiment, the preview device includes a recording unit, a material analyzing unit, a decoding unit, and a video synthesizing unit. Recording section teeth, Multiple different Broadcast material data Each individually The broadcasting information storage section stores a file to be saved in a format for a broadcasting station, and playback information for controlling playback of the broadcasting material. The material analysis section analyzes the broadcasting material based on the playback information of the broadcasting material to be previewed, From the file stored in the recording unit in a format for a broadcasting station The decoding unit extracts the broadcasting material data necessary for the preview. , each individually The video synthesis unit synthesizes the results of the decoding of the broadcasting material by the decoding unit into a format that can be played back by a browser. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing the configuration of a Web preview device according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing the configuration of a video synthesis unit in the embodiment. [Diagram 3] A diagram showing the data format of an MXF file that stores base video data for broadcast materials. [Figure 4] FIG. 4 is a diagram showing an example of playback information. [Diagram 5] 5 is a flowchart showing the operation of a terminal according to the present embodiment. [Figure 6] 5 is a flowchart showing the operation of a server in the present embodiment. [Figure 7] FIG. 4 is a diagram showing an example of a preview setting screen according to the embodiment. [Figure 8] FIG. 11 is a diagram showing another functional configuration of the terminal according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment will be described with reference to the drawings.

[0011] The Web preview device 1 in this embodiment decodes broadcast materials stored in the server 11 at the terminal 21 and performs a preview by compositing the images. The terminal 12 requests the server 11 to acquire the broadcast materials, and the server 11 extracts and generates only the data necessary for the preview from the broadcast materials and playback information for controlling the playback of the broadcast materials. The terminal 12 decodes the data of the broadcast materials generated by the server 11, and combines and outputs the decoded results.

[0012] This makes it possible to preview broadcast material without having to perform pre-encoding, as was previously required with conventional methods.

[0013] [Web preview device 1 configuration] Fig. 1 is a block diagram showing the configuration of a Web preview device 1 in this embodiment. The Web preview device 1 in this embodiment includes a server 11 and a terminal 21 connected via a network 30. Although one terminal 21 is shown in Fig. 1, multiple terminals 21 may be provided.

[0014] The server 11 has a computer configuration including a processor, a memory, and a storage device, and realizes various functions by executing programs stored in the memory with the processor.

[0015] The server 11 includes a file server 111 , a database (DB) 112 , a material analysis unit 113 , and a Web server unit 114 .

[0016] The file server 111 stores files that save broadcast material data in a format for broadcast stations. For example, MXF (Material eXchange Format) is used as the format for broadcast stations (see FIG. 3). The MXF file is a container format suitable for converting broadcast materials and the like into files and transmitting them, for example, between broadcast stations over a network. The broadcast materials include, for example, base video, subtitles, and presentation display.

[0017] The DB 112 stores playback information for controlling the playback of broadcast materials stored in the file server 111 (see FIG. 4).

[0018] The material analysis unit 113 analyzes and extracts the video / audio data, subtitles, and presentation display data required for previewing from the MXF files stored in the file server 111 based on the playback information stored in the DB 112 .

[0019] The Web server unit 114 communicates with the interface unit 214 of the terminal 21 .

[0020] The terminal 21 has a computer configuration including a processor, a memory, and a storage device, and realizes various functions by executing programs stored in the memory with the processor. For example, the terminal 21 realizes a function for previewing broadcast materials stored in the server 11 by executing a preview program with the processor. Preview programs include, for example, a Web browser program, a program using JavaScript (registered trademark) executed on a browser, and the like.

[0021] The terminal 21 realizes the functions of a decode section 211, a video synthesis section 212, a main section 213, and an interface section 214 by means of a preview program.

[0022] The decoding unit 211 performs a decoding process on the data of the broadcasting material (for example, base video, subtitles, presentation display, etc.) extracted by the material analysis unit 113 of the server 11 .

[0023] The video synthesis unit 212 synthesizes the results of the decoding of the broadcasting materials decoded by the decoding unit 211 so that they can be played back by the main unit 213 (browser). The video synthesis unit 212 specifies the contents of the images to be drawn, such as base video, subtitles, and presentation display, according to the technical specifications of Canvas in HTML (Hyper Text Markup Language) (HTML5), for example.

[0024] The main unit 213 is realized by, for example, a Web browser, and allocates processing requests to the decode unit 211, the video synthesis unit 212, and the interface unit 214. The main unit 213 displays on the display a preview setting screen for inputting designation of the material to be previewed and designation of at least one of the video, subtitles, and presentation display included in the broadcast material to be previewed. The main unit 213 displays on the display a preview according to the decoded result of the broadcast material synthesized by the decode unit 211.

[0025] The interface unit 214 communicates with the Web server unit 114 .

[0026] Next, a description will be given of the function of the image synthesizing unit 212 in this embodiment. Fig. 2 is a block diagram showing the configuration of the image synthesizing unit 212 in this embodiment.

[0027] The video synthesis unit 212 includes, for example, a base video canvas 212a, a provision canvas 212b, a subtitle canvas 212c, and an output canvas 212d.

[0028] The base video canvas 212a and the provision canvas 212b draw the video (base video, provision display video) decoded by the decoding unit 211. The subtitle canvas 212c draws the subtitle information analyzed by the material analysis unit 113. The output canvas 212d sequentially composites the base video canvas 212a, the provision canvas 212b, and the subtitle canvas 212c to generate an output video.

[0029] In addition, the video synthesis unit 212 (output Canvas 212d) can select and synthesize either the base video Canvas 212a, the provided Canvas 212b, or the subtitle Canvas 212c according to the broadcast material (base video, subtitles, provided display) to be displayed in the preview, in accordance with the specifications input via the preview setting screen displayed by the main unit 213.

[0030] FIG. 3 is a diagram showing the data format of an MXF file that stores base video data of broadcast materials stored in the file server 111 of the server 11. As shown in FIG.

[0031] Since MXF files are container formats, various video encoding methods can be used. In this embodiment, for example, MPEG (Moving Picture Experts Group)-2, LongGOP is used. However, it is not limited to MPEG-2, LongGOP.

[0032] As shown in FIG. 3, the base video MXF file 31 includes video data, audio data 1 to 8, and subtitle data for each frame.

[0033] An MXF file is a file format consisting of a collection of data elements called KLV (Key-length-value). The material analysis unit 113 extracts video and subtitle data based on the key value of the MXF file in accordance with the playback information of the broadcast material to be previewed. The video and subtitle data extracted by the material analysis unit 113 is transmitted to the terminal 21 in batches of several frames (for example, 15 frames).

[0034] In addition, the file server 111 stores an MXF file in which the provided display data is saved in the same format as the MXF file 31 shown in Fig. 3. In this case, the subtitles are data for displaying, for example, the name of the company that provides the subtitles. Since the data format is the same, an illustration of the MXF file in which the provided display data is saved is omitted.

[0035] FIG. 4 is a diagram showing an example of the playback information stored in the DB 112. As shown in FIG.

[0036] FIG. 4 shows, for example, playback information for material X (e.g., broadcast program X), and includes playback start time, playback end time, and provision information regarding provision display. The provision information includes information for the number of times the provision information is displayed during the broadcast of material X (program) (2 times in FIG. 4). The provision information includes start time, end time, and material ID. The material ID is data that specifies the video file used for provision display.

[0037] The material analysis unit 113 extracts data for displaying the material designated as the target for preview from the MXF file stored in the file server 111 in accordance with the playback information.

[0038] [Web preview device 1 operation] Fig. 5 is a flowchart showing the operation of the terminal 21 in this embodiment. Fig. 6 is a flowchart showing the operation of the server 11 in this embodiment.

[0039] The main unit 213 of the terminal 21 displays on the display a preview setting screen for designating a preview target from among the broadcast materials stored in the server 11 (step A1).

[0040] Fig. 7 is a diagram showing an example of a preview setting screen in this embodiment. The preview setting screen shown in Fig. 7 has a material designation area 41 for inputting designation of a material to be previewed, a base video button 421, a subtitle button 422, and a provision display button 423 for designating whether or not to combine each video for the base video, subtitle, and provision display of the broadcasting material to be played back. Also, an OK button 43 for instructing completion of the setting and an NG button 44 for instructing cancellation of the setting are provided.

[0041] In the material designation area 41, for example, a list of materials stored in the server 11 (file server 111) is displayed, and the target for preview can be designated from the list. Fig. 4 shows a state in which "material X" has been designated as the target for preview.

[0042] Also, in FIG. 7, the base video button 421 and the subtitle button 422 are in a selected state as playback targets, indicating that a preview of a composite of the base video and subtitle video, excluding the presentation display, is to be displayed.

[0043] When the OK button 43 is pressed to indicate completion of setting the material to be previewed, the main unit 213 inputs the content specified on the preview setting screen and requests the interface unit 214 to acquire the material (step A2). That is, a request is made to acquire the material to be previewed ("material X" in the settings shown in FIG. 4).

[0044] The interface section 214 requests the Web server section 114 to acquire the material (step A3).

[0045] When the Web server section 114 of the server 11 receives a request to acquire material from the terminal 21 (FIG. 6, step B1), it requests the material analysis section 113 to analyze the material requested by the terminal 21 as a target for preview (step B2).

[0046] The material analysis unit 113 acquires data of the material to be previewed from the file server 111, and also acquires playback information corresponding to the broadcast material to be previewed from the DB 112 (step B3).

[0047] The material analysis unit 113 analyzes the broadcast material to be previewed based on the acquired playback information of the broadcast material, and extracts from the MXF file the data necessary to display a preview image for the material specified on the terminal 21 (step B4).

[0048] The Web server section 114 transmits the data extracted by the analysis by the material analysis section 113 to the interface section 214 of the terminal 21 (step B5).

[0049] The interface section 214 of the terminal 21 acquires the analysis result data from the material analysis section 113 via the Web server section 114 (FIG. 5, step A4).

[0050] The main section 213 receives the broadcast material data from the interface section 214, and issues a decode request to the decoding section 211 (step A5).

[0051] In response to the decoding request, the decoding unit 211 decodes the base video and provided video data of the broadcast material received from the server 11 (step A6). The decoding by the decoding unit 211 differs from the case where the broadcast material data is encoded, and therefore does not change the content of the original broadcast material.

[0052] The main unit 213 passes the results of decoding by the decoding unit 211 to the video synthesis unit 212, requesting synthesis of the results of decoding (step A7).

[0053] The video synthesis unit 212 synthesizes the results of decoding by the decoding unit 211 in response to a request from the main unit 213 (step A8). Here, the video synthesis unit 212 synthesizes the broadcast materials (base video, subtitles, and provided display) to be previewed, which are specified on the preview setting screen. For example, when video and subtitles are specified on the preview setting screen shown in Fig. 7, the output Canvas 212d of the video synthesis unit 212 synthesizes the base video Canvas 212a and the subtitle Canvas 212c to generate an output video.

[0054] The main unit 213 displays the output video composited by the video composite unit 212 on the browser screen (step A9). In the preview displayed by the main unit 213, the objects (base video, subtitles, and provided display) designated in advance on the preview setting screen are composited and displayed, so that the video suited to the purpose of the preview can be confirmed.

[0055] In this way, the Web preview device 1 in this embodiment analyzes the broadcast material and performs a decoding process on the extracted data to be previewed, making it possible to preview the broadcast material without using dedicated hardware and without performing prior encoding processing.

[0056] Therefore, since dedicated hardware for previewing is not required, there is no need to increase the cost of capital investment, and the preview can be viewed on a terminal 21 installed at any location connected to the server 11 via a network 30, not limited to a location where the dedicated hardware is installed.

[0057] Furthermore, since there is no need to perform a pre-encoding process in order to display a preview, the time required to display a preview can be reduced by eliminating the need for labor.

[0058] The functional configuration of the terminal 21 may be different from that of FIG. 1 and may be as shown in FIG.

[0059] In many cases, broadcast materials have a frame rate of 30 fps (29.97 fps), and so 30 frames need to be rendered per second. In the configuration shown in Fig. 8, a plurality of decoding units 211-1 to 211-n, a plurality of video synthesis units 212-1 to 212-n, and a plurality of interface units 214-1 to 214-n are provided. That is, each processing unit is threaded using, for example, WebWorker (registered trademark), so that parallel processing can be performed on a plurality of frames. This makes it possible to display a smooth preview.

[0060] Furthermore, in the above explanation, the Web preview device 1 is configured from the server 11 and the terminal 21, but it is also possible to realize it as a device that integrates the functions of the server 11 and the terminal 21 described above.

[0061] The methods described in each of the above embodiments may be distributed as a program that can be executed by a computer, stored in a storage medium such as a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), a magneto-optical disk (MO), or a semiconductor memory. It is also possible.

[0062] Furthermore, the storage medium may be in any storage format as long as it is a storage medium that can store a program and is computer readable.

[0063] In addition, an OS (operating system), database management software, network software, or other MW (middleware) running on a computer based on instructions from a program installed on the computer from a storage medium may execute some of the processes for realizing the above embodiments.

[0064] Furthermore, the storage medium in each embodiment is not limited to a medium independent of a computer, but also includes a storage medium that stores or temporarily stores a program downloaded via a LAN, the Internet, or the like.

[0065] Furthermore, the number of storage media is not limited to one, and cases in which the processes in the above embodiments are executed from a plurality of media are also included in the storage media of the present invention, and any medium configuration may be used.

[0066] In addition, the computer in each embodiment executes each process in each of the above embodiments based on a program stored in a storage medium, and may be configured as either a single device such as a personal computer, or a system in which multiple devices are connected to a network.

[0067] Furthermore, the computer in each embodiment includes an arithmetic processing device, a microcomputer, etc. included in an information processing device, and is a general term for a device or apparatus that can realize the functions of the present invention by a program.

[0068] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0069] 1...Web preview device, 11...server, 111...file server, 112...database (DB), 113...material analysis section, 114...Web server section, 21...terminal, 211, 211-1, ..., 211-n...decoding section, 212, 212-1, ..., 212-n...video synthesis section, 213...main section, 214, 214-1, ..., 214-n...interface section, 30...network, 212a...base video canvas, 212b...providing canvas, 212c...subtitle canvas, 212d...output canvas.

Claims

1. A recording unit for storing files for storing data of a plurality of different broadcast materials in a format for a broadcast station, and playback information for controlling playback of the broadcast materials; a material analysis unit that analyzes the broadcast material to be previewed based on playback information of the broadcast material and extracts data of the broadcast material required for previewing from a file stored in the recording unit in a format for a broadcast station; a decoding unit that individually decodes the broadcasting material data extracted by the material analysis unit; a video synthesis unit that synthesizes the results of the decoding of the broadcasting material by the decoding unit into a format that can be played back by a browser.

2. The apparatus further includes an input unit for inputting a designation of at least one of a video, a subtitle, and a presentation display included in the broadcast material as a preview target, 2. The preview device according to claim 1, wherein the video synthesizing section synthesizes a result of decoding at least one of the broadcasting material data of the video, the subtitle, and the presentation display corresponding to the input specification into a format reproducible by a browser.

3. 2. The preview device according to claim 1, wherein a plurality of said decoding sections and a plurality of said video synthesizing sections are provided, and a plurality of frames are processed in parallel.

4. A preview device having a server and a terminal connected via a network, The server, a recording unit for storing files for storing data of a plurality of different broadcast materials in a format for a broadcast station, and playback information for playing back the broadcast materials; a material analysis unit that, in response to a request from the terminal, analyzes the broadcast material to be previewed based on playback information of the broadcast material, and extracts data of the broadcast material required for previewing from a file saved in a broadcast station format stored in the recording unit; The terminal includes: a decoding unit that individually decodes the broadcasting material data extracted by the material analysis unit; a video synthesis unit that synthesizes the results of the decoding of the broadcasting material by the decoding unit into a format that can be played back by a browser.

5. Computer, a display unit that displays a screen for allowing a user to select a preview target from among the broadcasting materials recorded in the recording unit of the server; an interface unit that receives from the server the broadcast material data required for the preview, which is extracted from a file that stores a plurality of different broadcast material data individually in a broadcast station format in accordance with a preview target designated through the screen, by analyzing the broadcast material based on playback information of the broadcast material to be previewed from the file stored in the broadcast station format; a decoding unit for individually decoding the broadcasting material data received by the interface unit; A preview program for causing the decoding unit to function as a video synthesis unit that synthesizes the results of the broadcasting material decoded by the decoding unit into a format that can be played back in a browser.

Citation Information

Patent Citations

  • Broadcast program sending system and preview processing method thereof

    JP2005244713A

  • Method for previewing broadcast material

    JP2006148644A

  • Closed caption display system and method

    JP2009188462A

  • Caption checking apparatus and caption checking method

    JP2009260823A

  • Web preview material generative system in nonlinear bank system

    JP2010183264A