Image processing system

Abstract

To make the number of SDI cables minimum and perform superimposition of information on an original image for broadcast with a simple configuration even on the occasion of increased / complicated system number of pieces of information to be imposed on the image for broadcasting.SOLUTION: An image processing system includes: an image processing device having means 140 for receiving an operation of selecting two or more material images as processing targets from a plurality of material images and receiving combination order information for specifying an order in which the two or more material images are to be superimposed, means 150 for generating an image for superimposition in which the two or more material images as processing targets are combined with each other according to the combination order information in a state where a plurality of previous material images are not changed, and means 160 for converting the image for superimposition into a data format that can be processed by a transfer destination, and transferring it to an SDI transfer device; and the SDI transfer device having means 180 for generating only one set of Fill-Key video signals based on the image for superimposition and means 190 for transferring only one set of Fill-Key video signals to a video composition device in accordance with an SDI standard.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a technique for generating an image to be superimposed on a broadcast image (for example, a caption image) and transferring the image to a video synthesizer. [Background technology]

[0002] As a means for providing additional information to viewers, a broadcast image in which a caption image is superimposed on an original broadcast image is sometimes broadcast.

[0003] In this case, the caption image to be superimposed on the original broadcast image is generated as video signals called a Fill video signal and a Key video signal, and the broadcast image on which the Fill-Key video signal is superimposed (combined) in a video synthesis device is broadcast from the broadcasting equipment.

[0004] Research and development has been ongoing into technology for superimposing caption images on broadcast video. For example, Patent Document 1 proposes a caption monitoring device that enables easy and accurate confirmation of the transmitted video. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2011-9835 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, with the above-mentioned conventional technology, when increasing the number of systems of captions to be composited into broadcast images, the number of SDI (Serial Digital Interface) cables connected to the video composition device must be increased, which creates the problem that complex captions cannot be composited easily.

[0007] In view of the above problems, the present invention has an object to provide an image processing system that can realize information superimposition on original broadcast images with a simple configuration, while requiring only a minimum number of SDI cables, even when the number of systems for information to be superimposed on broadcast images increases and becomes more complex. [Means for solving the problem]

[0008] One embodiment of the image processing system to be disclosed includes a material image storage means for storing a plurality of material images serving as materials for a superimposition image to be superimposed on an original broadcast image, a selection instruction receiving means for receiving a user operation for selecting two or more of the material images to be processed from the plurality of material images and for receiving synthesis order information for specifying an order in which the two or more material images are to be superimposed, a superimposition image generating means for generating the superimposition image in which the two or more material images to be processed are synthesized according to the synthesis order information while no changes are made to the plurality of material images, and an SDI (Serial Digital Interface) for transferring a Fill video signal and a Key video signal to be synthesized on the original broadcast image to a video synthesizing device that transfers the broadcast image to a broadcast facility. and an image processing device having an image transfer means for converting the overlay image into a data format processable by the SDI transmission device and transferring the image to the SDI transmission device at a predetermined data transfer rate. The SDI transmission device has a Fill-Key generation means for generating only one set of the Fill video signal based on a color information portion of the overlay image and the Key video signal based on a transparent information portion of the overlay image, and a Fill-Key transfer means for transferring only the set of the Fill video signal and the Key video signal to the video synthesizer in accordance with the SDI standard. Effect of the Invention

[0009] The disclosed image processing system requires only a minimum number of SDI cables, even when the number of systems for information to be superimposed on broadcast images increases and becomes more complex, and achieves information superimposition on original broadcast images with a simple configuration. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram showing an overview of an image processing system according to an embodiment of the present invention. [Diagram 2] 1 is a functional block diagram of an image processing system according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram for explaining a superimposition image generating means according to the present embodiment. [Figure 4] FIG. 1 is a diagram illustrating an example of a hardware configuration of an image processing device according to an embodiment of the present invention. [Diagram 5] FIG. 2 is a diagram showing a flow of processing by the image processing system according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS With reference to the drawings, an embodiment of the present invention will be described. (Operation principle of the image processing system according to the present embodiment)

[0012] The operation principle of an image processing system (hereinafter simply referred to as "this system") 100 according to this embodiment will be described with reference to Figures 1 to 3. Figure 1 is a diagram showing the connection relationship between this system 100 and peripheral devices, Figure 2 is a functional block diagram of this system 100, and Figure 3 is a diagram for explaining the processing of a superimposition image generating means 150, which will be described later.

[0013] 1, the system 100 includes an image processing device 110 and an SDI (Serial Digital Interface) transmission device 120 connected thereto. The image processing device 110 generates a superimposition image (e.g., a telop image 230) 220 to be composited with a broadcast image (video) 250 broadcast from a broadcast facility 370. The SDI transmission device 120 generates a Fill video signal 290 and a Key video signal 300 based on the superimposition image 220, and transfers these video signals 290, 300 to an image synthesizer 280. The image synthesizer 280 is, for example, a DSK (downstream keyer).

[0014] 1, the switcher 350 transfers original broadcast images 240, which are the basis of broadcast images, to the image synthesizer 280, which then synthesizes a fill video signal 290 and a key video signal 300 acquired from the SDI transmission device 120 with the original broadcast image 240. The image synthesizer 280 transfers broadcast images 250, which are the result of the combination of the fill video signal 290 and the key video signal 300, to the transmission equipment (broadcast equipment) 270, which then broadcasts the broadcast images 250.

[0015] 2, the image processing device 110 has a material image storage means 130, a selection instruction receiving means 140, a superimposition image generating means 150, a superimposition image transferring means 160, and an image acquiring means 170. The SDI sending device 120 has a Fill-Key generating means 180 and a Fill-Key transferring means 190.

[0016] The material image storage means 130 stores a plurality of material images 210 that are materials for the superimposition image 220 to be superimposed on the original broadcast image 240. The original broadcast image 240 is an image (video) before the Fill video signal 290 and the Key video signal 300 are combined, and is an image (video) provided by the switcher 350. The material image 210 may be a still image or a moving image. The overlay image 220 is, for example, a telop image 230 , which is the source image of a fill video signal 290 and a key video signal 300 . As shown in FIG. 3, the elemental image storage means 130 stores a plurality of elemental images 210, such as elemental image 1, elemental image 2, and elemental image 3, for example.

[0017] The selection instruction receiving means 140 receives a user operation for selecting two or more material images 210 to be processed from among the multiple material images 210 stored in the material image storage means 130. The selection instruction receiving means 140 also receives, as a user operation, composition order information 260 that specifies the order in which the two or more material images 210 to be processed are superimposed.

[0018] As shown in Fig. 3(1), the selection instruction receiving means 140 receives, for example, a user operation to select material images 1, 2, and 3 as processing targets. Also, as shown in Fig. 3(2), the selection instruction receiving means 140 receives, for example, a user operation to select material images 1, 3, and 4 as processing targets. Also, as shown in Fig. 3(3), the selection instruction receiving means 140 receives, for example, a user operation to select material images 1 and 4 as processing targets.

[0019] The compositing order information 260 is information that specifies the order of overlay, such that, for example, material image 1 is composited in the backmost position, material image 2 is composited in the third position from the top, material image 3 is composited in the second position from the top, and material image 4 is composited in the foreground.

[0020] The superimposition image generating means 150 generates a superimposition image 220 in which two or more material images 210 to be processed are composited in accordance with the composite order information 260, without any changes being made to the plurality of material images 210 stored in the material image storage means 130. The superimposition image 220 may be a still image or a moving image.

[0021] Furthermore, only one overlay image 220 is generated by the overlay image generation means 150, and the Fill video signal 290 and Key video signal 300 to be composited with the original broadcast image 240 in subsequent processing are generated based on the overlay image 220, and only one set is generated.

[0022] Conventionally, when attempting to synthesize a complex image for superimposition (for example, a caption image) with the original image for broadcast 240, a large number of images for superimposition were created, and accordingly a large number of sets of Fill video signals and Key video signals were also generated. It was also necessary to connect a large number of SDI cables connecting the SDI transmission device 120 and the video synthesizer 280, the number of which corresponded to the number of Fill video signals and Key video signals.

[0023] However, even if the image for superimposition (for example, a caption image) is complex, the process by the image for superimposition generating means 150 generates only one (one set) image for superimposition 220, fill video signal 290, and key video signal 300. Therefore, even if the number of systems for information to be superimposed on the broadcast image 250 increases and becomes more complex, this system 100 requires only the minimum number of SDI cables and can realize information superimposition on the original broadcast image 240 with a simple configuration.

[0024] The image synthesis process performed by the superimposition image generating means 150 is performed using a general technique. The material image 210 and the superimposition image 220 each have color information and transparency information for each pixel. The image processing device 110 can also add transparency information to the material image 210 and the superimposition image 220.

[0025] Moreover, it is preferable that the superimposition image 220 is described in HTML (Hyper Text Markup Language) format, which makes it possible to exchange the superimposition image 220 without using a dedicated device, and makes it easy to transfer the superimposition image 220.

[0026] The overlay image transfer means 160 converts the overlay image 220 from HTML format into a data format that can be processed by the SDI sending device 120, and transfers it to the SDI sending device 120 at a predetermined data transfer rate (for example, 30 frames / second).

[0027] The image acquisition means 170 can acquire the material image 210 or the image to be superimposed 220 from the other image processing devices 330 and the cloud device 340 connected via the communication network 360, and make it a processing target of the image processing device 110. This allows the image processing device 110 to work in cooperation with the other image processing devices 330 and the cloud device 340 connected via the communication network 360. The communication network 360 may be a wired communication network or a wireless communication network.

[0028] The Fill-Key generation means 180 generates a Fill video signal 290 based on the color information portion 310 of the overlay image 220, and generates a Key video signal 300 based on the transparent information portion 320 of the overlay image 220. The Fill-Key generation means 180 generates only one set of the Fill video signal 290 and the Key video signal 300. The overlay image 220 is transferred from the image processing device 110 by the overlay image transfer means 160.

[0029] Since the Fill-Key generation means 180 generates only one set of Fill video signal 290 and Key video signal 300, the system 100 requires only the minimum number of SDI cables, even when the number of systems for information to be superimposed on the broadcast image 250 increases and becomes more complex, and can achieve information superimposition on the broadcast original image 240 with a simple configuration.

[0030] The Fill-key transfer means 190 transfers only one set of the Fill video signal 290 and the Key video signal 300 generated by the Fill-key generation means 180 to the video synthesizer 280 in accordance with the SDI standard (via an SDI cable with the minimum number of units).

[0031] Based on the above operating principle, this system 100 requires only the minimum number of SDI cables, even when the number of systems for information to be superimposed on the broadcast image 250 increases and becomes more complex, and can realize information superimposition on the original broadcast image 240 with a simple configuration. Based on the above-mentioned operating principle, the present system 100 can easily increase the number of channels of the telop 230 to be synthesized with the broadcast image 250. Based on the above-mentioned operating principle, the present system 100 can easily synthesize a complex telop 230 onto a broadcast image 250 . Based on the above-mentioned operating principle, the present system 100 can simplify the system for synthesizing the telop 230 onto the broadcast image 250.

[0032] Based on the above operating principle, this system 100 makes it possible to construct a system that synthesizes subtitles 230 onto broadcast images 250 even when it is not connected to an external device (excluding transmission equipment) (a cloud device 340 that stores data 210 that is the material for the subtitles 230).

[0033] Based on the above-mentioned operating principle, this system 100 makes it possible to easily build a system for synthesizing a telop 230 onto a broadcast image 250 in a mobile station such as a broadcast van. (Hardware configuration of the image processing device according to the present embodiment)

[0034] An example of the hardware configuration of the image processing device 110 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the hardware configuration of the image processing device 110. As shown in Fig. 4, the image processing device 110 has a CPU (Central Processing Unit) 510, a ROM (Read-Only Memory) 520, a RAM (Random Access Memory) 530, an auxiliary storage device 540, a communication I / F 550, an input / output device 560, an external device I / F 570, and a storage medium I / F 580.

[0035] CPU 510 is a device that executes a program stored in ROM 520, performs arithmetic processing on data loaded into RAM 530 in accordance with instructions from the program, and controls the entire image processing device 110. ROM 520 stores programs and data to be executed by CPU 510. When CPU 510 executes a program stored in ROM 520, the program and data to be executed are loaded into RAM 530, and RAM 530 temporarily holds the arithmetic data during calculation.

[0036] The auxiliary storage device 540 is a device that stores the OS (Operating System) which is basic software, the application program according to the present embodiment, and the like together with related data. The auxiliary storage device 540 is, for example, a HDD (Hard Disk Drive) or a flash memory.

[0037] The communication I / F 550 is an interface for connecting to a communication network 360 such as a wired or wireless LAN (Local Area Network) or the Internet, and for transmitting and receiving data to and from other devices that provide communication functions.

[0038] The input / output device 560 is a device such as a keyboard for inputting data to the image processing device 110. The input / output device 560 also includes a device configured with an LCD (Liquid Crystal Display) or the like, and functions as a user interface when the user uses the functions of the image processing device 110 or when various settings are made.

[0039] The external device I / F 570 is an interface that is connected to an external device such as the SDI transmission device 120 and transmits and receives data to and from the external device. For example, the image processing device 110 is connected to the SDI transmission device 120 via the external device I / F 570. The storage medium I / F 580 is an interface for transmitting and receiving data to and from a storage medium 590 such as a CD-ROM, a DVD-ROM, or a USB memory.

[0040] Each unit of the image processing device 110 may be realized by the CPU 510 executing a program corresponding to each unit stored in the ROM 520 or the auxiliary storage device 540. Each unit of the image processing device 110 may be realized by implementing the processing related to each unit as hardware. Alternatively, the program according to the present invention may be read from an external server device via the communication I / F 550, or read from the storage medium 590 via the storage medium I / F 580, to cause the device 100 to execute the program. (Processing example by the image processing system according to the present embodiment) An example of processing by the present system 100 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of an example of processing by the present system 100.

[0041] In S10, the image acquisition means 170 acquires the material image 210 or the overlay image 220 from the other image processing devices 330 and the cloud device 340 connected via the communication network 360. This enables the image processing device 110 to work collaboratively with the other image processing devices 330 and the cloud device 340 connected via the communication network 360.

[0042] The material image 210 acquired by the image acquisition means 170 is stored in the material image storage means 130. Note that the image processing device 110 may perform the processes from S20 onward without acquiring the material image 210 or the superimposition image 220 from another image processing device 330 or the cloud device 340.

[0043] In S20, the selection instruction receiving means 140 receives a user operation to select two or more material images 210 to be processed from among the multiple material images 210 stored in the material image storage means 130. The selection instruction receiving means 140 also receives, as a user operation, composition order information 260 that specifies the order in which the two or more material images 210 to be processed are superimposed.

[0044] As shown in FIG. 3, the selection instruction receiving means 140 receives, for example, (1) a user operation to select material images 1, 2, and 3 as processing targets, (2) a user operation to select material images 1, 3, and 4, and (3) a user operation to select material images 1 and 4.

[0045] In S30, the superimposition image generating means 150 generates a superimposition image 220 in which two or more material images 210 to be processed are composited in accordance with the composite order information 260, without any changes being made to the plurality of material images 210 stored in the material image storage means 130. The superimposition image 220 may be a still image or a moving image.

[0046] Even if the image for superimposition (e.g., caption image 230) 220 is complex, only one image for superimposition 220, Fill video signal 290, and Key video signal 300 are generated by the processing by the image for superimposition generating means 150. Therefore, even if the number of systems of information to be superimposed on the broadcast image 250 increases and becomes more complex, this system 100 requires only the minimum number of SDI cables and can realize information superimposition on the original broadcast image 240 with a simple configuration.

[0047] Moreover, it is preferable that the superimposition image 220 is written in HTML format, which makes it possible to exchange the superimposition image 220 without using a dedicated device, and makes it easy to pass the superimposition image 220 over.

[0048] In S40, the overlay image transfer means 160 converts the overlay image 220 generated in S30 from HTML format into a data format processable by the SDI transmission device 120, and transfers it to the SDI transmission device 120 at a predetermined data transfer rate (for example, 30 frames / second).

[0049] In S50, the Fill-key generation means 180 generates a Fill video signal 290 based on the color information portion 310 of the superimposition image 220 transferred in S40, and generates a Key video signal 300 based on the transparent information portion 320 of the superimposition image 220. Since only one superimposition image 220 was transferred in S40, the Fill-key generation means 180 generates only one set of Fill video signal 290 and Key video signal 300.

[0050] Since the Fill-Key generation means 180 generates only one set of Fill video signal 290 and Key video signal 300, this system 100 requires only a minimum number of SDI cables between the devices 120, 280, even if the number of systems for information to be superimposed on the broadcast image 250 increases and becomes more complex, and therefore can realize information superimposition on the broadcast original image 240 with a simple configuration.

[0051] In S60, the Fill-Key transfer means 190 transfers only one set of the Fill video signal 290 and the Key video signal 300 generated in S50 to the video synthesizer 280 in accordance with the SDI standard (via the minimum number of SDI cables).

[0052] On the other hand, the video synthesizer 280 acquires the original broadcast image 240 from the switcher 350. Then, the video synthesizer 280 synthesizes only one set of the Fill video signal 290 and the Key video signal 300 transferred in S60 with the original broadcast image 240 acquired from the switcher 350, thereby generating the broadcast image 250.

[0053] Furthermore, the image synthesizer 280 transfers the generated broadcast image 250 to the transmission facility (broadcast facility) 270. Then, the transmission facility (broadcast facility) 270 transmits the broadcast image 250 transferred from the image synthesizer 280 from an antenna, and broadcasts it.

[0054] As described above, with the present system 100, even if the number of systems of information to be superimposed on the broadcast image 250 increases and becomes more complex, the number of SDI cables required is the minimum unit, and the superimposition of information on the broadcast original image 240 can be realized with a simple configuration.

[0055] Although the embodiment of the present invention has been described in detail above, the present invention is not limited to such specific embodiment, and various modifications and variations are possible within the scope of the gist of the present invention described in the claims. [Explanation of symbols]

[0056] 100 Image Processing System 110 Image processing device 120 SDI (Serial Digital Interface) transmission device 130 Material image storage means 140 Selection instruction receiving means 150 Superimposed image generating means 160 Image transfer means for superimposition 170 Image Acquisition Means 180 Fill-Key generation means 190 Fill-Key Transfer Method 210 stock images 220 Overlay Image 230 Images for subtitles 240 Original Broadcast Images 250 Broadcast Images 260 Composition order information 270 Transmission equipment (broadcasting equipment) 280 Image Synthesizer 290 Fill video signal 300 Key video signal 310 Color information part of the image for superimposition 320 Transparent information part of the image for overlay 330 Other image processing devices 340 Cloud Device 350 Switcher 360 Communication Network 510 CPU 520 ROM 530 RAM 540 Auxiliary storage 550 Communication Interface 560 I / O device 570 External Device Interface 580 Storage Media Interface 590 Storage medium

Claims

1. a material image storage means for storing a plurality of material images serving as materials for an image to be superimposed on an original image for broadcast; a selection instruction receiving means for receiving a user operation for selecting two or more of the material images to be processed from among the plurality of material images, and for receiving synthesis order information for specifying an order in which the two or more material images are superimposed; a superimposition image generating means for generating the superimposition image in which the two or more material images to be processed are composited in accordance with the composite order information while the plurality of material images are not modified; an image processing device having: a superimposition image transfer means for converting the superimposition image into a data format processable by an SDI (Serial Digital Interface) transmission device, which transfers a Fill video signal and a Key video signal to be superimposed on an original image for broadcast to a video synthesizer that transfers the image for broadcast to a broadcast facility, and transferring the image for superimposition to an SDI transmission device at a predetermined data transfer rate; a Fill-Key generating means for generating only one set of the Fill video signal based on a color information portion of the image for superimposition and the Key video signal based on a transparent information portion of the image for superimposition; and a Fill-Key transfer means for transferring only a set of the Fill video signal and the Key video signal to the video synthesizer in accordance with the SDI standard.

2. The image processing device, 2. The image processing system according to claim 1, further comprising an image acquisition unit that acquires the material image or the image for superimposition from another image processing device connected via a communication network.

3. 2. The image processing system according to claim 1, wherein the image to be superimposed is described in HTML (Hyper Text Markup Language) format.

4. 1. An image processing apparatus having a material image storage means for storing a plurality of material images serving as materials for an image to be superimposed on an original image for broadcast, a selection instruction receiving means for receiving a user operation for selecting two or more of the material images to be processed from among the plurality of material images, and receiving synthesis order information for specifying an order in which the two or more material images are to be superimposed; a step of generating the superimposition image in which the two or more material images to be processed are composited in accordance with the composite order information by a superimposition image generating means while the plurality of material images are not modified; a step in which a superimposition image transfer means converts the superimposition image into a data format processable by an SDI transmission device, which transfers a Fill video signal and a Key video signal to be combined with the original broadcast image to a video synthesizer which transfers the broadcast image to a broadcast facility, and transfers the superimposition image to an SDI transmission device at a predetermined data transfer rate; In the SDI transmission device, a Fill-Key generating means generating only one set of the Fill video signal based on a color information portion of the image for superimposition and the Key video signal based on a transparent information portion of the image for superimposition; and a step of a Fill-Key transfer means transferring only the set of the Fill video signal and the Key video signal to the video synthesizer in accordance with the SDI standard.

5. In the image processing device, 5. The image processing method according to claim 4, further comprising a step in which image acquisition means acquires the material image or the image to be superimposed from another image processing apparatus connected via a communication network.

6. 5. The image processing method according to claim 4, wherein the image to be superimposed is described in HTML (Hyper Text Markup Language) format.

7. An image processing device having a material image storage means for storing a plurality of material images serving as materials for an image to be superimposed on an original image for broadcast, a selection instruction receiving means for receiving a user operation for selecting two or more of the material images to be processed from among the plurality of material images, and receiving synthesis order information for specifying an order in which the two or more material images are to be superimposed; a step of generating the superimposition image in which the two or more material images to be processed are composited in accordance with the composite order information by a superimposition image generating means while the plurality of material images are not modified; an image processing program for executing an image processing method including a step of converting the image for overlay into a data format processable by an SDI transmission device and transferring the image for overlay at a predetermined data transfer rate to an SDI transmission device having a Fill-Key generation means for generating only one set of the Fill video signal based on a color information portion of the image for overlay and the Key video signal based on a transparent information portion of the image for overlay, and a Fill-Key transfer means for transferring only the set of the Fill video signal and the Key video signal to the image synthesis device in accordance with the SDI standard, wherein the overlay image transfer means transfers a Fill video signal and a Key video signal to be overlayed with the original image for broadcast to an image synthesis device that transfers the image for broadcast to a broadcast facility, and

Images