Video splitting device, video compositing device, and program

Abstract

To transmit a video signal with any aspect ratio and number of pixels.SOLUTION: A sub-frame division unit 10 of a video division device 1 divides a full frame FF video into N sub-frames SF, and generates division information C (ID1,..., ID5). An effective frame designation unit 11 designates an effective frame EF according to a user operation, and generates effective frame information A for identifying the effective frame EF. A sub-effective frame designation unit 12 designates a sub-effective frame SEF for each sub-frame SF based on the division information C and the effective frame information A, and generates sub-effective frame information B (ID6, ID7) for identifying the sub-effective frame SEF. A video transmitting unit 13 generates identification information I (ID1,..., ID7) using the division information C and the sub-effective frame information B for each sub-frame SF, multiplexes the sub-frame SF and the identification information I, and transmits the video signal for each sub-frame SF via each link of an SDI.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a technique for transmitting video signals between studio devices, and particularly to a video splitting device that splits and transmits video, a video synthesizing device that receives and synthesizes video, and programs therefor.

Background Art

[0002] Conventionally, since the start of high-definition broadcasting, the aspect ratio of video in content production by broadcasters has been fixed at 16:9. This is because the aspect ratios of 2K, 4K, and 8K adopted as regulations for video formats in broadcasting are 16:9.

[0003] When video is sent and viewed through a broadcast service, since the aspect ratio of the display device is also 16:9, the aspect ratios of the video and the display are the same and correspond one-to-one. As a result, video is displayed in all areas on the display device, and there is no non-display area.

[0004] On the other hand, in recent years, the number of operators providing video through communication services has been increasing. When video is sent and viewed through a communication service, the aspect ratio of the display device is not limited to 16:9, which is the same as that of a television. For example, when viewing a video with an aspect ratio of 16:9 using a smartphone or a tablet terminal, the long side of the video is horizontal, while the long side of the display device is vertical, etc., and there may be a case where the aspect ratio is different between the video and the display device.

[0005] Therefore, the types of aspect ratios handled in communication services are various, unlike those in broadcast services.

[0006] To handle video signals with aspect ratios different from the 16:9 aspect ratio used in 2K, 4K, and 8K video, the SMPTE (Society of Motion Picture and Television Engineers) standard ST2016-2 has been defined as a standard for transmission between studio equipment via SDI (Serial Digital Interface) (see Non-Patent Literature 1).

[0007] This standard, ST2016-2, specifies auxiliary information for transmitting video with an aspect ratio and pixel count different from 16:9 within a broadcasting station when the transmitting side designates a portion of the full-frame video transmitted via SDI using aspect ratio designation identification and horizontal / vertical pixel count designation information, and the receiving side detects this designation information.

[0008] In addition, consideration is underway for video formats with a resolution exceeding 8K as a future video format.

[0009] For example, ITU-R Recommendation BT.2123 specifies a pixel count of 30,720 × 15,360 as a specific image parameter for presenting images across a wide area of ​​the viewer's field of vision and providing an immersive experience (see Non-Patent Document 2).

[0010] When transmitting the number of pixels specified in ITU-R Recommendation BT.2123 as a video signal, two characteristics of the video parameters must be considered: the aspect ratio is not 16:9, and the number of pixels exceeds 8K.

[0011] First, regarding the aspect ratio, since it differs from the 16:9 aspect ratio used in current broadcasting services, similar to the aspect ratio of display devices in the aforementioned communication services, it is necessary to transmit the video signal in accordance with the standard ST2016-2 mentioned in Non-Patent Document 1.

[0012] Next, regarding the number of pixels, the number of pixels specified in ITU-R Recommendation BT.2123, mentioned in Non-Patent Document 2 above, exceeds 8K, but no interface exists on the market that can realize such a video signal with a single physical connection (link). Therefore, when using existing interfaces, the video signal must be transmitted via multiple links. [Prior art documents] [Non-patent literature]

[0013] [Non-Patent Document 1] SMPTE Standard ST2016-2, “Format for Pan-Scan Information,” 2014. [Non-Patent Document 2] Recommendation ITU-R BT.2123-0, “Video parameter values ​​for advanced immersive audio-visual systems for production and international program exchange in broadcasting,” 2019. [Overview of the project] [Problems that the invention aims to solve]

[0014] Here, we consider a case where a video signal with a non-16:9 aspect ratio, as defined in ITU-R Recommendation BT.2123 of Non-Patent Document 2 mentioned above, is transmitted via a conventional studio equipment interface such as SDI, exceeding the number of pixels that can be transmitted over a single interface link.

[0015] In this case, the standard ST2016-2 in Non-Patent Document 1 is based on the premise that video signals are transmitted over a single SDI link, and therefore, the standard ST2016-2 cannot be used as is. Specifically, the standard ST2016-2 in Non-Patent Document 1 assumes that full-frame video is transmitted over a single link, and therefore it is possible to specify the effective frames (video displayed on the display device) for full-frame video. In contrast, if one attempts to transmit a video signal as defined in ITU-R Recommendation BT.2123 in Non-Patent Document 2 in accordance with the standard ST2016-2 in Non-Patent Document 1, it is necessary to transmit it over two or more links, and therefore, simply specifying the effective frames for full-frame video is insufficient.

[0016] Thus, when transmitting the number of pixels specified in ITU-R Recommendation BT.2123, as described in Non-Patent Document 2 above, as a video signal, it is necessary to consider two characteristics of the video parameters: the aspect ratio is not 16:9, and the number of pixels exceeds 8K.

[0017] Currently, SMPTE is investigating methods for transmitting video signals with aspect ratios other than 16:9 and with pixel counts exceeding 8K, but there are no existing transmission / reception systems or devices designed to support these new transmission methods.

[0018] Therefore, the present invention has been made to solve the above-mentioned problems, and its objective is to provide a video splitting device, a video combining device, and a program capable of transmitting video signals with any aspect ratio and number of pixels. [Means for solving the problem]

[0019] To solve the above problem, the video splitting device of claim 1 is a video splitting device that splits and transmits a full frame video, comprising: a subframe splitting unit that splits the full frame into a plurality of subframes; an effective frame designation unit that designates a predetermined area within the full frame as an effective frame and generates effective frame information indicating the position of the effective frame within the full frame; a sub-effective frame designation unit that, for each of the plurality of subframes split by the subframe splitting unit, uses the effective frame information generated by the effective frame designation unit to designate an area within the subframe that overlaps with the effective frame as a sub-effective frame and generates sub-effective frame information indicating the position of the sub-effective frame within the subframe; and a video transmission unit that, for each of the plurality of subframes split by the subframe splitting unit, generates identification information for identifying the effective frame and the sub-effective frame, including the sub-effective frame information corresponding to the subframe generated by the sub-effective frame designation unit, and transmits a plurality of video signals corresponding to the plurality of subframes via a plurality of links, using the subframe and the corresponding identification information as video signals.

[0020] Furthermore, the video splitting device of claim 2 is characterized in that, in addition to the sub-effective frame information, the identification information includes information that includes the total number of the plurality of subframes, the arrangement relationship of the plurality of subframes in the full frame, and a number corresponding to the position of the subframe in the full frame.

[0021] Furthermore, the video splitting device of claim 3 is characterized in that, in the video splitting device of claim 1, the sub-effective frame information is the number of pixels in the horizontal and vertical directions of the sub-effective frame, and the number of pixels in the horizontal and vertical directions between the center pixel of the sub-frame and the center pixel of the sub-effective frame.

[0022] Further, the video splitting device according to claim 4 is the video splitting device according to claim 1, wherein the sub-valid frame information is the coordinate information of the upper left pixel and the coordinate information of the lower right pixel in the sub-valid frame.

[0023] Further, the video splitting device according to claim 5 is the video splitting device according to claim 1, wherein when the sub-valid frame does not match the sub-frame for each of the plurality of sub-frames, the video transmission unit generates the identification information including the sub-valid frame information. When the sub-valid frame matches the sub-frame, the identification information is generated without including the sub-valid frame information and including the total number of the plurality of sub-frames, the arrangement relationship of the plurality of sub-frames in the full frame, and the number corresponding to the position of the sub-frame in the full frame.

[0024] Furthermore, the video synthesis apparatus of claim 6 is a video synthesis apparatus that receives a plurality of video signals from a video splitting device, each containing a plurality of subframes from which a full frame has been divided and a plurality of corresponding identification information, synthesizes the plurality of subframes into the full frame, and outputs a predetermined area within the full frame as video of an effective frame specified by the video splitting device, and is characterized by comprising: a video receiving unit that receives the plurality of video signals via a plurality of links, and for each of the plurality of subframes included in the plurality of video signals, extracts sub-effective frame information indicating the position of the sub-effective frame within the subframe from the identification information corresponding to the subframe, with the area where the subframe and the effective frame overlap being a sub-effective frame; a frame processing unit that generates effective frame information indicating the position of the effective frame within the full frame using the sub-effective frame information corresponding to each of the plurality of subframes extracted by the video receiving unit; and a subframe synthesis unit that synthesizes the plurality of subframes included in the plurality of video signals received by the video receiving unit into the full frame, and extracts video of the effective frame from the full frame based on the effective frame information generated by the frame processing unit.

[0025] Further, the video composition device according to claim 7 is the video composition device according to claim 6, wherein the identification information includes, in addition to the sub-effective frame information, the total number of the plurality of sub-frames, the arrangement relationship of the plurality of sub-frames in the full frame, and a number corresponding to the position of the sub-frame within the full frame. The video receiving unit extracts the sub-effective frame information from the identification information corresponding to each of the plurality of sub-frames, and extracts the total number of the plurality of sub-frames, the arrangement relationship of the plurality of sub-frames, and the position of the sub-frame. Using the total number of the plurality of sub-frames, the arrangement relationship of the plurality of sub-frames, and the position of the sub-frame, the video splitting device generates splitting information when the full frame is split into the plurality of sub-frames. The frame processing unit generates the effective frame information based on the sub-effective frame information extracted by the video receiving unit and the splitting information generated by the video receiving unit.

[0026] Further, the video composition device according to claim 8 is the video composition device according to claim 6, wherein the sub-effective frame information is the number of pixels in the horizontal and vertical directions of the sub-effective frame, and the number of pixels in the horizontal and vertical directions between the center pixel of the sub-frame and the center pixel of the sub-effective frame.

[0027] Further, the video composition device according to claim 9 is the video composition device according to claim 6, wherein the sub-effective frame information is the coordinate information of the upper left pixel and the coordinate information of the lower right pixel in the sub-effective frame.

[0028] Furthermore, the video synthesis apparatus of claim 10 is characterized in that, in the video synthesis apparatus of claim 6, the video receiving unit extracts the sub-effective frame information from the identification information corresponding to each of the plurality of subframes if the identification information corresponding to the subframe includes the sub-effective frame information, and sets the sub-effective frame information indicating that the sub-effective frame matches the subframe if the identification information corresponding to the subframe does not include the sub-effective frame information, and the frame processing unit generates the effective frame information using the sub-effective frame information corresponding to each of the plurality of subframes extracted or set by the video receiving unit.

[0029] Furthermore, the program of claim 11 is characterized in that a computer constituting a video splitting device that splits and transmits a full frame of video is configured to function as a video transmission unit that: divides the full frame into a plurality of subframes; designates a predetermined area within the full frame as an effective frame and generates effective frame information indicating the position of the effective frame within the full frame; for each of the plurality of subframes divided by the subframe splitting unit, uses the effective frame information generated by the effective frame designating unit to designate an area within the subframe that overlaps with the effective frame as a sub-effective frame and generates sub-effective frame information indicating the position of the sub-effective frame within the subframe; and for each of the plurality of subframes divided by the subframe splitting unit, generates identification information for identifying the effective frame and the sub-effective frame, including the sub-effective frame information corresponding to the subframe generated by the sub-effective frame designating unit, and transmits a plurality of video signals corresponding to the plurality of subframes via a plurality of links, using the subframes and the corresponding identification information as video signals.

[0030] Furthermore, the program of claim 12 is characterized in that a computer constituting a video synthesis device receives a plurality of video signals from a video splitting device, each of which contains a plurality of subframes from which a full frame has been divided and a plurality of corresponding identification pieces of information, synthesizes the plurality of subframes into the full frame, and outputs a predetermined area within the full frame as video of an effective frame specified by the video splitting device, and the computer is configured to function as a video receiving unit that receives the plurality of video signals via a plurality of links, and for each of the plurality of subframes included in the plurality of video signals, extracts sub-effective frame information indicating the position of the sub-effective frame within the subframe from the identification piece of information corresponding to the subframe, with the area where the subframe and the effective frame overlap being a sub-effective frame; a frame processing unit that generates effective frame information indicating the position of the effective frame within the full frame using the sub-effective frame information corresponding to each of the plurality of subframes extracted by the video receiving unit; and a subframe synthesis unit that synthesizes the plurality of subframes included in the plurality of video signals received by the video receiving unit into the full frame, and extracts video of the effective frame from the full frame based on the effective frame information generated by the frame processing unit. [Effects of the Invention]

[0031] As described above, according to the present invention, it is possible to transmit video signals with any aspect ratio and number of pixels. [Brief explanation of the drawing]

[0032] [Figure 1] This figure shows a specific example illustrating the outline of the present invention. [Figure 2] This figure shows an example of identification information I. [Figure 3] This figure shows an example of the configuration of a video splitting device according to an embodiment of the present invention. [Figure 4] This flowchart shows an example of processing by a video splitting device according to an embodiment of the present invention. [Figure 5]This figure shows an example configuration of an image synthesis device according to an embodiment of the present invention. [Figure 6] This flowchart shows an example of processing by an image synthesis apparatus according to an embodiment of the present invention. [Figure 7] This diagram illustrates the full frame (FF), subframe (SF), effective frame (EF), and sub-effective frame (SEF). [Modes for carrying out the invention]

[0033] The embodiments for carrying out the present invention will be described in detail below with reference to the drawings. [Definition of Terms] First, before describing the outline and embodiments of the present invention, we will define the terms used in these descriptions. A video signal refers to video data transmitted through an interface connecting studio equipment. The number of pixels refers to the number of pixels per frame in the video signal. For example, if the horizontal resolution is 3,840 pixels and the vertical resolution is 2,160 pixels, the number of pixels is written as 3,840 × 2,160.

[0034] The aspect ratio indicates the ratio between the number of pixels in the horizontal direction and the number of pixels in the vertical direction of an image. Here, the horizontal-to-vertical ratio is denoted as horizontal:vertical. The video format indicates the combination of video parameters such as the number of pixels and frame rate that define the video signal. SDI indicates an interface used for transmission between studio equipment.

[0035] A full frame refers to video data consisting of all pixels contained in one frame. For example, if the number of pixels in a video signal is 3,840 × 2,160, the full frame is 3,840 × 2,160 video data consisting of all these pixels. An effective frame refers to a region within the full frame that is specified by additional information (effective frame information described later), i.e., a predetermined region within the full frame. This predetermined region within the full frame includes not only a portion of the full frame but also a region that coincides with the full frame. In the latter case, the effective frame will coincide with the full frame.

[0036] 2K refers to video data with a resolution of 1,920 x 1,080 pixels, 4K refers to video data with a resolution of 3,840 x 2,160 pixels, and 8K refers to video data with a resolution of 7,680 x 4,320 pixels.

[0037] A subframe represents video data that has been divided into multiple video segments from a full frame. A sub-effective frame represents a region within a subframe that is specified by additional information (sub-effective frame information described later), i.e., a predetermined region within the subframe. This predetermined region within a subframe includes not only a portion of the subframe but also a region that coincides with the subframe. In the latter case, the sub-effective frame will coincide with the subframe.

[0038] Broadcast services refer to video services transmitted via terrestrial digital broadcasting and satellite broadcasting, including 4K and 8K. Communication services refer to video services transmitted via communication channels such as simultaneous retransmission over the internet, on-demand distribution, and retransmission via social media.

[0039] [Summary of the Invention] Next, the outline of the invention will be described. The video splitting device of the present invention is characterized in that, when dividing a full-frame video into a plurality of subframes and distributing the plurality of subframes to the signals of a plurality of corresponding links for transmission, it generates additional information for identifying the valid frames within the full frame that have been set in advance, and transmits the additional information together with the plurality of subframes.

[0040] Furthermore, the video synthesis apparatus of the present invention is characterized by receiving signals from multiple links, each containing a plurality of subframes and additional information for identifying valid frames within a full frame; synthesizing a full-frame video from the plurality of subframes; and extracting valid frames from the full-frame video based on the additional information.

[0041] Next, the outline of the invention will be explained with specific examples. Figure 1 is a diagram illustrating a specific example for explaining the outline of the present invention. Note that this example does not represent the present invention itself. Figure 1(1) shows the flow of a video signal when transmitting an effective frame EF with a resolution of 2560 x 1080 pixels, an aspect ratio of 2.4:1, a frame frequency of 30Hz progressive, and YCbCr 10 bits using two 2K-sized containers (subframes SF). Hereafter, for the sake of convenience in explanation, the term "container" may be used, but "container" and "subframe SF" are synonymous.

[0042] The container arrangement uses a square division method, which arranges the area in a tile-like pattern. A 4K camera is assumed as the video signal source. The 4K camera's output interface is 3G-SDI (level B-DS).

[0043] For further details on 3G-SDI (level B-DS), please refer to the following document. [Non-Patent Literature 3] SMPTE Standard ST425-1, “Source Image Format and Ancillary Data Mapping for the 3 Gb / s Serial Interface,” 2014.

[0044] The 4K camera corresponds to the video splitting device 1 described later, and the display device corresponds to the video compositing device 2 described later.

[0045] When a 4K camera captures full-frame (FF) video, it specifies the target 2560 x 1080 effective frame area (EF) for the video to be transmitted (the video to be displayed on the display device) according to user input, and acquires the effective frame area (EF) using a portion of the 4K image sensor's area.

[0046] As shown in Figure 1(2), a predetermined area within the full frame FF, known as the effective frame EF (the area enclosed by the inner solid line in Figure 1(2)), is specified.

[0047] The 4K camera assigns the left half of the effective frame EF to container number 1 and the right half to container number 2. In this case, as shown in Figure 1(3), the number of pixels in the sub-effective frame SEF-1 in the assigned container is 1280×1080. The same applies to sub-effective frame SEF-2. The number of pixels in the container, i.e., the number of pixels in subframes SF-1 and SF-2, is 1920×1080.

[0048] The 4K camera divides the region containing the effective frame EF within the full frame FF (the region where the two dotted lines in Figure 1(2) are joined) into two subframes SF-1 and SF-2 (the left and right regions enclosed by dotted lines in Figure 1(2)), and generates predetermined additional information, namely identification information I-1 and I-2. Details of identification information I-1 and I-2 will be described later.

[0049] Note that the example in Figure 1 does not show the entire area of ​​the full-frame FF being divided into two subframes SF-1 and SF-2. This is because the divided subframes SF-1 and SF-2 are shown for convenience in order to explain the outline of the invention. In reality, as shown in Figure 3, which will be described later, the entire area of ​​the full-frame FF will be divided into multiple subframes SF.

[0050] The 4K camera multiplexes identification information I-1 onto subframe SF-1 (1920 x 1080 pixels and 30Hz frame rate) and uses this as data stream 1. The 4K camera also multiplexes identification information I-2 onto subframe SF-2 (1920 x 1080 pixels and 30Hz frame rate) and uses this as data stream 2.

[0051] The 4K camera assigns the multiplexed data streams 1 and 2 to two HD-SDI signals and outputs them to the display device as a 3G-SDI (level B-DS) signal (1920 x 1080 pixels and 60Hz frame rate) composed of these two streams.

[0052] The display device receives 3G-SDI (level B-DS) signals of data streams 1 and 2, which are multiplexed signals. It separates the two subframes SF-1 and SF-2 and the two identification information signals I-1 and I-2. It then combines the two subframes SF-1 and SF-2, and based on the identification information signals I-1 and I-2, it extracts the effective frame EF (2560 x 1080 pixels and 30Hz frame frequency), which is formed by combining the sub-effective frames SEF-1 and SEF-2, from the combined image and displays it on the screen.

[0053] Furthermore, subframes SF-1 and SF-2 include images other than the effective frame EF (shaded areas in Figures 1(2) and (3)) from the images captured by the 4K image sensor (the combined area of ​​the two dotted lines in Figure 1(2)).

[0054] Since this shaded area is not treated in subsequent processing, the image of that area can be output as is, or it can be filled with a specific pattern such as a black image, to make it easier for the user to understand the effective frame EF within subframes SF-1 and SF-2. Furthermore, subframes SF-1 and SF-2 each have a resolution of 1920 x 1080 pixels, a frame frequency of 30Hz progressive, and can be transmitted at a bitrate of 1.5Gbps. Therefore, the output of the 4K camera can be output as a Dual-Link HD-SDI signal from two interfaces.

[0055] For more information on Dual-Link HD-SDI, please refer to the following documents. [Non-Patent Literature 4] SMPTE Standard ST372, “Dual Link 1.5 Gb / s Digital Interface for 1920 × 1080 and 2048 × 1080 Picture Formats,” 2017.

[0056] Figure 1(1) shows an example where the output is a 3G-SDI (level B-DS) signal consisting of two streams of HD-SDI signals, each equipped with a 2K-sized subframe SF-1 and SF-2, in order to simplify cable routing.

[0057] Next, we will explain Identification Information I-1 and I-2 (collectively referred to as "Identification Information I"). Figure 2 shows an example of Identification Information I. Identification Information I is generated and multiplexed for each subframe SF (each container, each data stream). In the example in Figure 1(1), Identification Information I-1 is generated for data stream 1 of container number 1 to which subframe SF-1 is transmitted, and Identification Information I-2 is generated for data stream 2 of container number 2 to which subframe SF-2 is transmitted, and these are then multiplexed.

[0058] Identification information I consists of parameters ID1 to ID7, which are ID numbers 1 to 7 (ID No. 1 to 7). Each parameter ID1 to ID5 is set based on the division information C when a full-frame FF is divided into multiple subframes SF. ID6 and ID7 are set based on the division information C and the position of the valid frame EF within the full-frame FF. Details of division information C will be described later.

[0059] The ID1 parameter indicates the total number of containers (subframes SF). In the example in Figure 1(1), the total number of containers is 2, and both container numbers 1 and 2 have ID1=2.

[0060] The ID2 parameter indicates the array (row and column) relationships formed by all containers (subframes SF). In the example in Figure 1(1), all containers form an array with one row vertically and two columns horizontally, so ID2=(1(array row),2(array column)) is set for both container numbers 1 and 2.

[0061] The ID3 parameter indicates the identification number (Container No.) of each container (subframe SF). In other words, it indicates the identification number corresponding to the position of each subframe SF within the full-frame FF. In the example in Figure 1(1), ID3=1 is set for container number 1 and ID3=2 for container number 2.

[0062] For example, consider a case where the array relationship of containers is ID2 = (m (row of array), n (column of array)) (m and n are integers greater than or equal to 2). In this case, the identification number of each container is set by first assigning ID3=1 to the container number in the top left of the array, counting to the right, and then assigning the value obtained by counting from left to right in the row below to assign the value obtained by counting to the right in the same row until the count for n columns is complete.

[0063] The ID4 parameter indicates the pixel mapping structure (division method) of the video transmitted by all containers (subframes SF), and either two-sample interleave (SI) or square division (SQD) is selected. In the example in Figure 1(1), both container numbers 1 and 2 are set to ID4 = square division.

[0064] The ID5 parameter indicates the number of pixels to be used as a container (subframe SF) (Total container size, number of pixels in the horizontal direction and number of pixels in the vertical direction). In other words, it indicates the number of pixels in the subframe SF. In the example in Figure 1(1), both container numbers 1 and 2 are set to ID5=(1920 (number of horizontal pixels in the container), 1080 (number of vertical pixels in the container)).

[0065] The ID6 and ID7 parameters indicate the position of the active frame EF within the container (subframe SF). In other words, they indicate the position of the sub-active frame SEF within the subframe SF. Specifically, the ID6 parameter indicates the number of pixels in the sub-active frame SEF within the container (active area size, number of pixels in the horizontal direction, and number of pixels in the vertical direction). In the example in Figure 1(1), both container numbers 1 and 2 are set to ID6 = (1280 (number of horizontal pixels in the sub-active frame SEF), 1080 (number of vertical pixels in the sub-active frame SEF)).

[0066] The ID7 parameter indicates the offset (offset, horizontal pixel count, and vertical pixel count) of the sub-effective frame SEF relative to the container (subframe SF). In other words, it indicates the offset of the sub-effective frame SEF relative to the subframe SF. In the example in Figure 1(1), ID7 for container number 1 is set to (320 (horizontal pixel count, which is the offset of sub-effective frame SEF-1 relative to subframe SF-1), 0 (vertical pixel count, which is the offset of sub-effective frame SEF-1 relative to subframe SF-1)). Also, ID7 for container number 2 is set to (-320, 0).

[0067] Furthermore, various formats are possible for determining the position of the sub-effective frame SEF within the subframe SF, as indicated by IDs 6 and 7. In the example shown in Figure 2, following the format described in the standard ST2016-2 of Non-Patent Literature 1 mentioned above, ID 6 sets the number of pixels in the horizontal and vertical directions, and ID 7 sets the number of pixels in the sub-effective frame SEF relative to the subframe SF when offset horizontally and vertically from the center of the subframe SF.

[0068] [Video splitting device] Next, a video splitting device according to an embodiment of the present invention will be described. Figure 3 is a diagram showing an example of the configuration of a video splitting device according to an embodiment of the present invention, and Figure 4 is a flowchart showing an example of its processing.

[0069] This video splitting device 1 includes a subframe splitting unit 10, an effective frame designation unit 11, a sub-effective frame designation unit 12, and a video transmission unit 13.

[0070] The subframe division unit 10 receives the input video, which is the full-frame FF (step S401). The subframe division unit 10 then divides the full-frame FF into N subframes SF-1, ..., SF-N (collectively referred to as "subframe SF") according to a predetermined division rule, and generates division information C for each subframe SF that defines the relationship between the full-frame FF and the subframe SF (step S402). That is, the subframe division unit 10 generates ID1, ..., ID5 as division information C, as shown in Figure 2. Division information C is a collective term for division information C-1, ..., CN, which corresponds to each of the subframes SF-1, ..., SF-N.

[0071] In this case, the subframe division unit 10 performs a division process so that the video transmission unit 13, described later, assigns each of the N subframes SF-1,...,SF-N to each of the N SDI links. In other words, the N subframes SF-1,...,SF-N generated by the division process correspond to the N SDI links and are transmitted via the interface along with the identification information I-1,...,IN, described later.

[0072] As shown in Figure 2, the division information C for each subframe SF consists of ID1, the total number of subframes SF (N), ID2, the arrangement relationship formed by all subframes SF, ID3, an identification number corresponding to the position of the subframe SF (1,...,N in this example), ID4, the pixel mapping structure (division method) of the video transmitted by all subframes SF (square division in this example), and ID5, the number of pixels in the subframe SF.

[0073] This generates division information C-1,...,CN for each of the subframes SF-1,...,SF-N, which defines the relationship between the full frame FF and the sub-effective frames SEF-1,...,SEF-N.

[0074] The subframe division unit 10 outputs video data for subframes SF-1, ..., SF-N to the video transmission unit 13, and outputs division information C-1, ..., CN (ID1, ..., ID5 for each subframe SF) to the subframe valid frame designation unit 12.

[0075] Figure 7 illustrates the full-frame FF, subframe SF, effective frame EF, and sub-effective frame SEF. Referring to the lower part of the subframe division section 10 shown in Figures 7(1) and 3, the full-frame FF is composed of subframes SF-1, ..., SF-N numbered from 1 to N. The subframe division section 10 divides the full-frame FF into N subframes SF-1, ..., SF-N.

[0076] Returning to Figures 3 and 4, the user input specifies the position of the valid frame EF within the full-frame FF. The valid frame designation unit 11 then designates the valid frame EF within the full-frame FF according to the user input and generates valid frame information A to identify the valid frame EF within the full-frame FF (step S403). The valid frame designation unit 11 outputs the valid frame information A to the sub-valid frame designation unit 12.

[0077] Referring to the lower portion of the effective frame designation section 11 shown in Figures 7(2) and 3, the effective frame EF is a predetermined region within the full frame FF and is designated by user operation.

[0078] Returning to Figures 3 and 4, the effective frame information A identifies the position of the effective frame EF within the full-frame FF. For example, effective frame information A consists of the number of pixels in the horizontal and vertical directions of the effective frame EF, and the number of pixels in the horizontal and vertical directions indicating the offset of the effective frame EF relative to the full-frame FF (the number of pixels in the horizontal and vertical directions between the center pixel of the full-frame FF and the center pixel of the effective frame EF).

[0079] Furthermore, the effective frame information A may consist of the coordinate information of the top-left pixel and the coordinate information of the bottom-right pixel in the effective frame EF.

[0080] The sub-effective frame designation unit 12 receives division information C-1,...,CN from the sub-frame division unit 10, and effective frame information A from the effective frame designation unit 11.

[0081] The sub-effective frame designation unit 12, for each subframe SF, designates the region overlapping with the effective frame EF within that subframe SF as the sub-effective frame SEF based on the division information C and the effective frame information A, and generates sub-effective frame information B to identify the sub-effective frame SEF within that subframe SF (step S404). That is, the sub-effective frame designation unit 12 generates ID6 and ID7 as the sub-effective frame information B shown in Figure 2. The sub-effective frame information B is a collective term for the sub-effective frame information B-1,...,BN corresponding to the sub-effective frames SEF-1,...,SEF-N within subframes SF-1,...,SF-N, respectively.

[0082] As shown in Figure 2, the sub-effective frame information B for each subframe SF consists of the number of pixels in the sub-effective frame SEF as ID6 and the offset of the sub-effective frame SEF relative to the subframe SF as ID7.

[0083] This generates sub-effective frame information B-1,...,BN for each of the subframes SF-1,...,SF-N, which identifies the corresponding sub-effective frames SEF-1,...,SEF-N.

[0084] The sub-effective frame designation unit 12 outputs division information C-1,...,CN (ID1,...,ID5 for each subframe SF) and sub-effective frame information B-1,...,BN (ID6,ID7 for each subframe SF) to the video transmission unit 13.

[0085] Referring to the lower right portion of the sub-effective frame designation section 12 shown in Figures 7(3) and 3, the sub-effective frames SEF-1,...,SEF-N are predetermined regions within subframes SF-1,...,SF-N.

[0086] Returning to Figures 3 and 4, the sub-effective frame information B identifies the location of the sub-effective frame SEF within the sub-frame SF.

[0087] Furthermore, the sub-effective frame information B may consist of the coordinate information of the top-left pixel and the coordinate information of the bottom-right pixel in the sub-effective frame SEF.

[0088] The video transmission unit 13 receives video data for subframes SF-1, ..., SF-N from the subframe division unit 10. The video transmission unit 13 also receives division information C-1, ..., CN (ID1, ..., ID5 for each subframe SF) and sub-effective frame information B-1, ..., BN (ID6, ID7 for each subframe SF) from the sub-effective frame designation unit 12.

[0089] The video transmission unit 13 generates identification information I consisting of ID1, ..., ID7 for each subframe SF using the corresponding division information C and sub-effective frame information B (step S405).

[0090] This generates corresponding identification information I-1, ..., IN for each of the subframes SF-1, ..., SF-N.

[0091] The video transmission unit 13 multiplexes each subframe SF and its corresponding identification information I to generate a multiplexed signal (step S406).

[0092] The video transmission unit 13 assigns each of the subframes SF-1, ..., SF-N (their multiplexed signals) to each of the N links (N SDI signals) in the SDI. The video transmission unit 13 then transmits the multiplexed signals for each subframe SF as video signals to the video synthesis device 2, which will be described later, via each link (multilink) of the SDI, which is the physical interface (step S407).

[0093] As a result, subframes SF-1,...,SF-N and identification information I-1,...,IN are transmitted as SDI multilink video signals.

[0094] As described above, according to the video splitting device 1 of the embodiment of the present invention, the subframe splitting unit 10 receives a full-frame FF video and splits it into N subframes SF, and generates splitting information C(ID1,...,ID5).

[0095] The valid frame designation unit 11 designates a valid frame EF according to user operation and generates valid frame information A to identify the valid frame EF within the full frame FF. The sub-valid frame designation unit 12 designates a sub-valid frame SEF for each subframe SF based on the division information C and the valid frame information A, and generates sub-valid frame information B (ID6, ID7) to identify the sub-valid frame SEF within the subframe SF.

[0096] The video transmission unit 13 generates identification information I consisting of ID1, ..., ID7 for each subframe SF using division information C and sub-effective frame information B, multiplexes the subframe SF and identification information I, and transmits the video signal for each subframe SF via each SDI link.

[0097] As a result, the video synthesis device 2, described later, can receive the video signal for each subframe SF, separate the N subframes SF and N identification information I, reconstruct the sub-effective frame information B and effective frame information A, synthesize the full frame FF, and extract the effective frame EF from the full frame FF. This effective frame EF is specified as an image with an arbitrary aspect ratio and number of pixels by the effective frame specification unit 11 of the video splitting device 1.

[0098] Therefore, video signals with any aspect ratio and pixel count can be transmitted from the video splitting device 1 to the video compositing device 2. In other words, it becomes possible to transmit video with a non-16:9 aspect ratio and pixel counts other than 2K, 4K, and 8K between studio equipment.

[0099] [Image compositing device] Next, an image synthesis apparatus according to an embodiment of the present invention will be described. Figure 5 is a diagram showing an example of the configuration of an image synthesis apparatus according to an embodiment of the present invention, and Figure 6 is a flowchart showing an example of its processing.

[0100] This video synthesis device 2 includes a video receiving unit 20, a sub-effective frame processing unit 21, an effective frame processing unit 22, and a sub-frame synthesis unit 23.

[0101] The video receiving unit 20 receives video signals (multiplexed signals) for each subframe SF from the aforementioned video splitting device 1 via each SDI link (step S601). The video receiving unit 20 then separates the subframe SF and its corresponding identification information I for each video signal (for each subframe SF) (step S602). As described above, the identification information I consists of ID1, ..., ID7.

[0102] This allows us to obtain subframes SF-1, ..., SF-N and their corresponding identification information I-1, ..., IN for each subframe SF.

[0103] The video receiving unit 20 extracts ID1,...,ID5 and ID6,ID7 from ID1,...,ID7, which constitute the identification information I, for each subframe SF. Then, for each subframe SF, the video receiving unit 20 sets ID1,...,ID5 into the division information C (step S603). This corresponds to the process in step S405 of Figure 4, where the video transmitting unit 13 of the video division device 1 generates the identification information I (ID1,...,ID7) using the division information C (ID1,...,ID5) and sub-effective frame information B (ID6,ID7).

[0104] The video receiving unit 20 sets the IDs 6 and 7 of each subframe SF to the sub-effective frame information B (step S604). This also corresponds to the process in step S404 of Figure 4.

[0105] This allows us to obtain sub-effective frame information B-1, ..., BN corresponding to each subframe SF-1, ..., SF-N.

[0106] The video receiving unit 20 outputs video data for subframes SF-1, ..., SF-N to the subframe synthesis unit 23. The video receiving unit 20 also outputs division information C-1, ..., CN (ID1, ..., ID5 for each subframe SF) and sub-effective frame information B-1, ..., BN (ID6, ID7 for each subframe SF) to the sub-effective frame processing unit 21.

[0107] The sub-effective frame processing unit 21 receives division information C-1,...,CN and sub-effective frame information B-1,...,BN from the video receiving unit 20. Then, the sub-effective frame processing unit 21 restores the effective frame information A based on the division information C and sub-effective frame information B for each subframe SF (step S605).

[0108] This corresponds to the process in step S403 of Figure 4 in which the effective frame designation unit 11 of the video splitting device 1 generates effective frame information A. As mentioned above, the division information C-1,···,CN, ID1,···,ID5, is information that defines the relationship between the full frame FF and each subframe SF when the full frame FF is divided into N subframes SF. In addition, the sub-effective frame information B-1,···,BN, ID6,ID7, is information for identifying the sub-effective frame SEF within the subframe SF.

[0109] Therefore, by using the sub-frame information C-1,...,CN and the sub-effective frame information B-1,...,BN for each sub-frame SF, the effective frame information A for identifying the effective frame EF within the full frame FF can be reconstructed by synthesizing the sub-effective frame SEF within sub-frames SF-1,...,SF-N.

[0110] The sub-effective frame processing unit 21 outputs effective frame information A to the effective frame processing unit 22, and also outputs division information C-1,...,CN to the sub-frame synthesis unit 23.

[0111] The valid frame processing unit 22 receives valid frame information A from the sub-valid frame processing unit 21 and generates specification information for extracting valid frames EF from full frames FF based on the valid frame information A (step S606). The valid frame processing unit 22 then outputs the specification information to the sub-frame synthesis unit 23.

[0112] The subframe synthesis unit 23 receives video data for subframes SF-1, ..., SF-N from the video receiving unit 20, and also receives division information from the sub-effective frame processing unit 21. In addition, the subframe synthesis unit 23 receives specification information from the effective frame processing unit 22.

[0113] The subframe synthesis unit 23 synthesizes subframes SF-1, ..., SF-N into a full-frame FF based on the division information (step S607). This corresponds to the process in step S402 of Figure 4, where the full-frame FF is divided into subframes SF-1, ..., SF-N by the subframe division unit 10 of the video division device 1, and division information is generated.

[0114] The subframe synthesis unit 23 extracts the video of the effective frame EF, which is the output video, from the full frame FF based on the specified information, and outputs the video of the effective frame EF (step S608).

[0115] As a result, the effective frame EF specified by the effective frame specification unit 11 of the video splitting device 1 shown in Figure 3 is output from the video synthesis device 2.

[0116] As described above, according to the video synthesis apparatus 2 of the embodiment of the present invention, the video receiving unit 20 receives video signals for each subframe SF from the video splitting device 1 via each SDI link, separates N subframes SF and N identification information I, and sets splitting information C and sub-effective frame information B using the identification information I for each subframe SF.

[0117] The sub-effective frame processing unit 21 restores the effective frame information A based on the division information C and sub-effective frame information B for each subframe SF. The effective frame processing unit 22 generates specification information for the effective frame EF in the full frame FF based on the effective frame information A.

[0118] The subframe synthesis unit 23 synthesizes N subframes SF into a full frame FF, extracts the effective frame EF from the full frame FF based on specified information, and outputs the video of the effective frame EF.

[0119] This effective frame EF is designated by the effective frame designation unit 11 of the video splitting device 1 as an image with an arbitrary aspect ratio and number of pixels.

[0120] Therefore, video signals with any aspect ratio and pixel count can be transmitted from the video splitting device 1 to the video compositing device 2. In other words, it becomes possible to transmit video with a non-16:9 aspect ratio and pixel counts other than 2K, 4K, and 8K between studio equipment.

[0121] Although the present invention has been described above with reference to embodiments, the present invention is not limited to the above embodiments and can be modified in various ways without departing from the technical concept.

[0122] For example, in the embodiment described above, the video synthesis apparatus 2 shown in Figure 5 includes a sub-effective frame processing unit 21 and an effective frame processing unit 22, and the sub-frame synthesis unit 23 extracts effective frames EF from full frames FF based on specified information generated by the effective frame processing unit 22.

[0123] In contrast, the video synthesis device 2 may be equipped with a frame processing unit instead of the sub-effective frame processing unit 21 and the effective frame processing unit 22. Specifically, the frame processing unit, similar to the sub-effective frame processing unit 21, reconstructs the effective frame information A based on the division information C and sub-effective frame information B for each subframe SF. Then, the subframe synthesis unit 23 extracts the effective frame EF from the full frame FF based on the effective frame information A reconstructed by the frame processing unit.

[0124] Furthermore, in the above-described embodiment, the video transmission unit 13 of the video splitting device 1 shown in Figure 3 transmits a video signal in which the subframe SF and identification information I of ID1,...,ID7 are multiplexed, and the video receiving unit 20 of the video combining device 2 shown in Figure 5 receives this video signal. In contrast, the video splitting device 1 may omit the transmission of ID6 and ID7 for the sub-effective frame SEF if it matches the subframe SF. This reduces the amount of video signal transmitted from the video splitting device 1 to the video combining device 2.

[0125] Specifically, the video transmission unit 13 of the video splitting device 1 compares ID5 (number of pixels in subframe SF) and ID6 (number of pixels in sub-effective frame SEF) for the subframe SF. If ID5 and ID6 are not the same, the video transmission unit 13 determines that sub-effective frame SEF does not match subframe SF, and if ID5 and ID6 are the same, it determines that sub-effective frame SEF matches subframe SF.

[0126] Then, if the video transmission unit 13 determines that the sub-effective frame SEF does not match the subframe SF (i.e., determines that the sub-effective frame SEF is part of the subframe SF), it generates identification information I consisting of ID1,...,ID7 as described above, and transmits the subframe SF and the identification information I consisting of ID1,...,ID7 in multiplexed format.

[0127] On the other hand, if the video transmission unit 13 determines that the sub-effective frame SEF matches the subframe SF, it generates identification information I consisting of IDs 1, ..., and 5, and transmits the subframe SF and the identification information I consisting of IDs 1, ..., and 5 in multiplexed format. In this case, the video transmission unit 13 does not transmit IDs 6 and 7.

[0128] Here, the video transmission unit 13 may, if it determines that the sub-effective frame SEF matches the subframe SF, set blank (or null) ID6 and ID7, generate identification information I consisting of ID1,...,ID7, and transmit the subframe SF and the identification information I consisting of ID1,...,ID7 in multiplexed mode.

[0129] Meanwhile, the video receiving unit 20 of the video synthesis device 2 receives video signals for each subframe SF from the video splitting device 1 and separates subframes SF-1, ..., SF-N and their corresponding identification information I-1, ..., IN. The video receiving unit 20 then determines whether ID6 and ID7 are included in the identification information I for each subframe SF.

[0130] If the video receiving unit 20 determines that the identification information I contains ID6 and ID7, it performs the same processing as described above, such as extracting ID6 and ID7 and setting them in the sub-effective frame information B.

[0131] In response, if the video receiving unit 20 determines that ID6 and ID7 are not included in the identification information I, it determines that the sub-effective frame SEF matches the sub-frame SF, sets ID6 and ID7 for the sub-frame SF as sub-effective frame information B, and then performs the same processing as described above. In this case, sub-effective frame information B is also information indicating that the sub-effective frame SEF matches the sub-frame SF, with the same number of pixels in the sub-frame SF as ID5 set as ID6, and the number of pixels in the horizontal and vertical directions, which are offsets, set to 0 as ID7.

[0132] Here, if ID6 and ID7 are set to blank (or null), the video receiving unit 20 determines that ID6 and ID7 are not included in the identification information I and performs the same processing as described above.

[0133] Furthermore, although the interface between the video splitting device 1 and the video compositing device 2 was described as SDI in the above-described embodiment, the present invention is not limited to SDI, and other interfaces may be used.

[0134] The video transmission unit 13 of the video splitting device 1 shown in Figure 3 generates a multiplexed signal by multiplexing the subframe SF and its corresponding identification information I for each subframe SF, assigns each of the multiplexed signals of the subframes SF-1, ..., SF-N to each of the N links in the SDI, and transmits the multiplexed signal for each subframe SF as a video signal to the video synthesis device 2 via each link of the SDI.

[0135] In contrast, the video transmission unit 13 may, for example, assign a multiplexed signal to each of the N links for each subframe SF, store the multiplexed signal in an IP packet, and transmit multiple IP packets corresponding to multiple subframes SF-1, ..., SF-N to the video synthesis device 2 via each link. In this case, the video receiving unit 20 of the video synthesis device 2 receives multiple IP packets from the video splitting device 1 via each link, extracts the multiplexed signal from the IP packets, separates the subframe SF and its corresponding identification information I for each subframe SF using the same processing as described above, and extracts (sets) the splitting information C and the sub-effective frame information B using the same processing as described above.

[0136] Furthermore, the video splitting device 1 may transmit the subframe SF and identification information I separately without generating multiplexed signals. Specifically, the video transmission unit 13 of the video splitting device 1 assigns each subframe SF and its corresponding identification information to each of the N links, and transmits the subframe and its corresponding identification information as video signals to the video synthesis device 2 via the N links, with multiple video signals corresponding to multiple subframes.

[0137] The video receiving unit 20 of the video synthesis device 2 shown in Figure 5 receives multiple video signals corresponding to multiple subframes via N links, recognizes the subframe SF and its corresponding identification information I for each video signal (for each subframe SF), and extracts (sets) the division information C and the sub-effective frame information B using the same processing as described above.

[0138] Furthermore, a standard computer can be used as the hardware configuration for the video splitting device 1 and video synthesis device 2 according to the embodiments of the present invention. Each of the video splitting device 1 and video synthesis device 2 is composed of a computer equipped with a CPU, a volatile storage medium such as RAM, a non-volatile storage medium such as ROM, and an interface, etc.

[0139] The functions of the subframe division unit 10, the effective frame designation unit 11, the sub-effective frame designation unit 12, and the video transmission unit 13 provided in the video division device 1 are each realized by having the CPU execute a program that describes these functions.

[0140] Furthermore, the functions of the video receiving unit 20, sub-effective frame processing unit 21, effective frame processing unit 22, and sub-frame synthesis unit 23, all of which are provided in the video synthesis device 2, are realized by having the CPU execute programs that describe these functions.

[0141] These programs are stored in the aforementioned storage medium and are read and executed by the CPU. These programs can also be stored and distributed on storage media such as magnetic disks (floppy disks, hard disks, etc.), optical disks (CD-ROMs, DVDs, etc.), and semiconductor memory, and can be transmitted and received via a network. [Explanation of Symbols]

[0142] 1. Video splitting device 2. Image compositing device 10 Subframe division section 11. Effective frame designation section 12 Sub-effective frame designation section 13 Video transmission unit 20 Video receiving unit 21 Sub-effective frame processing unit 22 Effective frame processing unit 23 Subframe synthesis section FF Full Frame EF Effective Frame SF subframe SEF Sub-Effective Frames A Effective frame information B Sub-effective frame information C division information I. Identification Information

Claims

1. In a video splitting device that divides and transmits full-frame video, A subframe division unit that divides the full frame into multiple subframes, A valid frame designation unit designates a predetermined region within the full frame as a valid frame and generates valid frame information indicating the position of the valid frame within the full frame. A sub-effective frame designation unit, for each of the plurality of subframes divided by the subframe division unit, uses the effective frame information generated by the effective frame designation unit to designate the region of the subframe that overlaps with the effective frame as a sub-effective frame, and generates sub-effective frame information indicating the position of the sub-effective frame within the subframe; For each of the plurality of subframes divided by the subframe division unit, the unit generates identification information for identifying the effective frame and the subeffective frame, including the subeffective frame information corresponding to the subframe generated by the subeffective frame designation unit, and the subframe and the corresponding identification information are used as a video signal. A video transmission unit that transmits multiple video signals corresponding to the multiple subframes via multiple links, A video splitting device characterized by having the following features.

2. In the video splitting device according to claim 1, The video splitting device is characterized in that the identification information includes, in addition to the sub-effective frame information, the total number of the plurality of subframes, the arrangement relationship of the plurality of subframes in the full frame, and a number corresponding to the position of the subframe in the full frame.

3. In the video splitting device according to claim 1, The video splitting device is characterized in that the sub-effective frame information is the number of pixels in the horizontal and vertical directions of the sub-effective frame, and the number of pixels in the horizontal and vertical directions between the center pixel of the sub-frame and the center pixel of the sub-effective frame.

4. In the video splitting device according to claim 1, The video splitting device is characterized in that the sub-effective frame information is the coordinate information of the upper left pixel and the coordinate information of the lower right pixel in the sub-effective frame.

5. In the video splitting device according to claim 1, The aforementioned video transmission unit is For each of the plurality of subframes, if the sub-effective frame does not match the subframe, the identification information including the sub-effective frame information is generated. A video splitting device characterized in that, when the sub-effective frame matches the subframe, it generates identification information that does not include the sub-effective frame information, but includes the total number of the plurality of subframes, the arrangement relationship of the plurality of subframes in the full frame, and a number corresponding to the position of the subframe in the full frame.

6. A video combining device that receives multiple video signals from a video splitting device, each containing multiple subframes from which a full frame has been divided and multiple pieces of identification information corresponding thereto, combines the multiple subframes into the full frame, and outputs a predetermined region within the full frame as video of an effective frame specified by the video splitting device, A video receiving unit that receives the plurality of video signals via a plurality of links, and for each of the plurality of subframes included in the plurality of video signals, extracts sub-effective frame information indicating the position of the sub-effective frame within the subframe from the identification information corresponding to the subframe, where the region where the subframe and the effective frame overlap is considered a sub-effective frame. A frame processing unit generates effective frame information indicating the position of the effective frame within the full frame using the sub-effective frame information corresponding to each of the plurality of subframes extracted by the video receiving unit, A subframe synthesis unit synthesizes the plurality of subframes included in the plurality of video signals received by the video receiving unit into the full frame, and extracts the video of the effective frame from the full frame based on the effective frame information generated by the frame processing unit, A video synthesis device characterized by having the following features.

7. In the image synthesis apparatus according to claim 6, The identification information includes, in addition to the sub-effective frame information, the total number of the multiple subframes, the arrangement relationship of the multiple subframes in the full frame, and a number corresponding to the position of the subframe within the full frame. The aforementioned video receiving unit is For each of the plurality of subframes, the sub-effective frame information is extracted from the identification information corresponding to the subframe, and the total number of the plurality of subframes, the arrangement relationship of the plurality of subframes, and the position of the subframes are extracted. Using the total number of the plurality of subframes, the arrangement relationship of the plurality of subframes, and the position of the subframes, division information is generated when the full frame is divided into the plurality of subframes by the video division device. The frame processing unit, A video synthesis apparatus characterized by generating effective frame information based on the sub-effective frame information extracted by the video receiving unit and the division information generated by the video receiving unit.

8. In the image synthesis apparatus according to claim 6, The image synthesis apparatus is characterized in that the sub-effective frame information is the number of pixels in the horizontal and vertical directions of the sub-effective frame, and the number of pixels in the horizontal and vertical directions between the center pixel of the sub-frame and the center pixel of the sub-effective frame.

9. In the image synthesis apparatus according to claim 6, The image synthesis apparatus is characterized in that the sub-effective frame information is the coordinate information of the upper left pixel and the coordinate information of the lower right pixel in the sub-effective frame.

10. In the image synthesis apparatus according to claim 6, The aforementioned video receiving unit is For each of the aforementioned subframes, if the identification information corresponding to that subframe includes the sub-effective frame information, the sub-effective frame information is extracted from the identification information corresponding to that subframe. If the identification information corresponding to the subframe does not include the sub-effective frame information, the sub-effective frame information is set to indicate that the sub-effective frame matches the subframe. The frame processing unit, A video synthesis apparatus characterized by generating effective frame information using the sub-effective frame information corresponding to each of the plurality of subframes extracted or set by the video receiving unit.

11. A computer that constitutes a video splitting device that divides and transmits full-frame video is A subframe division unit that divides the full frame into multiple subframes, A valid frame designation unit that designates a predetermined region within the full frame as a valid frame and generates valid frame information indicating the position of the valid frame within the full frame. A sub-effective frame designation unit, which, for each of the plurality of subframes divided by the subframe division unit, uses the effective frame information generated by the effective frame designation unit to designate the region of the subframe that overlaps with the effective frame as a sub-effective frame, and generates sub-effective frame information indicating the position of the sub-effective frame within the subframe, and For each of the plurality of subframes divided by the subframe division unit, the unit generates identification information for identifying the effective frame and the subeffective frame, including the subeffective frame information corresponding to the subframe generated by the subeffective frame designation unit, and the subframe and the corresponding identification information are used as a video signal. A program for causing a video transmission unit to function as a unit that transmits multiple video signals corresponding to the multiple subframes via multiple links.

12. A computer comprising a video synthesis device that receives multiple video signals from a video splitting device, each containing multiple subframes from which a full frame has been divided and multiple corresponding identification information, synthesizes the multiple subframes into the full frame, and outputs a predetermined area within the full frame as video of an effective frame specified by the video splitting device, A video receiving unit that receives the plurality of video signals via a plurality of links, and for each of the plurality of subframes included in the plurality of video signals, the region in which the subframe and the effective frame overlap is designated as a sub-effective frame, and extracts sub-effective frame information indicating the position of the sub-effective frame within the subframe from the identification information corresponding to the subframe. A frame processing unit generates effective frame information indicating the position of the effective frame within the full frame using the sub-effective frame information corresponding to each of the plurality of subframes extracted by the video receiving unit, and A program for functioning as a subframe synthesis unit that synthesizes the plurality of subframes contained in the plurality of video signals received by the video receiving unit into the full frame, and extracts the video of the effective frame from the full frame based on the effective frame information generated by the frame processing unit.

Images