Signal Processing Device and Signal Processing Method

Abstract

The present invention prevents the addition of memory hardware on the serial digital signal transmitting or receiving side and reduces the burden on the CPU. A signal input unit is configured to input a transmission digital signal comprising a data packet containing a video signal and metadata associated with the video signal. A data write unit extracts predetermined metadata from the transmission digital signal based on metadata-specifying information and writes the metadata to an accumulation register. For example, the specified information includes header information of the data packet containing the predetermined metadata. For example, the header information includes classification information indicating the classification of the predetermined metadata and auxiliary information of the predetermined metadata.

Description

Technical Field

[0001] The present technology relates to a signal processing device and a signal processing method, and more particularly to a signal processing device and the like suitable for a video system and the like in a broadcasting station and the like. Background Art

[0002] In the related art, a system for transmitting a digital signal is known. The digital signal includes a video signal and metadata associated with the video signal. In one example, Patent Document 1 discloses a technology for transmitting a video signal and metadata associated with the video signal, wherein the metadata is embedded in an auxiliary area of a serial digital signal in an SDI format.

[0003] Considering the use of video signals for various applications, more types of metadata will be superimposed on the auxiliary area of the serial digital signal from now on. In this case, the auxiliary area of the serial digital signal will be filled with multiple types of metadata, resulting in a large amount of unnecessary or unknown metadata being transmitted to some receivers at a later stage.

[0004] Recently, a method has been frequently implemented to add specific metadata to locations with given line numbers to enable collaboration between senders and receivers. Adding metadata with different intended uses complicates the state of auxiliary areas. Therefore, the CPU (software) needs to acquire all metadata and extract the desired data from it to achieve proper reception.

[0005] Sending large amounts of metadata requires a large storage area, which increases memory hardware. Furthermore, constantly scanning the auxiliary area sent for each frame and identifying the data makes a large amount of processing unnecessary and inefficient. Furthermore, switchers and video routers with multi-channel inputs need to process large amounts of metadata simultaneously. This processing is performed solely by the CPU, placing a significant burden on the CPU.

[0006] Citation List

[0007] Patent Literature

[0008] Patent Document 1: Japanese Patent Application Laid-Open No. 2011-155701 Summary of the Invention

[0009] Problems to be solved by the present invention

[0010] The present technology aims to prevent or reduce the increase in memory hardware in a transmitter or receiver of a serial digital signal, thereby reducing the burden on a CPU.

[0011] Solution to the problem

[0012] The concept of this technology is

[0013] A signal processing device, comprising:

[0014] a signal input unit configured to receive as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; and

[0015] The data writing unit is configured to extract predetermined metadata from the digital signal for transmission based on the metadata designation information and write the extracted metadata into the accumulation register.

[0016] According to the present technology, a signal input unit receives as input a video signal and a digital signal for transmission, the digital signal for transmission including data packets containing metadata associated with the video signal. For example, the digital signal for transmission is a serial digital signal in SDI format, and the data packets may be embedded in an auxiliary area of the SDI serial digital signal. A data writing unit extracts predetermined metadata from the digital signal for transmission based on metadata designation information and writes the extracted metadata to an accumulation register.

[0017] For example, the metadata-specifying information may include header information of the data packet having the predetermined metadata. In this case, the header information may include classification information indicating a classification for the predetermined metadata. For example, the classification information may include first classification information indicating a classification for the predetermined metadata and second classification information indicating a subclassification of the classification of the first classification information for the predetermined metadata.

[0018] In addition, in this case, for example, the header information may further include auxiliary information of the predetermined metadata. For example, the auxiliary information may include information indicating that the predetermined metadata is historical data.

[0019] Furthermore, for example, the auxiliary information may include information indicating that the predetermined metadata is metadata requiring immediacy. In this case, for example, the data writing unit may write the predetermined metadata to a register area of the accumulation register for storing the predetermined metadata until it is read by the software and interrupt the software.

[0020] In addition, for example, the auxiliary information may include information indicating that the predetermined metadata is a single metadata item. In this case, for example, the data writing unit may write the predetermined metadata into a register area of the accumulation register, which is used to hold the predetermined metadata until it is read by software.

[0021] As described above, the present technology aims to extract predetermined metadata from an input digital signal for transmission based on metadata designation information and write it to an accumulation register. Therefore, even when the digital signal for transmission includes additional metadata, it is possible to prevent or reduce the increase in memory hardware and reduce the burden on the CPU that reads and processes the metadata from the accumulation register.

[0022] Note that in the present technology, for example, the signal processing device may further include an information adding unit configured to, when outputting the input digital signal for transmission, add auxiliary information to the data packet when metadata included in the data packet included in the input digital signal for transmission is historical data, the auxiliary information indicating that the metadata included in the data packet is historical data. This configuration makes it possible to immediately convert the historical data included in the input digital signal for transmission into historical data without requiring software processing intervention and without losing any frames.

[0023] In the present technology, for example, the signal processing apparatus may further include: a header information extraction unit configured to extract header information of the data packet included in the input digital signal for transmission; and a register configured to store the extracted header information. This configuration enables checking a list of metadata items included in the input digital signal for transmission.

[0024] In addition, the concept of this technology is to

[0025] A signal processing device, comprising:

[0026] a signal input unit configured to receive as input a digital signal for transmission including a video signal; and

[0027] a signal output unit configured to superimpose and output a data packet, which is newly superimposed and has metadata associated with the video signal, on a designated line of the input digital signal for transmission,

[0028] The signal output unit includes

[0029] an end detection unit configured to detect the end of the last data packet previously superimposed on a designated line of the digital signal input for transmission, and

[0030] The data superimposing unit is configured to superimpose the data packet to be newly superimposed after the end of the last data packet previously superimposed on a designated line of the digital signal input for transmission, based on the detection of the end.

[0031] In this technology, a signal input unit receives a digital signal for transmission, including a video signal, as input. The signal output unit then superimposes a data packet on a specified line of the input digital signal for transmission and outputs the data packet, which has been newly superimposed and includes metadata associated with the video signal. For example, the digital signal for transmission is a serial digital signal in SDI format, and the data packet can be embedded in an auxiliary area of this SDI serial digital signal.

[0032] In this case, the end detection unit detects the end of the last data packet that has been superimposed on the designated line of the digital signal for transmission being input. Then, the data superimposing unit superimposes a newly superimposed data packet after the end of the last data packet previously superimposed on the designated line of the digital signal for transmission being input based on the detection of the end.

[0033] For example, the end detection unit may determine the end of a specific data packet as the end of the last data packet when the end of the specific data packet is detected and a predetermined number of periods have passed without detecting the next data packet. This configuration allows the end of the last data packet to be correctly detected even when the next data packet is not superimposed after the previous data packet.

[0034] Furthermore, for example, the signal processing device may further include a register configured to retain information regarding a data packet to be newly superimposed. If the data packet to be newly superimposed includes information indicating that metadata included in the data packet requires immediacy, the signal output unit may, in a frame following a frame in which the data packet to be newly superimposed is superimposed, change the information indicating that the metadata to be superimposed requires immediacy to information indicating that the metadata to be superimposed does not require immediacy, while continuing to superimpose the data packet to be newly superimposed, or continue to superimpose the data packet to be newly superimposed without changing the information. This configuration enables appropriate transmission of metadata with immediacy or immediacy.

[0035] Furthermore, for example, the signal processing device further includes a register configured to retain information regarding the data packet to be newly superimposed. If the data packet to be newly superimposed may include information indicating that the metadata included in the data packet is a single metadata item, the signal output unit may stop superimposition in a frame following a frame in which the data packet to be newly superimposed is superimposed, or may continue superimposition by changing the information indicating that the metadata is a single metadata item to information indicating that the metadata is not a single metadata item. This configuration enables the appropriate transmission of a single metadata item.

[0036] As described above, the present technology provides an automatic superimposition position control function that detects the end of the last data packet superimposed on a specified line of a digital signal input for transmission and superimposes a new data packet after the end of the data packet. Thus, using software, a new data packet can be automatically superimposed at the correct position on the line to be superimposed by specifying information related to the data packet and line to be superimposed. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 is a block diagram illustrating a configuration example of a video system according to the embodiment.

[0038] Figure 2 is a diagram illustrating an example of the SDI format structure of “HD-SDI / 3G-SDI Level-B” and “3G-SDI Level-A / 12G-SDI”.

[0039] Figure 3 is a block diagram illustrating a detailed configuration example of a camera device and a CCU.

[0040] Figure 4 is a diagram illustrating a configuration example of a data packet embedded in an auxiliary area (auxiliary packet) of an SDI signal.

[0041] Figure 5 is a diagram illustrating examples of the contents of various types of flag information (LPM flag) of the 9th word.

[0042] Figure 6 is a diagram illustrating an operation in a case where a “single” flag is set as auxiliary information of metadata.

[0043] Figure 7 is a diagram illustrating an operation in a case where an “immediacy” flag is set as auxiliary information of metadata.

[0044] Figure 8 is a diagram illustrated to describe an outline of the configuration of the SDI signal input unit.

[0045] Figure 9 is a block diagram illustrating a configuration example of an input unit (input terminal).

[0046] Figure 10 : is a diagram illustrating an example of the contents of information written into the ID register, information written into the treatment ID register, and condition flag information.

[0047] Figure 11 : is a diagram illustrating an example of the contents of information and status flag information written to one register area of a group register.

[0048] Figure 12is a block diagram illustrating a configuration example of an output unit (output terminal).

[0049] Figure 13 : is a diagram illustrating an example of the content of information written into one register area of a group register and order flag information.

[0050] Figure 14 is a block diagram illustrating another configuration example of the output unit (output terminal).

[0051] Figure 15 is a diagram illustrating an example of information corresponding to one piece of metadata written to a packet register and an example of the contents of checksum / status information. DETAILED DESCRIPTION

[0052] A mode for carrying out the present technology (hereinafter referred to as an "embodiment") will now be described.

[0053] 1. Example

[0054] 2. Modification

[0055] <1. Example>

[0056] [Configuration example of video system]

[0057] Figure 1 The figure shows an example configuration of a video system 10 according to an embodiment. The video system 10 includes a plurality of camera devices, a plurality of camera control units (CCUs) 103-1 to 103-3, and a video tape recorder 104. The three camera devices 101-1 to 101-3 shown in the figure are connected to the CCUs 103-1 to 103-3 via cables 102-1 to 102-3, respectively.

[0058] In addition, the video system 10 includes a switcher 105, a server 106, monitors 107 and 108, a converter 109, and a plurality of waveform monitors (WFMs). This example illustrates three waveform monitors 110-1 to 110-3.

[0059] The CCU 103 (103-1 to 103-3) generates and outputs a digital signal for transmission, which includes a video signal supplied from the camera device 101 (101-1 to 101-3) via the cable 102 (102-1 to 102-3). The CCU 103 incorporates metadata associated with the video signal into the digital signal for transmission. In the present embodiment, the digital signal for transmission is a serial digital signal in a serial digital interface (SDI) format (hereinafter appropriately referred to as an "SDI signal"). The SDI signal has an auxiliary area in which a data packet with metadata is embedded. Moreover, in the illustrated example, "embe" indicates that the metadata is embedded in the auxiliary area of the SDI signal.

[0060] Examples of metadata embedded in the auxiliary area of the SDI signal in the CCU 103 include lens information, live use metadata, and the like. Live use metadata herein is metadata used in a series of workflows for live video production. More specifically, live use metadata is metadata used to control various equipment or execute applications, and is used for purposes that require real-time acquisition, inspection, and reflection of data in addition to recording and transmitting data such as video. Live use metadata includes camera setting data that puts together camera drawing settings, etc., data that puts together settings that determine the relationship between a high dynamic range (HDR) signal and a standard dynamic range (SDR) signal, data that puts together settings required for down-conversion of a video signal, data that puts together various types of environmental data related to the camera, data that puts together various types of identification information added to the video signal, and the like.

[0061] "Example of SDI format structure"

[0062] Figure 2 (a) illustrates an example of an SDI format structure of "HD-SDI / 3G-SDI Level-B" (hereinafter appropriately referred to as "Level-B SDI format structure"). Figure 2 (b) illustrates an example of an SDI format structure of “3G-SDI Level-A / 12G-SDI” (hereinafter appropriately referred to as “Level-A SDI format structure”).

[0063] exist Figure 2 In the example Level-B SDI format structure shown in (a), lines 9 to 20 and lines 571 to 583 are the vertical auxiliary (VANC) area. Lens metadata (as shown in the figure) is superimposed on lines 9, 571, and 572. Material transmission ancillary data defined in ARIB TR-B22 is superimposed on lines 11 and 574.

[0064] Digital closed caption data defined in ARIB STD-B37 is superimposed on lines 19 and 582. Inter-broadcasting station control signals defined in ARIB STD-B39 and data broadcast trigger signals defined in ARIB STD-B35 are superimposed on lines 20 and 583.

[0065] In addition, in the Level-B SDI format structure example, various types of live-use metadata are superimposed on lines 14, 15, and 16. In this format, "camera drawing metadata" indicates camera setting data that puts together the drawing settings of the camera, etc. "HDR SDR relationship metadata" indicates data that puts together the settings that determine the mutual relationship between the high dynamic range (HDR) signal and the standard dynamic range (SDR) signal. "Down-conversion setting metadata" indicates data that puts together the settings required for down-conversion of the video signal. "Camera trace metadata" indicates data that puts together various types of environmental data related to the camera. "ID group metadata" indicates data that puts together various types of identification information added to the video signal.

[0066] Furthermore, the rows on which the live usage metadata is superimposed are not limited to rows 14, 15, and 16, and may be superimposed on other rows. Furthermore, not all types of live usage metadata to be superimposed are shown in the figure, and some types of live usage metadata may not be shown. Furthermore, it is also possible to superimpose other types of live usage metadata.

[0067] exist Figure 2 In the example of the Level-A SDI format structure shown in (b), lines 9 to 41 are the VANC area. Lens metadata (as shown in the figure) is superimposed on line 9. Material transmission auxiliary data defined in ARIB TR-B22 is superimposed on line 11. Furthermore, material transmission auxiliary data can also be superimposed on lines 32 or 40, as shown in the figure.

[0068] On line 19, digital closed caption data defined in ARIB STD-B37 is superimposed. On line 20, an inter-broadcasting station control signal defined in ARIB STD-B39 and a data broadcast trigger signal defined in ARIB STD-B35 are superimposed. Furthermore, for example, an inter-broadcasting station control signal or a data broadcast trigger signal may be superimposed on line 41, as shown in the figure.

[0069] In addition, in the Level-A SDI format structure example, similar to the Level-B SDI format structure example, various types of live use metadata are superimposed on the 14th, 15th, and 16th lines (see Figure 2 (a)).

[0070] "Detailed configuration example of camera device and CCU"

[0071] Figure 3 The diagram shows a detailed configuration example of the camera device 101 and the CCU 103. The camera device 101 is connected to the CCU 103 via a cable 102. The camera device 101 is connected to a lens device 111. The lens device 111 is attached to a lens mounting portion on the front of the camera device 101.

[0072] The camera device 101 includes a camera CPU 112, a sensor unit 113, a camera signal processing unit 114, a pick-me switch (Pick Me SW, shown in the figure) 115, and a USB terminal 116. In addition, the CCU 103 includes a CPU 131, a video processing unit 132, a video formatter 133, and a USB terminal 134.

[0073] The camera CPU 112 controls the operation of each component in the camera device 101. The camera CPU 112 transmits necessary signals to the CPU 131 of the CCU 103. In one example, the camera CPU 112 manages information such as the model name, serial number, and camera number of the camera device 101 and transmits this information to the CPU 131 of the CCU 103 via the communication line of the cable 102.

[0074] In addition, for example, the camera CPU 112 acquires information such as the photographer's name and camera position from a USB memory (not shown) attached to the USB terminal 116, and transmits such information to the CPU 131 of the CCU 103 via the communication line of the cable 102. Furthermore, for example, the camera CPU 112 detects that the photographer has pressed the pick-me switch (Pick Me SW) 115 when framing a shot, and transmits a detection signal to the CPU 131 of the CCU 103 via the communication line of the cable 102.

[0075] The sensor unit 113 includes an image sensor with a resolution of HD, 4K, 8K, or the like, and outputs an image capture video signal corresponding to the subject being captured. The lens device 111 forms an image of the subject on the image capture surface of the image sensor. The camera signal processing unit 114 performs processing such as gain control, white balance, and gamma correction on the image capture video signal output from the sensor unit 113. The camera signal processing unit 114 outputs and transmits the camera video signal as an output of the camera device 101 to the video processing unit 132 of the CCU 103 via the video line of the cable 102.

[0076] The CPU 131 controls the operation of each component in the CCU 103. The CPU 131 transmits necessary signals to the camera CPU 112 of the camera device 101. The video processing unit 132 subjects the camera video signal transmitted from the camera device 101 to processing such as color correction through the video line of the cable 102, and outputs the processed video signal.

[0077] The video formatter 133 generates and outputs a digital signal for transmission, which includes the video signal output from the video processing unit 132. The digital signal for transmission is a serial digital signal (SDI signal) in the SDI format herein.

[0078] The CPU 131 manages information such as the model name, serial number, and system name of the CCU 103. Based on this managed information and information transmitted from the camera device 101, the CPU 131 generates "ID group metadata" metadata, which combines various types of identification information to be added to the video signal as metadata associated with the video signal output from the video processing unit 132, as described above. The video formatter 133 embeds the "ID group metadata" metadata into the auxiliary area of the SDI signal. Furthermore, although a detailed description is omitted, the video formatter 133 embeds other necessary metadata, such as lens information and live-use metadata, into the auxiliary area of the SDI signal.

[0079] "Configuration Example of Data Group (Auxiliary Group)"

[0080] Figure 4 The diagram shows an example configuration of a data packet embedded in the auxiliary area (auxiliary packet) of an SDI signal. This data packet includes words 1 through N+1. Words 1 through 3 indicate the start of the packet and are auxiliary data flags (ADFs). Word 4 is the packet's data ID (DID). Word 5 is the packet's secondary data ID (SDID). Word 6 is the data count (Data Count, as shown in the diagram), indicating the number of words N in the payload. Words 7 and 8 are numbering information (live production metadata; LPM Number, as shown in the diagram), indicating the data type of the live-use metadata. Word 9 is flag information for various types (LPM Flag, as shown in the diagram). Words 10 through N are main data words (Main Data, as shown in the diagram), including metadata. Word N+1 is the check sum (Check Sum, as shown in the diagram).

[0081] In this data packet, the header includes the auxiliary data flag (ADF), data ID (DID), secondary data ID (SDID), and data count. The payload includes number information (LPM Number), various types of flag information (LPM Flag), and the main data word (Main Data Word). In this data packet, the maximum value of N is 255, that is, the maximum number of words in the payload is 255.

[0082] In this data packet, each word includes 10 bits from bit 0 to bit 9. The auxiliary data flag (ADF) indicates a three-word value of "0003FF 3FF h". In this data packet, the 8th bit of each word in the 4th to Nth words is an even parity of bits 0 to 7 of each word. In addition, in this data packet, the 9th bit of the 4th to N+1th words is the inverse of bit 8, that is, "not bit 8".

[0083] If the data ID (DID) and the secondary data ID (SDID) indicate a type of live metadata, the payload includes number information (LPM Number) and various types of flag information (LPM Flag). In this case, if the data ID (DID) and the secondary data ID (SDID) indicate a type of live metadata, values such as "53 01h," "53 02h," and "53 03h" are displayed.

[0084] Also, if the data ID (DID) and the secondary data ID (SDID) do not indicate the classification of live usage metadata, the payload includes only the main data word (Main Data Word).

[0085] The number information (LPM Number) indicates a subcategory of the data ID (DID) and secondary data ID (SDID) categories of live metadata. Using this number information allows the live metadata to be handled as table data. The upper 8 bits of the LPM number (2 bytes) are referred to as "Live Meta U," and the lower 8 bits are referred to as "Live Meta D."

[0086] In one example, if the live-use metadata is camera setting data that lists camera rendering settings, etc., the number information (LPM Number) indicates "01 00h." Furthermore, if the live-use metadata is data that lists settings for determining the relationship between a high dynamic range (HDR) signal and a standard dynamic range (SDR) signal, for example, the number information (LPM Number) is "02 00h."

[0087] Furthermore, for example, if the live-use metadata is data that lists settings required for down-conversion of a video signal, the number information (LPM Number) indicates "03 00h." Furthermore, for example, if the live-use metadata is data that lists various types of environmental data related to a camera, the number information (LPM Number) indicates "04 00h." Furthermore, for example, if the live-use metadata is data that lists various types of identification information added to a video signal, the number information (LPM Number) indicates "10 01 / 10 02 / 10 03 / 10 04h."

[0088] Figure 5 The figure shows an example of the contents of various types of flag information (LPM Flag) in the 9th word. Various types of flag information (LPM Flag) constitute auxiliary information of the metadata. In this flag, the 7th bit is the "history" flag, which indicates that the metadata is historical data. In one example, a value of "0" indicates that the metadata is not historical data, that is, it is the latest data available, and a value of "1" indicates that the metadata is historical data.

[0089] In the event that the data content of the metadata changes, and if the original metadata still exists or is intended to be retained as historical data after the latest metadata is copied, the "historical" flag is set, i.e., the value is set to "1", even if it no longer has value as metadata for live use.

[0090] In one example, when a pick-me signal (a signal from a cameraman telling a director that a significant scene is being captured) is copied with a video signal as metadata for live use, this signal is meaningful for real-time use, but once recorded and played back, the pick-me operation becomes relatively meaningless. However, associating it with the reproduced video signal allows it to be used as information indicating the possibility of adding a significant scene. In other words, it is meaningful to use it as historical data indicating that a pick-me operation has been performed, so the metadata to be superimposed on the reproduced video signal is set as a "historical" flag for identification.

[0091] The sixth bit is the "immediacy" flag, which indicates that the metadata requires immediacy (urgency). In one example, a value of "0" indicates that the metadata does not require immediacy, while a value of "1" indicates that the metadata requires immediacy. If the metadata is important and requires immediacy, this "immediacy" flag is set, that is, the value is set to "1."

[0092] The "immediate" flag requires (expects) immediate metadata processing at the next stage, but does not guarantee that the processing will be performed immediately at the next stage. In other words, the processing at the next stage (receiver) is determined based on the situation at the next stage, so the previous stage (sender) cannot make the decision.

[0093] In the aforementioned pick-me operation, etc., the pick-me operation is often a decisive moment and often requires immediacy, so an "immediacy" flag is set. Furthermore, as described later, the receiver circuit configuration enables hardware detection of this "immediacy" flag information and interrupts the CPU, etc.

[0094] Bit 5 is a "single" flag indicating that the metadata is a single metadata item. In one example, a value of "0" indicates that the metadata is not a single metadata item, while a value of "1" indicates that the metadata is a single metadata item.

[0095] Normally, metadata is replicated per frame, but if a single metadata item is transmitted, it can be easily lost in relay or at the next stage. To avoid this, if the metadata indicates that it is important and unique (valuable), the "single" flag is set, i.e., the value is set to "1".

[0096] In addition, even in the case of continuous transmission of metadata per frame, if there is a change in the data content and the data content at the time of the change is unintentionally lost in the next stage, the "single" flag is set and it can be handled as a single metadata item.

[0097] This "single" flag requires (expects) determinism in metadata retrieval processing from the next level, but it does not guarantee that data loss will not occur at the next level. In other words, the processing of the next level (receiver) is determined by the situation at the next level, so it is impossible to perform determinism in the previous level (sender).

[0098] Bits 1 and 0 are flags indicating the size information of the metadata (table data). This size information is used to classify the size of the metadata into large (L), medium (M), and small (S). In one example, a value of "00" indicates large (L), i.e., a maximum of 252 bytes (maximum 252 bytes). A value of "01" indicates medium (M), i.e., a maximum of 119 bytes (maximum 119 bytes). A value of "10" indicates small (S), i.e., a maximum of 55 bytes (maximum 55 bytes).

[0099] The size information is intended to have the potential to reduce the memory area required by the receiver. When the maximum number of bytes in the payload of a data packet (auxiliary packet) is 255 bytes and it is necessary to process a large amount of metadata, a memory area of (255 + α) bytes is generally required for each metadata. However, adding size information to the metadata (table data) allows the receiver to allocate a small memory area when handling small-sized metadata, which makes it possible to reduce the total memory area prepared by the receiver. In this case, similar to the receiver, the total memory area prepared by the transmitter can also be reduced.

[0100] Reference again Figure 1 The video tape recorder 104 outputs an SDI signal including a video signal during playback. This SDI signal also includes metadata associated with the video signal included in the SDI signal, similar to the SDI signals output from the above-mentioned CCUs 103-1 to 103-3.

[0101] The switcher 105 receives as input an SDI signal output from the CCUs 103-1 to 103-3 or the video tape recorder 104. The switcher 105 outputs SDI signals for displaying images to the monitors 107 and 108, outputs SDI signals for on-air broadcasting, and outputs predetermined SDI signals to the waveform monitors 110-1 to 110-3.

[0102] In addition, the switch 105 outputs a predetermined SDI signal to the converter 109. The SDI signal input to the converter 109 undergoes conversion processing and is then fed back to the input terminal of the switch 105. The converter 109 extracts metadata from the auxiliary area of the SDI signal during input and embeds the metadata into the auxiliary area of the SDI signal during output. In the example shown, "get" indicates that metadata is extracted from the auxiliary area of the SDI signal, and "embe" indicates that metadata is embedded into the auxiliary area of the SDI signal.

[0103] In addition, the switcher 105 outputs a predetermined SDI signal to the server 106. In addition, the SDI signal played back by the server 106 is input to the switcher 105. The server 106 extracts metadata from the auxiliary area of the SDI signal when input, and embeds the metadata in the auxiliary area of the SDI signal when output. In the example shown, "get" indicates that metadata is extracted from the auxiliary area of the SDI signal, and "embe" indicates that metadata is embedded in the auxiliary area of the SDI signal.

[0104] The switcher 105 includes a CPU 151, a router 152, and a video processor 153, all implemented as software. The CPU 151 controls the operation of each component in the switcher 105. SDI signals input to the switcher 105 from the CCUs 103-1 to 103-3 or the video tape recorder 104 are input to the router 152. In addition, SDI signals input to the switcher 105 from the converter 109 or the server 106 are input to the router.

[0105] In addition, a predetermined SDI signal output from the router 152 is input to the video processor 153, and an SDI signal processed by the video processor 153 is input to the router 152. An identification information group is embedded in the auxiliary area of the SDI signal output from the video processor 153 in this manner. Moreover, in the example shown, "embe" indicates that metadata is embedded in the auxiliary area of the SDI signal.

[0106] Metadata is extracted from the auxiliary area of each SDI signal input to the router 152 and held in a register, and then read by the CPU 151. The CPU 151 discriminates the output destination of each SDI signal input to the router 152 based on the metadata serving as identification information of the SDI signal, and controls the router 152 based on the discriminant result. This configuration allows each output unit of the router 152 to output an appropriate SDI signal.

[0107] In this case, for example, the CPU 151 identifies the output destination of each SDI signal based on an association table between identification information and output destinations preset by user operation, and controls the router 152. In one example, this example illustrates an association table in which the output units P1, P2, and P3 of the router 152 for supplying SDI signals to the video processor 153 are associated with the identification information of "VTR 1," "CAMERA 1," and "CAMERA 2," respectively. Thus, the CPU 151 controls the routing of the router 152 in such a manner that the SDI signal from the video tape recorder 104, the SDI signal from the CCU 103-2, and the SDI signal from the CCU 103-4 are output to the output units P1, P2, and P3 of the router 152, respectively.

[0108] In addition, for example, although the description of the association table is omitted, the CPU 151 controls the router 152 in the following manner: based on the identification information of the camera number, the SDI signal from the CCU 103-1, the SDI signal from the CCU 103-2, and the SDI signal from the CCU 103-3 are output to the corresponding output units of the router 152 to which the waveform monitors 110-1, 110-2, and 110-3 are connected.

[0109] In addition, for example, although the description of the association table is omitted, the CPU 151 controls the router 152 in such a manner that the SDI signal having the pick-me identification information is transmitted to the output unit of the router 152 connected to the monitor 108. This configuration allows the monitor 108 to display an image captured by the camera device 101 when the photographer presses the pick-me switch (Pick Me SW) 115.

[0110] In addition, the CPU 151 can control the router 152 in such a manner that the SDI signal with the pick-me identification information is sent to the output unit of the router 152 connected to a storage device (not shown). This configuration allows the storage device to record the captured image of the camera device 101 when the camera operator presses the pick-me switch (Pick Me SW) 115.

[0111] In addition, for example, although the description of the association table is omitted, the CPU 151 controls the router 152 in such a manner that, based on the identification information indicating the character name (e.g., output unit (P1, P2, P3)), the SDI signal obtained by the video processor 153 is output to the output unit of the router 152 connected to the monitor 107. This configuration allows the monitor 107 to display a processed image based on the SDI signal obtained by the video processor 153, that is, a picture-in-picture image in the illustrated example.

[0112] In addition, for example, although the description of the association table is omitted, the CPU 151 controls the router 152 in such a manner that the SDI signal obtained by the video processor 153 is output to the output unit of the router 152 that should output the SDI signal for broadcast. This configuration allows the SDI signal obtained by the video processor 153 to be output as an SDI signal for broadcast.

[0113] In the switcher 105, an input unit (input terminal, shown in the figure) 161 implemented by hardware extracts metadata from the auxiliary area of the SDI signal input to the router 152. In addition, an output unit (output terminal, shown in the figure) 162 implemented by hardware hardware embeds metadata in the auxiliary area of the SDI signal output from the router 152. The detailed configurations of the input unit (input terminal) 161 and the output unit (output terminal) 162 will be described later.

[0114] refer to Figure 6The operation of the switch 105 will be briefly described when the "Single" flag is set as auxiliary information for metadata. The input unit (input terminal) 161 of each channel extracts the metadata transmitted for each frame and stores it in a register. The CPU 151 reads the metadata stored in the register of each input unit (input terminal) 161. The register area implemented by hardware in each input unit (input terminal) 161 has a limited capacity and is therefore generally refreshed for each frame and overwritten by the metadata of the next frame.

[0115] In a multi-channel input device such as the switch 105, when it is difficult for the CPU 151 to obtain all metadata of each frame, in some cases, the CPU 151 sends the scan control signal S1 to the selector 171, and thus, the selector 171 sequentially sends the scan control signal to each input unit (input end) 161, and scans each input unit (input end) 161 by polling, so that the CPU 151 sequentially obtains metadata.

[0116] In addition, when metadata is sequentially read from each input unit (input terminal) 161 according to the timing of the CPU 151, if the readout interval of each input unit (input terminal) 161 is longer than the frame rate, it is impossible to completely acquire metadata for each frame. In this case, if the timing of acquiring metadata from the CPU 151 is not met while metadata is transmitted once, the metadata transmitted only once is overwritten by other metadata and lost.

[0117] Therefore, metadata that is not intended to be lost is sent with the "single" flag set. In this case, if the hardware of the input unit (input terminal) 161 has a "single" flag detection function and the "single" flag is set, the metadata is stored in an area of the register that is not automatically overwritten. This register area is reset by reading data from the CPU 151 and can be reused as an empty area of the register.

[0118] refer to Figure 7 The following briefly describes the operation of the switcher when the "immediacy" flag is set as auxiliary information for metadata. The input unit (input terminal) 161 of each channel extracts the metadata transmitted for each frame and stores it in a register. The CPU 151 reads the metadata stored in the register in each input unit (input terminal) 161. The register area implemented by hardware in each input unit (input terminal) 161 has a limited capacity and therefore generally has a structure in which it is refreshed for each frame and overwritten with the metadata of the next frame.

[0119] In a multi-channel input device such as the switch 105, if it is difficult for the CPU 151 to acquire all metadata for each frame, in some cases, the CPU 151 sends a scan control signal S1 to the selector 171. As a result, the selector 171 sequentially sends a scan control signal to each input unit (input terminal) 161, scanning each input unit (input terminal) 161 by polling, so that the CPU 151 sequentially acquires metadata. In this case, if time-critical metadata is transmitted, data acquisition may be delayed.

[0120] Therefore, the time-critical metadata is set with the "immediate" flag and transmitted. In this case, if the hardware of the input unit (input terminal) 161 is equipped with an "immediate" flag detection function and the "immediate" flag is set, the metadata is stored in an area of the register that is not automatically overwritten. In addition, in this case, the detection signal S3 of the "immediate" flag is sent to the interrupt circuit 172, and the interrupt signal S4 and the interrupt channel number S5 are sent from the interrupt circuit 172 to the CPU 151. This allows the CPU 151 to preferentially obtain the metadata of the interrupt channel.

[0121] "Configuration Example of Input Unit"

[0122] Figure 8 (a) illustrates an example of the outline of the configuration of an SDI signal input unit. The input SDI signal is supplied to the video processing circuit 182 via the metadata extraction unit 181. The metadata extraction unit 181 extracts all data packets (ancillary packets) from the VANC area of the SDI signal and writes the contents of the data packets (header information and metadata) to the metadata register 183. The CPU 184 then reads and processes the contents of the data packets written to the metadata register 183.

[0123] exist Figure 8 In the case of the configuration shown in (a), all data packets in the VANC area are extracted, and the contents of the data packets are written to the metadata register 183. Therefore, in the case where the number of data packets placed in the VANC area increases, the metadata register 183 requires a large capacity, and the processing load on the CPU 184 also increases.

[0124] Figure 8(b) illustrates another example of the configuration outline of the SDI signal input unit. The input SDI signal is supplied to the video processing circuit 192 via the metadata extraction unit 191. The CPU 193 sets metadata designation information (line information, header information) for specifying the desired metadata to the metadata designation unit 194. The metadata extraction unit 191 extracts the data packet (ancillary packet) specified using the designation information from the metadata designation unit 194 from the VANC area of the SDI signal and writes the contents of the data packet (header information and metadata) to the metadata register 195. The CPU 193 then reads and processes the contents of the data packet written to the metadata register 195.

[0125] exist Figure 8 In the case of the configuration shown in (b), not all data packets in the VANC area but data packets specified as needed by the CPU 193 are extracted, and the contents of the data packets are written to the metadata register 195. Therefore, even in the case where the number of data packets placed in the VANC area increases, the capacity of the metadata register 195 can be kept small, thereby reducing the processing burden of the CPU 193.

[0126] Figure 9 The input unit (input terminal) 161 is shown (see Figure 1 ) configuration example. This configuration example is based on Figure 8 (b) This configuration example is implemented by, for example, a programmable logic device (PLD).

[0127] The input unit (input end) 161 includes a VANC extraction unit 201, a delay unit 202, a controller 203, a cyclic redundancy check (CRC) unit 204, a header information extraction unit 205, an ID register 206 and a disposal ID register 208, a designation-determination unit 207, a historical object determination unit 209, and grouping registers 211, 212, and 213.

[0128] The VANC extraction unit 201 extracts the signal of the VANC area from the input SDI signal. The delay unit 202 delays the SDI signal output from the VANC extraction unit 201 (same as the input SDI signal) and inputs the delayed signal to the controller 203. In this case, the SDI signal is given a delay time for timing adjustment, which is required for metadata specification and determination, etc.

[0129] The header information extraction unit 205 detects all data packets (auxiliary packets) embedded in the VANC area from the signal in the VANC area extracted by the VANC extraction unit 201 (see Figure 4). The header information extraction unit 205 extracts the header information (DID, SDID, Data Count, LPM Number, LPM Flag) included in the data packet and writes them into the ID register 206.

[0130] In this embodiment, the ID register 206 has an area in which header information of 32 data packets can be written. In this case, header information of up to 32 data packets can be written into the ID register 206 per frame. Here, 6 (=3+3) bytes are prepared for the register area of header information of one data packet, and 6 (=3+3) bytes are written. Figure 10 The information shown in (a).

[0131] In other words, in the byte register area, 1-byte data ID (DID), 1-byte secondary data ID (SDID), 1-byte data count (Data Count), 2-byte number information (LPM Number), and 1-byte various types of flag information (LPM Flag) are written.

[0132] The CPU 151 is capable of reading and processing the header information of each data packet written to the ID register 206. This configuration allows the CPU 151 to check a list of which type of metadata is superimposed on which row in the VANC area. Although not shown, the CPU 151 allows the list to be displayed on the display unit to present the list to the user.

[0133] Reference again Figure 9 The handling ID register 207 is set with metadata designation information indicating which metadata to extract from various types of metadata superimposed on the VANC area. This setting is performed by the CPU 151.

[0134] In this embodiment, the disposal ID register 207 has an area in which eight pieces of metadata specifying information can be written. In this article, 8 (= 3 + 2 + 3) bytes are prepared for the register area for one piece of metadata specifying information, and the following is written: Figure 10 The information items shown in (b).

[0135] In other words, the 8-byte register area is an area for writing, including 1-byte condition flag (Condition Flag, as shown) information, 2-byte line number (Line-No., as shown), 1-byte data ID (DID), 1-byte secondary data ID (SDID), 2-byte numbering information (LPM Number), and 1-byte various types of flag information (LPM Flag).

[0136] Figure 10 (c) illustrates an example of the content of the Condition Flag information. Here, bit 6 is a flag indicating whether to process only the metadata specified by bits 5 and below or to exclude only the metadata specified by bits 5 and below. In one example, a value of "0" indicates processing, and a value of "1" indicates exclusion.

[0137] The 5th bit indicates whether the specified line number (Line-No.) is invalid or valid. In one example, a value of "0" indicates invalid, and "1" indicates valid. In the case of invalid, all lines are taken as objects. The 4th bit indicates whether the specified data ID (DID) and secondary data ID (SDID) are invalid or valid. In one example, a value of "0" indicates invalid, and "1" indicates valid. The 3rd bit indicates whether the specified number information (LPM Number) is invalid or valid. In one example, a value of "0" indicates invalid, and "1" indicates valid.

[0138] Bit 2 indicates whether the "history" flag is valid or invalid in the various types of flag information (LPM Flag). In one example, a value of "0" indicates invalid, while a value of "1" indicates valid. Bit 1 indicates whether the "immediacy" flag is valid or invalid in the various types of flag information (LPMFlag). In one example, a value of "0" indicates invalid, while a value of "1" indicates valid. Bit 0 indicates whether the "single" flag is valid or invalid in the various types of flag information (LPM Flag). In one example, a value of "0" indicates invalid, while a value of "1" indicates valid.

[0139] In addition, refer again Figure 9 , the designation determination unit 208 determines whether the metadata included in the data packet having the header information extracted by the header information extraction unit 205 satisfies the metadata designation information set in the disposal ID register 207 based on the header information sequentially extracted by the header information extraction unit 205 and the row information embedded in the data packet having the header information.

[0140] If the metadata satisfies the metadata designation information, designation determination unit 208 transmits a write control signal to controller 203, causing the header information and metadata included in the data packet to be written to the register. Furthermore, when transmitting the write control signal to controller 203, designation determination unit 208 also transmits to controller 203 the size information (L, M, and S information) of the metadata (table data), as indicated by bits 1 and 0 of the LPM Flag in the header information. Furthermore, if the "Immediate" flag (bit 6) of the LPM Flag is set, or the "Single" flag (bit 5) is set, information indicating this is also transmitted to controller 203.

[0141] As described above, the packet register (L) 211 is a register for writing metadata that satisfies metadata specification information and header information corresponding to the metadata. In this embodiment, the packet register 211 has eight register areas, enabling eight pieces of metadata to be written, and 261 bytes are reserved for each register area. In other words, the packet register 211 is used to write metadata when the size information of the metadata (table data) indicated by bits 1 and 0 of the LPM flag is Large (L) (i.e., a maximum of 252 bytes). The CPU 151 can read and process the metadata written to the packet register 211.

[0142] As described above, the packet register (M) 212 is also a register for writing metadata that satisfies metadata specification information and header information corresponding to the metadata. In this embodiment, the packet register 212 has six register areas, enabling eight pieces of metadata to be written, and 128 bytes are reserved for each register area. In other words, the packet register 212 is used to write metadata when the size information of the metadata (table data) indicated by bits 1 and 0 of the LPM flag is medium (M) (i.e., a maximum of 119 bytes). The CPU 151 can read and process the metadata written to the packet register 212.

[0143] As described above, the packet register (S) 213 is also a register for writing metadata that satisfies metadata specification information and header information corresponding to the metadata. In this embodiment, the packet register 213 has six register areas, enabling eight pieces of metadata to be written, and 64 bytes are reserved for each register area. In other words, the packet register 213 is used to write metadata when the size information of the metadata (table data) indicated by bits 1 and 0 of the LPM flag is small (S) (i.e., a maximum of 55 bytes (maximum 55 bytes)). The CPU 151 can read and process the metadata written to the packet register 213.

[0144] In each of the group registers 211, 212, and 213, a predetermined number of areas, for example, two register areas, are set as register areas where overwriting cannot be prohibited. User data with the "immediate" or "single" flag set is written to the register area where overwriting can be prohibited.

[0145] In this embodiment, if Figure 11The information items shown in (a) are written to one register area in each of the group registers 211, 212, and 213. In other words, 1-byte status flag (Status Flag, as shown) information, 2-byte line number (Line-No.), 1-byte data ID (DID), 1-byte secondary data ID (SDID), 1-byte data count (Data Count), 2-byte number information (LPM Number), 1-byte various type flag information (LPM Flag), and a predetermined number of bytes of main data (metadata) are written.

[0146] Figure 11 (b) illustrates an example of the contents of the Status Flag information. Bit 7 is a flag indicating the status of the "History" flag included in various types of flag information (LPM Flag). In one example, a value of "0" indicates that the "History" flag is not historical data, while a value of "1" indicates that the "History" flag is historical data.

[0147] The 6th bit is a flag indicating the status of the "immediacy" flag included in various types of flag information (LPM Flag). In one example, a value of "0" indicates that the "immediacy" flag is not metadata requiring immediacy, while a value of "1" indicates that the "immediacy" flag is metadata requiring immediacy.

[0148] The 5th bit is a flag indicating the state of the "single" flag included in the various types of flag information (LPM Flag). In one example, a value of "0" indicates that the "single" flag is not a single metadata item, and "1" indicates that the "single" flag is a single metadata item. The 4th bit is a checksum indicating the N+1th byte of the data packet (auxiliary packet) (see Figure 4 ) is a flag of whether the result is “OK” or “NG”. In one example, a value of “0” indicates “OK” and a value of “1” indicates “NG”.

[0149] Bit 0 indicates whether overwriting is permitted. In one example, a value of "0" indicates permission, while a value of "1" indicates disapproval. In one example, when metadata with the "immediate" or "single" flag set is written, bit 0 is set to "1" and overwriting is disapproved. However, when the CPU 151 subsequently reads the metadata, bit 0 is set to "0" and overwriting is permitted.

[0150] In addition, refer again Figure 9The controller 203 detects a data packet including metadata designated to be extracted from the SDI signal whose timing has been adjusted (delayed) by the delay unit 202, based on the write control signal transmitted from the designation-determination unit 208. The controller 203 extracts header information (DID, SDID, Data Count, LPMNumber, LPM Flag) included in the data packet and metadata.

[0151] Then, the controller 203 writes the extracted header information and metadata into any one of the grouping registers 211 to 213 according to the size information of the metadata (table data) sent from the designation-determination unit 208. In this case, if the size information is large (L), they are written into the grouping register 211. If the size information is medium (M), they are written into the grouping register 212. If the size information is small (S), they are written into the grouping register 213.

[0152] In addition, the controller 203 writes the metadata in which the "immediacy" or "single" flag is set and the header information associated with the metadata into a register area that can prohibit overwriting of the group registers 211 to 213 based on the information indicating that the "immediacy" or "single" flag is set sent from the designation-determination unit 208.

[0153] In this manner, metadata designated to be extracted is selectively extracted from the VANC area of the SDI signal based on the write control signal sent from the designation-determination unit 208, and written to the packet registers 211 to 213. This configuration makes it possible to reduce the capacity of the entire data packet register and also to reduce the processing load of the CPU 151.

[0154] Furthermore, as described above, metadata designation information to be extracted is set in the handling ID register 207. For metadata other than metadata for which the "immediate" or "single" flag is set, the same information is typically superimposed across multiple frames. Therefore, by repeating metadata extraction while changing the metadata designation information set in the handling ID register 207, it is possible to extract all metadata while keeping the overall packet register capacity small (i.e., using a small amount of hardware resources).

[0155] In addition, as described above, the LPM Flag includes metadata size information (bits 1 and 0), and the extracted header information and metadata are written to one of the packet registers 211 to 213 based on this size information. This configuration eliminates the need to set the register area of the entire packet register to 261 bytes, thereby preventing or reducing an increase in the capacity of the entire packet register. In other words, the amount of metadata that can be written and held in the packet register can be increased while preventing or reducing an increase in the capacity of the entire packet register.

[0156] In addition, in the case where the extracted header information or metadata is written into the register areas of the packet registers 211 to 213, the controller 203 adds status flag information or line number (Line-No.) to the extracted information and writes them (see Figure 11 (a)). Here, in the case where the "immediate" or "single" flag is set, the controller 203 sets the status flag information (see Figure 11 (b)) Bit 0 is set to "1" and overwriting on the register area is set to not be approved. Then, if the metadata is read by the CPU 151, bit 0 is set to "0" and overwriting on the register area is approved.

[0157] In the case where the “Immediate” or “Single” flag is set in this manner, if the extracted header information and metadata are written to the register areas of the packet registers 211 to 213, overwriting thereof is not permitted until the register areas are read by the CPU 151. Therefore, the CPU 151 can acquire metadata requesting immediacy (urgency) for which the “Immediate” flag is set, or acquire a single metadata item for which the “Single” flag is set, without omission.

[0158] Here, in the case where the "immediacy" flag is set, the controller 203 sends a detection signal S3 of the "immediacy" flag to the interrupt circuit 172 (see Figure 7 ). This configuration makes it possible to transmit the interrupt signal S4 and the interrupt channel number S5 from the interrupt circuit 172 to the CPU 151, thereby allowing the CPU 151 to preferentially acquire metadata of the interrupt channel.

[0159] Furthermore, when monitoring metadata by simply setting the "immediate" or "single" flag through software processing, it is necessary to monitor all metadata for all frames in real time. However, in the case of equipment with many input systems, it is difficult to continuously monitor all inputs in real time. However, as described above, in the controller 203, the extracted header information and metadata are written to the register areas of the packet registers 211 to 213, and they can be read by the software (CPU 151) at any optional timing (e.g., polling), making it easier to obtain without missing.

[0160] In addition, refer again Figure 9 The historization target determination unit 209 determines whether the metadata included in the data packet having the header information is a target of the historization target based on the header information (e.g., number information (LPM Number)) sequentially extracted by the header information extraction unit 205. Furthermore, the LPM number designated as the target of the historization target may be selected, for example, from only the upper 8 bits of "Live Meta U" or from both the upper 8 bits of "Live Meta U" and the lower 8 bits of "Live Meta D."

[0161] In one example, if the LPM number indicates metadata for live use, such as a pick-me signal, the metadata is determined to be a target for the historicization object. Furthermore, for example, if the number information indicates metadata indicating a video signal, the metadata indicates the source (e.g., camera, server) from which the video signal is output, the metadata is determined to be a target for the historicization object.

[0162] In the case where the historicization object determination unit 209 determines that the metadata is the target of the historicization object, the historicization object determination unit 209 sends a historicization object control signal to the controller 203, so that the 7th bit of the LPMFlag of the data group having the metadata is set to the "historical" flag, that is, the value is set to "1".

[0163] The controller 203 executes a historiographical object processing for the SDI signal whose timing has been adjusted (delayed) by the delay unit 202, based on the historiographical object control signal (which indicates that the metadata is historical data), by setting the "historical" flag at the 7th bit of the LPM Flag of the data packet having the metadata determined as the target of the historiographical object. This configuration makes it possible to change the metadata that is the target of the historiographical object superimposed on the VANC area of the SDI signal input into the historical data without performing software processing.

[0164] Furthermore, if such history construction is performed only by software processing, it is necessary to perform the following control for each frame to be completed within that frame.

[0165] 1. Observe the metadata superimposed on the SDI signal and check that the historicized object metadata is not included.

[0166] 2. If historicized object metadata is included, then check for superimposed rows or loops and prepare data grouping information that only has the "history" flag rewritten.

[0167] 3. Overwrite the prepared data packet information at the same position of the SDI signal as the data packet including the historization object metadata.

[0168] In the case of rigs with many input systems, it can be difficult to maintain real-time monitoring of all incoming SDI signals.

[0169] In this embodiment, as described above, the controller 203 can perform a historiographic object process on the SDI signal whose timing has been adjusted (delayed) by the delay unit 202. Furthermore, the controller 203 can perform a masking process on a specific row among the rows on which metadata is superimposed on the SDI signal. In this masking process, the row data is replaced with a fixed value. Furthermore, when performing the masking process, the CPU 151 turns this function on and specifies the row number.

[0170] The cyclic redundancy check (CRC) unit 204 performs a process of replacing the CRC with a recalculated CRC on the SDI signal subjected to the historization object process and the mask process by the controller 203 , thereby obtaining an SDI signal to be output.

[0171] "Configuration Example of Output Unit"

[0172] Figure 12 The output unit (output terminal) 162 is shown in FIG. Figure 1 This configuration example is implemented by, for example, a programmable logic device (PLD).

[0173] The output unit 162 includes a VANC extraction unit 301 , a delay unit 302 , a metadata superposition unit 303 , a cyclic redundancy check (CRC) unit 304 , an end detection unit 305 , a controller 306 , and group registers 307 , 308 , and 309 .

[0174] The VANC extraction unit 301 extracts a signal of a VANC area from an input SDI signal. The delay unit 302 delays the SDI signal output from the VANC extraction unit 301 (same as the input SDI signal) and inputs the delayed signal to the metadata superimposition unit 303. In this case, the SDI signal is delayed by a predetermined amount of time to match a data packet sent from the controller 306 to the metadata superimposition unit 303, which will be described later.

[0175] End detection section 305 extracts the superimposed data packets in each row of the VANC area extracted by VANC extraction section 301 and detects the end of the last data packet superimposed on that row. In a row where no data packets are superimposed, the head position of that row is considered to be the end of the last data packet superimposed on that row.

[0176] In this case, it is conceivable that the next data packet is not necessarily continuous at the end of a certain data packet, and the next data packet overlaps. Therefore, in the case where the end of a specific data packet is detected and the next data packet is not detected until a predetermined number of cycles (for example, 5 cycles) have passed, the end detection unit 302 deterministically determines the end of the specific data packet as the end of the data packet. In this context, whether the next data packet is detected depends on whether the 3-word auxiliary data flag (ADF) located at the beginning of the data packet is detected (see Figure 4 ). In this article, one cycle corresponds to one word (10 bits) period.

[0177] The end detection unit 305 transmits a metadata superimposition control signal at the final determination timing of the end detection on each line to the controller 306. In this case, the end detection unit 305 transmits the metadata superimposition control signal to which line number (Line-No.) information is attached.

[0178] The packet register (L) 307 is a register that holds information about the metadata packet to be newly superimposed (including header information and metadata). In this embodiment, the packet register 307 has four register areas to hold information for four metadata packets. In this case, 261 bytes are prepared for each register area.

[0179] When the size information of the metadata (table data) indicated by bits 1 and 0 of the LPM Flag is large (L) (i.e., up to 252 bytes (maximum 252 bytes)), the packet register 307 is used to hold information of a data packet with new metadata. The CPU 151 can access the packet register 307 to set information about the metadata packet to be newly superimposed in the packet register 307.

[0180] The packet register (M) 308 is also a register that holds information about the metadata packet to be newly superimposed (including header information and metadata). In this embodiment, the packet register 308 has four register areas to hold information for four metadata packets. In this case, 128 bytes are prepared for each register area.

[0181] When the size information of metadata (table data) indicated by bits 1 and 0 of the LPM Flag is medium (M), ie, up to 119 bytes (maximum 119 bytes), the packet register 308 is used to hold information of a data packet with new metadata.

[0182] The CPU 151 can access the packet register 308 to set information on the metadata packet to be newly superimposed in the packet register 308 .

[0183] The packet register (S) 309 is also a register that holds information about the metadata packet to be newly superimposed (including header information and metadata). In this embodiment, the packet register 309 has four register areas to hold information for four metadata packets. In this case, 64 bytes are prepared for each register area.

[0184] When the size information of metadata (table data) indicated by bits 1 and 0 of the LPM flag is small (S), ie, up to 55 bytes (maximum 55 bytes), the packet register 309 is used to hold information of data packets having new metadata.

[0185] The CPU 151 can access the packet register 309 to set information on the metadata packet to be newly superimposed in the packet register 309 .

[0186] In this embodiment, if Figure 13 The information items shown in (a) are written to one register area in each of the group registers 307, 308, and 309. Specifically, a 1-byte order flag (as shown), a 2-byte line number (Line-No.), a 1-byte data ID (DID), a 1-byte secondary data ID (SDID), a 2-byte numbering information (LPM Number), 1-byte various types of flag information (LPM Flag), and a predetermined number of bytes of main data (metadata) are written. Here, the line number (Line-No.) has, for example, a 12-bit representation.

[0187] Figure 13 (b) illustrates an example of the contents of the order flag information. Bit 7 is a flag indicating whether the function of masking the original data of a specific line (i.e., superimposing metadata) is enabled. In one example, a value of "0" indicates that this function is not enabled, while a value of "1" indicates that it is enabled. Although not described above, this masking function is performed in the VANC extraction unit 201.

[0188] Bit 6 indicates that the SDI signal has a Level-B SDI format structure (see Figure 2In the case of (a)), this flag indicates whether the function of automatically copying metadata is enabled even in even-numbered field lines of +563. In one example, a value of "0" indicates that this function is not enabled, while a value of "1" indicates that this function is enabled. When this function is enabled, the flag information in bit 7 described above also applies to even-numbered field lines of +563.

[0189] Bit 3 is a flag indicating an operation (immediate action) when the "immediate" flag is set (i.e., the value is set to "1"). In one example, a value of "0" instructs the hardware to set the "immediate" flag to "0" and start copying from the next time (next frame) after one copy. A value of "1" indicates that copying will continue as it is from the next time (next frame), that is, the "immediate" flag remains "1".

[0190] Bit 2 is a flag indicating an operation (single action) when the "single" flag is set (i.e., the value is set to "1"). In one example, a value of "0" instructs the hardware to stop copying from the next time (next frame) after one copy. A value of "1" instructs the hardware to set the "single" flag to "0" and start copying from the next time (next frame).

[0191] Bit 0 is a flag indicating whether the metadata has been copied. In one example, a value of "0" indicates that it has not been executed, while a value of "1" indicates that it has been executed before.

[0192] In addition, refer again Figure 12 , the controller 306 extracts information about the relevant data packet from the group registers 307 to 309 based on the metadata superimposition control signal and line number (Line-No.) information sent from the end detection unit 305, adds a 3-word auxiliary data flag (ADF) to the extracted information, and sends it as a data packet format to the metadata superimposition unit 303. In this case, if there are a plurality of pieces of data packet information corresponding to the group registers 307 to 309, the controller 306 sends the data packets to be superimposed to the metadata superimposition unit 303, for example, in ascending order of the size of the metadata.

[0193] In addition, in this manner, the controller 306 extracts information about the corresponding data packet from the packet registers 307 to 309. When the controller 306 transmits the data packet including the extracted information to the metadata superimposing unit 303, if the 0th bit of the order flag information added to the information about the data packet in the data packet registers 307 to 309 is "0", the controller 306 changes the bit value to "1". This configuration allows an indication that the metadata has been previously copied.

[0194] Here, if the "immediate action" flag is "1" in the information about the relevant data packet included in the packet registers 307 to 309, the controller 306 performs an operation based on the state of the "immediate action" flag at bit 3 of the order flag information. In other words, if the "immediate action" flag is "0," after copying one frame, the "immediate action" flag is set to "0" in the subsequent frame to generate a data packet to be superimposed, and this data packet is sent to the metadata superimposition unit 303. Furthermore, if the "immediate action" flag is "1," even in the subsequent frame after copying one frame, a data packet to be superimposed is generated with the "immediate action" flag set to "1," and the generated data packet is sent to the metadata superimposition unit 303.

[0195] Furthermore, if the "single" flag is "1" in the information regarding the relevant data packet included in the packet registers 307 to 309, the controller 306 performs an operation based on the state of the "single action" flag of bit 2 of the order flag information. Furthermore, if the "single action" flag is "0," after copying one frame, "generation of a data packet to be superimposed for transmission to the metadata superimposition unit 303" is not performed in subsequent frames. Furthermore, if the "single action" flag is "1," after copying one frame, the "single immediacy" flag is set to "0" in subsequent frames to generate a data packet to be superimposed and transmit it to the metadata superimposition unit 303.

[0196] The metadata superimposing unit 303 performs processing to superimpose the data packets sent from the controller 306 on each line corresponding to the VANC area of the SDI signal whose timing is adjusted (delayed) by the delay unit 302. In this case, the metadata superimposing unit 303 superimposes a new data packet after the end of the last data packet superimposed previously. Here, when superimposing multiple new data packets, the next data packet is superimposed sequentially after the end of the last data packet.

[0197] The cyclic redundancy check (CRC) unit 304 performs a process of replacing the CRC with the CRC after recalculation on the SDI signal subjected to the superimposition process by the metadata superimposition unit 303 , thereby obtaining an SDI signal to be output.

[0198] In the case where many data packets have been previously superimposed on the VANC area of the input SDI signal, adding a new data packet to a certain line requires the following control: detecting the end of the data packet previously superimposed on the line and starting to overwrite the new data packet to be superimposed from the detected end.

[0199] exist Figure 12In the output unit 162 shown in FIG, the end detection unit 305 implemented by hardware detects the end of the previously superimposed data packet of the relevant line in the VANC area. The controller 306 sends a new data packet to the metadata superimposition unit 303 implemented by hardware based on the detection timing. The new data packet is superimposed starting from the end of the previously superimposed data packet of the relevant line.

[0200] As mentioned above, Figure 12 The output unit 162 shown in FIG is provided with an automatic control function for the superimposition position. Therefore, using software, a new data packet can be automatically superimposed at the correct position of the row to be superimposed by simply specifying information about the data packet and row to be superimposed.

[0201] Furthermore, metadata for which the "Single" flag is set is required to be superimposed on only a single frame, but it is difficult to perform processing on a frame-by-frame basis using software. In other words, if metadata for which the "Single" flag is set is superimposed on a certain frame, it is difficult to stop superimposing the metadata in the next frame without exception using software control.

[0202] Figure 12 The output unit 162 shown in is provided with a frame-based automatic control function (metadata sending assist function) for metadata output by hardware, and metadata for which the "single" or "immediate" flag is set is appropriately sent out.

[0203] In other words, for a data packet including metadata with a "single" flag set, the controller 306 implemented by hardware copies the packet once, and then stops copying the packet the next time (next frame) or copies it by dropping the "single" flag. In addition, for a data packet including metadata with an "immediate" flag set, the controller 306 implemented by hardware copies it once, and then copies it by dropping the "immediate" flag or copies it with the "immediate" flag set.

[0204] "Another configuration example of input unit"

[0205] Figure 14 FIG. 1 shows another configuration example of the input unit (input terminal) 161. Figure 14 In, with Figure 9 Those corresponding parts in FIG. 1 are assigned the same reference numerals, and detailed descriptions thereof will be appropriately omitted.

[0206] The designation-determination unit 208 determines whether the metadata included in the data packet having the header information extracted by the header information extraction unit 205 satisfies the metadata designation information set in the handling ID register 207 based on the header information sequentially extracted by the header information extraction unit 205 and the row information in which the data packet having the header information is embedded.

[0207] If the metadata satisfies the metadata designation information, designation-determination unit 208 transmits a write control signal to controller 203, causing the header information and metadata included in the data packet to be written to the register. Furthermore, if designation-determination unit 208 transmits the write control signal to controller 203, then if the "immediate" flag at bit 6 of the LPM Flag is set or the "single" flag at bit 5 is set, designation-determination unit 208 also transmits information indicating this to controller 203.

[0208] The packet registers 221 and 222 are registers for writing metadata that satisfies metadata designation information and header information corresponding to the metadata, as described above. The CPU 151 can read and process the metadata written in the packet registers 221 and 222.

[0209] The packet register 222 is a register for writing metadata for which a "single" flag is set that needs to be held until it is read by the CPU 151. Metadata written in the packet register 222 is held unless a read and clear operation is performed.

[0210] In this article, read and clear operations are clear operations with read and check.

[0211] When checking the read flag, if the read flag is "1", the read is successful and the internal data is cleared. On the other hand, when checking the read flag, if the read flag is "0", the read is considered to have failed and the internal data is retained. If the next metadata is input, it is added to the end.

[0212] The group register 221 is a register for writing metadata in which the “single” flag is not set. The metadata written to the group register 221 is reset at the start timing of each frame, for example.

[0213] Figure 15 (a) illustrates an example of information corresponding to one piece of metadata written into the group registers 221 and 222. This information includes a 2-byte line number (Line-No.), a 1-byte data ID (DID), a 1-byte secondary data ID (SDID), a 1-byte data count (Data Count), 2-byte numbering information (LPM Number), 1-byte various types of flag information (LPMFlag), a predetermined number of bytes of main data (metadata), and 1-byte checksum / status information.

[0214] Figure 15(b) illustrates an example of the contents of the checksum / status information. Bit 7 indicates the checksum of the N+1th byte of the data packet (auxiliary packet) (see Figure 4 ) is a flag of whether the result is “OK” or “NG”. In one example, a value of “0” indicates “OK” and a value of “1” indicates “NG”.

[0215] The 6th bit is a flag that is set if unnecessary space is detected between metadata items superimposed on the same line, provided that metadata items superimposed on the same line are tightly packed. In one example, a value of "0" indicates that unnecessary space is not detected, while a value of "1" indicates that unnecessary space is detected.

[0216] Bit 5 is a flag that indicates that the next metadata has arrived before data of the required size is detected (stored), even though the size of the metadata can be known from the data count. In one example, a value of "0" indicates that the next metadata has not arrived before data of the required size is detected (stored), while a value of "1" indicates that the next metadata has arrived before data of the required size is detected (stored).

[0217] In addition, refer again Figure 14 The controller 203 detects a data packet including metadata designated to be extracted from the SDI signal whose timing is adjusted (delayed) by the delay unit 202 based on the write control signal transmitted from the designation-determination unit 208. The controller 203 extracts header information (DID, SDID, Data Count, LPM Number, LPM Flag) included in the data packet and metadata.

[0218] Then, the controller 203 writes the metadata for which the "single" flag is set or its related header information into the group register 222 based on the information indicating that the "single" flag is set sent from the designation-determination unit 208, and writes other metadata and its related header information into the group register 221.

[0219] Figure 14 The other configurations of the input unit (input terminal) 161 shown in FIG are similar to those of FIG. Figure 9 The configuration of the input unit (input terminal) 161 is shown in FIG, and thus a detailed description is omitted.

[0220] In such Figure 9 In the case where the group register to be held is switched according to the size of the metadata in the configuration of the input unit (input terminal) 161 shown in , if the ratio of the amount of metadata included in the VANC area of the input SDI signal for each size is significantly different from the ratio of the prepared group register for each size, then the data group register will be wasted.

[0221] exist Figure 14 In the configuration of the input unit (input terminal) 161 shown in FIG, the controller 203 writes metadata extracted from the VANC area of the SDI signal into the group registers 221 and 222 without determining their sizes, holding them by bundling them in a row. Thus, it is prevented that Figure 9 The waste occurs in the configuration of the input unit (input terminal) 161 shown in FIG. Figure 14 In the configuration of the input unit (input terminal) 161 shown in , the size of each metadata written in the group registers 221 and 222 is different, so it is difficult to acquire the individual metadata from the CPU 151, and data acquisition is performed by scanning the entire register area.

[0222] As mentioned above, in Figure 1 In the input unit (input terminal) 161 in the video system 10 shown in FIG, predetermined metadata is extracted from the VANC area of the input SDI signal based on the metadata designation information and written into the accumulation register (data packet register). Therefore, even if the metadata included in the VANC area of the input SDI signal increases, the increase in memory hardware can be prevented or reduced, thereby reducing the burden on the CPU 151 of reading and processing the metadata from the accumulation register.

[0223] in addition, Figure 1 The output unit 162 in the video system 10 shown in FIG. 1 is equipped with an automatic superimposition position control function. This function detects the end of the last data packet previously superimposed on a specified line in the VANC area of the input SDI signal and superimposes a new data packet after the end of the data packet. Therefore, the CPU (software) 151 can automatically superimpose a new data packet at the correct position on the line to be superimposed by simply specifying information about the data packet and line to be superimposed.

[0224] <2. Modification>

[0225] Furthermore, although not described above, the present technology can be similarly applied to a video system that transmits a video signal through IP packets.

[0226] In addition, the preferred embodiments of the present disclosure have been described above with reference to the accompanying drawings, but the present disclosure is not limited to the above examples. Those skilled in the art may find various changes and modifications within the scope of the appended claims, and it should be understood that they will naturally fall within the technical scope of the present disclosure.

[0227] In addition, the effects described in this specification are merely illustrative or exemplary and are not necessarily restrictive. That is, in addition to or in place of the above effects, the technology according to the present disclosure can achieve other effects that are clear to those skilled in the art based on the description of this specification.

[0228] Furthermore, the present technology can also be configured as follows.

[0229] (1) A signal processing device comprising:

[0230] a signal input unit configured to receive as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; and

[0231] The data writing unit is configured to extract predetermined metadata from the digital signal for transmission based on the metadata designation information and write the extracted metadata into the accumulation register.

[0232] (2) The signal processing device according to (1), wherein

[0233] The metadata designation information includes header information of the data packet having predetermined metadata.

[0234] (3) The signal processing device according to (2), wherein

[0235] The header information includes classification information indicating a classification for predetermined metadata.

[0236] (4) The signal processing device according to (3), wherein

[0237] The classification information includes first classification information and second classification information, the first classification information indicating a classification of predetermined metadata, and the second classification information indicating a sub-classification under the classification of the first classification information of the predetermined metadata.

[0238] (5) The signal processing device according to (3) or (4), wherein

[0239] The header information also includes auxiliary information of predetermined metadata.

[0240] (6) The signal processing device according to (5), wherein

[0241] The auxiliary information includes information indicating that the predetermined metadata is history data.

[0242] (7) The signal processing device according to (5), wherein

[0243] The auxiliary information includes information indicating that the predetermined metadata is metadata requiring immediacy.

[0244] (8) The signal processing device according to (7), wherein

[0245] The data writing unit writes predetermined metadata into a register area of the accumulation register, which holds the predetermined metadata until read by the software, and interrupts the software.

[0246] (9) The signal processing device according to (5), wherein

[0247] The auxiliary information includes information indicating that the predetermined metadata is a single metadata item.

[0248] (10) The signal processing device according to (9), wherein

[0249] The data writing unit writes predetermined metadata into a register area of the accumulation register, which holds the predetermined metadata until read by software.

[0250] (11) The signal processing device according to any one of (1) to (10), further comprising:

[0251] An information adding unit is configured to, in a case where metadata included in the data packet included in the input digital signal for transmission is historicized object metadata, add auxiliary information to the data packet when outputting the input digital signal for transmission, the auxiliary information indicating that the metadata included in the data packet is historical data.

[0252] (12) The signal processing device according to any one of (1) to (11), further comprising:

[0253] a header information extraction unit configured to extract header information of the data packet included in the input digital signal for transmission; and

[0254] A register configured to hold the extracted header information.

[0255] (13) The signal processing device according to any one of (1) to (12), wherein

[0256] The digital signal used for transmission is a serial digital signal in SDI format, and

[0257] The data packets are embedded in an auxiliary area of the serial digital signal in the SDI format.

[0258] (14) A signal processing method comprising:

[0259] receiving as input a video signal and a digital signal for transmission comprising data packets having metadata associated with the video signal; and

[0260] Predetermined metadata is extracted from the digital signal for transmission based on the metadata designation information, and the extracted metadata is written into the accumulation register.

[0261] (15) A signal processing device comprising:

[0262] a signal input unit configured to receive as input a digital signal for transmission including a video signal; and

[0263] a signal output unit configured to superimpose and output a data packet, which is newly superimposed and has metadata associated with the video signal, on a designated line of the input digital signal for transmission,

[0264] The signal output unit includes

[0265] an end detection unit configured to detect the end of the last data packet previously superimposed on a designated line of the digital signal input for transmission, and

[0266] The data superimposing unit is configured to superimpose the data packet to be newly superimposed after the end of the last data packet previously superimposed on a designated line of the digital signal input for transmission, based on the detection of the end.

[0267] (16) The signal processing device according to (15), wherein

[0268] The end detection unit determines the end of the specific data packet as the end of the last data packet when the end of the specific data packet is detected and then a predetermined number of periods pass without detecting the next data packet.

[0269] (17) The signal processing device according to (15) or (16), further comprising:

[0270] a register configured to hold information about said data packet to be newly superimposed,

[0271] Wherein, in a case where the data packet to be newly superimposed includes information indicating that metadata included in the data packet requires immediacy, the signal output unit changes the information indicating that the metadata to be superimposed requires immediacy to information indicating that the metadata to be superimposed does not require immediacy in a frame following a frame in which the data packet to be newly superimposed is superimposed, and continues to superimpose the data packet to be newly superimposed, or continues to superimpose the data packet to be newly superimposed without changing the information.

[0272] (18) The signal processing device according to (15) or (16), further comprising:

[0273] a register configured to hold information about said data packet to be newly superimposed,

[0274] In which, in a case where the data packet to be newly superimposed includes information indicating that the metadata included in the data packet is a single metadata item, the signal output unit stops the superposition in a frame after a frame in which the data packet to be newly superimposed is superimposed, or continues the superposition by changing the information indicating that the metadata is a single metadata item to information indicating that the metadata is not a single metadata item.

[0275] (19) The signal processing device according to any one of (15) to (18), wherein

[0276] The digital signal used for transmission is a serial digital signal in SDI format, and

[0277] The data packets are embedded in an auxiliary area of the serial digital signal in the SDI format.

[0278] (20) A signal processing method comprising:

[0279] a signal input step of receiving as input a digital signal for transmission including a video signal; and

[0280] a signal output step of superimposing and outputting a data packet, the data packet being newly superimposed and having metadata associated with the video signal, on a designated line of the input digital signal for transmission,

[0281] The signal output steps include

[0282] detecting the end of the last data packet previously superimposed on a designated line of the digital signal being input for transmission, and

[0283] Based on the detection of the end, the data packet to be newly superimposed is superimposed after the end of the last data packet previously superimposed on a designated line of the digital signal input for transmission.

[0284] Reference Signs List

[0285] 10 Video System

[0286] 101, 101-1 to 101-3 Camera Equipment

[0287] 102, 102-1 to 102-3 cables

[0288] 103, 103-1 to 103-3 CCU

[0289] 104 Video Tape Recorder

[0290] 105 Switcher

[0291] 106 servers

[0292] 107, 108 Monitor

[0293] 109 Converter

[0294] 110-1 to 110-3 Waveform Monitors

[0295] 111 Lens Equipment

[0296] 112 Camera CPU

[0297] 113 sensor unit

[0298] 114 Camera signal processing unit

[0299] 115 Pick-me switch

[0300] 116 USB terminal

[0301] 131 CPU

[0302] 132 Video Processing Unit

[0303] 133 Video Formatter

[0304] 134 USB terminal

[0305] 151 CPU

[0306] 152 Router

[0307] 153 Video Processor

[0308] 161 Input Unit

[0309] 162 output units

[0310] 171 Selector

[0311] 172 Interrupt Circuit

[0312] 201 VANC extraction unit

[0313] 202 Delay Unit

[0314] 203 Controller

[0315] 204 CRC unit

[0316] 205 Header Information Extraction Unit

[0317] 206 ID register

[0318] 207 Disposal ID Register

[0319] 208 Designation-Determination Unit

[0320] 209 Historic Object Determination Unit

[0321] 211, 212, 213, 221, 222 Group registers

[0322] 301 VANC extraction unit

[0323] 302 Delay Unit

[0324] 303 Metadata Overlay Unit

[0325] 305 End Detection Unit

[0326] 306 Controller

[0327] 307, 308, 309 Group registers

Claims

1. A signal processing device, comprising: a signal input unit configured to receive as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; as well as A data writing unit is configured to extract predetermined metadata from the digital signal for transmission based on metadata designation information and write the extracted metadata into the accumulation register, wherein The metadata designation information includes header information of the data packet having predetermined metadata, The header information includes classification information indicating a classification for predetermined metadata, The header information also includes auxiliary information of predetermined metadata, The auxiliary information includes information indicating that the predetermined metadata is historical data.

2. A signal processing device, comprising: a signal input unit configured to receive as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; as well as A data writing unit is configured to extract predetermined metadata from the digital signal for transmission based on metadata designation information and write the extracted metadata into the accumulation register, wherein The metadata designation information includes header information of the data packet having predetermined metadata, The header information includes classification information indicating a classification for predetermined metadata, The header information also includes auxiliary information of predetermined metadata, The auxiliary information includes information indicating that the predetermined metadata is metadata requiring immediacy.

3. The signal processing device according to claim 2, wherein The data writing unit writes predetermined metadata into a register area of the accumulation register, which holds the predetermined metadata until read by the software, and interrupts the software.

4. A signal processing device comprising: a signal input unit configured to receive as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; as well as A data writing unit is configured to extract predetermined metadata from the digital signal for transmission based on metadata designation information and write the extracted metadata into the accumulation register, wherein The metadata designation information includes header information of the data packet having predetermined metadata, The header information includes classification information indicating a classification for predetermined metadata, The header information also includes auxiliary information of predetermined metadata, The auxiliary information includes information indicating that the predetermined metadata is a single metadata item. The signal processing device according to claim 4 , wherein The data writing unit writes predetermined metadata into a register area of the accumulation register, which holds the predetermined metadata until read by software.

6. The signal processing device according to any one of claims 1, 2 and 4, wherein The classification information includes first classification information and second classification information, the first classification information indicating a classification of predetermined metadata, and the second classification information indicating a sub-classification under the classification of the first classification information of the predetermined metadata.

7. A signal processing device comprising: a signal input unit configured to receive as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; a data writing unit configured to extract predetermined metadata from the digital signal for transmission based on the metadata designation information and write the extracted metadata into the accumulation register; as well as An information adding unit is configured to, in a case where metadata included in the data packet included in the input digital signal for transmission is historicized object metadata, add auxiliary information to the data packet when outputting the input digital signal for transmission, the auxiliary information indicating that the metadata included in the data packet is historical data.

8. The signal processing device according to any one of claims 1, 2, 4 and 7, further comprising: a header information extraction unit configured to extract header information of the data packet included in the input digital signal for transmission; as well as A register configured to hold the extracted header information.

9. The signal processing device according to any one of claims 1, 2, 4 and 7, wherein The digital signal used for transmission is a serial digital signal in SDI format, and The data packets are embedded in an auxiliary area of the serial digital signal in the SDI format.

10. A signal processing method, comprising: receiving as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; as well as extracting predetermined metadata from the digital signal for transmission based on the metadata designation information and writing the extracted metadata into the accumulation register, wherein The metadata designation information includes header information of the data packet having predetermined metadata, The header information includes classification information indicating a classification for predetermined metadata, The header information also includes auxiliary information of predetermined metadata, The auxiliary information includes information indicating that the predetermined metadata is historical data.

11. A signal processing method, comprising: receiving as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; as well as extracting predetermined metadata from the digital signal for transmission based on the metadata designation information and writing the extracted metadata into the accumulation register, wherein The metadata designation information includes header information of the data packet having predetermined metadata, The header information includes classification information indicating a classification for predetermined metadata, The header information also includes auxiliary information of predetermined metadata, The auxiliary information includes information indicating that the predetermined metadata is metadata requiring immediacy.

12. A signal processing method, comprising: receiving as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; as well as extracting predetermined metadata from the digital signal for transmission based on the metadata designation information and writing the extracted metadata into the accumulation register, wherein The metadata designation information includes header information of the data packet having predetermined metadata, The header information includes classification information indicating a classification for predetermined metadata, The header information also includes auxiliary information of predetermined metadata, The auxiliary information includes information indicating that the predetermined metadata is a single metadata item.

13. A signal processing method, comprising: receiving as input a video signal and a digital signal for transmission, the digital signal for transmission comprising data packets having metadata associated with the video signal; extracting predetermined metadata from the digital signal for transmission based on the metadata designation information, and writing the extracted metadata into an accumulation register; as well as In a case where metadata included in the data packet included in the input digital signal for transmission is historicized object metadata, auxiliary information indicating that the metadata included in the data packet is historical data is added to the data packet when the input digital signal for transmission is output.

14. A signal processing device comprising: a signal input unit configured to receive as input a digital signal for transmission including a video signal; a signal output unit configured to superimpose and output a data packet, which is newly superimposed and has metadata associated with the video signal, on a designated line of the input digital signal for transmission; as well as a register configured to hold information about said data packet to be newly superimposed, The signal output unit includes an end detection unit configured to detect the end of the last data packet previously superimposed on the designated line of the digital signal input for transmission, and a data superimposing unit configured to superimpose the data packet to be newly superimposed after the end of the last data packet previously superimposed on the designated line of the digital signal input for transmission based on detection of the end, Wherein, in a case where the data packet to be newly superimposed includes information indicating that metadata included in the data packet requires immediacy, the signal output unit continues to superimpose the data packet to be newly superimposed by changing the information indicating that the metadata to be superimposed requires immediacy to information indicating that the metadata to be superimposed does not require immediacy in a frame following a frame in which the data packet to be newly superimposed is superimposed, or continues to superimpose the data packet to be newly superimposed without changing the information.

15. A signal processing device comprising: a signal input unit configured to receive as input a digital signal for transmission including a video signal; a signal output unit configured to superimpose and output a data packet, which is newly superimposed and has metadata associated with the video signal, on a designated line of the input digital signal for transmission; as well as a register configured to hold information about said data packet to be newly superimposed, The signal output unit includes an end detection unit configured to detect the end of the last data packet previously superimposed on the designated line of the digital signal input for transmission, and a data superimposing unit configured to superimpose the data packet to be newly superimposed after the end of the last data packet previously superimposed on the designated line of the digital signal input for transmission based on detection of the end, In which, in a case where the data packet to be newly superimposed includes information indicating that the metadata included in the data packet is a single metadata item, the signal output unit stops the superposition in a frame after a frame in which the data packet to be newly superimposed is superimposed, or continues the superposition by changing the information indicating that the metadata is a single metadata item to information indicating that the metadata is not a single metadata item.

16. The signal processing device according to claim 14 or 15, wherein The end detection unit determines the end of a specific data packet as the end of the last data packet when the end of the specific data packet is detected and then a predetermined number of periods have passed without detecting the next data packet.

17. The signal processing device according to claim 14 or 15, wherein The digital signal used for transmission is a serial digital signal in SDI format, and The data packets are embedded in an auxiliary area of the serial digital signal in the SDI format.

18. A signal processing method, comprising: a signal input step of receiving a digital signal for transmission including a video signal as input; a signal outputting step of superimposing and outputting a data packet, the data packet being newly superimposed and having metadata associated with the video signal, on a designated line of the input digital signal for transmission; as well as a holding step of holding information about the data packet to be newly superimposed in a register, The signal output step includes detecting the end of the last data packet previously superimposed on said designated line of the digital signal input for transmission, and superimposing the data packet to be newly superimposed after the end of the last data packet previously superimposed on the designated line of the digital signal input for transmission based on the detection of the end, Wherein, in the signal output step, in a case where the data packet to be newly superimposed includes information indicating that metadata included in the data packet requires immediacy, in a frame after one frame in which the data packet to be newly superimposed is superimposed, the data packet to be newly superimposed is continued to be superimposed by changing the information indicating that the metadata to be superimposed requires immediacy to information indicating that the metadata to be superimposed does not require immediacy, or the data packet to be newly superimposed is continued to be superimposed without changing the information.

19. A signal processing method, comprising: a signal input step of receiving a digital signal for transmission including a video signal as input; a signal outputting step of superimposing and outputting a data packet, the data packet being newly superimposed and having metadata associated with the video signal, on a designated line of the input digital signal for transmission; as well as a holding step of holding information about the data packet to be newly superimposed in a register, The signal output step includes detecting the end of the last data packet previously superimposed on said designated line of the digital signal input for transmission, and superimposing the data packet to be newly superimposed after the end of the last data packet previously superimposed on the designated line of the digital signal input for transmission based on the detection of the end, Wherein, in the signal output step, in a case where the data packet to be newly superimposed includes information indicating that the metadata included in the data packet is a single metadata item, in a frame after a frame in which the data packet to be newly superimposed is superimposed, the superimposition is stopped, or the superimposition is continued by changing the information indicating that the metadata is a single metadata item to information indicating that the metadata is not a single metadata item.

Images