Monitoring System and Program
The monitoring system addresses the challenge of monitoring IP flow transmission states in program production facilities by acquiring and verifying relevant information, ensuring alignment with operator settings and enhancing operational efficiency.
Patent Information
- Application Number
- JP2021107112
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-06-28
- Publication Date
- 2025-06-12
- Estimated Expiration
- 2041-06-28
AI Technical Summary
In program production facilities using IP networks, it is challenging for operators to easily monitor whether the transmission state of an IP flow conforms to the settings made by the operator, due to the complexity of IP network operations and the limitations of existing monitoring technologies like sFlow.
A monitoring system that includes a network switch information acquisition unit, an IP flow information acquisition unit, a program production equipment information acquisition unit, and a state verification unit. This system acquires and verifies network switch information, IP flow information, and program production equipment information to ensure that the transmission state of the IP flow aligns with the operator's settings.
The monitoring system enables operators to more easily and accurately verify that the transmission state of IP flows in program production facilities matches the intended settings, thereby improving operational efficiency and reducing the time required for monitoring and troubleshooting.
Smart Images

Figure 0007691865000001 
Figure 0007691865000002 
Figure 0007691865000003
Abstract
Description
Technical Field
[0001] The present invention relates to a monitoring system and a program.
Background Art
[0002] There has been a consideration to replace the program production equipment that has been configured by SDI (Serial Digital Interface) (see Non-Patent Document 1) with a general Ethernet (registered trademark) / IP (Internet Protocol) network (see Non-Patent Document 2). Compared with SDI, the IP network has a larger amount of data that can be transmitted per unit time, and can multiplex and transmit different types of signals such as video and audio on the same network. Therefore, program production using the IP network is suitable not only for the production of HD (High Definition) quality programs that have been conventionally performed, but also for the production of programs with higher resolutions such as 4K and 8K.
[0003] As a standard for packetizing video and transmitting it via an IP network, SMPTE ST2110-20 (see Non-Patent Document 3) has already been issued, and SMPTE ST2110-30 / 31 has already been issued as a standard for audio transmission. In SMPTE ST2110-20 / 30 / 31, video signals are transmitted by UDP (User Datagram Protocol) (see Non-Patent Document 4) / RTP (Real-Time Applications) (see Non-Patent Document 5).
[0004] For the transmission of video and audio using an IP network, there are features such as multiplexing and transmitting multiple videos and audios over a single physical line, the network switch that transfers IP packets on the IP network autonomously determines the transmission path on the IP network, and packet loss of IP packets occurs within the IP network. Different from the SDI network, which has features such as transmitting one video or audio over one physical line and the operator performing the connection setting of the physical input and output of the SDI matrix, it is difficult for the operator to grasp how the video and audio are being transmitted in the IP network. Therefore, a technology for monitoring the state of the network switch or the IP flow of video and audio in the program production facility is required.
[0005] As a technology for obtaining the state of the IP flow on the IP network, sFlow is known (see Non-Patent Document 6). In sFlow, IP packets passing through the network switch are sampled within the network switch, and statistical processing is performed to estimate the utilization bandwidth of the IP flow. In sFlow, while it is possible to perform the necessary processing for monitoring by sampling IP packets, due to the monitoring by sampling, the number of IP flows that can be obtained and the utilization bandwidth of each IP flow are not accurate. Also, sFlow cannot detect packet loss.
[0006] Patent Document 1 proposes a technology that replicates and analyzes all IP packets passing through a device, extracts the necessary information, transmits it to an analysis application, and the analysis application detects the throughput, packet loss, transmission delay, jitter, video resolution, or packet time of audio of the IP flow.
Prior Art Documents
Patent Documents
[0007]
Patent Document 1
Non-Patent Documents
[0008] [Non-Patent Document 1] SMPTE ST 292-1: 1.5 Gb / S Signal / Data Serial Interface [Non-Patent Document 2] RFC791: Internet Protocol [Non-Patent Document 3] SMPTE ST2110-20: Professional Media Over Managed IP Networks: Uncompressed Active Video [Non-Patent Document 4] RFC768: User Datagram Protocol [Non-Patent Document 5] RFC3550: RTP: A Transport Protocol for Real-Time Applications [Non-Patent Document 6] RFC 3176: A Method for Monitoring Traffic in Switched and Routed Networks [Summary of the Invention] [Problems to be Solved by the Invention]
[0009] In the technology described in Patent Document 1, it is impossible to determine whether the state analyzed by the analysis application matches the operator's intention, and there is a problem that the operator needs to check the analysis content, which is time-consuming. Therefore, in program production equipment using an IP network, there has been a demand for a technology that can more easily monitor whether the transmission state of an IP flow conforms to the settings made by the operator.
[0010] An object of the present invention is to solve the above-described problems and provide a monitoring system and a program that can more easily monitor whether the transmission state of an IP flow conforms to the content set by an operator in a program production facility using an IP network.
Means for Solving the Problems
[0011] To solve the above problems, a monitoring system according to the present invention is a monitoring system for a program production facility including a network switch provided on an IP network and transferring IP packets constituting an IP flow flowing through the IP network, and program production equipment that performs program production by transmitting and receiving an IP flow via the network switch, and includes a network switch information acquisition unit that acquires network switch information regarding the transfer of IP packets by the network switch, an IP flow information acquisition unit that acquires IP flow information regarding an IP flow flowing through the IP network, a program production equipment information acquisition unit that acquires program production equipment information regarding a set IP flow that is an IP flow transmitted and received by the program production equipment set in the program production equipment, and a state verification unit that verifies a transmission state of the IP flow by the program production equipment based on the network switch information, the IP flow information, and the program production equipment information.
[0012] Further, in the monitoring system according to the present invention, the state verification unit specifies a program production equipment of a transmission source and a program production equipment of a reception destination of the set IP flow based on the program production equipment information, determines whether or not there is a transmission path from the program production equipment of the transmission source to the program production equipment of the reception destination based on the program production equipment information and the network switch information, and when it is determined that the transmission path exists, it is preferable to determine whether or not there is an IP flow corresponding to the set IP flow in the transmission path based on the IP flow information.
[0013] Also, in the monitoring system according to the present invention, when video is transmitted in the IP flow, the IP flow information includes video parameters related to the video, and when audio is transmitted in the IP flow, the IP flow information includes audio parameters related to the audio. When video is transmitted in the set IP flow, the program production device information includes video parameters related to the video, and when audio is transmitted in the set IP flow, the program production device information includes video parameters related to the audio. When the state verification unit determines that there is an IP flow corresponding to the set IP flow in the transmission path, it is preferable to determine whether the video parameters included in the program production device information match the video parameters included in the IP flow information of the IP flow corresponding to the set IP flow, or to determine whether the audio parameters included in the program production device information match the audio parameters included in the IP flow information of the IP flow corresponding to the set IP flow.
[0014] Also, in the monitoring system according to the present invention, when video is transmitted in the set IP flow, the program production device information includes video parameters related to the video, and when audio is transmitted in the set IP flow, the program production device information includes video parameters related to the audio. When video is transmitted in the IP flow, the IP flow information includes video parameters related to the video, and when audio is transmitted in the IP flow, the IP flow information includes audio parameters related to the audio. When the state verification unit determines whether the difference between the throughput calculated based on the video parameters included in the program production device information and the throughput related to the video observed in the IP flow included in the IP flow information of the IP flow corresponding to the set IP flow is greater than a predetermined threshold value, or to determine whether the difference between the throughput calculated based on the audio parameters included in the program production device information and the throughput calculated based on the audio parameters related to the audio observed in the IP flow included in the IP flow information of the IP flow corresponding to the set IP flow is greater than a predetermined threshold value.
[0015] In the monitoring system according to the present invention, when the state verification unit determines that there is an IP flow corresponding to the set IP flow in the transmission path, it is preferable to determine the presence or absence of packet loss in the IP flow corresponding to the set IP flow based on the IP flow information of the IP flow corresponding to the set IP flow.
[0016] In order to solve the above problems, the program according to the present invention causes a computer to function as any of the monitoring systems described above.
Advantages of the Invention
[0017] According to the monitoring system and program of the present invention, in a program production facility using an IP network, it is possible to more easily monitor whether the transmission state of an IP flow conforms to the content set by an operator.
Brief Description of the Drawings
[0018]
Figure 1
Figure 2
Figure 3
Embodiments for Carrying Out the Invention
[0019] Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0020] FIG. 1 is a diagram showing a configuration example of a monitoring system 10 according to an embodiment of the present invention. The monitoring system 10 according to the present embodiment is provided on an IP network 1 and monitors a program production facility including a network switch 2 that transfers IP packets constituting an IP flow flowing through the IP network 1 and a program production device 3 that performs program production by transmitting and receiving the IP flow via the network switch 2. The program production device 3 is, for example, equipment such as a camera and a monitor for performing program production.
[0021] As shown in FIG. 1, the monitoring system 10 according to the present embodiment includes a network switch information acquisition unit 11, an IP flow information acquisition unit 12, a program production device information acquisition unit 13, and a state verification unit 14. Each of the above-described units may be provided independently or may be integrated and provided as one device.
[0022] The network switch information acquisition unit 11 acquires network switch information, which is information related to the transfer of IP packets by the network switch 2. The network switch information acquisition unit 11 acquires, as network switch information, the state of each port, the IP address of each port, connection device information, which is information on a connection device connected to each port, unicast routing table information, and multicast routing table information. The network switch information acquisition unit 11 acquires network switch information, for example, using an external control interface that can be connected to the network switch 2 via the IP network 1. Further, the network switch information acquisition unit 11 may directly acquire network switch information from the console.
[0023] The IP flow information acquisition unit 12 analyzes IP packets passing through the IP network 1 and acquires IP flow information, which is information regarding the IP flows flowing through the IP network 1. The IP flow information acquisition unit 12 acquires, as IP flow information, information regarding the source / destination IP addresses, source / destination L4 ports, throughput, jitter, and packet loss, etc. for each IP flow flowing through the IP network 1. Also, when video is transmitted in an IP flow, the IP flow information acquisition unit 12 acquires, as the IP flow information of that IP flow, information such as the resolution, frame rate, and transmission delay of the video (hereinafter referred to as "video parameters"). Further, when audio is transmitted in an IP flow, the IP flow information acquisition unit 12 acquires, as the IP flow information of that IP flow, information such as the transmission delay, packet time, and packet size (hereinafter referred to as "audio parameters"). Thus, the IP flow information includes video parameters regarding the video when video is transmitted in the IP flow. Also, the IP flow information includes audio parameters regarding the audio when audio is transmitted in the IP flow.
[0024] The IP flow information acquisition unit 12 may be incorporated in the network switch 2, or may be provided independently of the network switch 2 as shown in FIG. 1.
[0025] The program production equipment information acquisition unit 13 acquires program production equipment information, which is information regarding the set IP flow in the program production equipment 3. The program production equipment information acquisition unit 13 acquires, as program production equipment information, information such as the transmission / reception settings of the IP flow, the transmission device ID of the set IP flow, the source / destination addresses, the destination L4 port, and the IP address of the network interface. Further, when video is transmitted in the set IP flow, the program production equipment information acquisition unit 13 acquires, as program production equipment information, information such as the resolution, frame rate, color depth, and sampling method of the video (hereinafter referred to as "video parameters"). Also, when audio is transmitted in the set IP flow, the program production equipment information acquisition unit 13 acquires, as program production equipment information, information such as the sampling frequency, quantization bit number, and packet time of the audio (hereinafter referred to as "audio parameters"). Thus, the program production equipment information includes video parameters related to the video when video is transmitted in the set IP flow. Also, the program production equipment information includes audio parameters related to the audio when audio is transmitted in the set IP flow.
[0026] The program production equipment information acquisition unit 13 acquires program production equipment information using, for example, AMWS NMOS IS-04 / IS-05.
[0027] Based on the network switch information acquired by the network switch information acquisition unit 11, the IP flow information acquired by the IP flow information acquisition unit 12, and the program production equipment information acquired by the program production equipment information acquisition unit 13, the status verification unit 14 verifies the transmission status of the IP flow by the program production equipment 3.
[0028] Next, the operation of the monitoring system 10 according to the present embodiment will be described. FIG. 2 is a flowchart showing an example of the operation of the monitoring system 10 according to the present embodiment.
[0029] The network switch information acquisition unit 11 acquires network switch information, which is information regarding the transfer of IP packets by the network switch 2 (step S10). As described above, the network switch information acquisition unit 11 acquires, as the network switch information, the status of each port, the IP address of each port, the connection device information of the connection devices connected to each port, the unicast routing table information, and the multicast routing table information.
[0030] The IP flow information acquisition unit 12 acquires IP flow information, which is information regarding the IP flows flowing through the IP network 1 (step S20). As described above, the IP flow information acquisition unit 12 acquires, as the IP flow information, information regarding the source / destination IP address, the source / destination L4 port, the throughput, the jitter, and the packet loss for each IP flow flowing through the IP network 1.
[0031] The program production device information acquisition unit 13 acquires program production device information, which is information regarding the set IP flows set in the program production device 3 (step S30). As described above, the program production device information acquisition unit 13 acquires, as the program production device information, information such as the transmission / reception settings of the IP flow, the transmission device ID of the set IP flow, the source / destination address, the destination L4 port, and the IP address of the network interface.
[0032] The status verification unit 14 verifies the transmission status of the IP flow by the program production device 3 based on the network switch information, the IP flow information, and the program production device information (step S40). The details of the verification of the transmission status of the IP flow by the program production device 3 by the status verification unit 14 will be described with reference to the flowchart shown in FIG. 3.
[0033] The status verification unit 14 acquires program production device information regarding the set IP flows set in the program production device 3 (step S41).
[0034] The status verification unit 14 analyzes the acquired program production device information and determines whether the program production device 3 is attempting to receive an IP flow (step S42).
[0035] If it is determined that the program production device 3 is not attempting to receive an IP flow (step S42: No), the status verification unit 14 returns to the process of step S41.
[0036] If it is determined that the program production device 3 is attempting to receive an IP flow (step S42: Yes), the status verification unit 14 identifies the program production device 3 that is the source of the IP flow (the set IP flow) and the program production device 3 that is the destination, and determines whether the information of the IP flow transmitted and received by the source program production device 3 and the destination program production device 3 matches (step S43). Specifically, the status verification unit 14 determines whether the source / destination IP address of the IP flow, the destination L4 port, the video parameters (when the IP flow transmits video), and the audio parameters (when the IP flow transmits audio) match between the source program production device 3 and the destination program production device 3.
[0037] If it is determined that the information of the IP flow transmitted and received does not match between the source program production device 3 and the destination program production device 3 of the IP flow (step S43: No), the status verification unit 14 outputs the determination result (step S44). The status verification unit 14 outputs the determination result, for example, by displaying a text message or an image indicating the determination result on a display device (not shown). After the process of step S44, the status verification unit 14 returns to the process of step S41.
[0038] When it is determined that the information of the IP flow transmitted and received by the program production device 3 at the source of the IP flow and the program production device 3 at the destination matches (step S43: Yes), the state verification unit 14 determines whether there is a transmission path from the program production device 3 at the source of the set IP flow to the program production device 3 at the destination in the network switch 2 (step S45). The state verification unit 14 determines whether there is a transmission path from the program production device 3 at the source of the set IP flow to the program production device 3 at the destination by analyzing, for example, the connection device information of the network switch 2, the unicast routing table information, and the multicast routing table information. In this way, the state verification unit 14 identifies the program production device 3 at the source of the set IP flow and the program production device 3 at the destination based on the program production device information. Then, the state verification unit 14 determines whether there is a transmission path from the program production device 3 at the source to the program production device 3 at the destination based on the program production device information and the network switch information.
[0039] When it is determined that there is no transmission path from the program production device 3 at the source of the set IP flow to the program production device 3 at the destination (step S45: No), the state verification unit 14 proceeds to the process of step S44 and outputs the determination result.
[0040] When it is determined that there is a transmission path from the program production device 3 at the source of the set IP flow to the program production device 3 at the destination (step S45: Yes), the state verification unit 14 determines whether there is an IP flow corresponding to the set IP flow on that transmission path (step S46). Specifically, the state verification unit 14 determines whether there is an IP flow on the transmission path that matches the set IP flow, the source / destination IP address, and the destination port L4 based on the IP flow information. In this way, when the state verification unit 14 determines that there is a transmission path from the program production device 3 at the source of the set IP flow to the program production device 3 at the destination, it determines whether there is an IP flow corresponding to the set IP flow on the transmission path based on the IP flow information.
[0041] When it is determined that there is no IP flow corresponding to the set IP flow on the transmission path (step S46: No), the state verification unit 14 proceeds to the process of step S44 and outputs the determination result.
[0042] When it is determined that there is an IP flow corresponding to the set IP flow on the transmission path (step S46: Yes), the state verification unit 14 determines whether the IP flow is normal (step S47).
[0043] Specifically, the state verification unit 14 determines whether there is packet loss in the IP flow corresponding to the set IP flow based on the IP flow information. Also, the state verification unit 14 determines whether the IP flow is normal based on whether the video parameters included in the program production device information match the video parameters included in the IP flow information of the IP flow corresponding to the set IP flow. Also, the state verification unit 14 determines whether the IP flow is normal based on whether the audio parameters included in the program production device information match the audio parameters included in the IP flow information of the IP flow corresponding to the set IP flow.
[0044] Also, the state verification unit 14 determines whether the IP flow is normal based on whether the difference between the throughput calculated based on the video parameters included in the program production device information and the throughput regarding the video observed in the IP flow included in the IP flow information of the IP flow corresponding to the set IP flow is greater than a predetermined threshold. Also, the state verification unit 14 determines whether the IP flow is normal based on whether the difference between the throughput calculated based on the audio parameters included in the program production device information and the throughput regarding the audio observed in the IP flow included in the IP flow information of the IP flow corresponding to the set IP flow is greater than a predetermined threshold.
[0045] When the state verification unit 14 determines that the IP flow is not normal (step S47: No), and when it determines that the IP flow is normal (step S47: Yes), in each case, it proceeds to the process of step S44 and outputs the determination result.
[0046] The state verification unit 14 performs the process described with reference to FIG. 3 periodically or whenever the settings of the program production device 3 are changed. By doing so, according to the operator's control, the monitoring items can be automatically changed, and it is possible to more easily monitor whether the transmission state of the IP flow conforms to the content set by the operator.
[0047] As described above, the monitoring system 10 according to this embodiment includes a network switch information acquisition unit 11, an IP flow information acquisition unit 12, a program production device information acquisition unit 13, and a state verification unit 14. The network switch information acquisition unit 11 acquires network switch information regarding the transfer of IP packets by the network switch 2. The IP flow information acquisition unit 12 acquires IP flow information regarding the IP flow flowing through the IP network 1. The program production device information acquisition unit 13 acquires program production device information regarding the set IP flow set in the program production device 3. The state verification unit 14 verifies the transmission state of the IP flow by the program production device 3 based on the network switch information, the IP flow information, and the program production device information.
[0048] By verifying the transmission state of the IP flow by the program production device 3 in consideration of the program production device information regarding the set IP flow, it is possible to more easily monitor whether the transmission state of the IP flow conforms to the content set by the operator in the program production facility using the IP network 1.
[0049] Although not particularly mentioned in the embodiment, a program for causing a computer to function as the monitoring system 10 may be provided. Also, the program may be recorded on a computer-readable medium. If a computer-readable medium is used, it can be installed on a computer. Here, the computer-readable medium on which the program is recorded may be a non-transitory recording medium. The non-transitory recording medium is not particularly limited, and for example, it may be a recording medium such as a CD-ROM or a DVD-ROM.
[0050] Alternatively, a chip mounted on the video creation device 100 may be provided, which is composed of a memory that stores a program for executing each process performed by the monitoring system 10, and a processor that executes the program stored in the memory.
[0051] Although the above-described embodiments have been described as representative examples, it is obvious to those skilled in the art that many changes and substitutions are possible within the spirit and scope of the present invention. Therefore, the present invention should not be construed as being limited by the above-described embodiments, and various modifications and changes are possible without departing from the scope of the claims. For example, it is possible to combine a plurality of constituent blocks described in the configuration diagram of the embodiment into one, or to divide one constituent block.
Explanation of Reference Numerals
[0052] 1 IP network 2 Network switch 3 Program production equipment 10 Monitoring system 11 Network switch information acquisition unit 12 IP flow information acquisition unit 13 Program production equipment information acquisition unit 14 Status verification unit
Claims
1. A monitoring system for a program production facility, comprising: a network switch provided on an IP network for transferring IP packets that constitute an IP flow flowing through the IP network; and a program production device that performs program production by transmitting and receiving the IP flow via the network switch, a network switch information acquisition unit that acquires network switch information regarding the transfer of IP packets by the network switch; an IP flow information acquisition unit that acquires IP flow information regarding an IP flow flowing through the IP network; a program production device information acquisition unit that acquires program production device information regarding a set IP flow, which is an IP flow transmitted and received by the program production device, set in the program production device; and a state verification unit that verifies the transmission state of the IP flow by the program production device based on the network switch information, the IP flow information, and the program production device information.
2. In the monitoring system according to Claim 1, the state verification unit identifies a program production device as a transmission source and a program production device as a reception destination of the set IP flow based on the program production device information, determines whether there is a transmission path from the program production device as the transmission source to the program production device as the reception destination based on the program production device information and the network switch information, and when it is determined that the transmission path exists, determines whether there is an IP flow corresponding to the set IP flow in the transmission path based on the IP flow information.
3. In the monitoring system according to Claim 2, the IP flow information includes video parameters regarding the video when video is transmitted in the IP flow, and includes audio parameters regarding the audio when audio is transmitted in the IP flow, the program production device information includes video parameters regarding the video when video is transmitted in the set IP flow, and includes video parameters regarding the audio when audio is transmitted in the set IP flow. When the state verification unit determines that there is an IP flow corresponding to the set IP flow in the transmission path, it determines whether the video parameters included in the program production device information match the video parameters included in the IP flow information of the IP flow corresponding to the set IP flow, or determines whether the audio parameters included in the program production device information match the audio parameters included in the IP flow information of the IP flow corresponding to the set IP flow. Monitoring system.
4. In the monitoring system according to claim 2, When video is transmitted in the set IP flow, the program production device information includes video parameters related to the video, and when audio is transmitted in the set IP flow, the program production device information includes video parameters related to the audio. When video is transmitted in the IP flow, the IP flow information includes video parameters related to the video, and when audio is transmitted in the IP flow, the IP flow information includes audio parameters related to the audio. The state verification unit determines whether the difference between the throughput calculated based on the video parameters included in the program production device information and the throughput related to the video observed in the IP flow included in the IP flow information of the IP flow corresponding to the set IP flow is greater than a predetermined threshold, or determines whether the difference between the throughput calculated based on the audio parameters included in the program production device information and the throughput related to the audio observed in the IP flow included in the IP flow information of the IP flow corresponding to the set IP flow is greater than a predetermined threshold. Monitoring system.
5. A program that causes a computer to function as the monitoring system according to any one of claims 1 to 4.
Citation Information
Patent Citations
Verification device, verification method, and program
JP2017183891A
Packet flow monitoring device, packet data extraction device, extracted data aggregation device, and program
JP2020078057A