Material transfer device, material transfer method, and material transfer program

The material transfer device synchronizes transfers at video frame boundaries to mitigate noise during switching, addressing the issue of frame boundary neglect in existing IP routers.

JP7757656B2Active Publication Date: 2025-10-22NEC CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021131023
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-08-11
Publication Date
2025-10-22
Estimated Expiration
2041-08-11

AI Technical Summary

Technical Problem

Existing IP routers in broadcasting networks switch video streams without considering frame boundaries, leading to potential noise introduction during material transitions.

Method used

A material transfer device that detects video frame boundaries and synchronizes transfers to start and stop at these boundaries, using boundary position information to minimize noise during switching.

Benefits of technology

Reduces the possibility of noise introduction during material transitions by ensuring transfers occur at frame boundaries, thereby improving video playback quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007757656000001
    Figure 0007757656000001
  • Figure 0007757656000002
    Figure 0007757656000002
  • Figure 0007757656000003
    Figure 0007757656000003
Patent Text Reader

Abstract

To make it possible to reduce the possibility that a noise caused by material switching enters a reproduction video.SOLUTION: A material transfer device transfers a material to a subsequent-stage device, and detects boundary position information indicating a position of a boundary of video frames associated with the material on the basis of information included in the material, wherein the boundary position information is position information of a boundary of video frames of the material when the material is a video material and is position information of a boundary of video frames of a video material associated with the material when the material is not a video material, the transfer of the material is started from a position of a boundary of video frames on the basis of the boundary position information when a transfer start request signal that is a signal for requesting the start of the transfer of the material is inputted, and the material is transferred to a position of a boundary of video frames on the basis of the boundary position information and then the transfer is stopped when a transfer stop request signal that is a signal for requesting the stoppage of the transfer of the material currently being transferred is inputted.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a material transfer device and the like. [Background technology]

[0002] The broadcasting station's network center outputs the material input to the broadcasting station to an output destination such as a studio or master facility. Note that the material refers to information corresponding to the broadcast content, including, for example, video, audio, ancillary data, etc.

[0003] With the shift to IP (Internet Protocol) in broadcasting equipment, IP routers are now used to switch the materials to be output to the destination. Many general-purpose IP routers are equipped with IGMP (Internet Group Management Protocol) functionality.

[0004] The IGMP function is used, for example, in an IP broadcast receiving device to start or stop receiving a video stream. Patent Documents 1 and 2 describe methods for starting or stopping receiving a video stream in an IP broadcast receiving device.

[0005] In the techniques described in Patent Documents 1 and 2, when an IP broadcast receiving device starts receiving a video stream, it sends a Join packet to an IP router. The Join packet is a packet requesting participation in a multicast group. The multicast group to which the Join packet requests participation is the multicast group to which the desired video stream is being distributed. This enables the IP broadcast receiving device to receive the video stream being distributed by the distribution source to the multicast group. Furthermore, when the IP broadcast receiving device stops receiving the video stream, it sends a Leave packet to the IP router requesting withdrawal from the multicast group.

[0006] In a typical network center, this IGMP function can be used to switch the material to be sent to the output destination.

[0007] For example, in a typical circuit center, when using the IGMP function to switch the material to be sent to the output destination, the switching instruction device first sends a leave packet for the material before the switch to the IP router. When the IP router receives the leave packet, it stops forwarding the material before the switch (the material being forwarded). The switching instruction device also sends a join packet for the material after the switch to the IP router. When the IP router receives the join packet, it starts forwarding the material after the switch. This allows the circuit center to use the IGMP function to switch the material to be sent to the output destination. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-062690 [Patent Document 2] Japanese Patent Application Laid-Open No. 2009-225353 Summary of the Invention [Problem to be solved by the invention]

[0009] However, in a typical network center, IP routers stop and start transfers without considering the breaks between video frames, which means that if transfers are stopped or started in the middle of a video frame, noise may be introduced into the video played on the receiving device that received the material.

[0010] An object of the present invention is to provide a material transfer device or the like that can reduce the possibility that noise caused by switching materials will be introduced into the playback image. [Means for solving the problem]

[0011] In one aspect of the present invention, a material transfer device includes a transfer unit that transfers material to a subsequent device, and a detection unit that detects boundary position information that indicates the position of a boundary of a video frame related to the material based on information included in the material, wherein the boundary position information is position information of a boundary of a video frame of the material if the material is a video material, and is position information of a boundary of a video frame of a video material that is associated with the material if the material is not a video material, and when a transfer start request signal that requests the start of transfer of the material is input, the transfer unit starts transfer of the material from the position of the boundary of the video frame based on the boundary position information, and when a transfer stop request signal that requests the stop of transfer of the material that is being transferred is input, the transfer unit stops transfer after transferring the material up to the position of the boundary of the video frame based on the boundary position information.

[0012] In another aspect of the present invention, a material transfer method transfers material to a subsequent device, and detects boundary position information indicating the position of a boundary of a video frame related to the material based on information included in the material, wherein the boundary position information is position information of a boundary of a video frame of the material if the material is a video material, or is position information of a boundary of a video frame of a video material associated with the material if the material is not a video material, and when a transfer start request signal is input that is a signal requesting the start of transfer of the material, starts transfer of the material from the position of the boundary of the video frame based on the boundary position information, and when a transfer stop request signal is input that is a signal requesting the stop of transfer of the material that is being transferred, stops transfer after transferring the material up to the position of the boundary of the video frame based on the boundary position information.

[0013] In another aspect of the present invention, a material transfer program causes a computer to realize a transfer function for transferring material to a subsequent device and a detection function for detecting boundary position information indicating the position of the boundary of a video frame related to the material based on information contained in the material, wherein the boundary position information is position information of the boundary of a video frame of the material if the material is a video material, and is position information of the boundary of a video frame of a video material associated with the material if the material is not a video material, and the transfer function, when a transfer start request signal requesting the start of transfer of the material is input, starts transfer of the material from the position of the boundary of the video frame based on the boundary position information, and when a transfer stop request signal requesting the stop of transfer of the material being transferred is input, stops transfer after transferring the material up to the position of the boundary of the video frame based on the boundary position information. [Effects of the Invention]

[0014] According to the present invention, it is possible to reduce the possibility that noise caused by switching between materials will be introduced into the reproduced video. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a diagram illustrating an example of the configuration of a material transfer device according to a first embodiment of the present invention. [Figure 2] FIG. 4 is a diagram illustrating an example of an operation flow of the material transfer device according to the first embodiment of the present invention. [Figure 3] FIG. 10 is a diagram illustrating an example of the configuration of a switching system according to a second embodiment of the present invention. [Figure 4] FIG. 10 is a diagram illustrating a connection example of a switching system according to a second embodiment of the present invention. [Figure 5] FIG. 10 is a diagram illustrating an example of the configuration of a switching system according to a second embodiment of the present invention. [Figure 6] FIG. 10 is a diagram illustrating an example of the configuration of a material transfer device according to a second embodiment of the present invention. [Figure 7] FIG. 10 is a diagram illustrating an example of an operation flow of a switching instruction device and a material transfer device according to a second embodiment of the present invention. [Figure 8] FIG. 2 is a diagram illustrating an example of a hardware configuration according to each embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0016] [First embodiment] A first embodiment of the present invention will be described. A specific example of the material transfer device 10 in the first embodiment is a material transfer device 20 in a second embodiment, which will be described later.

[0017] 1 shows an example of the configuration of a material transfer device 10 according to this embodiment. The material transfer device 10 according to this embodiment includes a detection unit 11 and a transfer unit 12.

[0018] The transfer unit 12 transfers the material to a subsequent device.

[0019] The detection unit 11 detects boundary position information indicating the positions of boundaries of video frames related to the material, based on information included in the material.

[0020] The boundary position information is position information of the boundaries of the video frames of the material if the material is a video material, and is position information of the boundaries of the video frames of the video material associated with the material if the material is not a video material.

[0021] When a transfer start request signal is input, the transfer unit 12 starts transferring material from the boundary position of the video frame based on the boundary position information. The transfer start request signal is a signal that requests the start of material transfer. Furthermore, when a transfer stop request signal is input, the transfer unit 12 stops the transfer after transferring the material up to the boundary position of the video frame based on the boundary position information. The transfer stop request signal is a signal that requests the stop of the transfer of material that is being transferred.

[0022] By configuring the material transfer device 10 in this manner, the detection unit 11 detects boundary position information based on information included in the material. When a transfer start request signal is input, the transfer unit 12 starts transferring the material from the boundary position of the video frame based on the boundary position information. Furthermore, when a transfer stop request signal is input, the transfer unit 12 transfers the material up to the boundary position of the video frame based on the boundary position information and then stops the transfer. This allows the material transfer device 10 to start and stop transferring the material at the boundary position of the video frame. This makes it possible to reduce the possibility of noise caused by switching materials being introduced into the playback video.

[0023] Next, FIG. 2 shows an example of the operation flow of the material transfer device 10 of this embodiment.

[0024] The detection unit 11 detects boundary position information based on information included in the material (step S101).

[0025] When a transfer start request signal is input, the transfer unit 12 starts transferring the material from the boundary position of the video frame based on the boundary position information (step S102).Furthermore, when a transfer stop request signal is input, the transfer unit 12 stops transferring the material after transferring the material up to the boundary position of the video frame based on the boundary position information (step S103).

[0026] By operating in this manner, the material transfer device 10 detects boundary position information based on information included in the material. When a transfer start request signal is input, the material transfer device 10 starts transferring the material from the boundary position of the video frame based on the boundary position information. Furthermore, when a transfer stop request signal is input, the material transfer device 10 transfers the material up to the boundary position of the video frame based on the boundary position information and then stops the transfer. This allows the material transfer device 10 to start and stop transferring the material at the boundary position of the video frame. This makes it possible to reduce the possibility of noise caused by switching materials being introduced into the playback video.

[0027] As described above, in the first embodiment of the present invention, the material transfer device 10 includes a detection unit 11 and a transfer unit 12. The detection unit 11 detects boundary position information based on information included in the material. When a transfer start request signal is input, the transfer unit 12 starts transferring the material from the boundary position of the video frame based on the boundary position information. Furthermore, when a transfer stop request signal is input, the transfer unit 12 transfers the material up to the boundary position of the video frame based on the boundary position information and then stops the transfer. This allows the material transfer device 10 to start and stop transferring the material at the boundary position of the video frame. This makes it possible to reduce the possibility of noise caused by switching materials being introduced into the playback image.

[0028] [Second embodiment] Next, a material transfer device 20 according to a second embodiment of the present invention will be described.

[0029] 3 shows an example of the configuration of a switching system 70 including the material transfer device 20 of this embodiment. The switching system 70 of this embodiment includes the material transfer device 20 and a switching instruction device 40. The material transfer device 20 and the switching instruction device 40 are connected to each other. Furthermore, an instruction source device 50 and an output destination device 62 are connected to the switching instruction device 40. Furthermore, an input source device 61-A and an input source device 61-B are connected to the material transfer device 20.

[0030] The input source device 61-A and the input source device 61-B are devices that input materials collected inside and outside the broadcasting station to the material transfer device 20. The output destination device 62 is a device that receives materials in a studio, a master control room, a sub-control room, a material bank, etc.

[0031] In this embodiment, it is assumed that the input source device 61-A inputs the material before switching (hereinafter referred to as the material before switching), and the input source device 61-B inputs the material after switching (hereinafter referred to as the material after switching).

[0032] The materials input by the input source device 61-A and the input source device 61-B may be compliant with SMPTE (Society of Motion Picture and Television Engineers) ST 2022 or SMPTE ST 2110. SMPTE ST 2022 is a technology that maps SDI (Serial Digital Interface) signals directly into IP packets. In SMPTE ST 2022, audio, ancillary data, and video are packetized as a single stream. SMPTE ST 2110 is a technology that transmits video, audio, and ancillary data as separate streams.

[0033] The instruction source device 50 is a device that outputs a switching instruction regarding switching of materials, including information on the pre-switching material and information on the post-switching material. The instruction source device 50 outputs the switching instruction in response to an operation input according to a user's instruction, for example. Alternatively, the instruction source device 50 outputs the switching instruction in response to an input from an automatic program control device or the like.

[0034] In response to a switching instruction from the instruction source device 50, the switching instruction device 40 requests the material transfer device 20 to switch the material input to the switching instruction device 40 from the pre-switching material to the post-switching material. In addition, the switching instruction device 40 transfers the material received from the material transfer device 20 to the output destination device 62. The switching instruction device 40 is, for example, an IP gateway.

[0035] When the switching instruction device 40 receives a switching instruction from the instruction source device 50, it inputs a transfer stop request signal for the pre-switching material to the material transfer device 20. The transfer stop request signal is a signal requesting the stop of transfer. Specifically, the switching instruction includes, as information on the pre-switching material, the multicast group address of the input source device 61-A that transmits the pre-switching material. Then, when the switching instruction device 40 receives a switching instruction from the instruction source device 50, it transmits to the material transfer device 20 a Leave message that includes the multicast group address of the input source device 61-A that transmits the pre-switching material.

[0036] Furthermore, the switching instruction device 40 inputs a transfer start request signal for the post-switching material to the material transfer device 20. The transfer start request signal is a signal that requests the start of transfer. Specifically, the switching instruction includes the multicast group address of the input source device 61-B that will transmit the post-switching material as information on the post-switching material. Then, the material transfer device 20 transmits a Join message that includes the multicast group address of the input source device 61-B that will transmit the post-switching material to the material transfer device 20. Note that the switching instruction device 40 transmits the Join message after transmitting the Leave message.

[0037] In response to a request from the switching instruction device 40, the material transfer device 20 transfers the material input from the input source device to the switching instruction device 40. The material transfer device 20 is, for example, an IP router (L3 switch).

[0038] The switching system 70 may be used, for example, in a line center to distribute materials input to a broadcasting station. The switching system 70 can also be used for material switching not only in a line center but also in various locations within a broadcasting station, such as a master control room or a sub-control room.

[0039] Two or more input source devices and one or more output destination devices can be connected to the switching system, as shown in Fig. 4. Fig. 4 is a diagram showing an example of connections in the switching system of this embodiment.

[0040] In the example shown in Fig. 4, materials are input to switching system 71 from input source device 61-1 to input source device 61-m, where m is the number of input source devices and is an integer equal to or greater than 2. Switching system 71 also switches the materials to be output to each of output destination devices 62-1 to 62-n, where n is the number of output destination devices and is an integer equal to or greater than 1.

[0041] The input source devices 61-1 to 61-m are devices that input materials collected inside and outside the broadcasting station to the switching system 71. The output destination devices 62-1 to 62-n are devices that receive materials in studios, master control rooms, sub-control rooms, material banks, etc.

[0042] 5 shows an example of the configuration of the switching system 71 in the example of FIG. 4. In the example of the configuration of FIG. 5, input materials 83-1 to 83-m are input to the switching system 71 from input source devices 61-1 to 61-m. The switching system 71 also outputs output materials 84-j to output destination devices 62-j (1≦j≦n, j is an integer). The switching system 71 includes a switching instruction device 40-j that outputs the output material 84-j received from the material transfer device 20 to the output destination device 62-j. An instruction source device 50-j is also connected to the switching instruction device 40-j.

[0043] The instruction source device 50-j transmits to the switching instruction device 40-j a switching instruction including information on the pre-switching material and information on the post-switching material for the output material 84-j that the switching instruction device 40-j transfers to the output destination device 62-j. When the switching instruction device 40-j receives a switching instruction from the instruction source device 50-j, the switching instruction device 40-j requests the material transfer device 20 to switch the material input to the switching instruction device 40-j from the pre-switching material to the post-switching material. The material transfer device 20 switches the material input to the switching instruction device 40-j in accordance with the request from the switching instruction device 40-j.

[0044] The configuration example shown in Figure 3 corresponds to the configuration included in the configuration example shown in Figure 5, with the configuration relating to one output destination device (output material) extracted, and also the input source device that inputs the pre-switching material and the input source device that outputs the post-switching material extracted.

[0045] 6 shows an example of the configuration of the material transfer device 20 of this embodiment. The material transfer device 20 of this embodiment includes a detection unit 21 and a transfer unit 22.

[0046] The detection unit 21 detects boundary position information based on information included in the material. The boundary position information indicates the position of the boundary of a video frame related to the material. If the material is a video material, the boundary position information is position information of the boundary of the video frame of the material. If the material is not a video material, the boundary position information is position information of the boundary of the video frame of the video material associated with the material.

[0047] When a material conforms to SMPTE ST 2022, one material can include each of video, audio, and ancillary data. When a material conforms to SMPTE ST 2110, one material can include any of video, audio, and ancillary data. In other words, when broadcast material including video, audio, and ancillary data is IP packetized, material conforming to SMPTE ST 2022 includes video, audio, and ancillary data. Furthermore, when the material conforms to SMPTE ST 2110, material including video, material including audio, and material including ancillary data are generated. Note that the materials generated by IP packetizing one broadcast material are associated with each other. Note that, here, "broadcast material" refers to the material before it is IP packetized.

[0048] When the material contains video, the detection unit 21 detects position information of the boundaries of the video frames of the video of the material. When the material contains video, this means that the material complies with SMPTE ST 2022, or when the material complies with SMPTE ST 2110 and also contains video.

[0049] Furthermore, when a material does not contain video, the detection unit 21 detects position information of boundaries of video frames contained in the video material associated with the material. The video material is a material that contains video. When a material does not contain video, it means that the material conforms to SMPTE ST 2110 and further contains audio or ancillary data. The video material associated with a material is a video material generated by IP packetizing the same broadcast material as the material.

[0050] The detection unit 21 does not detect boundary position information if the material does not contain video and there is no video material associated with the material, i.e., if the original broadcast material does not contain video.

[0051] The detection unit 21 also detects boundary position information based on information included in the material. Specifically, the material is packetized using the Real-time Transport Protocol (RTP). The detection unit 21 detects boundary position information based on a timestamp included in the header of the RTP packet.

[0052] For video-containing material, the timestamps included in the RTP headers of IP packets for one video frame all have the same value. The timestamp changes with the next video frame. The marker bit included in the RTP header of the last packet of each video frame is set to "1." Therefore, for video-containing material, the detection unit 21 detects the position of the video frame boundary based on at least one of the marker bit and the timestamp included in the RTP header. More specifically, the detection unit 21 detects the boundary between a packet whose timestamp has changed from the previous packet and the previous packet after the boundary between a packet whose marker bit is "1" and the next packet as the position of the video frame boundary. The detection unit 21 may detect the position of the video frame boundary based on the timestamp or the marker bit.

[0053] Furthermore, material containing audio or ancillary data is assigned the same timestamp as the associated video material. However, the marker bit remains unchanged. Therefore, in the case of material containing audio or ancillary data, the detection unit 21 detects the position of the video frame boundary based on the timestamp included in the RTP header. More specifically, the detection unit 21 detects the boundary between the packet whose timestamp has changed from the previous packet and the previous packet as the position of the video frame boundary. This allows the detection unit 21 to detect the same location as the video material associated with the material as the position of the video frame boundary. Furthermore, the detection unit 21 can detect the position of the video frame boundary even if the material complies with SMPTE ST 2110.

[0054] When a transfer stop request signal is input, the transfer unit 22 stops the transfer after transferring the material up to the boundary position of the video frame based on the boundary position information. The transfer stop request signal is a signal that requests the stop of the transfer of the material that is being transferred. Furthermore, when a transfer start request signal is input, the transfer of the material starts from the boundary position of the video frame based on the boundary position information. The transfer start request signal is a signal that requests the start of the transfer of the material. This makes it possible to reduce the possibility of noise being introduced into the played back video.

[0055] It is also possible to have the material transfer device 20 transfer both the pre-switching material and the post-switching material, and have the switching instruction device 40 switch the material to be output to the output destination device 62. However, with this method, both the pre-switching material and the post-switching material are transferred by the material transfer device 20. Packet loss due to bandwidth exceedance may occur, potentially causing distortion in the video playback on the playback device to which the material is output. In this embodiment, the material transfer device 20, rather than the switching instruction device 40, detects boundary position information and starts or stops transfer at the position of the video frame boundary. This eliminates the need for the material transfer device 20 to transfer both the pre-switching material and the post-switching material to the switching instruction device 40, thereby reducing the possibility of packet loss due to bandwidth exceedance.

[0056] Note that the detection unit 21 does not detect boundary position information if the material does not contain video and there is no video associated with the material. Therefore, when a transfer stop request signal is input for a material that does not contain video and there is no associated video material, the transfer unit 22 stops transferring the material regardless of the position of the video frame boundary. Also, when a transfer start request signal is input for a material that does not contain video and there is no associated video material, the transfer unit 22 starts transferring the material regardless of the position of the video frame boundary.

[0057] Furthermore, the detection unit 21 may start monitoring the material to be stopped from being transferred when a transfer stop request signal is input. Here, monitoring refers to the detection of boundary position information. Then, when the transfer unit 22 stops the transfer, the detection unit 21 may stop monitoring the material to be stopped from being transferred. Furthermore, the detection unit 21 may start monitoring the material to be started from being transferred when a transfer start request signal is input. Then, when the transfer unit 22 starts the transfer, the detection unit 21 may stop monitoring the material to be started from being transferred. In this way, the transfer unit 22 can reduce the processing load involved in detecting boundary position information.

[0058] If a transfer start request signal (Join message) for the post-switching material is input to the material transfer device 20 before a transfer stop request signal (Leave message) for the pre-switching material, both the pre-switching material and the post-switching material will be transferred by the material transfer device 20. When this happens, packet loss occurs due to exceeding the bandwidth, which may cause distortion in the playback video on the playback device to which the material is output. Therefore, the switching instruction device 40 issues a transfer start request signal for the post-switching material after issuing a transfer stop request signal for the pre-switching material.

[0059] In addition, in order to shorten the time from when the material transfer device 20 stops transferring the pre-switching material to when it starts transferring the post-switching material as much as possible, the switching instruction device 40 transmits a transfer start request signal so that the time from the transfer stop request signal to the transfer start request signal is shortened.

[0060] Furthermore, there is a possibility that packets may be lost while the transfer stop request signal or the transfer start request signal is reaching the material transfer device 20 from the switching instruction device 40. As a countermeasure, the switching instruction device 40 may transmit the transfer stop request signal or the transfer start request signal two or more times. In this case, if the same transfer stop request signal or transfer start request signal is input within a predetermined time, the material transfer device 20 may ignore the second and subsequent requests.

[0061] Furthermore, if a transfer stop request signal is not input during the period from a predetermined time (first time) before the time when the transfer start request signal is input until the time when the transfer start request signal is input, the transfer unit 22 of the material transfer device 20 does not need to start transfer. In this way, even if the transfer stop request signal does not arrive at the material transfer device 20 for some reason, it is possible to prevent a situation in which both the pre-switching material and the post-switching material are transferred by the material transfer device 20.

[0062] Furthermore, the transfer unit 22 of the material transfer device 20 may suspend the start of transfer if a transfer stop request signal is not input during the period from a predetermined time (first time) before the time when the transfer start request signal is input until the transfer start request signal is input. If a transfer stop request signal is input within a predetermined time (second time) after the transfer start request signal is input, the transfer unit 22 may stop the transfer of the material requested by the transfer stop request signal and then start the transfer of the material requested by the transfer start request signal. In this way, even if the order of arrival of the transfer stop request signal and the transfer start request signal at the material transfer device 20 is reversed for some reason, it is possible to prevent a situation in which both the pre-switching material and the post-switching material are transferred by the material transfer device 20.

[0063] The above-described transfer control can be realized by using an L3 switch that supports the P4 (Programming Protocol-Independent Packet Processors) language as the material transfer device 20.

[0064] By configuring the material transfer device 20 in this manner, the detection unit 21 detects boundary position information based on information included in the material. When a transfer start request signal is input, the transfer unit 22 starts transferring the material from the boundary position of the video frame based on the boundary position information. Furthermore, when a transfer stop request signal is input, the transfer unit 22 transfers the material up to the boundary position of the video frame based on the boundary position information and then stops the transfer. This allows the material transfer device 20 to start and stop transferring the material at the boundary position of the video frame. This makes it possible to reduce the possibility of noise caused by switching materials being introduced into the playback image.

[0065] Next, FIG. 7 shows an example of an operation flow of the switching instruction device 40 and the material transfer device 20 of this embodiment.

[0066] When the switching instruction device 40 receives a switching instruction from the instruction source device 50 (step S301), it inputs a transfer stop request signal (Leave message) for the pre-switching material to the material transfer device 20 (step S302).

[0067] When the transfer stop request signal is input, the material transfer device 20 starts monitoring the material (pre-switching material) to be stopped, and detects boundary position information of the target material. Then, the material transfer device 20 waits until it reaches the position of the boundary of the video frame (step S303), and then stops transferring the target material (step S304).

[0068] The switching instruction device 40 also inputs a transfer start request signal (Join message) for the post-switching material to the material transfer device 20 (step S305). Note that the timing of the transfer start request signal can be after step S302.

[0069] When the transfer start request signal is input, the material transfer device 20 starts monitoring the material (post-switching material) to be transferred and detects boundary position information of the material. Then, the material transfer device 20 waits until the position of the boundary of the video frame (step S306), and starts transferring the material (step S307).

[0070] By operating in this manner, the material transfer device 20 detects boundary position information based on information included in the material. When a transfer start request signal is input, the material transfer device 20 starts transferring the material from the boundary position of the video frame based on the boundary position information. Furthermore, when a transfer stop request signal is input, the material transfer device 20 stops the transfer after transferring the material up to the boundary position of the video frame based on the boundary position information. This allows the material transfer device 20 to start and stop transferring the material at the boundary of the video frame. This makes it possible to reduce the possibility of noise caused by switching materials being introduced into the playback video.

[0071] As described above, in the second embodiment of the present invention, the material transfer device 20 includes a detection unit 21 and a transfer unit 22. The detection unit 21 detects boundary position information based on information included in the material. When a transfer start request signal is input, the transfer unit 22 starts transferring the material from the boundary position of the video frame based on the boundary position information. Furthermore, when a transfer stop request signal is input, the transfer unit 22 transfers the material up to the boundary position of the video frame based on the boundary position information and then stops the transfer. This allows the material transfer device 20 to start and stop transferring the material at the boundary position of the video frame. This makes it possible to reduce the possibility of noise caused by switching materials being introduced into the playback image.

[0072] Furthermore, in this embodiment, the material transfer device 20, rather than the switching instruction device 40, detects boundary position information and starts or stops transfer at the boundary positions of the video frames. This eliminates the need for the material transfer device 20 to transfer both the pre-switching material and the post-switching material to the switching instruction device 40, making it possible to reduce the possibility of packet loss due to exceeding the bandwidth.

[0073] Furthermore, the material transfer device 20 of this embodiment detects boundary position information based on information included in the material. Therefore, there is no need to receive information for detecting boundary position information from the input source device or other devices separately from the material.

[0074] Furthermore, the detection unit 21 of the material transfer device 20 of this embodiment starts detecting boundary position information when a transfer stop request signal is input or when a transfer start request signal is input, thereby making it possible to reduce the processing load related to the detection of boundary position information.

[0075] Furthermore, in this embodiment, the material is packetized using RTP, and the information contained in the material includes a timestamp contained in the header of the RTP packet. This allows the material transfer device 20 to stop and start transfer at the boundary of a video frame, even for material that complies with SMPTE ST 2110. As a result, the material transfer device 20 can switch audio and ancillary data at the same timing as switching video.

[0076] Furthermore, if a transfer stop request signal is not input during the period from a first time before the input of the transfer start request signal until the input of the transfer start request signal, the transfer unit 22 of the material transfer device 20 of this embodiment suspends the start of transfer of the material requested in the transfer start request signal. If a transfer stop request signal is input during the period from the input of the transfer start request signal until the second time has elapsed, the transfer unit 22 stops the transfer of the material requested in the transfer stop request signal and then starts the transfer of the material requested in the transfer start request signal. This allows the material transfer device 20 to prevent a situation in which both the pre-switching material and the post-switching material are transferred by the material transfer device 20, even if the order of arrival of the transfer stop request signal and the transfer start request signal at the material transfer device 20 is reversed for some reason.

[0077] Furthermore, the material transfer device 20 of this embodiment is an L3 switch. This makes it possible to realize switching systems such as those shown in Figures 3 and 5 using general-purpose devices. Furthermore, by having the L3 switch start and stop material transfer at the boundary positions of video frames, the material transfer device 20 does not need to transfer both pre-switching material and post-switching material to the switching instruction device 40. This makes it possible to reduce the possibility of packet loss due to exceeding the bandwidth.

[0078] In this embodiment, the subsequent device inputs a transfer start request signal and a transfer stop request signal to the material transfer device, and outputs the material transferred from the material transfer device to the output destination device, which is the output destination of the material. This makes it possible to realize a switching system such as that shown in Figures 3 and 5.

[0079] [Hardware configuration example] An example of the configuration of hardware resources for realizing the material transfer device (10, 20) in each of the above-described embodiments of the present invention using one information processing device (computer) will be described. Note that the material transfer device may be physically or functionally realized using at least two information processing devices. The material transfer device may also be realized as a dedicated device. Also, only some of the functions of the material transfer device may be realized using an information processing device.

[0080] 8 is a diagram illustrating an example of the hardware configuration of an information processing device that can realize the material transfer device according to each embodiment of the present invention. The information processing device 90 includes a communication interface 91, an input / output interface 92, a calculation device 93, a storage device 94, a nonvolatile storage device 95, and a drive device 96.

[0081] For example, the detector 11 and the transfer unit 12 in FIG.

[0082] The communication interface 91 is a communication means for the material transfer device of each embodiment to communicate with an external device via a wired or / and wireless connection. When the material transfer device is realized using at least two information processing devices, the devices may be connected via the communication interface 91 so as to be able to communicate with each other.

[0083] The input / output interface 92 is a man-machine interface including a keyboard as an example of an input device and a display as an output device.

[0084] The arithmetic device 93 is realized by a general-purpose central processing unit (CPU), a microprocessor, or other arithmetic processing device, and a plurality of electric circuits. The arithmetic device 93 can, for example, read various programs stored in a nonvolatile storage device 95 into the storage device 94 and execute processing in accordance with the read programs.

[0085] The storage device 94 is a memory device such as a RAM (Random Access Memory) that can be accessed by the arithmetic device 93, and stores programs, various data, etc. The storage device 94 may be a volatile memory device.

[0086] The nonvolatile storage device 95 is a nonvolatile storage device such as a ROM (Read Only Memory) or a flash memory, and is capable of storing various programs, data, and the like.

[0087] The drive device 96 is, for example, a device that processes reading and writing of data from and to a recording medium 97, which will be described later.

[0088] The recording medium 97 is any recording medium capable of recording data, such as an optical disk, a magneto-optical disk, or a semiconductor flash memory.

[0089] Each embodiment of the present invention may be realized, for example, by configuring a material transfer device using the information processing device 90 illustrated in FIG. 8 and supplying a program capable of realizing the functions described in each of the above embodiments to this material transfer device.

[0090] In this case, the embodiment can be realized by having the arithmetic unit 93 execute a program supplied to the material transfer device. Also, it is possible to configure some, but not all, of the functions of the material transfer device in the information processing unit 90.

[0091] Furthermore, the program may be recorded on a recording medium 97 and stored in the nonvolatile storage device 95 as appropriate when the material transfer device is shipped or when it is in operation. In this case, the program may be supplied by installing it in the material transfer device using an appropriate jig during the manufacturing stage before shipping or during operation. The program may also be supplied by a general procedure such as downloading it from an external source via a communication line such as the Internet.

[0092] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0093] (Appendix 1) a transfer unit that transfers the material to a subsequent device; a detection unit that detects boundary position information indicating a position of a boundary of a video frame related to the material based on information included in the material; Equipped with When the material is a video material, the boundary position information is position information of a boundary of a video frame of the material, and when the material is not a video material, the boundary position information is position information of a boundary of a video frame of a video material associated with the material, The transfer unit when a transfer start request signal which is a signal requesting the start of transfer of the material is input, starting transfer of the material from the position of the boundary of the video frame based on the boundary position information; When a transfer stop request signal is input, which is a signal requesting the stop of the transfer of the material being transferred, the transfer is stopped after the material has been transferred up to the boundary position of the video frame based on the boundary position information. Material transfer device.

[0094] (Appendix 2) The detection unit starts detecting the boundary position information when the transfer stop request signal is input or when the transfer start request signal is input. 10. The material transfer device of claim 1.

[0095] (Appendix 3) The material is packetized using RTP (Real-time Transport Protocol), The information contained in the material includes a timestamp contained in the header of the RTP packet. 10. The material transfer device of claim 1 or 2.

[0096] (Appendix 4) The transfer unit If the transfer stop request signal is not input during the period from a first time before the time when the transfer start request signal is input until the time when the transfer start request signal is input, suspending the start of transfer of the material that is the target of the request in the transfer start request signal; When the transfer stop request signal is input during the time period from when the transfer start request signal is input until a second time period has elapsed, the transfer of the material requested by the transfer stop request signal is stopped, and then the transfer of the material requested by the transfer start request signal is started. 4. A material transfer device according to any one of claims 1 to 3.

[0097] (Appendix 5) The material transfer device is an L3 switch. 5. A material transfer device according to any one of appendix 1 to appendix 4.

[0098] (Appendix 6) The latter device inputs the transfer start request signal and the transfer stop request signal to the material transfer device, and outputs the material transferred by the transfer unit to an output destination device that is an output destination of the material. 6. A material transfer device according to any one of appendix 1 to appendix 5.

[0099] (Appendix 7) Transfer the material to the downstream device, detecting boundary position information indicating the position of a boundary of a video frame related to the material based on information included in the material; When the material is a video material, the boundary position information is position information of a boundary of a video frame of the material, and when the material is not a video material, the boundary position information is position information of a boundary of a video frame of a video material associated with the material, when a transfer start request signal which is a signal requesting the start of transfer of the material is input, starting transfer of the material from the position of the boundary of the video frame based on the boundary position information; When a transfer stop request signal is input, which is a signal requesting the stop of the transfer of the material being transferred, the transfer is stopped after the material has been transferred up to the boundary position of the video frame based on the boundary position information. Material transfer method.

[0100] (Appendix 8) When the transfer stop request signal is input or when the transfer start request signal is input, detection of the boundary position information is started. 10. A material transfer method as described in Appendix 7.

[0101] (Appendix 9) The material is packetized using RTP, The information contained in the material includes a timestamp contained in the header of the RTP packet. 10. A material transfer method as set forth in Appendix 7 or Appendix 8.

[0102] (Appendix 10) If the transfer stop request signal is not input during the period from a first time before the time when the transfer start request signal is input until the time when the transfer start request signal is input, suspending the start of transfer of the material that is the target of the request in the transfer start request signal; When the transfer stop request signal is input during the time period from when the transfer start request signal is input until a second time period has elapsed, the transfer of the material requested by the transfer stop request signal is stopped, and then the transfer of the material requested by the transfer start request signal is started. 10. A material transfer method according to any one of appendices 7 to 9.

[0103] (Appendix 11) The device is an L3 switch 11. A material transfer method according to any one of claims 7 to 10.

[0104] (Appendix 12) The subsequent device inputs the transfer start request signal and the transfer stop request signal to the subsequent device, and outputs the material transferred from the subsequent device to an output destination device that is an output destination of the material. 12. A material transfer method according to any one of claims 7 to 11.

[0105] (Appendix 13) On the computer, A transfer function to transfer materials to downstream devices; a detection function for detecting boundary position information indicating the position of a boundary of a video frame related to the material based on information included in the material; To achieve this, When the material is a video material, the boundary position information is position information of a boundary of a video frame of the material, and when the material is not a video material, the boundary position information is position information of a boundary of a video frame of a video material associated with the material, The forwarding function is when a transfer start request signal which is a signal requesting the start of transfer of the material is input, starting transfer of the material from the position of the boundary of the video frame based on the boundary position information; When a transfer stop request signal is input, which is a signal requesting the stop of the transfer of the material being transferred, the transfer is stopped after the material has been transferred up to the boundary position of the video frame based on the boundary position information. Material transfer program.

[0106] (Appendix 14) The detection function starts detecting the boundary position information when the transfer stop request signal is input or when the transfer start request signal is input. 13. The material transfer program described in Appendix 13.

[0107] (Appendix 15) The material is packetized using RTP, The information contained in the material includes a timestamp contained in the header of the RTP packet. 15. A material transfer program as set forth in Appendix 13 or Appendix 14.

[0108] (Appendix 16) the transfer function suspends the start of transfer of the material requested in the transfer start request signal when the transfer stop request signal is not input during a period from a first time before the time when the transfer start request signal is input until the transfer start request signal is input; When the transfer stop request signal is input during the time period from when the transfer start request signal is input until a second time period has elapsed, the transfer of the material requested by the transfer stop request signal is stopped, and then the transfer of the material requested by the transfer start request signal is started. 16. A material transfer program according to any one of appendices 13 to 15.

[0109] (Appendix 17) The device is an L3 switch 17. A material transfer program according to any one of appendices 13 to 16.

[0110] (Appendix 18) The subsequent device inputs the transfer start request signal and the transfer stop request signal to the subsequent device, and outputs the material transferred from the subsequent device to an output destination device that is an output destination of the material. 18. A material transfer program according to any one of appendices 13 to 17.

[0111] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0112] 10, 20 Material Transfer Device 11, 21 Detection unit 12, 22 Transfer section 40 Switching indicator 50 Instruction source device 61 Input source device 62 Output device 70 Switching System 90 Information processing equipment 91 Communication Interface 92 Input / Output Interface 93 Arithmetic unit 94 Storage device 95 Non-volatile storage devices 96 Drive Device 97 Recording Media

Claims

1. a transfer unit that transfers the material to a subsequent device; a detection unit that detects boundary position information indicating a position of a boundary of a video frame related to the material based on information included in the material; Equipped with When the material is a video material, the boundary position information is position information of a boundary of a video frame of the material, and when the material is not a video material, the boundary position information is position information of a boundary of a video frame of a video material associated with the material, The transfer unit when a transfer start request signal which is a signal requesting the start of transfer of the material is input, starting transfer of the material from the position of the boundary of the video frame based on the boundary position information; when a transfer stop request signal is input, which is a signal requesting the stop of transfer of the material being transferred, the transfer is stopped after the material has been transferred up to the boundary position of the video frame based on the boundary position information; The transfer unit If the transfer stop request signal is not input during the period from a first time before the time when the transfer start request signal is input until the time when the transfer start request signal is input, suspending the start of transfer of the material that is the target of the request in the transfer start request signal; When the transfer stop request signal is input during the time period from when the transfer start request signal is input until a second time period has elapsed, the transfer of the material requested by the transfer stop request signal is stopped, and then the transfer of the material requested by the transfer start request signal is started. Material transfer device.

2. The detection unit starts detecting the boundary position information when the transfer stop request signal is input or when the transfer start request signal is input.

2. The material transfer device according to claim 1.

3. The material is packetized using the Real-time Transport Protocol (RTP), The information contained in the material includes a timestamp contained in the header of the RTP packet.

3. The material transfer device according to claim 1 or 2.

4. The material transfer device is an L3 switch.

4. The material transfer device according to claim 1.

5. The latter device inputs the transfer start request signal and the transfer stop request signal to the material transfer device, and outputs the material transferred by the transfer unit to an output destination device that is an output destination of the material.

5. A material transfer device according to claim 1.

6. A material transfer device, Transfer the material to the downstream device, detecting boundary position information indicating the position of a boundary of a video frame related to the material based on information included in the material; When the material is a video material, the boundary position information is position information of a boundary of a video frame of the material, and when the material is not a video material, the boundary position information is position information of a boundary of a video frame of a video material associated with the material, when a transfer start request signal which is a signal requesting the start of transfer of the material is input, starting transfer of the material from the position of the boundary of the video frame based on the boundary position information; when a transfer stop request signal is input, which is a signal requesting the stop of transfer of the material being transferred, the transfer is stopped after the material has been transferred up to the boundary position of the video frame based on the boundary position information; In transferring the material to the downstream device, If the transfer stop request signal is not input during the period from a first time before the time when the transfer start request signal is input until the time when the transfer start request signal is input, suspending the start of transfer of the material that is the target of the request in the transfer start request signal; When the transfer stop request signal is input during the time period from when the transfer start request signal is input until a second time period has elapsed, the transfer of the material requested by the transfer stop request signal is stopped, and then the transfer of the material requested by the transfer start request signal is started. Material transfer method.

7. The material transfer device, When the transfer stop request signal is input or when the transfer start request signal is input, detection of the boundary position information is started. The material transfer method according to claim 6.

8. The material is packetized in RTP, The information contained in the material includes a timestamp contained in the header of the RTP packet.

8. A material transfer method according to claim 6 or 7.

9. On the computer, A transfer function to transfer materials to downstream devices; a detection function for detecting boundary position information indicating the position of a boundary of a video frame related to the material based on information included in the material; To achieve this, When the material is a video material, the boundary position information is position information of a boundary of a video frame of the material, and when the material is not a video material, the boundary position information is position information of a boundary of a video frame of a video material associated with the material, The forwarding function is when a transfer start request signal which is a signal requesting the start of transfer of the material is input, starting transfer of the material from the position of the boundary of the video frame based on the boundary position information; when a transfer stop request signal is input, which is a signal requesting the stop of transfer of the material being transferred, the transfer is stopped after the material has been transferred up to the boundary position of the video frame based on the boundary position information; The forwarding function is If the transfer stop request signal is not input during the period from a first time before the time when the transfer start request signal is input until the time when the transfer start request signal is input, suspending the start of transfer of the material that is the target of the request in the transfer start request signal; When the transfer stop request signal is input during the time period from when the transfer start request signal is input until a second time period has elapsed, the transfer of the material requested by the transfer stop request signal is stopped, and then the transfer of the material requested by the transfer start request signal is started. Material transfer program.

Citation Information

Patent Citations

  • Digital data recording device and reproducing device

    JP2003284002A

  • IP broadcast receiver, IP broadcast reception control method, program, and recording medium

    JP2009225353A

  • Receiver and receiving method

    JP2010062690A

  • Method and apparatus for simultaneously switching audio stream and video stream

    WO2020173165A1