Transmission device, reception device, communication system, transmission method, and program

The system addresses the challenge of seamless data format and channel switching by using propagation identification information to synchronize frames across channels, ensuring uninterrupted real-time data transmission.

WO2024247047A1PCT designated stage expired Publication Date: 2024-12-05NT T INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/019947
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-29
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Conventional communication systems struggle to seamlessly switch both communication channels and data formats when switching from one channel to another, leading to interruptions in real-time stream data transmission, such as video, due to differences in data formats and lack of frame synchronization across channels.

Method used

The system employs a transmitting device that duplicates and encodes data streams on multiple channels, using propagation identification information to synchronize frames and switch data formats seamlessly by adding identification information to packets, allowing for integration of frames across different communication paths.

Benefits of technology

Enables seamless switching of data formats and communication channels, maintaining continuous data transmission without interruptions by ensuring frame synchronization and coordination across different communication paths.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023019947_05122024_PF_FP_ABST
    Figure JP2023019947_05122024_PF_FP_ABST
Patent Text Reader

Abstract

According to the present invention, a transmission device in a communication system including the transmission device and a reception device comprises: a packetization unit that generates a first packet to which is assigned first identification information capable of identifying transmission data and that generates a second packet to which is assigned second identification information capable of identifying the transmission data; and a communication unit that transmits the first packet to the reception device via a first communication path, and transmits the second packet to the reception device via a second communication path.
Need to check novelty before this filing date? Find Prior Art

Description

Transmitting device, receiving device, communication system, transmitting method, and program

[0001] The present invention relates to a communication system for performing data communication.

[0002] A use case in which real-time stream data such as video is encoded on the sending side, sent to the receiving side via a communication channel, and decoded on the receiving side for use is becoming widespread.

[0003] Since various networks can be used as communication paths, such as a wireless LAN and an IOWN (registered trademark) APN, there may be cases where the communication path for transmitting data needs to be switched from one path to another. For example, the communication path may need to be switched from a wireless LAN to an IOWN (registered trademark) APN.

[0004] RFC 8684 TCP Extensions for Multipath Operation with Multiple Addresses https: / / www.rfc-editor.org / rfc / rfc8684.pdfMultipath Extensions for QUIC (MP-QUIC) https: / / datatracker.ietf.org / doc / draft-deconinck-quic-multipath /

[0005] In the case of switching communication paths as described above, the appropriate data format may differ before and after the switching of the communication paths. For example, H.264 may be appropriate as a data format for one communication path, while RAW may be appropriate as a data format for the communication path after the switching.

[0006] For this reason, there is a demand for seamless switching of the data format along with the communication path when switching the communication path.

[0007] It is possible to switch communication paths by using MPTCP disclosed in Non-Patent Document 1 or MPQUIC disclosed in Non-Patent Document 2. However, these conventional technologies cannot seamlessly switch data formats in addition to communication paths.

[0008] The present invention has been made in consideration of the above points, and aims to provide a technology that enables seamless switching of data formats when switching a communication path for transmitting data from one communication path to another.

[0009] According to the disclosed technology, there is provided a transmitting device in a communication system including a transmitting device and a receiving device, the transmitting device including: a packetization unit that generates a first packet to which first identification information that can identify transmitted data is assigned, and generates a second packet to which second identification information that can identify the transmitted data is assigned; and a communication unit that transmits the first packet to the receiving device via a first communication path, and transmits the second packet to the receiving device via a second communication path.

[0010] The disclosed technology provides a technology that enables seamless switching of data formats when switching a communication path for transmitting data from one communication path to another.

[0011] 1 is a diagram illustrating switching of communication paths. FIG. 2 is a diagram illustrating a problem. FIG. 3 is a diagram illustrating an example configuration of a communication system. FIG. 4 is a diagram illustrating an example configuration of a transmitting device 100 and a receiving device 200. FIG. 5 is a diagram illustrating the operation of a communication system. FIG. 6 is a sequence diagram illustrating the operation of a communication system. FIG. 7 is a diagram illustrating redundancy. FIG. 8 is a diagram illustrating load balancing. FIG. 9 is a diagram illustrating example 1 of propagation of information that identifies a frame. FIG. 10 is a diagram illustrating example 2 of propagation of information that identifies a frame. FIG. 11 is a diagram illustrating example 3 of propagation of information that identifies a frame. FIG. 12 is a diagram illustrating an example hardware configuration of a device.

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The embodiment described below is merely an example, and the embodiment to which the present invention is applied is not limited to the following embodiment.

[0013] In the following description, it is assumed that the object to be transmitted is video stream data, but the technology according to the present invention can also be applied to data other than video stream data.

[0014] (Regarding the Problems) First, the problems of the technology according to the present embodiment will be described in more detail. The content of the description of the problems below is not publicly known technology.

[0015] As mentioned above, in a use case where real-time stream data such as video is encoded on the sending side, sent to the receiving side via a communication channel, and decoded and used on the receiving side, there may be cases where the communication channel needs to be switched from one channel to another. Since the appropriate data format (e.g., from H.264 to RAW) may differ before and after the communication channel switch, it is necessary to seamlessly switch the data format along with the communication channel.

[0016] However, if the data formats themselves are different before and after the switch, it is difficult to switch seamlessly, which means that streaming must be interrupted when switching the data formats.

[0017] FIG. 1 shows an image of switching the communication path from communication path 1 to communication path 2 when transmitting data from the sending side to the receiving side.

[0018] 1 shows an example of how seamless switching of communication paths is achieved by duplicating the data stream on the transmitting side and performing encoding and decoding on each of communication paths 1 and 2. However, while conventional technologies (for example, MPTCP in Non-Patent Document 1 and MPQUIC in Non-Patent Document 2) can switch communication paths, they cannot seamlessly switch data formats.

[0019] More specifically, in the conventional technology, the receiving side is unable to grasp the order of the frames when integrating frames from communication path 1 and communication path 2, and is therefore unable to properly integrate them. The reasons for this include, for example, the following (1) to (3):

[0020] (1) MJPEG or RAW video does not contain information such as frame numbers or time stamps in the data format.

[0021] (2) The decoded data is not necessarily the same between communication channel 1 and communication channel 2, so there is no point in comparing the decoded data.

[0022] (3) A timestamp is attached to the RTP (Real-time Transport Protocol) packets generated by packetizing the encoded data. However, since the timestamp is stamped at the time of encoding and the initial value of the timestamp of the RTP packet is recommended to be random, the timestamp cannot be used at the time of integration on the receiving side.

[0023] In addition to the above (1) to (3), conventional technologies have no means of obtaining information about network events such as changes in communication paths and of linking them together, so data formats cannot be switched when communication paths are switched.

[0024] 2 shows an example of how time stamps are stamped on the sending side during encoding. On the receiving side, for example, it is not possible to determine what kind of time stamp is attached to the data on communication path 2 that corresponds to the data attached with time stamp 1 on communication path 1.

[0025] (Outline of the embodiment) In order to solve the above problem and realize seamless switching of data formats when switching communication paths, in this embodiment, information for identifying frames in fields defined by communication protocols, such as RTP timestamps (this information is called propagation identification information), is used to propagate information for synchronizing frames before encoding and after decoding from the transmitting side to the receiving side.

[0026] In this embodiment, it is assumed that while data transmission is being performed on a certain communication path (hereinafter referred to as communication path 1), another communication path (hereinafter referred to as communication path 2) is added. On the transmitting side, the addition of communication path 2 is used as a trigger to determine whether packetization is required on communication path 1, and the stream is switched by thinning out packets to be transmitted as necessary.

[0027] (Configuration example of communication system / device) An example configuration of a communication system according to this embodiment is shown in Fig. 3. As shown in Fig. 3, this communication system has a transmitting device 100 and a receiving device 200, and is capable of communicating between the transmitting device 100 and the receiving device 200.

[0028] 4 shows an example of the functional configuration of each of the transmitting device 100 and the receiving device 200. As shown in FIG. 4, the transmitting device 100 includes a replicating unit 110, an encoding unit 120, a packetizing unit 130, and a communication unit 140.

[0029] The duplicating unit 110 generates multiple pieces of the same transmission data by duplicating (copying) the transmission data. In this embodiment, two pieces of transmission data are generated. Since this embodiment targets video stream transmission, the duplicating unit 110 duplicates each frame. In other words, a frame is an example of transmission data.

[0030] The encoding unit 120 encodes the transmission data to generate encoded data (for example, H.264 encoded data).

[0031] The packetization unit 130 generates packets (e.g., RTP packets) from the encoded data. Note that there are cases where the transmission data is packetized without being encoded. The communication unit 140 transmits the packets. Details of the processing for solving the problem will be described later.

[0032] The receiving device 200 includes an integration unit 210 , a decoding unit 220 , a depacketization unit 230 , and a communication unit 240 .

[0033] The communication unit 240 receives packets. The depacketization unit 230 obtains encoded data from the packets. The decoding unit 220 decodes the encoded data to generate frames. The integrating unit 210 integrates frames obtained from packets on communication path 1 and frames obtained from packets on communication path 2.

[0034] Note that both the transmitting device 100 and the receiving device 200 may be physically configured as a single device (such as a computer) or may be configured as multiple devices. For example, the transmitting device 100 may include a packetizing unit 130 and a communication unit 140, and a copying unit 110 and the like may be provided externally. Also, for example, the receiving device 200 may include an integration unit 210, and a decoding unit and the like may be provided externally.

[0035] (Example of Operation of Communication System) An example of operation of the transmitting device 100 and receiving device 200 having the above configuration will be described with reference to FIG.

[0036] After the frame identifier is assigned, the association between the frame and the assigned frame identifier is maintained until the frame is packetized. For example, when frame identifier A is assigned to frame A, transmitting device 100 recognizes that frame identifier A is associated with frame A intended for communication path 1 and frame A intended for communication path 2.

[0037] The encoding unit 120 encodes each of the frames intended for communication channel 1 and the frames intended for communication channel 2. After encoding, the packetizing unit 130 packetizes each of the encoded data intended for communication channel 1 and the encoded data intended for communication channel 2. At this time, the packetizing unit 130 assigns propagation identification information, which is information capable of identifying a frame, to the packet in a format suitable for a communication protocol corresponding to the packetization. The propagation identification information may be the same as the frame identifier described above, or may be information different from the frame identifier described above.

[0038] The packetizer 130, in response to an addition event of the communication path 2, determines whether packetization for the communication path 1 is necessary, and switches the stream by thinning out packets for the communication path 1 as necessary. Fig. 5 shows a state before complete switching is performed (a state in which packets are transmitted over each of the communication paths 1 and 2). Note that thinning out packets may mean not packetizing the encoded data, or may mean discarding the packetized packets.

[0039] The communication unit 140 transmits packets to both the communication path 1 and the communication path 2 .

[0040] In the receiving device 200, the depacketizing unit 230 depackets the packets received from the communication path 1 and the packets received from the communication path 2, respectively, to obtain the encoded data.

[0041] When depacketizing, the depacketizer 230 acquires (extracts) the propagation identification information attached to the packets. After the propagation identification information is extracted from the packets, the association between the frames and the data (encoded data, etc.) is maintained on both the communication path 1 side and the communication path 2 side by the propagation identification information until the integration process.

[0042] The decoding unit 220 decodes the coded data of the communication channel 1 and the coded data of the communication channel 2 to obtain frames.

[0043] By using the propagation identification information of communication path 1 and the propagation identification information of communication path 2, integrating unit 210 can identify frames of communication path 2 that are the same as frames of communication path 1, and can therefore integrate frames of communication path 1 and communication path 2. For example, if frames A, C, and D are obtained as frames of communication path 1 and frames A, B, C, and D are obtained as frames of communication path 2, integrating unit 210 outputs frames A, B, C, and D as integrated frames. In this example, integration means that when there are overlapping frames, one of the frames is discarded.

[0044] (Sequence Example) Next, an example of a processing sequence of the communication system in this embodiment will be described with reference to the sequence diagram of Fig. 6. Here, an example in which the data to be transmitted is a video stream will be described.

[0045] In S101, a video stream is transmitted from the transmitting device 100 to the receiving device 200 via a communication path 1 (for example, wirelessly).

[0046] In S102, a communication path 2 (for example, via a wired line) is established between the transmitting device 100 and the receiving device 200. Upon establishment of the communication path 2, in S103, the transmitting device 100 prepares for encoding.

[0047] In S104, for example, the encoding unit 120 notifies the receiving device 200 of the encoding information via the communication unit 140. This encoding information includes information on fields to be referenced in the packet as necessary. In S105, a response is returned from the receiving device 200 to the transmitting device 100.

[0048] In S106, the transmitting device 100 transmits the video streams via each of the communication paths 1 and 2 by duplicating frames as described above.

[0049] In S107, for example, the packetizer 120 determines whether or not to thin out packets on the communication path 1 or the communication path 2. In relation to packet thinning, there are the following three cases in this embodiment.

[0050] Case 1 is a case where switching is performed. In this case, the transmitting device 100 stops the video stream on communication path 1 in S201. Specifically, for example, the packetizer 130 stops packetizing the encoded data for communication path 1 and continues packetizing the encoded data for communication path 2. As a result, the video stream is transmitted on communication path 2 (S202).

[0051] Case 2 is a case where redundancy is implemented. In this case, the transmitting device 100 transmits video streams via both communication path 1 and communication path 2 (S301).

[0052] Case 3 is a case where load balancing is performed. In this case, the transmitting device 100 determines (decides) the load balancing ratio in S401. For example, it determines that half of the video stream traffic is transmitted over communication path 1 and the other half is transmitted over communication path 2. In S402, the transmitting device 100 transmits the video stream alternately over communication path 1 and communication path 2, for example.

[0053] The processing contents of redundancy and load balancing will be explained in more detail below.

[0054] (Regarding redundancy) First, redundancy will be described with reference to Fig. 7. In redundancy, the same video stream is sent over communication path 1 and communication path 2 without packet thinning for switching. Below, the same processes as those described in Fig. 5 will be omitted or only an outline will be described.

[0055] In the transmitting device 100, after the encoding unit 120 performs encoding, the packetizing unit 130 packetizes each of the encoded data for the communication path 1 and the encoded data for the communication path 2. At this time, the packetizing unit 130 assigns a frame identifier to the packet in a format suitable for the communication protocol corresponding to the packetization.

[0056] The packetizer 130 does not thin out packets on either the communication path 1 or the communication path 2. The communication unit 140 transmits packets (packets constituting a video stream) to each of the communication path 1 and the communication path 2.

[0057] In receiving device 200, integrating unit 210 integrates frames from communication path 1 and frames from communication path 2. When frames A, B, C, and D are obtained as frames from communication path 1 and frames A, B, C, and D are obtained as frames from communication path 2, integrating unit 210 outputs frames A, B, C, and D as integrated frames.

[0058] (Load Balancing) Next, load balancing will be described with reference to Fig. 8. In load balancing, communication load is balanced not only by switching communication paths but also by selectively using multiple communication paths. Below, processing that is the same as the processing described in Fig. 5 will be omitted or only an outline will be described.

[0059] In the transmitting device 100, after encoding by the encoding unit 120, the packetizing unit 130 performs thinning on each of the encoded data for communication path 1 and the encoded data for communication path 2 in accordance with the load balancing ratio, and then packetizes the data. At this time, the packetizing unit 130 assigns a frame identifier to the packet in a format suitable for the communication protocol corresponding to the packetization. The communication unit 140 transmits packets (packets constituting a video stream) to each of communication path 1 and communication path 2.

[0060] For example, consider a case where 50% of packets are transmitted via communication path 1 and 50% via communication path 2. The packetizer 130 knows the association between the coded data for communication path 1 and the coded data for communication path 2 based on the frame identifier.

[0061] For example, for coded data A, coded data B, coded data C, and coded data D, which are coded data for communication channel 1, the packetization unit 130 packetizes coded data A and coded data C to generate packets A and C.

[0062] In addition, the packetization unit 130 packetizes the encoded data B and D, which are encoded data A, encoded data B, encoded data C, and encoded data D intended for communication channel 2, to generate packets B and D.

[0063] In the above example, packets A and C are transmitted over communication path 1, and packets B and D are transmitted over communication path 2.

[0064] In receiving device 200, integrating unit 210 integrates frames from communication path 1 and communication path 2. When frames A and C are obtained as frames from communication path 1 and frames B and D are obtained as frames from communication path 2, integrating unit 210 outputs frames A, B, C, and D as integrated frames.

[0065] Hereinafter, examples 1 to 3 of propagation of information for identifying a frame (propagation identification information) will be described.

[0066] (Example 1 of Propagation of Information Identifying Frames) Example 1 will be described with reference to FIG. 9. Example 1 is an example in which packetization for communication path 1 and communication path 2 is performed using the same protocol (e.g., RTP). In Example 1, the same value is entered in packets associated with communication path 1 and communication path 2 as the value of the field that serves as propagation identification information. Below, the same processing as that described in FIG. 5 will be omitted or only an outline will be described.

[0067] In transmitting device 100, after encoding by encoding unit 120, packetizing unit 130 packetizes each of the encoded data for communication path 1 and the encoded data for communication path 2. At this time, packetizing unit 130 enters the same value in the RTP timestamp field for packets associated with communication path 1 and communication path 2. Packets are transmitted from communication unit 140 to each of communication path 1 and communication path 2.

[0068] In the receiving device 200, the depacketizing unit 230 depackets the packets received from the communication path 1 and the packets received from the communication path 2, respectively, to obtain the encoded data.

[0069] When depacketizing, the depacketizer 230 extracts the timestamp (timestamp value) attached to the packet. After the timestamp is extracted from the packet, the association between the timestamp and the frame corresponding to the packet is maintained until the integration process.

[0070] The decoding unit 220 decodes the coded data of the communication channel 1 and the coded data of the communication channel 2 to obtain frames.

[0071] By using the timestamp of a frame on communication path 1 and the timestamp of a frame on communication path 2, the integrating unit 210 can identify a frame on communication path 2 that is the same as a frame on communication path 1, and can therefore integrate frames on communication path 1 and communication path 2. For example, if frame A (timestamp 1), frame C (timestamp 3), and frame D (timestamp 4) are obtained as frames on communication path 1, and frame A (timestamp 1), frame B (timestamp 2), frame C (timestamp 3), and frame D (timestamp 4) are obtained as frames on communication path 2, the integrating unit 210 outputs frames A, frame B, frame C, and frame D as the integrated frames.

[0072] (Example 2 of Propagation of Information Identifying Frames) Example 2 will be described with reference to Fig. 10. In Example 2, the protocol used for packetization differs between communication path 1 and communication path 2. For example, packetization is performed using RTP on communication path 1, and packetization is performed using MPEG2-TS on communication path 2.

[0073] In Example 2, it is assumed that a common value can be input to a certain field of a packet on communication path 1 and a certain field of a packet on communication path 2.

[0074] In Example 2, the transmitting device 100 notifies the receiving device 200 in advance via the communication unit 140 which field of each communication protocol will be used to propagate information (propagation identification information) that identifies the frame, and the same value is entered into that field. In Example 2 shown in Figure 10, the MPEG2-TS DTS (Decode Time Stamp) is used as the propagation identification information. Below, processes that are the same as those described in Figure 5 will be omitted or only an outline will be described.

[0075] In the transmitting device 100, after encoding by the encoding unit 120, the packetizing unit 130 packetizes the encoded data for communication path 1 using RTP, and packetizes the encoded data for communication path 2 using MPEG2-TS. When packetizing the encoded data for communication path 2, an MPEG2-TS DTS is added to the packet. This DTS is used as propagation identification information.

[0076] The packetizer 130 assigns the same value as the DTS assigned to the packet for communication path 2 to the RTP extension header of the packet for communication path 1 associated with the packet. The communication unit 140 transmits packets to each of communication paths 1 and 2.

[0077] In the receiving device 200, the depacketizing unit 230 depackets the packets received from the communication path 1 and the packets received from the communication path 2, respectively, to obtain the encoded data.

[0078] The depacketization unit 230 has information indicating "for communication path 1, refer to the RTP extension header, and for communication path 2, refer to the DTS of MPEG2-TS" as information on the field to be referenced, which has been notified by the transmitting device 100.

[0079] When depacketizing, the depacketizer 230 extracts the DTS from the RTP extension header of the packet received from communication path 1, and extracts the DTS from the packet (MPEG2-TS) received from communication path 2. After the DTS is extracted from the packet, the association between the DTS and the frame corresponding to the packet is maintained until the integration process.

[0080] The decoding unit 220 decodes the coded data of the communication channel 1 and the coded data of the communication channel 2 to obtain frames.

[0081] By using the DTS corresponding to the frame on communication path 1 and the DTS corresponding to the frame on communication path 2, the integrator 210 can identify a frame on communication path 2 that is the same as the frame on communication path 1, and can integrate the frames on communication path 1 and communication path 2. For example, if frame A (DTS1), frame C (DTS3), and frame D (DTS4) are obtained as frames on communication path 1, and frame A (DTS1), frame B (DTS2), frame C (DTS3), and frame D (DTS4) are obtained as frames on communication path 2, the integrator 210 outputs frames A, B, C, and D as the integrated frames.

[0082] (Example 3 of Propagation of Information Identifying a Frame) Example 3 will be described with reference to Fig. 11. In Example 3, the protocol used for packetization differs between communication path 1 and communication path 2. For example, packetization is performed using RTP on communication path 1, and packetization is performed using MMT (MPEG Media Transport) on communication path 2.

[0083] In Example 3, it is assumed that a common value cannot be input to the field of a packet on communication path 1 and the field of a packet on communication path 2.

[0084] In Example 3, the transmitting device 100 notifies the receiving device 200 in advance via the communication unit 140 of information regarding which field of each communication protocol will be used to propagate information for identifying a frame (propagation identification information), as well as information regarding the difference in value, etc. In Fig. 11, the difference between the propagation identification information of communication path 1 and the propagation identification information of communication path 2, which are associated with the same frame, is indicated as "Delta."

[0085] In example 3 shown in Fig. 11, as propagation identification information, an RTP timestamp is used for communication path 1, and an MMT PTS (Presentation Time Stamp) is used for communication path 2. Hereinafter, the same processes as those described in Fig. 5 will be omitted or only an outline will be described.

[0086] In the transmitting device 100, after the encoding by the encoding unit 120, the packetizing unit 130 performs packetizing of the encoded data for the communication channel 1 using RTP, and performs packetizing of the encoded data for the communication channel 2 using MMT.

[0087] When packetizing encoded data for communication path 1, an RTP timestamp is added to the packet, and when packetizing encoded data for communication path 2, an MMT PTS is added to the packet. These pieces of information are used as propagation identification information.

[0088] That is, for packets of communication path 1 and communication path 2 that are associated via a frame identifier, packetizer 130 assigns an RTP timestamp to the packet of communication path 1 and an MMT PTS to the packet of communication path 2 so that the difference between the RTP timestamp and the MMT PTS becomes Delta. Packets are transmitted from communication unit 140 to each of communication path 1 and communication path 2.

[0089] In the receiving device 200, the depacketizing unit 230 depackets the packets received from the communication path 1 and the packets received from the communication path 2, respectively, to obtain the encoded data.

[0090] The depacketizer 230 has information indicating "for communication path 1, refer to the RTP timestamp, and for communication path 2, refer to the MMT PTS" as information on the field to be referenced that has been notified by the transmitter 100. The integrator 210 also has Delta that has been notified by the transmitter 100.

[0091] When depacketizing, the depacketizing unit 230 extracts the RTP timestamp from the packet received from communication path 1, and extracts the MMT PTS from the packet received from communication path 2. After the propagation identification information is extracted from the packet, the association between the propagation identification information and the frame corresponding to the packet is maintained until the integration process.

[0092] The decoding unit 220 decodes the coded data of the communication channel 1 and the coded data of the communication channel 2 to obtain frames.

[0093] By using the RTP timestamp corresponding to the frame on communication path 1, the MMT PTS corresponding to the frame on communication path 2, and Delta, the integration unit 210 can identify a frame on communication path 2 that is the same as a frame on communication path 1, and therefore can integrate frames on communication path 1 and communication path 2.

[0094] For example, if Delta is 12345, the integration unit 210 determines that a frame on communication path 2, which has an MMT PTS equal to the RTP timestamp corresponding to the frame on communication path 1 plus 12345, is the same frame as the frame on communication path 1.

[0095] For example, if frame A (timestamp 1), frame C (timestamp 3), and frame D (timestamp 4) are obtained as frames for communication path 1, and frame A (PTS = timestamp 1 + 12345), frame B (PTS = timestamp 2 + 12345), frame C (PTS = timestamp 3 + 12345), and frame D (PTS = timestamp 4 + 12345) are obtained as frames for communication path 2, the integration unit 210 outputs frames A, B, C, and D as the integrated frames.

[0096] (Hardware Configuration Example) Any of the devices described in this embodiment (transmitting device 100, receiving device 200) can be realized, for example, by causing a computer to execute a program. This computer may be a physical computer or a virtual machine on the cloud.

[0097] That is, the device can be realized by executing a program corresponding to the processing performed by the device using hardware resources such as a CPU and memory built into a computer. The program can be recorded on a computer-readable recording medium (such as a portable memory) and stored or distributed. The program can also be provided via a network such as the Internet or email.

[0098] Fig. 12 is a diagram showing an example of the hardware configuration of the computer. The computer in Fig. 12 includes a drive device 1000, an auxiliary storage device 1002, a memory device 1003, a CPU 1004, an interface device 1005, a display device 1006, an input device 1007, an output device 1008, and the like, all of which are interconnected via a bus B. The computer may further include a GPU.

[0099] The program that realizes the processing on the computer is provided by a recording medium 1001, such as a CD-ROM or a memory card. When the recording medium 1001 storing the program is set in the drive device 1000, the program is installed from the recording medium 1001 to the auxiliary storage device 1002 via the drive device 1000. However, the program does not necessarily have to be installed from the recording medium 1001, but may be downloaded from another computer via a network. The auxiliary storage device 1002 stores the installed program as well as necessary files, data, etc.

[0100] The memory device 1003 reads and stores a program from the auxiliary storage device 1002 when an instruction to start the program is received. The CPU 1004 realizes functions related to the device in accordance with the program stored in the memory device 1003. The interface device 1005 is used as an interface for connecting to a network, etc. The display device 1006 displays a GUI (Graphical User Interface) or the like according to the program. The input device 1007 is composed of a keyboard, mouse, buttons, a touch panel, etc., and is used to input various operation instructions. The output device 1008 outputs the results of calculations.

[0101] (Summary, effects, etc. of the embodiment) As described above, the technology described in the present embodiment makes it possible to seamlessly switch the data format when switching the communication path for transmitting data from one communication path to another.

[0102] The following additional notes are provided regarding the above-described embodiments.

[0103] <Additional Notes> (Additional Item 1) A transmission device in a communication system including a transmission device and a receiving device, the transmission device including: a memory; and at least one processor connected to the memory, wherein the processor generates a first packet assigned with first identification information capable of identifying transmission data, generates a second packet assigned with second identification information capable of identifying the transmission data, transmits the first packet to the receiving device via a first communication path, and transmits the second packet to the receiving device via a second communication path. (Additional Item 2) The transmission device according to Additional Item 1, wherein the processor generates the first packet by packetizing data in a first data format obtained from the transmission data, and generates the second packet by packetizing data in a second data format obtained from the transmission data. (Additional Item 3) The transmission device according to Additional Item 1 or 2, wherein the processor thins out the first packet or the second packet. (Supplementary Item 4) A receiving device in a communication system including a transmitting device and a receiving device, the receiving device including: a memory; and at least one processor connected to the memory, wherein the processor receives from the transmitting device, via a first communication path, a first packet to which first identification information capable of identifying transmission data is assigned, and receives from the transmitting device, via a second communication path, a second packet to which second identification information capable of identifying the transmission data is assigned, and performs integration processing on the transmission data acquired from the first packet and the transmission data acquired from the second packet based on the first identification information and the second identification information. (Supplementary Item 5) The receiving device according to Supplementary Item 4, wherein the processor performs integration processing on the transmission data acquired from the first packet and the transmission data acquired from the second packet based on the first identification information, the second identification information, and difference information between the first identification information and the second identification information received from the transmitting device. (Supplementary Item 6) A communication system including the transmitting device according to any one of Supplementary Items 1 to 3 and the receiving device according to Supplementary Item 4 or 5.(Supplementary Item 7) A transmission method executed by a transmission device in a communication system including a transmission device and a reception device, the transmission method comprising: generating a first packet having first identification information that allows transmission data to be identified, generating a second packet having second identification information that allows the transmission data to be identified, transmitting the first packet to the reception device via a first communication path, and transmitting the second packet to the reception device via a second communication path. (Supplementary Item 8) A non-transitory storage medium storing a program for causing a computer to function as each unit in the transmission device described in any one of Supplementary Items 1 to 3, or as each unit in the reception device described in Supplementary Item 4 or 5.

[0104] Although the present embodiment has been described above, the present invention is not limited to such a specific embodiment, and various modifications and changes are possible within the scope of the gist of the present invention described in the claims.

[0105] REFERENCE SIGNS LIST 100 Transmitting device 110 Duplicating unit 120 Encoding unit 130 Packetizing unit 140 Communication unit 200 Receiving device 210 Integrating unit 220 Decoding unit 230 Depacketizing unit 240 Communication unit 1000 Drive device 1001 Recording medium 1002 Auxiliary storage device 1003 Memory device 1004 CPU 1005 Interface device 1006 Display device 1007 Input device 1008 Output device

Claims

1. A transmitting device in a communication system including a transmitting device and a receiving device, the transmitting device comprising: a packetization unit that generates a first packet to which first identification information capable of identifying transmitted data is assigned, and generates a second packet to which second identification information capable of identifying the transmitted data is assigned; and a communication unit that transmits the first packet to the receiving device via a first communication path, and transmits the second packet to the receiving device via a second communication path.

2. The transmitting device according to claim 1, wherein the packetization unit generates the first packet by packetizing data in a first data format obtained from the transmission data, and generates the second packet by packetizing data in a second data format obtained from the transmission data.

3. The transmitting device according to claim 1, wherein the packetizing unit performs thinning on the first packets or the second packets.

4. A receiving device in a communication system having a transmitting device and a receiving device, comprising: a communication unit that receives a first packet having first identification information capable of identifying transmitted data from the transmitting device via a first communication path, and receives a second packet having second identification information capable of identifying the transmitted data from the transmitting device via a second communication path; and an integration unit that performs integration processing on the transmitted data obtained from the first packet and the transmitted data obtained from the second packet based on the first identification information and the second identification information.

5. The receiving device described in claim 4, wherein the integration unit performs integration processing on the transmission data obtained from the first packet and the transmission data obtained from the second packet based on the first identification information, the second identification information, and difference information between the first identification information and the second identification information received from the transmitting device.

6. A communication system comprising a transmitting device according to any one of claims 1 to 3 and a receiving device according to claim 4 or 5.

7. A transmission method executed by a transmitting device in a communication system including a transmitting device and a receiving device, the method comprising: generating a first packet having first identification information capable of identifying transmission data; generating a second packet having second identification information capable of identifying the transmission data; transmitting the first packet to the receiving device via a first communication path; and transmitting the second packet to the receiving device via a second communication path.

8. A program for causing a computer to function as each unit in the transmitting device according to any one of claims 1 to 3, or as each unit in the receiving device according to claim 4 or 5.

Citation Information

Patent Citations

  • Information processing device, information processing method, computer program, and information processing system

    JP2022038416A

  • Communication apparatus generating and eliminating redundant data packets

    JP2023031246A