Communication system, information processing terminal, and information processing system

Abstract

The present application relates to a communication system, an information processing terminal, and an information processing system. The communication system is an information processing terminal that transmits data received from an application to an information processing device, and has a processor configured to determine whether a transmission rate of the application is reduced, and in a case where it is determined that the transmission rate of the application is reduced, to cause data received after the transmission rate of the application is reduced to be transmitted preferentially to data received before the transmission rate of the application is reduced and not transmitted.

Description

Technical Field

[0001] This disclosure relates to communication systems, information processing terminals, and information processing systems. Background Technology

[0002] In the technology described in Japanese Patent Application Publication No. 2009-5193, when the transmitting unit temporarily stops transmitting frames, frames that have been accumulated in the transmitting buffer for a predetermined retention time or longer are discarded. This avoids the transmission of frames that cannot keep up with real-time processing.

[0003] However, when sending data from the sending terminal to the receiving terminal, in addition to the delay caused by data lingering in the buffer, the transmission delay between the sending terminal and the receiving terminal is also affected.

[0004] Furthermore, the technology in Japanese Patent Application Publication No. 2009-5193 does not consider the impact on applications caused by dropped frames. Therefore, even if latency is kept low, it sometimes fails to improve the user experience for applications.

[0005] For example, if an application transmits data in a frequency band larger than the bandwidth between the sending and receiving terminals, frames are periodically discarded according to the method described in Japanese Patent Application Publication No. 2009-5193. If the receiving terminal cannot decode the data transmitted by the application from the received frames (the frames that were not discarded), the transmission of data from the application will fail even if the delay is eliminated. This results in the user being unable to experience the application's functionality. Summary of the Invention

[0006] This disclosure was made in view of the above circumstances, and its purpose is to provide a communication system, an information processing terminal, and an information processing system that can improve the user experience for applications.

[0007] The communication system disclosed herein includes: an information processing terminal for transmitting data received from an application; and an information processing device for performing processing corresponding to the data received from the information processing terminal. The communication system includes a first processor configured to determine whether the transmission rate of the application has decreased, and if it is determined that the transmission rate of the application has decreased, to prioritize the transmission of data received after the transmission rate of the application has decreased over untransmitted data received before the transmission rate of the application has decreased. The information processing device includes a second processor configured to receive the data from the information processing terminal after the transmission rate of the application has decreased, and to perform processing corresponding to the received data.

[0008] The information processing terminal disclosed herein is an information processing terminal that transmits data received from an application to an information processing device. It includes a processor configured to determine whether the transmission rate of the application has decreased, and if it is determined that the transmission rate of the application has decreased, to transmit data received after the transmission rate of the application has decreased before the transmission rate of the application has decreased, prioritizing the transmission of untransmitted data received before the transmission rate of the application has decreased.

[0009] In the information processing terminal disclosed herein, the processor determines that the sending rate of the application has decreased when the receiving rate of the information processing terminal decreases.

[0010] In the information processing terminal disclosed herein, when the processor receives a notification of reduced transmission rate from the application, it determines that the transmission rate of the application has decreased.

[0011] In the information processing terminal disclosed herein, when the receiving rate of the information processing terminal exceeds the frequency band of the network between the information processing terminal and the information processing device, the processor determines that the sending rate of the application has decreased.

[0012] The information processing system disclosed herein includes an information processing terminal and a terminal device with the application installed. When the application receives line congestion information from the information processing terminal, it stops transmitting at the current transmission rate and sends a transmission rate reduction notification to the information processing terminal to reduce the transmission rate and restart transmission.

[0013] According to this disclosure, a communication system, an information processing terminal, and an information processing system can be realized that can improve the user experience for applications. Attached Figure Description

[0014] The features, advantages, and technical and industrial significance of typical embodiments of the present invention will now be described with reference to the accompanying drawings, in which the same reference numerals denote the same elements, wherein:

[0015] Figure 1 This is a block diagram illustrating the structure of a communication system that includes vehicles and servers.

[0016] Figure 2 It means Figure 1 The timing diagram for the communication system shown is a processing diagram.

[0017] Figure 3 This is a flowchart illustrating the process executed by the DCM involved in Example 1.

[0018] Figure 4 This is a flowchart illustrating the process executed by the DCM involved in Example 2.

[0019] Figure 5 This is a flowchart illustrating the process executed by the DCM involved in Example 3.

[0020] Figure 6 It is a flowchart representing the processing performed by the ECU.

[0021] Figure 7 This is a timing diagram showing the processing of a communication system that includes the information processing terminal involved in Embodiment 2.

[0022] Figure 8 This is a timing diagram representing the processing of the communication system in the comparative example. Detailed Implementation

[0023] Referring to the accompanying drawings, the communication system, information processing terminal, and information processing system involved in the embodiments of this disclosure will be described. The constituent elements in the following embodiments include elements that can be easily replaced by those skilled in the art, or elements that are substantially the same.

[0024] Implementation Method 1

[0025] Communication system

[0026] Figure 1 This is a block diagram illustrating the structure of a communication system that includes vehicles and servers. Figure 1 The communication system shown includes a vehicle 1 as an information processing system and a server 2 as an information processing device. Here, the communication between vehicle 1 and server 2 is used as an example for explanation, but the communication system can include any terminal and can be applied to all types of communication.

[0027] Both vehicle 1 and server 2 are equipped with communication capabilities, enabling them to communicate with each other and exchange various information via network N. This network N may consist of public line networks such as the Internet or mobile phone networks. Network N may also include wireless communications such as WiFi (registered trademark, Wireless Fidelity) and BLE (Bluetooth Low Energy), or satellite lines via satellite.

[0028] Vehicle 1 includes a DCM (Data Communication Module) 11 as an information processing terminal and an ECU (Electronic Control Unit) 12 as a terminal device. The following description illustrates an example of vehicle 1 equipped with both DCM 11 and ECU 12, but ECU 12 may also perform the functions of DCM 11.

[0029] The DCM11 comprises a microcomputer as its main components, including a first processor such as a CPU (Central Processing Unit) and memory such as ROM (Read Only Memory) and RAM (Random Access Memory). The DCM11 exchanges information with the server 2 via communication through network N. The DCM11 sends data received from the application of ECU12 to the server 2.

[0030] ECU12 is mainly composed of a microcomputer, including a processor such as a CPU and a memory such as ROM and RAM. Applications (hereinafter referred to as "applications" or "Apps") such as video conferencing applications are installed on ECU12.

[0031] Server 2 is implemented, for example, by a general-purpose computer such as a workstation or personal computer, which includes a second processor consisting of a CPU and a memory consisting of ROM, RAM and the like. If server 2 receives data from vehicle 1, it sends an acknowledgment (hereinafter also referred to as "Ack").

[0032] Communication system processing

[0033] Figure 2 It means Figure 1 The timing diagram for the communication system shown is a processing diagram. Figure 2 The horizontal axis is the time axis. Furthermore, from... Figure 2 Starting from the top, the data represents, in sequence, the data sent by the application (App) to DCM11, the data received by DCM12 from the application, the data sent by DCM11 to server 2, and the data received by server 2 from DCM12. Data is sent in data packets, with the area of ​​each packet corresponding to its data volume. Sequence numbers are assigned to each data packet in chronological order.

[0034] First, transmission begins when the application's transmission rate is high. The delay D1 from when the application receives the data packet with sequence number 1 from server 2 via DCM11 is 0.1s.

[0035] Then, suppose that when the data packet with sequence number 5 is sent from DCM11 to server 2, the line speed of network N decreases to 1 / 4. Therefore, as time passes, the delay accumulates.

[0036] Here, the application installed on ECU12 detects network congestion in N via delivery acknowledgments (Ack) from server 2. When the application sends a data packet with sequence number 12, it receives a delivery acknowledgment with sequence number 3. Similarly, when the application sends a data packet with sequence number 13, it receives a delivery acknowledgment with sequence number 4. However, when the application sends a data packet with sequence number 14, it fails to receive the next delivery acknowledgment. At this point, the application detects network congestion in N. Furthermore, if the application notifies DCM11 of the detected congestion, DCM11 temporarily suspends data transmission while waiting for the congestion to be cleared. The delay D2 until the data packet with sequence number 14, before the transmission restarts, is received by server 2 is 1 second.

[0037] Then, when the application sends the data packet with sequence number 17, it receives the delivery confirmation with sequence number 5. Thus, the application calculates the receiving rate of server 2 based on the time elapsed between the delivery confirmations for sequence number 4 and sequence number 5. Furthermore, when the application sends the data packet with sequence number 19, it sends the receiving rate of server 2 to DCM 11. DCM 11 then restarts data transmission starting with the data packet with sequence number 15 at a transmission rate corresponding to the receiving rate of server 2.

[0038] Furthermore, since the network congestion state of N does not clear up after the specified time, the application begins sending data at a reduced rate starting with the data packet of sequence number 39. Therefore, because the receiving rate of DCM11 decreases, DCM11 determines that the application's sending rate has decreased. At this time, DCM11 prioritizes data received after the application's sending rate decreases over unsent data received before the application's sending rate decreases. Specifically, DCM11 deletes data packets with sequence numbers 20 to 38 and begins sending data at a reduced rate starting with the data packet of sequence number 39. As a result, stable communication is achieved at a low sending rate starting with the data packet of sequence number 39. The delay D3 until the data packet of sequence number 19, before the reduced sending rate of DCM11 is received by server 2, is 1.5s. Additionally, the communication quality degradation period T1 until the data packet of sequence number 39 is received by server 2 is 1.9s.

[0039] Figure 8 This is a timing diagram illustrating the processing of the comparative example communication system. In the comparative example communication system, after the DCM starts transmitting by reducing the transmission rate starting with the data packet with sequence number 39, it also transmits data packets with smaller sequence numbers sequentially. In this case, the delay D11 until the data packet with sequence number 38, before the application reduces the transmission rate, is received by the server is 3 seconds. In addition, the communication quality degradation period T11 until the data packet with sequence number 43 is received by the server is 4.5 seconds.

[0040] DCM processing

[0041] Next, the process of prioritizing the transmission of subsequently received data when DCM11 determines that the application's transmission rate has decreased will be explained in detail.

[0042] Example 1

[0043] Figure 3 This is a flowchart illustrating the process executed by the DCM involved in Embodiment 1. For example... Figure 3 As shown, DCM11 infers the application's transmission rate (S1). Specifically, DCM11 infers the application's transmission rate based on DCM11's reception rate.

[0044] Next, DCM11 determines whether the estimated application's transmission rate has decreased by more than a threshold (S2) compared to the previously estimated application's transmission rate. Specifically, if DCM11's receiving rate decreases, DCM11 determines that the application's transmission rate has decreased. Alternatively, DCM11 may also determine that the application's transmission rate has decreased if DCM11's receiving rate exceeds the frequency band of network N between DCM11 and server 2.

[0045] If DCM11 determines that the application's transmission rate has not decreased (S2: No), the series of processes ends.

[0046] On the other hand, if DCM11 determines that the application's sending rate has decreased (S2: Yes), DCM11 determines whether the data packet with the decreased sending rate of the application has been received (S3).

[0047] If DCM11 determines that it has not received the data packet after the application's transmission rate has decreased (S3: No), the series of processes ends.

[0048] On the other hand, if DCM11 determines that a data packet has been received after the application's transmission rate has decreased (S3: Yes), it proceeds to S4. In S4, DCM11 prioritizes the transmission of data received from the application after the application's transmission rate has decreased over untransmitted data received before the application's transmission rate decreased. Specifically, as follows... Figure 2 As shown, DCM11 will delete any untransmitted data received before the application's transmission rate decreases, and will transmit the data received from the application after the transmission rate decreases. The untransmitted data received before the application's transmission rate decreases consists of data packets with sequence numbers 20 to 38. The data received from the application after the application's transmission rate decreases consists of data packets with sequence number 39.

[0049] Then, server 2 receives the data from DCM11 after the application's transmission rate has been reduced, and performs the corresponding processing for the received data. Since server 2 can receive all data after sequence number 39, communication is successful, and it can perform the corresponding processing for the received data. As a result, the user can obtain the experience corresponding to the application.

[0050] According to Embodiment 1 described above, when DCM11 determines that the application's transmission rate has decreased, it prioritizes sending data received from the application after the transmission rate has decreased. This prevents unsent data packets from remaining in DCM11 and allows newly received data packets after the application's transmission rate has decreased to be sent to server 2. As a result, since data packets after the application's transmission rate has decreased are not discarded, communication is successful, and the user can experience the application's functionality. In other words, according to Embodiment 1, the user experience of the application can be improved.

[0051] Furthermore, in Example 1, an example was described in which the DCM11 determines that the application's transmission rate has decreased when the DCM11's receiving rate decreases, but this is not limited to this. For example, the DCM11 receives a sequence number from the application that has received a delivery confirmation. Moreover, the DCM11 can compare this sequence number with the sequence number of the latest data packet received by the DCM11, and if their difference decreases, it determines that the application's transmission rate has decreased.

[0052] Additionally, in Example 1, an example was described where DCM11 deleted untransmitted data received before the application's transmission rate decreased, but this is not the only example. DCM11 can also cause untransmitted data received before the application's transmission rate decreased to be backed up from the waiting transmission queue to other storage areas.

[0053] Furthermore, when it is determined that the application's transmission rate has decreased, the DCM11 can also generate a higher-priority transmission queue, separate from the waiting transmission queue that stores untransmitted data received before the application's transmission rate decreased. Moreover, the DCM11 can also store data received from the application after the application's transmission rate decreased in this generated queue.

[0054] Additionally, when wide-area networks such as satellite lines or WiFi lines (different from cellular lines) can be used in addition to cellular lines, the DCM11 may sometimes determine that the application's transmission rate has decreased. In this case, the DCM11 can prioritize transmitting data received from the application after the application's transmission rate has decreased, using the line with lower latency. Moreover, the DCM11 can also transmit untransmitted data received before the application's transmission rate decreased, using the line with higher latency.

[0055] Example 2

[0056] Figure 4 This is a flowchart illustrating the process executed by the DCM involved in Example 2. For example... Figure 4 As shown, DCM11 receives a notification from the application that the sending rate has been reduced (S11). The notification of the reduced sending rate includes, for example, flow identification information such as IP address, port, and protocol, the reduced sending rate, the time when the sending rate started to decrease, and identification information (sequence number, etc.) of the data packet for which the sending rate started to decrease.

[0057] Therefore, DCM11 determines that the application's transmission rate has decreased. Then, DCM11 deletes the unsent data received before the application's transmission rate decreased, and transmits the data received from the application after the application's transmission rate decreased (S12).

[0058] As in Example 2, DCM11 can determine that the application's transmission rate has decreased when it receives a notification of a decrease in transmission rate from the application.

[0059] Example 3

[0060] First, let's explain the processing in DCM11. Figure 5 This is a flowchart illustrating the process executed by the DCM as described in Example 3. For example... Figure 5 As shown, DCM11 detects congestion on the line (network N) between DCM11 and server 2 (S21). Specifically, if the receiving rate of DCM11 exceeds the frequency band of network N between DCM11 and server 2, DCM11 determines that network N is congested. Additionally, DCM11 can also measure the delay of the data transmitted by DCM11, and determine congestion if the delay increases over time. Furthermore, DCM11 can also predict future line conditions based on the location of vehicle 1, the wireless area map, and base station congestion information, thus predicting the occurrence of congestion.

[0061] Next, DCM11 sends line congestion information to the application (S22).

[0062] Next, the processing in ECU12 will be explained. Figure 6 This is a flowchart representing the processes performed by the ECU. For example... Figure 6 As shown, the application installed on ECU12 receives line congestion information from DCM11 (S31).

[0063] Therefore, the application stops sending at the current sending rate (S32).

[0064] Furthermore, the application sends a notification to DCM11 to reduce the transmission rate (S33).

[0065] Then, the application reduces the sending rate and restarts sending (S34).

[0066] Subsequently, DCM11 was executed in the same manner as in Example 2. Figure 4 The process is as shown. Specifically, if DCM11 receives a notification from the application that the application's transmission rate has decreased, it determines that the application's transmission rate has decreased. Then, DCM11 deletes any unsent data received before the application's transmission rate decreased and transmits the data received from the application after the application's transmission rate decreased.

[0067] As in Example 3, DCM11 can detect congestion in network N and output a signal from DCM12 to the application to reduce the transmission rate.

[0068] Implementation Method 2

[0069] Figure 7 This is a timing diagram illustrating the processing of a communication system including the information processing terminal described in Embodiment 2. In this communication system, in addition to cellular lines, wide-area lines such as satellite lines and secondary lines such as WiFi lines (different from cellular lines) can be utilized. Furthermore, since the configuration of Embodiment 2 can be compared with... Figure 1 The configuration of Embodiment 1 shown is the same, so the description is omitted.

[0070] The line speed of network N decreases to 1 / 4 starting from the data packet with sequence number 5. Since the processing performed on it is the same as in Implementation Method 1, the description is omitted. Subsequently, because the congestion state of network N exceeds a predetermined time, the application begins to transmit by reducing its transmission rate starting from the data packet with sequence number 39. Therefore, because the receiving rate of DCM11 decreases, DCM11 determines that the application's transmission rate has decreased. At this time, DCM11 prioritizes the transmission of data received after the application's transmission rate decreases over untransmitted data received before the application's transmission rate decreases. Specifically, DCM11 prioritizes the transmission of data received after the application's transmission rate decreases from the secondary line, and continues to transmit untransmitted data received before the application's transmission rate decreases. The communication quality degradation period T2 until the data packet with sequence number 39 is received is 1.8 seconds.

[0071] As in Implementation 2, when multiple lines can be used, DCM11 can prioritize sending data received after the application's transmission rate is reduced from the secondary line.

[0072] Those skilled in the art can readily derive further effects and modifications. Therefore, the invention is not limited to the specific, detailed, and representative embodiments shown and described above. Thus, various modifications can be made without departing from the spirit or scope of the general inventive concept as defined by the technical solutions and their equivalents.

Claims

1. A communication system, wherein, have: The information processing terminal sends data received from the application; and The information processing device performs processing corresponding to the data received from the information processing terminal. The information processing terminal includes a first processor configured to determine whether the application's transmission rate has decreased, and if it is determined that the application's transmission rate has decreased, to prioritize the transmission of data received after the application's transmission rate has decreased over untransmitted data received before the application's transmission rate has decreased. The information processing device includes a second processor configured to receive data from the information processing terminal after the application's transmission rate has been reduced, and to perform processing corresponding to the received data.

2. An information processing terminal that sends data received from an application to an information processing device, wherein, The information processing terminal includes a processor configured to determine whether the application's transmission rate has decreased, and if the application's transmission rate has decreased, to prioritize the transmission of data received after the application's transmission rate has decreased over untransmitted data received before the application's transmission rate has decreased.

3. The information processing terminal according to claim 2, wherein, When the receiving rate of the information processing terminal decreases, the processor determines that the sending rate of the application has decreased.

4. The information processing terminal according to claim 2, wherein, When the processor receives a notification of reduced transmission rate from the application, it determines that the application's transmission rate has decreased.

5. The information processing terminal according to claim 2, wherein, If the processor determines that the sending rate of the application has decreased when the receiving rate of the information processing terminal exceeds the frequency band of the network between the information processing terminal and the information processing device.

6. An information processing system, wherein, The device comprises the information processing terminal as described in claim 4 and a terminal device with the application installed. When the application receives line congestion information from the information processing terminal, it stops sending at the current sending rate, sends a sending rate reduction notification to the information processing terminal, and resumes sending at a reduced sending rate.

Images