Transmit / receive compatibility determination device, transmit / receive compatibility determination method, and program

Abstract

Provided is a transmission / reception correspondence determination system comprising: a time / position information recording unit configured to record information indicating a relationship between the position and time of a moving device; a transmitted information recording unit configured to record an identifier of information transmitted from the device and the transmission time of the information in association with each other; an observation data recording unit configured to record an identifier of information, which has been transmitted from the device and received by an apparatus via a network, in the apparatus and data observed in relation to the information in association with each other; and a transmission / reception correspondence determination unit configured to determine that the transmission time associated with the same identifier as an identifier recorded in the observation data recording unit among the identifiers recorded in the transmitted information recording unit and the position of the device at the transmission time correspond to the data associated with the identifier. Accordingly, it is possible to ascertain the correspondence relationship between data observed by an information reception side and matters related to transmission.

Description

[Technical Field]

[0001] The present invention relates to a device for determining whether a device is compatible with sending and receiving, a method for determining whether a device is compatible with sending and receiving, and a program. [Background technology]

[0002] Device-side information acquired by sensors such as cameras and LiDAR (Light Detection and Ranging) is transmitted via the network to an information processing platform at the edge or in the cloud. This information is then processed and modified for use by users such as humans or AI. In addition, this information is utilized, and as needed, the information processing platform transmits signals to control the device or sends alert notifications, resulting in downstream information transmission. This type of edge / cloud computing is being used in various fields.

[0003] Among the diverse range of sensor data, video has a wide range of applications for humans and AI, and is often treated as information that can be intuitively viewed. On the other hand, video is relatively large in volume, and transmitting and receiving it over a network is costly. Therefore, video streaming methods for continuously transmitting high-quality, real-time information at low cost, and metrics for evaluating the video quality of the received results, are being widely considered, mainly in the field of video distribution.

[0004] Typically, when measuring the quality of the network itself involved in sending and receiving information, test data or test packets are sent and received between information sending and receiving devices over the network (see Figure 1 (1)). In addition, at the application layer, for example, video is transmitted using various video streaming methods (video transmission methods), and how the received video quality, its continuity, and transmission / reception costs change is analyzed. Based on the results of the analysis, it is possible to evaluate whether the use of each video streaming method was appropriate and to assess the merits of each video transmission method (see Figure 1 (2)). [Prior art documents] [Non-patent literature]

[0005] [Non-Patent Document 1] "The Secret of Internet 'Time'", Nikkei CrossTech, [online], [Accessed June 21, 2022], Internet<URL:https: / / xtech.nikkei.com / it / article / COLUMN / 20081015 / 316880 / > [Non-Patent Document 2] Hara et al., "Development of a communication delay measurement tool using GPS time synchronization mechanism," Distributed Systems / Internet Operation Technology Symposium, 1999. [Overview of the Initiative] [Problems that the invention aims to solve]

[0006] For example, when creating a heatmap (=dynamic map of network quality) that takes spatiotemporal variations into account for the quality of the network used by a device moving on public roads, such as an autonomous vehicle, to send and receive information (hereinafter referred to as "NW quality"), it is necessary to measure the NW quality on the public road where the autonomous vehicle is traveling. However, measuring NW quality by stopping on a public road for a certain period of time would occupy the public road, making it impractical. Therefore, it is necessary to measure NW quality while the vehicle is moving on the public road.

[0007] However, with conventional technology, when measuring network quality while moving, there was a problem in that it was not precisely possible to determine which transmission event (when and where the information was transmitted) the data observed at the information receiving end (e.g., network quality) corresponds to.

[0008] The present invention has been made in view of the above points, and aims to enable the understanding of the correspondence between data observed at the information receiving end and transmitted events. [Means for solving the problem]

[0009] Therefore, in order to solve the above problem, the transmission / reception compatibility determination system is a moving device By measuring the position at each time interval, the device Shows the relationship between location and time. time / position A time / location information recording unit configured to record information, and a recorder that records the identifier of the information transmitted from the device in association with the transmission time of the information. It is configured in such a way, but the location information of the device is not recorded. A transmission information recording unit configured in such a way, and an observation data recording unit configured to record the identifier of the information transmitted from the device via the network in association with the data observed with respect to the information, and the data recorded by the transmission information recording unit Information Among the identifiers, those recorded by the observation data recording unit Information The transmission time associated with the same identifier as the identifier, Of the time / location information for each of the aforementioned time periods The time of transmission The aforementioned time / location information including the same time The location of the device in the said identifier is associated with the said identifier Observed It includes a transmission / reception correspondence determination unit configured to determine whether the data corresponds to the data. [Effects of the Invention]

[0010] This makes it possible to understand the correspondence between the data observed at the receiving end of the information and the transmitted events. [Brief explanation of the drawing]

[0011] [Figure 1] This figure shows a method for evaluating network quality and video streaming methods. [Figure 2] This figure shows an example of the configuration of the information processing system in the first embodiment. [Figure 3] This figure shows an example of the hardware configuration of the transmission / reception compatibility determination device 10 in the first embodiment. [Figure 4] This figure shows an example of the functional configuration of the information processing system in the first embodiment. [Figure 5] This is a sequence diagram illustrating an example of a processing procedure performed in the information processing system according to the first embodiment. [Figure 6] This figure shows an example of the structure of the generated information recorded in the information storage unit 18. [Figure 7] This figure shows an example of the configuration of the transmission information recorded in the information storage unit 18. [Figure 8] This figure shows an example of the configuration of the time / location information of a device recorded in the information storage unit 18. [Figure 9] This figure shows an example of the configuration of reception quality information recorded in the information storage unit 18. [Figure 10] This figure shows an example of the configuration of the reception result information recorded in the information storage unit 18. [Figure 11] This flowchart illustrates an example of the processing procedure for determining the correspondence between information transmission events and network quality in the first embodiment. [Figure 12] This diagram shows a situation where multiple transmission events are associated with a single network quality. [Figure 13] This figure shows an example of recording network quality in relation to transmission time and transmission location. [Figure 14] This flowchart illustrates an example of the processing procedure for determining the correspondence between information transmission events and video-level reception results in the first embodiment. [Figure 15] This figure shows an example of recording video-level reception results in association with transmission time and transmission location. [Figure 16] This figure shows an example of the functional configuration of the information processing system in the second embodiment. [Figure 17] This is a sequence diagram illustrating an example of a processing procedure performed in the information processing system according to the second embodiment. [Figure 18] This flowchart illustrates an example of the processing procedure for determining the correspondence between information transmission events and network quality in the second embodiment. [Figure 19] This flowchart illustrates an example of the processing procedure for determining the correspondence between information transmission events and video-level reception results in the second embodiment. [Modes for carrying out the invention]

[0012] Embodiments of the present invention will be described below with reference to the drawings. Figure 2 is a diagram showing an example of the configuration of an information processing system in the first embodiment. In Figure 2, the information processing system includes a device 20, an information utilization device 30, and a transmission / reception compatibility determination device 10.

[0013] Device 20 and information utilization device 30 are interconnected via a network such as the Internet, which includes wireless and wired sections. Device 20 and information utilization device 30 are also connected to the transmission / reception compatibility determination device 10 via the network.

[0014] Device 20 is a mobile device. For example, device 20 may be an autonomous vehicle or other mobile object. Device 20 may be self-propelled or may be moved by a person or another mobile object. While moving, device 20 transmits information acquired from sensors, etc., to the information utilization device 30 via a network. In this embodiment, the information transmitted from device 20 to the information utilization device 30 is assumed to be video. However, this embodiment may also be applied when the information to be transmitted is other than video.

[0015] The information utilization device 30 is one or more computers that receive information transmitted from device 20 and utilize (make use of) said information.

[0016] The transmission / reception correspondence determination device 10 is one or more computers that determine the correspondence between the data observed with respect to the information received by the information utilization device 30 and the location and time transmitted by the device 20.

[0017] The information processing system may include two or more devices 20 and two or more information utilization devices 30. The correspondence between the devices 20 and the information utilization devices 30 may be one-to-one, many-to-one, one-to-many, or many-to-many.

[0018] Figure 3 shows an example of the hardware configuration of the transmit / receive compatibility determination device 10 in the first embodiment. The transmit / receive compatibility determination device 10 in Figure 3 includes a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, and an interface device 105, etc., which are all interconnected by bus B.

[0019] The program that enables processing in the transmission / reception compatibility determination device 10 is provided on a recording medium 101 such as a CD-ROM. When the recording medium 101 containing the program is set in the drive device 100, the program is installed from the recording medium 101 to the auxiliary storage device 102 via the drive device 100. However, the program does not necessarily have to be installed from the recording medium 101; it may also be downloaded from another computer via a network. The auxiliary storage device 102 stores the installed program as well as necessary files and data.

[0020] When a program startup command is received, the memory device 103 reads the program from the auxiliary storage device 102 and stores it. The CPU 104 executes the functions related to the transmit / receive compatibility determination device 10 according to the program stored in the memory device 103. The interface device 105 is used as an interface for connecting to the network.

[0021] Device 20 and information utilization device 30 may also have hardware configurations as shown in Figure 3.

[0022] Figure 4 shows an example of the functional configuration of an information processing system in the first embodiment. In Figure 4, device 20 has an information generation unit 21 and an information transmission unit 22. Each of these units is realized by processing that one or more programs installed on device 20 cause the processor of device 20 to execute.

[0023] The information utilization device 30 includes an information receiving unit 31 and an information utilization unit 32. Each of these units is realized by a process in which one or more programs installed in the information utilization device 30 cause the processor of the information utilization device 30 to execute.

[0024] The transmission / reception compatibility determination device 10 includes a generation information recording unit 11, a transmission information recording unit 12, a time / location information recording unit 13, a reception information acquisition unit 14, a network quality calculation unit 15, a reception result recording unit 16, and a transmission / reception compatibility determination unit 17. Each of these units is realized by processing that one or more programs installed in the transmission / reception compatibility determination device 10 cause the processor 104 to execute. The transmission / reception compatibility determination device 10 also utilizes an information storage unit 18. The information storage unit 18 can be realized using, for example, an auxiliary storage device 102, or a storage device that can be connected to the transmission / reception compatibility determination device 10 via a network.

[0025] Note that the functional configuration example shown in Figure 4 is just one example. For example, a device other than device 20 may have the information transmission unit 22 (the information generation unit 21 and the information transmission unit 22 may be distributed to different devices). Also, the information receiving unit 31 and the information utilization unit 32 may be distributed to different devices. Furthermore, device 20 may have a time / location information recording unit 13. Also, device 20 may have a generation information recording unit 11 and a transmission information recording unit 12. Furthermore, the information utilization device 30 may have a received information acquisition unit 14, a network quality calculation unit 15 and a received result recording unit 16. Also, device 20 or the information utilization device 30 may have a transmission / reception correspondence determination unit 17 and an information storage unit 18.

[0026] The following describes the processing procedures performed in the information processing system. Figure 5 is a sequence diagram illustrating an example of the processing procedures performed in the information processing system in the first embodiment.

[0027] When the information generation unit 21 acquires (inputs) video to be transmitted to the information utilization device 30 at absolute time a, it stores the video in packet P. aGenerate (TCP packets, RTP packets, QUIC packets, etc.), and the absolute time a (hereinafter referred to as "acquisition time a"), the transmission setting C of the video at the acquisition time a a , and the packet P a Transmit the information (hereinafter referred to as "generated information") including the identifier of, and the information source identifier, to the generated information recording unit 11 (S101). The transmission setting C a For example, it is a codec, resolution, frame rate, bit rate, setting delay, etc. Also, the identifier of the packet P a For example, if the packet P a is a TCP packet or an RTP packet, it is a sequence number or a timestamp, and if it is a QUIC packet, it is a packet number, etc. Also, hereinafter, the meaning of the packet and the identifier of the packet is the same. Also, the information source identifier is an identifier such as the name of the information generation unit 21 of the information transmission source. In this embodiment, the name of the device 20 is used as the information source identifier.

[0028] When the generated information recording unit 11 receives the generated information (information source identifier, a, C a , P a ), it records the generated information in the information storage unit 18 (S102). FIG. 6 is a diagram showing a configuration example of the generated information recorded in the information storage unit 18.

[0029] When the information transmission unit 22 transmits any packet P b generated by the information generation unit 21 to the information reception unit 31 of the information utilization device 30, the absolute time (hereinafter referred to as "transmission time b") when the packet P b is transmitted, the NW usage form F b at the transmission time b, and the identifier of the packet P b , and the identifier of the device 20 as the information source identifier (hereinafter referred to as "transmission information") are recorded in the transmission information recording unit 12 (S103). Note that step S102 is not necessarily synchronized with step S101. Therefore, the packet P b is not necessarily the packet P a (for example, the packet P aIt may also be a packet that was generated earlier. ) Network Usage Mode F b This means that the information transmission unit 22 transmits packet P b This is an identifier, such as the type and name, of all networks used (or connected to (=enabled)) for sending the packet. b The meaning of the identifier is packet P a The identifier has the same meaning as the one shown. The transmission information recording unit 12 records the transmission information from the information transmission unit 22 (source information identifier, b, F b ,P b When a transmission is received, the transmission information is output to the NW quality calculation unit 15 (S104), and the transmission information is recorded in the information storage unit 18 (S105). Figure 7 shows an example of the configuration of the transmission information recorded in the information storage unit 18.

[0030] Furthermore, the time / location information recording unit 13 measures the position (latitude, longitude, altitude) of the device 20 at each time (assuming UTC) using, for example, the positioning calculation function based on satellite signals such as a GNSS receiver that the device 20 has, and records the position L of the device 20 at each time t. t Information showing the relationship between the position and time of device 20 is recorded in the information storage unit 18 (S106). Figure 8 shows an example of the configuration of the time / position information of device 20 recorded in the information storage unit 18. Figure 8 also shows an example in which the speed and orientation of device 20 are also recorded. The speed and orientation of device 20 can be measured based on information from an IMS (Inertial Measurement unit) or a six-axis sensor.

[0031] Furthermore, the absolute time of the information generation unit 21 and the information transmission unit 22 are assumed to be synchronized via an NTP server with the absolute time (assuming UTC) acquired by the time / location information recording unit 13.

[0032] Meanwhile, the information receiving unit 31 receives any packet P transmitted by the information transmitting unit 22. c Upon receiving, packet P c The absolute time of reception (hereinafter referred to as "reception time c"), and the network usage pattern at reception time c (hereinafter referred to as "NW usage pattern") Fc , and packet P c Information including the identifier of the information utilization device 30 (hereinafter referred to as "received information") is transmitted to the received information acquisition unit 14 (S111). The received information acquisition unit 14 receives the received information from the information receiving unit 31 (identifier of the information utilization device 30, c,F c ,P c When a packet P is received, the received information is output to the NW quality calculation unit 15 (S112). c The identifier is, in addition to the packet identifier mentioned above, packet P c This also includes information indicating which network the data was received via (network type or name). Furthermore, the reception time c does not necessarily need to be synchronized with other devices via an NTP server.

[0033] The NW quality calculation unit 15 calculates the network quality (hereinafter referred to as "NW quality") at reception time c. c , received packet P c or each packet received up to reception time c (hereinafter referred to as "packet P") Qc It calculates based on the transmission information output from the transmission information recording unit 12, and the received information, network quality Q c and each packet P Qc Information containing the identifier (hereinafter referred to as "reception quality information") is recorded in the information storage unit 18 (S113). Figure 9 shows an example of the configuration of reception quality information recorded in the information storage unit 18. NW quality refers to one or more of the following: throughput (actual value), packet loss rate (actual value), delay (actual value), and jitter (actual value), and is an example of data observed on the information receiving side. NW usage mode F c If the network includes multiple networks, the network quality is calculated for each network. That is, the network quality calculation unit 15 calculates the network quality Q for each network based on the packets received through that network. c Calculate.

[0034] In this embodiment, an example is shown in which the network usage pattern is obtained from both the information transmission unit 22 and the information reception unit 31, but the network usage pattern may be obtained from only one of them.

[0035] The information utilization unit 32 receives any packet transmitted from the information receiving unit 31, and when it completes the utilization process of the packet (such as decoding video) at the absolute time (hereinafter referred to as "utilization time d"), it processes the packet and each of the packets that have been utilized up to that point (hereinafter referred to as "packet P"). Rd Based on this, the video level reception result R d The following is calculated. The received results at the video level include, for example, MDI DF / MLR, frame rate, bitrate, delay, etc. (and other video quality indicators such as VMAF), and are examples of data observed on the information receiving side. Alternatively, the received results may be the subjective quality of the video as perceived by the viewer (presence or absence of video interruptions that can be perceived by a person, MOS value, etc.).

[0036] The information utilization unit 32 receives the identifier of the information utilization device 30, the utilization time d, and the received result R. d , and each packet P Rd Information containing the identifier (hereinafter referred to as "reception result information") is transmitted to the reception result recording unit 16 (S114). The reception result recording unit 16 records the reception result information in the information storage unit 18 (S115). Figure 10 shows an example of the configuration of the reception result information recorded in the information storage unit 18. Note that the reception time d does not necessarily need to be synchronized with other devices via an NTP server.

[0037] Subsequently, at any time (for example, at a time specified by the user or at a predetermined time), the transmit / receive compatibility determination unit 17 refers to the information storage unit 18 (S121) and executes the transmit / receive compatibility determination process (S122). In the transmit / receive compatibility determination process, the transmit / receive compatibility determination unit 17 reverse-looks up the transmission method and transmission time of each packet (information) based on the packet identifier related to the calculation of the reception result of the NW quality or video level, and identifies the location of the device 20 from the transmission time, thereby associating the NW quality or reception result with the transmission event of the information (transmission time and location). Subsequently, the transmit / receive compatibility determination unit 17 calculates the result of the transmit / receive compatibility determination process (t / L t / Q Lt , or t / L t / C Lt / F Lt / R L ) is recorded in the information storage unit 18 (S123).

[0038] The recording of various types of information to the information storage unit 18 in Figure 5 may be performed in real time in response to the event that is the source of the information, or it may be performed asynchronously with respect to the event, based on logs or the like.

[0039] Next, the details of step S122 will be explained. In step S122, the transmit / receive compatibility determination unit 17 executes the processing procedure shown in Figure 11 and / or Figure 14 below, or either one of the processing procedures.

[0040] Figure 11 is a flowchart illustrating an example of the processing procedure for determining the correspondence between information transmission events and network quality in the first embodiment.

[0041] In step S210, the transmit / receive correspondence determination unit 17 determines from the "received packets" column of a certain received quality information (Figure 9) (hereinafter referred to as "target received quality information") the packets P related to the calculation of NW quality Q included in the received quality information. Q The identifier and P Q Obtain the network identifier used for sending and receiving data.

[0042] Next, the transmit / receive compatibility determination unit 17 determines packet P Q The information storage unit 18 retrieves the time t at which the packet was transmitted (S220). Specifically, the transmission / reception correspondence determination unit 17 checks the value of the "transmitted packet" column in the transmission information (Figure 7) stored in the information storage unit 18 for P Q The identifier is in the "Network Usage Type" column, and P Q The transmission time of the transmission information (hereinafter referred to as "target transmission information") which includes the identifier of the network used to receive the transmission information is P Q The transmission time t is obtained. Note that P Q If there are multiple P Q The transmission time t is obtained for each transmission time, and the smallest time interval (hereinafter referred to as the "transmission time interval") that includes all transmission times t is identified. That is, as shown in (1) of Figure 12, multiple transmission times are associated with a single network quality.

[0043] Next, the transmission / reception compatibility determination unit 17 determines the position L of the device 20 at time t. t The information storage unit 18 is searched for (S230). Specifically, the transmission / reception correspondence determination unit 17 searches the time / location information (Figure 8) stored in the information storage unit 18 for time / location information that includes the transmission time t, and the location of the searched time / location information is the transmission position L t It is obtained as follows. In this embodiment, the transmission / reception correspondence determination unit 17 also obtains the speed / attitude values ​​from the time / location information. Note that P Q If there are multiple P Q Regarding the position of device 20 at transmission time t, transmission position L t Acquired as, all transmission positions L t Identify the smallest geographical range that includes (hereinafter referred to as the "transmission range"). That is, as shown in (2) of Figure 12, multiple transmission locations are associated with a single network quality.

[0044] Next, the transmission / reception compatibility determination unit 17 determines the network quality Q based on the transmission time t (or transmission time interval) and position L. t(or transmission range), and the acquired speed / attitude are recorded in the information storage unit 18 (S240). That is, the transmission / reception correspondence determination unit 17 records the transmission time t (or transmission time interval) and position L t Determine that (or the transmission range) corresponds to NW quality Q.

[0045] Figure 13 shows an example of recording network quality in relation to transmission time and transmission location. Figure 13 shows transmission time t and transmission location L t An example in which network quality is directly associated with the transmission time t (or transmission time interval) is a predetermined time zone, and the transmission location L is a predetermined region. t Network quality may be associated with the region division to which (or transmission range) belongs. In Figure 13, the source identifier records the source identifier of the target transmission information (Figure 7) and the source identifier of the target reception quality information (Figure 9).

[0046] The processing procedure shown in Figure 11 is performed for each piece of received quality information (Figure 9), thereby associating the network quality of each piece of received quality information (Figure 9) with the transmission time and transmission location, etc.

[0047] Furthermore, if the transmission / reception compatibility determination unit 17 performs only the processing procedure shown in Figure 11 and does not perform the processing procedure shown in Figure 14 described later, the information generation unit 21 does not need to synchronize its time with the absolute time used by the time / location information recording unit 13. Also, if the transmission / reception compatibility determination unit 17 performs only the processing procedure shown in Figure 11 and does not perform the processing procedure shown in Figure 14 described later, the transmission / reception compatibility determination device 10 does not need to have a generated information recording unit 11 and a reception result recording unit 16.

[0048] Figure 14 is a flowchart illustrating an example of the processing procedure for determining the correspondence between information transmission events and video-level reception results in the first embodiment.

[0049] In step S310, the transmit / receive correspondence determination unit 17 determines the packet P involved in calculating the reception result R of certain reception result information (Figure 10) (hereinafter referred to as "target reception result information") RThe identifier is obtained, and the packet and P R From the "Received Packet" column of the reception quality information (Figure 9) (hereinafter referred to as "Target Reception Quality Information") which includes the identifier in the "Received Packet" column, packet P R Obtain the network identifier used for sending and receiving data.

[0050] Next, the transmission / reception compatibility determination unit 17 acquires the network usage pattern F of the target reception quality information (Figure 9) (S320).

[0051] Next, the transmit / receive compatibility determination unit 17 determines packet P R The transmission setting C is obtained from the generation information (Figure 6) (hereinafter referred to as "target generation information") which includes the identifier in the "generated packet" column (S330). R If there are multiple Cs, multiple Cs may be obtained.

[0052] Next, the transmission / reception compatibility determination unit 17 determines P R The information storage unit 18 retrieves the time t at which the packet was transmitted (S340). Specifically, the transmission / reception correspondence determination unit 17 checks the value of the "transmitted packet" column in the transmission information (Figure 7) stored in the information storage unit 18 and determines P R The identifier is such that the transmission time of the transmission information (hereinafter referred to as "target transmission information") whose value in the "Network Usage Type" column matches Network Usage Type F is P R The transmission time t is obtained. Note that P R If there are multiple P R The transmission time t is obtained, and the smallest time interval (hereinafter referred to as the "transmission time interval") that includes all transmission times t is identified.

[0053] Next, the transmission / reception compatibility determination unit 17 determines the position L of the device 20 at time t. t The information storage unit 18 is searched for (S350). Specifically, the transmission / reception correspondence determination unit 17 searches the time / location information (Figure 8) stored in the information storage unit 18 for time / location information that includes the transmission time t, and the location of the searched time / location information is the transmission position L tIt is obtained as follows. In this embodiment, the transmission / reception correspondence determination unit 17 also obtains the speed / attitude values ​​from the time / location information. Note that P Q If there are multiple P Q Regarding the position of device 20 at transmission time t, transmission position L t Acquired as, all transmission positions L t Identify the smallest geographical area that includes (hereinafter referred to as the "transmission range").

[0054] Next, the transmission / reception correspondence determination unit 17 determines the reception result R by specifying the transmission time t (or transmission time interval) and position L t The information is recorded in the information storage unit 18 in association with the transmission time t (or transmission range), acquired speed / attitude, transmission setting C, and network usage mode F (S360). That is, the transmission / reception correspondence determination unit 17 records the transmission time t (or transmission time interval) and position L t Determine that (or the transmission range) corresponds to R in the received result.

[0055] Figure 15 shows an example of recording the reception results at the video level in association with the transmission time and transmission location. The information recorded is time t, location L t The reception result R when transmission setting C and network usage mode F are applied is shown. Figure 15 shows the transmission time t and transmission location L t An example is shown where the reception result is directly associated with the time zone, where the transmission time t (or transmission time interval) belongs to a predetermined time zone, and the transmission location L is determined within a predetermined region. t The reception results may be associated with the region division to which the (or transmission range) belongs. In Figure 15, the source identifiers recorded are the source identifier for the target generation information (Figure 6), the source identifier for the target transmission information (Figure 7), the source identifier for the target reception quality information (Figure 9), and the source identifier for the target reception result information (Figure 10).

[0056] The processing procedure shown in Figure 14 is executed for each received result information (Figure 10), thereby associating the received result of each received result information (Figure 10) with the transmission time, transmission location, etc.

[0057] Furthermore, if the transmission / reception compatibility determination unit 17 performs only the processing procedure shown in Figure 14 and does not perform the processing procedure shown in Figure 11, the information transmission unit 22 does not need to synchronize its time with the absolute time used by the time / location information recording unit 13.

[0058] By executing the processing procedure shown in Figure 11, it becomes possible to identify "when / where information transmission" corresponds to the network quality (especially in the case of metrics expressed as a quantity per unit time, such as throughput and packet loss rate) obtained based on the information reception results. As a result, it becomes possible to create a dynamic map of network quality (based on actual throughput values ​​rather than maximum values ​​for bandwidth) based on the information transmission events of the moving device 20.

[0059] Similarly, by executing the processing procedure in Figure 14, it becomes possible to identify "which transmission settings" and "when / where" the results obtained from receiving video were transmitted. As a result, a set of "time, location, video transmission settings, network usage pattern, and reception result" can be used as historical data to serve as the basis for selection in proactive control and other processes to choose an appropriate video streaming method.

[0060] While synchronization with respect to absolute time (assuming UTC) is necessary for the information generation unit 21 and the information transmission unit 22, time synchronization between all devices, which was essential in existing technology-based approaches, can be eliminated.

[0061] The creation of a heatmap / dynamic map that takes spatiotemporal variations into account according to this embodiment can be performed based on the results of information transmission and reception in actual operation (for example, transmission and reception of video in remote monitoring of autonomous vehicles). Therefore, there is no need to prepare a separate test vehicle for measuring network quality and video reception results for the purpose of taking spatiotemporal variations into account and to have it constantly running on public roads. As a result, the enormous measurement costs associated with running test vehicles, which increase in size as the measurement range expands, can be reduced.

[0062] Furthermore, it is not necessary to record the generation information (Figure 6), transmission information (Figure 7), reception quality information (Figure 9), and reception result information (Figure 10). In this case, the transmission / reception correspondence determination process can be performed for some packets in which this information is recorded. By limiting the packets in which this information is recorded to only some packets, the recording processing load on the information storage unit 18 can be reduced.

[0063] As described above, according to the first embodiment, it is possible to understand the correspondence between the data observed at the information receiving end and the transmitted event.

[0064] Next, a second embodiment will be described. The differences between the second embodiment and the first embodiment will be described. Points not specifically mentioned in the second embodiment may be the same as in the first embodiment.

[0065] The first embodiment describes a method for determining the correspondence between network quality or reception results and information transmission events based on packet identifiers related to the calculation of network quality or reception results. The second embodiment describes a method for determining the correspondence between network quality or reception results and information transmission events based on delays related to packet transmission between the information transmission unit 22 and the information reception unit 31 (hereinafter referred to as "transmission delay"), or delays related to processing from the start of packet generation by the information generation unit 21 to the end of video utilization by the information utilization unit 32 (hereinafter referred to as "processing delay").

[0066] Figure 16 is a diagram showing an example of the functional configuration of the information processing system in the second embodiment. In Figure 16, the same or corresponding parts as in Figure 4 are denoted by the same reference numerals. In Figure 16, the transmission / reception correspondence determination device 10 further includes a delay measurement unit 19.

[0067] Figure 17 is a sequence diagram illustrating an example of a processing procedure performed in the information processing system according to the second embodiment. In Figure 17, steps that are the same as or corresponding to those in Figure 5 are given the same step number, and their explanations are omitted as appropriate.

[0068] In FIG. 17, steps S101 and S102 are replaced by steps S101a and S102a. Further, step S116 is added. Hereinafter, these steps will be described.

[0069] In step S101a, the information generation unit 21 generates a packet P storing the acquired video, and transmits the generated information including the acquisition time a of the acquired video, the transmission setting C of the video at the acquisition time a, and the information source identifier to the generation information recording unit 11. a to the generation information recording unit 11. a 、及び情報源識別子を含む生成情報を生成情報記録部11へ送信する。

[0070] When the generation information recording unit 11 receives the generation information (information source identifier, a, C a ) from the information generation unit 21, it records the generation information in the information storage unit 18 (S102a). That is, in the second embodiment, the generation information does not have to include the identifier of the packet P a .

[0071] Also, the delay measurement unit 19 periodically measures the transmission delay and the processing delay, and records the respective measurement results of the transmission delay and the processing delay in the information storage unit 18 in association with the respective measurement times (S116).

[0072] Note that the measurement of the transmission delay and the processing delay may be performed using a known technique.

[0073] For example, communication delay measurement using RTT (Round Trip Time) may be used. This is a mechanism for correcting the communication delay used in a general NTP (Network Time Protocol). The round-trip delay is calculated based on the time information described in the NTP packet exchanged between the NTP server and the NTP client via the NW, and half of it is estimated to be the one-way delay. If the transmitting node and the receiving node are time-synchronized, the transmission time can be estimated by subtracting the one-way delay estimated in advance from the reception time of the receiving node.

[0074] In addition, communication delay measurement using STS (Synchronized Time Stamp) may be used. This is a method of calculating one-way delay by transmitting and receiving measurement packets between nodes that are time-synchronized to UTC (Coordinated Universal Time) using GNSS (Global Navigation Satellite System).

[0075] Details of step S122 in the second embodiment will be described.

[0076] FIG. 18 is a flowchart for explaining an example of a processing procedure for determining the correspondence relationship between an information transmission event and NW quality in the second embodiment. In FIG. 18, the same step numbers are assigned to the same steps as in FIG. 11, and the description thereof will be omitted as appropriate. When the transmission / reception correspondence determination unit 17 executes the processing procedure of FIG. 18, it is sufficient that the information reception unit 31 is time-synchronized with the absolute time (the absolute time used by the time / position information recording unit 13).

[0077] Step S210 is the same as in FIG. 11. That is, in step S210, the transmission / reception correspondence determination unit 17 obtains, from the column of "received packet" of a certain reception quality information (FIG. 9) (hereinafter referred to as "target reception quality information"), the identifier of the packet P Q involved in the calculation of the NW quality Q included in the reception quality information and the identifier of the NW used for the transmission and reception of P Q

[0078] Subsequently, the transmission / reception correspondence determination unit 17 obtains the time t' when P Q was received from the column of "reception time" of the target reception quality information (FIG. 9) (S215). When there are a plurality of Ps Q , the transmission / reception correspondence determination unit 17 specifies the minimum time width including the time t' of each P Q

[0079] Subsequently, the transmission / reception correspondence determination unit 17 determines the time t when P Q was transmitted, based on the transmission delay D measured by the delay measurement unit 19 with respect to the time t'. t ​​It is estimated based on (S220a). Specifically, the transmit / receive correspondence determination unit 17 determines t'-D t Let t be the estimated value. Q If there are multiple P Q We identify the smallest time interval (reception time interval) that includes the estimated time t. t For this purpose, pre-measured values ​​or fixed estimates may be used.

[0080] From step S230 onward, the same process as in Figure 11 is executed using the estimated time t.

[0081] Furthermore, if the transmission / reception compatibility determination unit 17 performs only the processing procedure shown in Figure 18 and does not perform the processing procedure shown in Figure 19, which will be described later, the transmission / reception compatibility determination device 10 does not need to have a generated information recording unit 11 and a received result recording unit 16.

[0082] Figure 19 is a flowchart illustrating an example of the processing procedure for determining the correspondence between information transmission events and video-level reception results in the second embodiment. In Figure 19, steps identical to those in Figure 14 are given the same step numbers, and their explanations are omitted as appropriate. Note that when the transmission / reception correspondence determination unit 17 executes the processing procedure in Figure 19, it is sufficient that the information generation unit 21 and the information utilization unit 32 are time-synchronized with absolute time (absolute time used by the time / location information recording unit 13).

[0083] Step S310 is the same as in Figure 14. That is, in step S310, the transmit / receive correspondence determination unit 17 determines the packet P involved in calculating the reception result R of certain reception result information (Figure 10) (hereinafter referred to as "target reception result information") R The identifier is obtained, and the packet and P R From the "Received Packet" column of the reception quality information (Figure 9) (hereinafter referred to as "Target Reception Quality Information") which includes the identifier in the "Received Packet" column, packet P R Obtain the network identifier used for sending and receiving data.

[0084] Step 320 is the same as in Figure 14.

[0085] Following step S320, the transmit / receive compatibility determination unit 17 performs P R The time t' at which the utilization process was completed is obtained from the "Utilization Time" column of the target reception result information (Figure 10) (S321).

[0086] Next, the transmission / reception compatibility determination unit 17 determines P R The time t generated by the information generation unit 21 is used in relation to the processing delay D measured by the delay measurement unit 19 with respect to time t'. p It is estimated based on (S322). Specifically, the transmit / receive correspondence determination unit 17 determines t'-D p Let t be the estimated value. R If there are multiple P R We identify the minimum time interval (hereinafter referred to as the "generation time interval") that includes the estimated time t. p For this purpose, pre-measured values ​​or fixed estimates may be used.

[0087] Next, the transmission / reception correspondence determination unit 17 determines P based on time t. R The transmission setting C is estimated (S330a). Specifically, the transmission / reception correspondence determination unit 17 estimates the transmission setting C as the generated information (Figure 6) with time t as the acquisition time from the generated information recorded in the information storage unit 18. R If there are multiple Cs, multiple Cs can be estimated.

[0088] In step S350, the above-mentioned time t and transmission setting C are used to execute the same process as in Figure 14.

[0089] By executing the processing procedure in Figure 18, the same effect as when executing the processing procedure in Figure 11 can be obtained (however, it differs from Figure 11 in that the information receiving unit 31 requires time synchronization).

[0090] Furthermore, executing the processing procedure in Figure 19 yields the same results as executing the processing procedure in Figure 14 (however, it differs from Figure 14 in that time synchronization is required for the information generation unit 21 and the information utilization unit 32).

[0091] Furthermore, while the transmission / reception correspondence determination process in the second embodiment is considered to have lower accuracy in associating with transmission events compared to the transmission / reception correspondence determination process in the first embodiment because it does not completely identify packets, it is considered that sufficient accuracy can be obtained as a function for determining transmission / reception results, depending on the synchronization accuracy to absolute time, the measurement accuracy of processing / transmission delay, and the intended use of the transmission / reception result database.

[0092] Furthermore, the processing procedure shown in Figure 18 (the process of associating network quality with transmission events) can be completed solely on the information receiving unit 31 side (the upper end of the network), which offers the advantage of ease of implementation.

[0093] The processing procedure shown in Figure 19 (the process of associating the video-level reception results with the transmission event) requires time synchronization of the information generation unit 21 and acquisition of transmission settings. However, since it is not necessary to acquire information down to the packet level, this can be done by general log acquisition.

[0094] In each of the above embodiments, the transmission / reception compatibility determination device 10 is an example of a transmission / reception compatibility determination system. The NW quality calculation unit 15 or the reception result recording unit 16 is an example of an observation data recording unit.

[0095] Although embodiments of the present invention have been described in detail above, the present invention is not limited to these specific embodiments, and various modifications and changes are possible within the scope of the gist of the present invention as described in the claims. [Explanation of Symbols]

[0096] 10. Transmit / Receive Compatibility Determination Device 11. Generated Information Recording Unit 12 Transmission Information Recording Section 13. Time / Location Information Recording Unit 14. Receiving Information Acquisition Unit 15 NW Quality Calculation Department 16 Reception Result Recording Unit 17. Transmission / reception compatibility determination unit 18 Information storage section 19 Delay Measurement Unit 20 devices 21 Information generation section 22 Information Transmission Section 30 Information utilization device 31 Information Receiving Unit 32 Information Utilization Department 100 drive unit 101 Recording media 102 Auxiliary storage device 103 Memory device 104 Processors 105 Interface device B Bus

Claims

1. A time / location information recording unit is configured to record time / location information that shows the relationship between the position and time of a moving device by measuring the position of the moving device at each time interval, A transmission information recording unit is configured to record an identifier of the information transmitted from the device in association with the transmission time of the information, but is configured not to record the location information of the device. An observation data recording unit is configured to record, in association with the identifier of the information transmitted from the aforementioned device via a network, and the data observed with respect to that information in a device that receives the information transmitted from the aforementioned device. A transmission / reception correspondence determination unit is configured to determine that the transmission time associated with the same identifier as the identifier of the information recorded by the observation data recording unit among the identifiers of the information recorded by the transmission information recording unit, and the location of the device in the time / location information for each time that includes the same time as the transmission time, correspond to the observed data associated with the identifier, A transmission / reception correspondence determination system characterized by having the following features.

2. The identifier of the aforementioned information is the identifier of the packet containing the aforementioned information. The transmission / reception correspondence determination system according to claim 1.

3. The observed data includes one or more of the following: throughput, packet loss rate, delay, and jitter. The transmission / reception correspondence determination system according to claim 1 or 2, characterized in that it is the same as described in claim 1 or 2.

4. A time / location information recording procedure that records time / location information showing the relationship between the position and time of a moving device by measuring the position of the device at each time interval, A transmission information recording procedure that records the identifier of the information transmitted from the device in association with the transmission time of the information, but does not record the location information of the device, An observation data recording procedure for recording, in which an instrument that receives information transmitted from the aforementioned device via a network associates the identifier of the information with the data observed with respect to the information, A transmission / reception correspondence determination procedure that determines that the transmission time associated with the same identifier as the identifier of the information recorded by the transmission information recording procedure, and the location of the device in the time / location information for each time that includes the same time as the transmission time, correspond to the observed data associated with the identifier, A method for determining whether a computer is responsible for sending and receiving data.

5. A time / location information recording procedure that records time / location information showing the relationship between the position and time of a moving device by measuring the position of the device at each time interval, A transmission information recording procedure that records the identifier of the information transmitted from the device in association with the transmission time of the information, but does not record the location information of the device, An observation data recording procedure for recording, in which an instrument that receives information transmitted from the aforementioned device via a network associates the identifier of the information with the data observed with respect to the information, A transmission / reception correspondence determination procedure that determines that the transmission time associated with the same identifier as the identifier of the information recorded by the transmission information recording procedure, and the location of the device in the time / location information for each time that includes the same time as the transmission time, correspond to the observed data associated with the identifier, A program characterized by causing a computer to execute something.

Images