Information processing system, information processing device, and information processing method

Abstract

In order to maintain the stability of wireless communication even when a communication status changes during the communication, an information processing system (1) comprises: a specification means (11) that specifies a selection method for selecting a wireless communication line for transmitting data acquired by a mobile body, according to a predicted bandwidth that indicates a range of predicted variation over time in the bandwidth of each of a plurality of wireless communication lines; and a first selection means (12) that refers to the specified selection method and selects, from among the plurality of wireless communication lines, at least one wireless communication line for transmitting data during transmission.

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing apparatus, and an information processing method.

Background Art

[0002] In recent years, the increase in communication traffic has been remarkable, but it is not easy to increase the capacity of communication facilities accordingly. Therefore, various methods for ensuring the quality of communication by effectively using existing facilities have been studied.

[0003] For example, Patent Document 1 discloses a network control apparatus including a link information management unit that notifies other communication apparatuses of quality information of wireless links formed by a plurality of distributed communication apparatuses, a line quality prediction unit that predicts fluctuations in communication quality of each wireless link based on the quality information, and a path control unit that determines a path for transmitting traffic between a source communication apparatus and a destination communication apparatus based on the prediction result. With this configuration, it is said that the line operation rate and throughput of the entire network can be improved.

[0004] Further, Patent Document 2 discloses a path control system having a path control apparatus that preferentially sets, in a network, a communication path for which a band probability, which is a probability indicating the stability of a band, of a wireless link using adaptive modulation is higher than a predetermined threshold value, and prepares another path for a communication path for which the band probability is lower than the predetermined threshold value. It is said that this enables high-quality communication.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] In the technologies described in Patent Document 1 or Patent Document 2, even if a transmission path or communication path is determined once, the communication conditions may change during wireless communication. This is because wireless communication is susceptible to changes in the environment and the influence of other wireless communication devices. One aspect of the present invention has been made in view of the above problems, and one of its objectives is to provide a technology for maintaining the stability of wireless communication even when the communication conditions change during communication. [Means for solving the problem]

[0007] An information processing system according to one aspect of the present invention includes: a selection means for identifying a selection method for selecting a wireless communication line for transmitting data acquired by a mobile device, according to a predicted bandwidth indicating a predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines; and a first selection means for selecting one or more of the wireless communication lines for transmitting the data from among the plurality of wireless communication lines during transmission, by referring to the identified selection method.

[0008] An information processing device according to one aspect of the present invention includes: a selection means for identifying a selection method for selecting a wireless communication line for transmitting data acquired by a mobile device, according to a predicted bandwidth indicating a predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines; and a first selection means for selecting one or more of the wireless communication lines for transmitting the data from among the plurality of wireless communication lines during transmission, by referring to the identified selection method.

[0009] An information processing method according to one aspect of the present invention includes at least one processor identifying a selection method for selecting a wireless communication line for transmitting data acquired by a mobile device, according to a predicted bandwidth indicating a predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines, and, with reference to the identified selection method, selecting one or more of the wireless communication lines for transmitting the data from among the plurality of wireless communication lines during transmission. [Effects of the Invention]

[0010] According to one aspect of the present invention, the stability of wireless communication can be maintained even when the communication conditions change during communication. [Brief explanation of the drawing]

[0011] [Figure 1] This is a block diagram showing the configuration of an information processing system 1 according to an exemplary embodiment 1 of the present invention. [Figure 2] This is a block diagram showing the configuration of the information processing device 2 according to exemplary embodiment 1. [Figure 3] This is a flowchart showing the flow of the information processing method S1 according to exemplary embodiment 1. [Figure 4] This is a block diagram showing the configuration of the information processing system 1A according to exemplary embodiment 2. [Figure 5] This is a schematic diagram illustrating an example of a selection method for the first selection unit to select a wireless communication line to transmit video data. [Figure 6] This is a schematic diagram showing an example of an allocated bandwidth map generated by the first selection unit. [Figure 7] This is a schematic diagram showing an example of an allocated bandwidth map generated by the first selection unit. [Figure 8] This is a schematic diagram showing an example of an allocated bandwidth map generated by the first selection unit. [Figure 9] This is a schematic diagram showing an example of an allocated bandwidth map generated by the first selection unit. [Figure 10] This is a schematic diagram illustrating how to switch the allocated bandwidth map according to the communication area. [Figure 11] This is a block diagram showing the configuration of the information processing device 2A according to exemplary embodiment 2. [Figure 12] This is a flowchart showing the flow of the information processing method S2 according to exemplary embodiment 2. [Figure 13] This is a block diagram showing the configuration of the information processing system 1B according to exemplary embodiment 3. [Figure 14] This is a block diagram showing the configuration of the information processing system 2B according to exemplary embodiment 3. [Figure 15] It is a configuration diagram for realizing an information processing apparatus by software.

Embodiments for Carrying Out the Invention

[0012] 〔Exemplary Embodiment 1〕 The first exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is a basic form of the exemplary embodiments described later. The information processing system 1 according to this exemplary embodiment 1 is a wireless communication system for stably transmitting and receiving data even when the transmitting device moves.

[0013] (Configuration of Information Processing System 1) The configuration of the information processing system 1 according to this exemplary embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram showing the configuration of the information processing system 1.

[0014] The information processing system 1 includes a specifying unit 11 and a first selection unit 12. The specifying unit 11 specifies a selection method for selecting a wireless communication line for transmitting data acquired in a moving body according to a predicted band corresponding to the predicted variation range of the band over time in each of a plurality of wireless communication lines. Data is, for example, video data including still images and / or moving images, or audio data, etc. The specifying unit 11 is one form of the specifying means described in the claims.

[0015] In this exemplary embodiment, the wireless communication line is, for example, a line configured based on a mobile communication standard such as LTE, 4G, 5G, etc. (hereinafter, also represented as "LTE line" for short), a line configured based on a short-range wireless communication standard such as Wi-Fi (registered trademark) (hereinafter, also referred to as "Wi-Fi (registered trademark) line"), or any wireless communication line including a satellite communication line, etc.

[0016] Bandwidth refers to the amount of data that can be transmitted over a wireless communication line, and is expressed as the data bitrate or frame rate, etc. Since the transmitting equipment (not shown) is mobile, the bandwidth fluctuates over time in accordance with changes in the communication environment. How and to what extent the bandwidth will fluctuate can be predicted using known methods. The predicted range of bandwidth fluctuation is called the predicted bandwidth. Details of the selection method will be described later.

[0017] The first selection unit 12, referring to the selection method identified by the identification unit 11, selects one or more wireless communication lines from among multiple wireless communication lines to transmit data during data transmission. Selecting a wireless communication line during data transmission means, for example, dividing the data into multiple packets and selecting the wireless communication line to be used for transmission from among multiple wireless communication lines between the transmission of the first packet and the transmission of the last packet. The transmitting device 10 can transmit data using the wireless communication line selected by the first selection unit 12. The first selection unit 12 is one form of the first selection means described in the claims.

[0018] Furthermore, the specific unit 11 and the first selection unit 12 do not need to be located in a single housing; they may be distributed across different housings and connected to each other in a manner that enables information communication. Also, at least a portion of the specific unit 11 and the first selection unit 12 may be located on the cloud. Thus, the fact that at least a portion of each unit or device may be distributed or located on the cloud is also true in the exemplary embodiments described below.

[0019] As described above, the information processing system 1 according to this exemplary embodiment employs a configuration that includes a selection means for identifying a selection method for selecting a wireless communication line to transmit data acquired by a mobile device, according to a predicted bandwidth indicating the predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines, and a selection means for selecting one or more wireless communication lines from the plurality of wireless communication lines to transmit data during transmission by referring to the identified selection method. Therefore, the information processing system 1 according to this exemplary embodiment has the effect of maintaining the stability of wireless communication even when the communication conditions change during communication. In other words, even if the communication conditions change during communication, data can be transmitted without interruption or degradation.

[0020] (Configuration of Information Processing Device 2) Next, the configuration of the information processing device 2 according to this exemplary embodiment will be described with reference to Figure 2. Figure 2 is a block diagram showing the configuration of the information processing device 2. As shown in the figure, the information processing device 2 includes a specific unit 11 and a first selection unit 12.

[0021] The identification unit 11 identifies a selection method for selecting a wireless communication line to transmit data acquired by a mobile device, based on the predicted bandwidth, which indicates the predicted range of bandwidth fluctuations over time for each of the multiple wireless communication lines. The bandwidth, data, wireless communication lines, etc., are as described in the configuration of the information processing system 1. The first selection unit 12 then refers to the identified selection method and selects one or more wireless communication lines from among the multiple wireless communication lines to transmit data during transmission. Details of the selection method will be described later.

[0022] As described above, the information processing device 2 according to this exemplary embodiment employs a configuration that includes a selection means for identifying a selection method for selecting a wireless communication line to transmit data acquired by a mobile device, according to a predicted bandwidth indicating the predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines, and a selection means for selecting one or more wireless communication lines from the plurality of wireless communication lines to transmit data during transmission by referring to the identified selection method. Therefore, the information processing system 1 according to this exemplary embodiment has the effect of being able to maintain the stability of wireless communication even when the communication conditions change during communication.

[0023] (Information processing method S1 flow) Next, the flow of the information processing method S1 according to this exemplary embodiment will be explained with reference to Figure 3. Figure 3 is a flowchart showing the flow of the information processing method S1.

[0024] As shown in the figure, the information processing method S1 includes steps S11 and S12. Step S11 is a step in which at least one processor (e.g., a specific unit 11) identifies a selection method for selecting a wireless communication line to transmit data acquired by a mobile device, according to a predicted bandwidth that indicates a predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines.

[0025] Step S12 is a step in which at least one processor (e.g., the first selection unit 12) selects one or more wireless communication lines from among a plurality of wireless communication lines to transmit data during transmission, with reference to a specified selection method.

[0026] According to the information processing method S1 described above, a wireless communication line is selected according to the predicted bandwidth, and data is transmitted using that line. Therefore, even if the communication conditions change during communication, the stability of the wireless communication can be maintained.

[0027] As described above, in the information processing method S1 according to this exemplary embodiment, at least one processor identifies a selection method for selecting a wireless communication line to transmit data acquired by a mobile device, according to the predicted bandwidth, which indicates the predicted range of bandwidth fluctuations over time in each of the multiple wireless communication lines, and selects one or more wireless communication lines from the multiple wireless communication lines to transmit data during transmission by referring to the identified selection method. Therefore, according to the information processing method S1 according to this exemplary embodiment, the stability of wireless communication can be maintained even if the communication conditions change during communication.

[0028] [Exemplary Embodiment 2] A second exemplary embodiment of the present invention will be described in detail with reference to the drawings. Components having the same function as those described in Exemplary Embodiment 1 will be denoted by the same reference numerals, and their descriptions will be omitted as appropriate.

[0029] (Configuration of Information Processing System 1A) Figure 4 is a block diagram showing the configuration of information processing system 1A according to exemplary embodiment 2. As shown in the figure, information processing system 1A comprises a transmitting device 10, a receiving device 20, a bandwidth adjustment device 30, and a control device 40. As an example, information processing system 1A can be used as a monitoring system for transmitting and receiving video from a camera mounted on a mobile device and monitoring for any abnormalities. As mentioned above, the transmitting device 10, the receiving device 20, the bandwidth adjustment device 30, and the control device 40 may be located in different locations. For example, the imaging device and the transmitting device 10 may be located in a vehicle as a mobile device, and the receiving device 20 may be located in a monitoring center or the like. In addition, either or both of the bandwidth adjustment device 30 and the control device 40 may be located on the cloud or in a monitoring center. In the following exemplary embodiment, the case in which the data is video data captured by the imaging means will be explained as an example.

[0030] The transmitting device 10 comprises a specific unit 11, a first selection unit 12, and a data transmission unit 13. The functions of the specific unit 11 and the first selection unit 12 are the same as those described in Exemplary Embodiment 1. The data transmission unit 13 transmits video data using the selected wireless communication line 15. The transmitting device 10 is, as an example, a device that acquires video data captured on a moving object and transmits it wirelessly. Video data captured on a moving object refers to video data captured by an imaging device (imaging means) such as a camera mounted on a moving object such as a car, train, aircraft, or ship. Alternatively, it may be an image captured by an imaging device that can be carried by a person. Such video data is video data in which the shooting position may change over time. The shooting position may change continuously or intermittently. The transmitting device 10 acquires the video data from the imaging device in real time. That is, the transmitting device 10 moves together with the imaging device that captured the video data. The transmitting device 10 may be configured integrally with the imaging device.

[0031] The receiving device 20 comprises a second selection unit 21 and a data receiving unit 22. The receiving device 20 receives video data transmitted from the transmitting device 10. The data receiving unit 22 receives video data transmitted from the transmitting device 10. The second selection unit 21 selects one of the received video data when multiple wireless communication lines 15 for transmitting video data are selected by the first selection unit 12 of the transmitting device 10. In other words, when multiple wireless communication lines 15 for transmitting video data are selected by the first selection unit 12, the same video data is transmitted for each of those multiple wireless communication lines. Therefore, the second selection unit 21 selects the video data with the best video quality from among the received video data. The selected video data may be displayed on a display device (not shown) or saved. Video data that is not selected may not be displayed or saved.

[0032] As an example, the video data is transmitted and received via the Internet N, as shown in Figure 4. More specifically, the video data is transmitted from the transmitting device 10 to the nearest connection point of the Internet N using at least one of the multiple wireless communication lines 15. The video data is also received by the receiving device 20 from the nearest connection point of the Internet N of the receiving device 20 via a wired communication circuit 25 or a wireless communication line 25. The receiving device 20 is one form of the receiving means described in the claims. The second selection unit 21 is one form of the second selection means described in the claims.

[0033] The line 25 from the internet N to the receiving device 20 usually uses a single line. This is because, for example, the receiving device 20 installed in a monitoring center does not move and is located in a fixed place, so it can use a stable wired communication line or the best quality wireless communication line available at that location.

[0034] The bandwidth adjustment device 30 adjusts the bandwidth used to transmit video data in each of the multiple wireless communication lines 15 by referring to the predicted bandwidth. The bandwidth adjustment device 30 includes a bandwidth fluctuation prediction unit 31 and a transmission bandwidth adjustment unit 32. The bandwidth fluctuation prediction unit 31 predicts a predicted bandwidth that indicates what the bandwidth will be in the near future for each of the wireless communication lines 15. The bandwidth fluctuation prediction unit 31 may, for example, acquire bandwidth fluctuation information over time and predict the trend of bandwidth fluctuation in the near future from the trend of that fluctuation. Alternatively, the bandwidth fluctuation prediction unit 31 may predict bandwidth fluctuations using a bandwidth prediction model that predicts near future fluctuations from past bandwidth fluctuations. The predicted range of bandwidth fluctuations over time is called the predicted bandwidth. The near future may be up to a few minutes ahead, up to a few tens of minutes ahead, or up to a few hours ahead. Predictions are performed as appropriate by the bandwidth fluctuation prediction unit 31 and the predicted bandwidth is updated.

[0035] The transmission bandwidth adjustment unit 32 adjusts the transmission bandwidth, which is the bandwidth used to transmit video data, by referring to the predicted bandwidth for each of the multiple wireless communication lines 15. In other words, if the bandwidth of a certain wireless communication line 15 is predicted to decrease, the bandwidth adjustment device 30 sets a smaller transmission bandwidth for video data when transmitting using that wireless communication line 15. Conversely, if the bandwidth of a certain wireless communication line 15 is predicted to increase, the bandwidth adjustment device 32 sets a larger transmission bandwidth for video data when transmitting using that wireless communication line 15. The transmission bandwidth adjustment unit 32 may adjust the transmission bandwidth for video data for each of the multiple wireless communication lines 15. The bandwidth adjustment device 30 is one form of the bandwidth adjustment means described in the claims.

[0036] The control device 40 provides overall control of the information processing system 1A. The control device 40 comprises at least one processor 41 and at least one memory 42. The processor 41 can be configured using, for example, at least one general-purpose processor such as an MPU (Micro Processing Unit) or CPU (Central Processing Unit). The memory 42 may comprise multiple types of memory, such as ROM (Read Only Memory) and RAM (Random Access Memory). As an example, the processor 41 implements the functions of a transmitter 10, a receiver 20, and a bandwidth adjustment device 30 by loading various control programs recorded in the ROM of the memory 42 into the RAM and executing them. Multiple control devices 40 may be provided depending on the object being controlled. Furthermore, multiple control devices may be spaced apart. In addition, the processor 41 may include a processor composed of an ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), or PLD (Programmable Logic Device).

[0037] Next, the selection method by which the first selection unit 12 of the transmitting device 10 selects the wireless communication line 15 will be described. As an example, the selection method identified by the identification unit 11 may be a method in which, by referring to the predicted bandwidth, a priority line is determined from among the multiple wireless communication lines 15 to which video data will be transmitted preferentially, and lines to which transmission bandwidth can be allocated are designated as backup lines.

[0038] Furthermore, the selection method identified by the identification unit 11 may be a method of determining an allocated bandwidth map by referring to the communication area where the transmitting device 10 is located. For example, suppose the transmitting device 10 is mounted in a car, as shown in 510 of Figure 5. In that case, the first selection unit 12 may determine the Wi-Fi® line as the preferred line in areas close to Wi-Fi® connection points, such as the area 511 near the store where Wi-Fi® 1 is available and the area 512 near the home where Wi-Fi® 2 is available. This is because there are basically no costs involved when using the Wi-Fi® line. Alternatively, the line to be used may be predetermined considering factors other than cost, such as communication speed and security. The first selection unit 12 may also use the LTE® line as an alternative line when the Wi-Fi® bandwidth is small, such as in area 513, or when it is not possible to connect to a connection point. The first selection unit 12 may also use the satellite communication line as a backup line when both the Wi-Fi® line and the LTE line are unavailable.

[0039] Furthermore, for example, as shown in 520 of Figure 5, suppose the transmitting device 10 is installed on a ship. In that case, the selection method may be to use 3 or 4 Wi-Fi® lines in domestic urban areas 522, 523, 524 or foreign urban areas 526, 2 or 3 LTE lines in coastal areas 521, 525, and satellite communication lines in other marine areas 528. Alternatively, the selection method may be a combination of a method for determining a priority line and a method for determining a wireless communication line by referring to the communication area.

[0040] Furthermore, the selection method identified by the identification unit 11 may be a method of selecting one from a plurality of pre-created allocation bandwidth maps that show the transmission bandwidth allocated to each of the plurality of wireless communication lines. The allocation bandwidth map is a map representation of a method for determining the bandwidth used for each line by mutually referencing the transmittable bandwidth (transmission bandwidth) of the plurality of wireless communication lines. This method will be explained in detail with reference to the drawings. Figures 6 to 9 are schematic diagrams showing examples of allocation bandwidth maps selected by the first selection unit 12.

[0041] Figure 6 illustrates the basic concept of selecting a line and bandwidth using an allocated bandwidth map. In Figure 6, the horizontal axis represents the bandwidth (bps) value of the Wi-Fi® line, and the vertical axis represents the bandwidth (bps) value of the LTE line. The area enclosed by the solid line, 601, represents the transmission bandwidth of the Wi-Fi® line, with the minimum value being Y and the maximum value being the transmission max. The transmission max is smaller than the line's max value. The transmission bandwidth in the allocated bandwidth map is the range of bandwidth sufficient to transmit good video data, set for each wireless communication line. The area enclosed by the dashed line, 602, represents the transmission bandwidth of the LTE line, with the minimum value being Z and the maximum value being the transmission max. The transmission max is smaller than the line's max value. The area enclosed by the double-dash line, 603, represents the transmission bandwidth of the satellite line, covering the area not covered by either the Wi-Fi® line or the LTE line. Note that in Figures 7-9 thereafter, the horizontal and vertical axes are the same, and the display method of the transmission bandwidth is also the same.

[0042] If the predicted bandwidth of a particular line is not within the transmission bandwidth, that line is not used unconditionally. For example, suppose the predicted bandwidth at a certain point in time is V for the Wi-Fi® line and Z' for the LTE line. V is outside the transmission bandwidth 601 of the Wi-Fi® line. In that case, the first selection unit 12 unconditionally selects the LTE line. The transmission unit 10 transmits the video data using a bandwidth adjusted according to the predicted bandwidth. If multiple lines are available (within the range where the transmission bandwidths overlap), the transmission unit 10 may use multiple lines to transmit. In that case, the receiving side selects the video data with the best quality. Video data with the best quality is, for example, the video data with the highest average bitrate.

[0043] Another approach is as follows: First, prioritize the Wi-Fi® connection. Also, if the predicted bandwidth of Wi-Fi® is greater than X, turn off transmission over the LTE connection (use only Wi-Fi®). The value of X can be somewhat arbitrary. For example, X can be 3Mbps. Also, if the predicted bandwidth of Wi-Fi® is less than or equal to X, turn on transmission over the LTE connection. If the predicted bandwidth of Wi-Fi® is less than Y, turn off transmission over the Wi-Fi® connection. Y can be, for example, several hundred kbps.

[0044] Figure 7 shows an example of an allocated bandwidth map when a relatively simple selection method is used. In the example in Figure 7, only the transmission bandwidth for the Wi-Fi® line and the transmission bandwidth for the LTE line are specified. These are shown as ranges from minimum to maximum transmission. In this case, if the predicted bandwidth for each line is included in the respective transmission bandwidth, the video data is transmitted using the bandwidth independently adjusted for each line. In that case, the receiving side selects the video data with the best quality. When using an allocated bandwidth map like the one in Figure 7, transmission is carried out using as many lines as possible, so it is possible to transmit video data of the highest possible quality at the time of transmission.

[0045] Figure 8 shows an example of an allocated bandwidth map for a method that matches the maximum transmission bandwidth of the Wi-Fi® network to the maximum transmission bandwidth of the LTE network within the range where the LTE network is available. In the example shown in Figure 8, within the range where the LTE network is available, the maximum transmission bandwidth of the Wi-Fi® network is limited to LTEmax (the maximum transmission bandwidth of the LTE network). Within the range where both the LTE and Wi-Fi® networks are available, video data is transmitted using independently adjusted bandwidths for each network, and the receiving end selects the video data with the best quality. This selection method reduces the difference in video quality when switching between video transmitted via the LTE network and video transmitted via the Wi-Fi® network. In other words, it reduces the change in video quality when switching networks, thereby reducing the sense of unease when switching networks.

[0046] Figure 9 shows an example of an allocated bandwidth map in which the Wi-Fi® line adjusts its bandwidth independently, and in the bandwidth where the Wi-Fi® line is available, the LTE line is not allocated any transmission bandwidth (does not transmit). Specifically, a line with a slope of -1 is drawn from the intersection of the lower limit of the LTE line's transmission bandwidth (transmission min) and the upper limit of the Wi-Fi® line's transmission bandwidth (transmission max) (the scale intervals on the horizontal and vertical axes are the same), and the LTE line's transmission bandwidth to the right of this line is not allocated. In the range where both the LTE and Wi-Fi® lines are available, video data is transmitted using independently adjusted bandwidths for each, and the receiving end selects the video data with the best quality. This selection method makes it possible to optimize transmission while prioritizing the Wi-Fi® line and maintaining video quality as much as possible.

[0047] Figure 10 is a schematic diagram illustrating how the allocated bandwidth maps exemplified in Figures 6 to 9 are identified according to changes in the predicted bandwidth of multiple lines. For example, the identification unit 11 may identify the allocated bandwidth map by mutually referencing the predicted bandwidth results of multiple lines. For example, in the map in the lower left of the figure, the transmission bandwidth 1001 of line 1 and the transmission bandwidth 1002 of line 2 partially overlap. On the other hand, in the map in the upper right, the transmission bandwidth 1003 of line 1 and the transmission bandwidth 1004 of line 2 do not overlap. In this way, the allocated bandwidth map to be used can be identified according to the user's policy (for example, which conditions to prioritize, such as cost, communication speed, or security). Alternatively, the identification unit 11 may identify the allocated bandwidth map based on the communication area where the transmitting device is located.

[0048] As described above, in the information processing system 1A according to this exemplary embodiment, the first selection unit 12 identifies the wireless communication line to transmit video by referring to the predicted bandwidth, determining a priority line from among a plurality of wireless communication lines to which the data will be transmitted preferentially, and designating lines to which transmission bandwidth can be allocated as backup lines. Therefore, according to the information processing system 1A according to this exemplary embodiment, in addition to the effects of the information processing system 1 according to exemplary embodiment 1, the effect of reducing communication costs can be obtained by preferentially selecting a Wi-Fi® line.

[0049] Furthermore, in the information processing system 1A according to this exemplary embodiment, the first selection unit 12 identifies the wireless communication line to transmit video by selecting one from a plurality of pre-created allocation bandwidth maps, each of which indicates the transmission bandwidth allocated to a plurality of wireless communication lines. Therefore, in addition to the effects achieved by the information processing system 1 according to exemplary embodiment 1, the information processing system 1A according to this exemplary embodiment provides the effect of efficiently selecting lines by selecting one from a plurality of pre-created allocation bandwidth maps.

[0050] (Configuration of Information Processing Device 2A) Next, the information processing device 2A according to this exemplary embodiment will be described with reference to Figure 11. Figure 11 is a block diagram showing the configuration of the information processing device 2A. The information processing device 2A includes a transmission unit 10, a bandwidth adjustment unit 30, and a control unit 40.

[0051] The transmission unit 10 comprises a selection unit 11, a first selection unit 12, and a data transmission unit 13. The bandwidth adjustment unit 30 comprises a bandwidth fluctuation prediction unit 31 and a transmission bandwidth adjustment unit 32. The control unit 40 comprises a processor 41 and a memory 42. The configuration and functions of each of these units are the same as those described in the information processing system 1A. The video data transmitted from the data transmission unit 13 is received by a receiving device (not shown).

[0052] As described above, in the information processing device 2A according to this exemplary embodiment, the first selection unit 12 employs a selection method in which it refers to the predicted bandwidth to determine a priority line from among the multiple wireless communication lines 15 to which video data will be transmitted preferentially, and designates lines to which transmission bandwidth can be allocated as backup lines. Alternatively, the first selection unit 12 employs a selection method in which it identifies the wireless communication line to which video will be transmitted by selecting one from a plurality of pre-created allocation bandwidth maps that show the transmission bandwidth allocated to each of the multiple wireless communication lines. Therefore, according to the information processing device 2A according to this exemplary embodiment, the same effects as those obtained by the information processing system 1A can be obtained.

[0053] (Information processing method S2 flow) Next, the flow of the information processing method S2 according to this exemplary embodiment will be explained with reference to Figure 12. Figure 12 is a flowchart showing the flow of the information processing method S2.

[0054] As shown in the figure, the information processing method S2 includes steps S21 to S26. Step S21 is a step in which at least one processor (e.g., a bandwidth fluctuation prediction unit 31) predicts a predicted bandwidth that indicates the range of bandwidth fluctuations over time in each of the plurality of wireless communication lines.

[0055] Step S22 is a step in which at least one processor (e.g., a transmission bandwidth adjustment unit 32) adjusts the bandwidth used to transmit video data in each of the multiple wireless communication lines by referring to the predicted bandwidth.

[0056] Step S23 is a step in which at least one processor (e.g., specific unit 11) identifies a selection method for selecting a wireless communication line to which video data is transmitted, according to the predicted bandwidth.

[0057] Step S24 is a step in which at least one processor (e.g., the first selection unit 12) selects one or more wireless communication lines from among a plurality of wireless communication lines to transmit video data during transmission, with reference to a specified selection method.

[0058] Step S25 is, for example, a step in which the data transmission unit 13 transmits the video data captured on the mobile device using the selected wireless communication line.

[0059] Step S26 is a step in which at least one processor (for example, the control unit 40) determines whether or not transmission has finished. If it is determined in step S26 that transmission has finished (step S26: YES), then information processing is terminated. If it is determined in step S26 that transmission has not finished (step S26: NO), then the process returns to step S21.

[0060] Although not shown in Figure 12, the information processing method S2 may further include receiving the transmitted video data, and if there are multiple video data files received, selecting one from among the multiple received video data files.

[0061] According to the information processing method S2 described above, the stability of wireless communication can be maintained even if the communication conditions change during communication. For example, video data can be transmitted stably without interruption or stopping.

[0062] [Exemplary Embodiment 3] A third exemplary embodiment of the present invention will be described in detail with reference to the drawings. Components having the same function or configuration as those described in exemplary embodiments 1 and 2 will be denoted by the same reference numerals, and their descriptions will not be repeated.

[0063] (Configuration of Information Processing System 1B) Figure 13 is a block diagram showing the configuration of the information processing system 1B according to this exemplary embodiment 3. As shown in the figure, the information processing system 1B includes a transmitting device 10, a receiving device 20, a bandwidth adjustment device 30, a control device 40A, and an imaging device 50. Of these, the configuration or function of the transmitting device 10, the receiving device 20, and the bandwidth adjustment device 30 are the same as those described for the information processing system 1A, so their description is omitted.

[0064] The control device 40A includes a processor 41 and a memory 42, and the memory 42 stores allocated bandwidth map data 421. The allocated bandwidth map data 421 is the data of the allocated bandwidth map described in the information processing system 1A.

[0065] The imaging device 50 captures video data. The captured video data is sent to the transmitting device 10. The bandwidth adjustment device 30 sends adjusted bandwidth information for transmitting the video data to the transmitting device 10. The transmitting device 10 transmits the video data using the selected wireless communication line 15 at the adjusted bandwidth. The receiving device 20 receives the video data transmitted from the transmitting unit 10. If video data is transmitted using multiple wireless communication lines, the second selection unit 21 selects the video data to be used.

[0066] As described above, in the information processing system 1B according to this exemplary embodiment, the transmitting device 10 selects a wireless communication line by referring to the allocated bandwidth map data 421 and transmits the video data captured by the imaging device 50 in the adjusted bandwidth. Therefore, in addition to the effects of the information processing system 1 according to the exemplary embodiment 1, the information processing system 1B according to this exemplary embodiment provides the effect of efficiently selecting a wireless communication line and transmitting video data.

[0067] (Configuration of Information Processing Unit 2B) Next, the information processing device 2B according to this exemplary embodiment 3 will be described with reference to Figure 14. Figure 14 is a block diagram showing the configuration of the information processing device 2B. The information processing device 2B is configured as a transmitting and receiving device.

[0068] As shown in the figure, the information processing device 2B comprises a transmitting unit 10, a receiving unit 20, a bandwidth adjustment unit 30, a control unit 40A, and an imaging unit 50. Of these, the configuration and function of the transmitting unit 10 and the bandwidth adjustment unit 30 are the same as those of the corresponding devices described in the information processing device 2A, so their explanation is omitted.

[0069] The receiving unit 20 comprises a second selection unit 21 and a data receiving unit 22. The functions of the second selection unit 21 and the data receiving unit 22 are the same as those of the devices described in the configuration of the information processing system 1A, so their description is omitted. Furthermore, the configuration or function of the control unit 40A and the imaging unit 50 are the same as those of the control device 40A and imaging device 50 described in the configuration of the information processing system 1B, so their description is omitted. The transmitting unit 10 and the receiving unit 20 are located at separate positions from each other.

[0070] As described above, in the information processing device 2B according to this exemplary embodiment, the transmission unit 10 selects a wireless communication line by referring to the allocated bandwidth map data 421 and transmits the video data captured by the imaging unit 50 in the adjusted bandwidth. Therefore, the same effects as the information processing system 1B can be obtained with the information processing device 2B according to this exemplary embodiment.

[0071] [Examples of implementation using software] Some or all of the functions of the information processing systems 1, 1A, 1B and the information processing devices 2, 2A, 2B (hereinafter referred to as "information processing systems, etc.") may be implemented by hardware such as integrated circuits (IC chips) or by software.

[0072] In the latter case, the information processing system, etc., is implemented by a computer that executes instructions for a program, which is software that realizes each function. An example of such a computer (hereinafter referred to as computer C) is shown in Figure 15. Computer C comprises at least one processor C1 and at least one memory C2. The memory C2 stores a program P that causes computer C to operate as an information processing system, etc. In computer C, the processor C1 reads program P from memory C2 and executes it, thereby realizing each function of the information processing system, etc.

[0073] For processor C1, for example, a CPU (Central Processing Unit), GPU (Graphic Processing Unit), DSP (Digital Signal Processor), MPU (Micro Processing Unit), FPU (Floating Point Number Processing Unit), PPU (Physics Processing Unit), TPU (Tensor Processing Unit), quantum processor, microcontroller, or a combination thereof can be used. For memory C2, for example, flash memory, HDD (Hard Disk Drive), SSD (Solid State Drive), or a combination thereof can be used.

[0074] Computer C may also be equipped with RAM (Random Access Memory) for loading program P at runtime and for temporarily storing various data. Furthermore, computer C may be equipped with communication interfaces for sending and receiving data with other devices. Additionally, computer C may be equipped with input / output interfaces for connecting input / output devices such as keyboards, mice, displays, and printers.

[0075] Furthermore, program P can be recorded on a non-temporary, tangible recording medium M that is readable by computer C. Such a recording medium M could be, for example, tape, disk, card, semiconductor memory, or programmable logic circuitry. Computer C can acquire program P via such a recording medium M. Program P can also be transmitted via a transmission medium. Such a transmission medium could be, for example, a communication network or broadcast waves. Computer C can also acquire program P via such a transmission medium.

[0076] [Additional Note 1] The present invention is not limited to the embodiments described above, and various modifications are possible within the scope of the claims. For example, embodiments obtained by appropriately combining the technical means disclosed in the embodiments described above are also included in the technical scope of the present invention.

[0077] [Additional Note 2] Some or all of the embodiments described above may also be described as follows. However, the present invention is not limited to the embodiments described below.

[0078] (Note 1) An information processing system comprising: identification means for identifying a selection method for selecting a wireless communication line for transmitting data acquired by a mobile device, according to a predicted bandwidth indicating a predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines; and first selection means for selecting one or more of the wireless communication lines for transmitting the data from among the plurality of wireless communication lines during transmission, by referring to the identified selection method. With the above configuration, the stability of wireless communication can be maintained even if the communication conditions change during communication.

[0079] (Note 2) The information processing system according to Appendix 1, characterized in that the selection method involves referring to the predicted bandwidth to determine a priority line from among the plurality of wireless communication lines to which the data will be transmitted preferentially, and designating a line to which a transmission bandwidth can be allocated as a backup line. The above configuration allows for efficient selection of wireless communication lines.

[0080] (Note 3) The information processing system according to Appendix 2, characterized in that the selection method is a method of selecting one from a plurality of pre-created allocation bandwidth maps that show the transmission bandwidth allocated to each of the plurality of wireless communication lines. The above configuration allows for efficient selection of wireless communication lines.

[0081] (Note 4) The information processing system according to any one of the appendices 1 to 3, further comprising a bandwidth adjustment means for adjusting the bandwidth used to transmit the data in each of the plurality of wireless communication lines, with reference to the predicted bandwidth. With the above configuration, data can be transmitted stably depending on the conditions of the wireless communication line.

[0082] (Note 5) The information processing system according to any one of the appendices 1 to 4, further comprising a receiving means for receiving transmitted data, wherein the receiving means comprises a second selection means for selecting one of the received data when a plurality of wireless communication lines for transmitting the data are selected. With the above configuration, it is possible to retain only the highest quality data among the data transmitted using multiple wireless communication lines.

[0083] (Note 6) The information processing system according to Appendix 3, characterized in that the selection method is a method for determining the allocated bandwidth map by referring to the communication area in which the transmitting means is located. According to the above configuration, the optimal bandwidth allocation map can be determined according to the communication area.

[0084] (Note 7) The information processing system according to Appendix 3, characterized in that the selection method is a method of limiting the maximum value of the transmission bandwidth of a line configured by a short-range wireless communication standard to the maximum value of the transmission bandwidth of a line configured by a mobile communication standard, within the range where a line configured by a mobile communication standard can be used. According to the above configuration, the change in video quality when switching lines can be minimized, reducing the sense of unease during line switching.

[0085] (Note 8) The information processing system according to Appendix 3, characterized in that the selection method is such that, in the bandwidth where a line configured by a short-range wireless communication standard is available, a line configured by a mobile communication standard is not allocated the transmission bandwidth. With the above configuration, transmission can be optimized to prioritize lines configured with short-range wireless communication standards while maintaining video quality as much as possible.

[0086] (Note 9) An information processing device comprising: identification means for identifying a selection method for selecting a wireless communication line for transmitting data acquired by a mobile device, according to a predicted bandwidth indicating a predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines; and first selection means for selecting one or more of the wireless communication lines for transmitting the data from among the plurality of wireless communication lines during transmission, by referring to the identified selection method. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 1.

[0087] (Note 10) The information processing apparatus according to Appendix 9, characterized in that the selection method involves referring to the predicted bandwidth to determine a priority line from among the plurality of wireless communication lines to which the data will be transmitted preferentially, and designating a line to which a transmission bandwidth can be allocated as a backup line. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 2.

[0088] (Note 11) The information processing device according to Appendix 10, characterized in that the selection method is a method of selecting one from a plurality of pre-created allocation bandwidth maps that show the transmission bandwidth allocated to each of the plurality of wireless communication lines. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 3.

[0089] (Note 12) The information processing apparatus according to any one of appendices 9 to 11, further comprising a bandwidth adjustment means for adjusting the bandwidth used to transmit the data in each of the plurality of wireless communication lines, with reference to the predicted bandwidth. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 4.

[0090] (Note 13) The information processing apparatus according to any one of appendices 9 to 12, further comprising a receiving means for receiving transmitted data, wherein the receiving means comprises a second selection means for selecting one of the received data when a plurality of wireless communication lines for transmitting the data are selected. According to the above configuration, it is possible to obtain effects similar to those obtained by the information processing system described in Appendix 5.

[0091] (Note 14) The information processing apparatus according to Appendix 11, characterized in that the selection method is a method for determining the allocated bandwidth map by referring to the communication area in which the transmitting means is located. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 6.

[0092] (Note 15) An information processing method characterized by comprising: at least one processor identifying a selection method for selecting a wireless communication line for transmitting data acquired by a mobile device, in accordance with a predicted bandwidth indicating a predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines; and, with reference to the identified selection method, selecting one or more of the wireless communication lines for transmitting the data from among the plurality of wireless communication lines during transmission. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 1.

[0093] (Note 16) The information processing method according to Appendix 15, characterized in that the selection method refers to the predicted bandwidth to determine a priority line from among the plurality of wireless communication lines to which the data will be transmitted preferentially, and the line to which a transmission bandwidth can be allocated will be designated as a backup line. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 2.

[0094] (Note 17) The information processing method according to Appendix 16, characterized in that the selection method is a method of selecting one from a plurality of pre-created allocation bandwidth maps that show the transmission bandwidth allocated to each of the plurality of wireless communication lines. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 3.

[0095] (Note 18) The information processing method according to any one of appendices 15 to 17, further comprising adjusting the bandwidth used to transmit the data in each of the plurality of wireless communication lines, with reference to the predicted bandwidth. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 4.

[0096] (Note 19) The information processing method according to any one of appendices 15 to 18, further comprising receiving the transmitted data, and further comprising selecting one of the received data from the multiple wireless communication lines selected for transmitting the data. According to the above configuration, it is possible to obtain effects similar to those obtained by the information processing system described in Appendix 5.

[0097] (Note 20) The information processing method according to Appendix 17, characterized in that the selection method is a method for determining the allocated bandwidth map by referring to the communication area in which the transmitting means is located. According to the above configuration, it is possible to obtain the same effects as those obtained by the information processing system described in Appendix 6.

[0098] (Note 21) An information processing program that causes a computer to perform the following steps: identify a selection method for selecting a wireless communication line to transmit data acquired by a mobile device, according to a predicted bandwidth indicating the predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines; and, referring to the identified selection method, select one or more of the wireless communication lines from the plurality of wireless communication lines to transmit the data during transmission.

[0099] (Note 22) A computer-readable, non-temporary recording medium containing the information processing program described in Appendix 21.

[0100] [Additional Note 3] Some or all of the embodiments described above can also be expressed as follows: An information processing system comprising at least one processor, the processor performing: a identification process to identify a selection method for selecting a wireless communication line for transmitting data acquired by a mobile device, according to a predicted bandwidth indicating a predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines; and a selection process to select one or more of the wireless communication lines for transmitting the data from among the plurality of wireless communication lines during transmission, with reference to the identified selection method.

[0101] Furthermore, this information processing system may also be equipped with memory, and this memory may store a program that causes the processor to execute the specific processing and the selection processing. This program may also be recorded on a computer-readable, non-temporary, tangible recording medium. [Explanation of Symbols]

[0102] 1, 1A, 1B… Information Processing Systems 2, 2A, 2B… Information Processing Devices 10…Transmitter (transmitter unit) 11…Specific part 12…First Selection Section 13…Transmitter 20... Receiving device (receiving unit) 21...Second Selection Section 22... Receiver 30…Bandwidth adjustment device (bandwidth adjustment unit) 31…Bandwidth fluctuation prediction section 32... Bandwidth adjustment section 40, 40A... Control device (control unit) 41… Processor 42...memory 50…Imaging device (imaging unit)

Claims

1. A selection means for identifying a selection method for selecting the wireless communication line for transmitting data acquired by a mobile device, according to the predicted bandwidth, which indicates the predicted range of bandwidth fluctuations over time in each of the multiple wireless communication lines, A first selection means that, with reference to the specified selection method, selects one or more wireless communication lines from among the plurality of wireless communication lines for transmitting the data during transmission, An information processing system characterized by comprising the following features.

2. The selection method involves referring to the predicted bandwidth to determine a priority line from among the multiple wireless communication lines to which the data will be transmitted preferentially, and designating lines to which transmission bandwidth can be allocated as backup lines. The information processing system according to feature 1.

3. The selection method is a method of selecting one from a plurality of pre-created allocation bandwidth maps that show the transmission bandwidth allocated to each of the plurality of wireless communication lines. The information processing system according to feature 2.

4. The system further comprises bandwidth adjustment means for adjusting the bandwidth used to transmit the data in each of the plurality of wireless communication lines, with reference to the predicted bandwidth. The information processing system according to any one of claims 1 to 3.

5. The system further comprises receiving means for receiving the transmitted data, The receiving means includes a second selection means for selecting one of the received data when multiple wireless communication lines for transmitting the data are selected. The information processing system according to any one of claims 1 to 3.

6. The selection method is a method for determining the allocated bandwidth map by referring to the communication area where the transmitting means is located. The information processing system according to feature 3.

7. The aforementioned selection method is a method that, within the range where a line configured by a mobile communication standard can be used, limits the maximum value of the transmission bandwidth of a line configured by a short-range wireless communication standard to the maximum value of the transmission bandwidth of the line configured by the said mobile communication standard. The information processing system according to feature 3.

8. The aforementioned selection method is one in which, in the bandwidth where a link configured by a short-range wireless communication standard is available, a link configured by a mobile communication standard is not allocated the aforementioned transmission bandwidth. The information processing system according to feature 3.

9. At least one processor, To identify a selection method for selecting the wireless communication line for transmitting data acquired by a mobile device, according to the predicted bandwidth, which indicates the predicted range of bandwidth fluctuations over time in each of the multiple wireless communication lines. Referencing the specified selection method, select one or more wireless communication lines from among the plurality of wireless communication lines to transmit the data during transmission. An information processing method characterized by including

10. An information processing program that causes a computer to perform the following processes: identify a selection method for selecting a wireless communication line for transmitting data acquired by a mobile device, according to a predicted bandwidth indicating a predicted range of bandwidth fluctuations over time in each of a plurality of wireless communication lines; and, referring to the identified selection method, select one or more of the wireless communication lines for transmitting the data from among the plurality of wireless communication lines during transmission.

Images