Information processing device, vehicle, information processing method, and program

Abstract

To provide an information processing device, a vehicle, an information processing method, and a program.SOLUTION: An information processing device for communicating with an external device via a communication network includes: a communication state measuring unit that measures a communication state between the external device and the information processing device; a communication state prediction unit that predicts a future communication state between the external device and the information processing device based on the communication state measured by the communication state measuring unit; a reaching situation estimation unit that estimates a future reaching situation of data transmitted from the information processing device to the external device based on the future communication state predicted by the communication state prediction unit; and a reaching situation notification unit that notifies a user of the information processing device of the reaching situation estimated by the reaching situation estimation unit.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an information processing device, a vehicle, an information processing method, and a program. [Background technology]

[0002] Patent document 1 states that "when one computer receives voice data from another computer, the one computer notifies the other computer that it has received the data, and the other computer, upon receiving the notification, displays an image corresponding to the notification" (Claim 1). [Prior art document] [Patent documents] [Patent Document 1] JP 2004-48329 A Summary of the Invention

[0003] In a first aspect of the present invention, an information processing device that communicates with an external device via a communication network is provided. The information processing device may include a communication state measurement unit that measures a state of communication between the external device and the information processing device. The information processing device may include a communication state prediction unit that predicts a future state of communication between the external device and the information processing device based on the state of communication measured by the communication state measurement unit. The information processing device may include a delivery state estimation unit that estimates a future delivery state of data transmitted from the information processing device to the external device during communication between the external device and the information processing device based on the future state of communication predicted by the communication state prediction unit. The information processing device may include a delivery state notification unit that notifies a user of the information processing device of the delivery state estimated by the delivery state estimation unit.

[0004] The state of the communication may include any of the bandwidth and throughput.

[0005] The information processing device may further include a communication state adjustment unit that adjusts a state of communication between the external device and the information processing device. The communication state measurement unit may measure the state of communication adjusted by the communication state adjustment unit.

[0006] The information processing device may perform one-way communication with an external display device. The arrival status notification unit may notify a user of the arrival status by causing the display device to display the arrival status.

[0007] The arrival status notification unit may notify the user of the arrival status by displaying an icon indicating the arrival status on the display device. The arrival status notification unit may display an icon having a different display form depending on the communication status on the display device.

[0008] The delivery status estimation unit may further estimate a current delivery status of the data based on the communication status measured by the communication status measurement unit. The delivery status notification unit may display the future delivery status and the current delivery status estimated by the delivery status estimation unit on a display device.

[0009] The information processing device may further include a voice detection unit that detects a voice uttered by a user. The data may be voice data of a voice detected by the voice detection unit, and may include voice data that the information processing device transmits to an external device during communication between the external device and the information processing device. The arrival status notification unit may cause the display device to display a current arrival status of the voice data while the voice detection unit is detecting a voice, and may cause the display device to display a future arrival status of the voice data while the voice detection unit is not detecting a voice.

[0010] The information processing device may further include a voice detection unit that detects a voice uttered by a user. The data may be voice data of a voice detected by the voice detection unit, and may include voice data that the information processing device transmits to an external device during communication between the external device and the information processing device. The arrival status notification unit may cause the display device to display the arrival status of the voice data while the voice detection unit is detecting the voice, and may not cause the display device to display the arrival status of the voice data while the voice detection unit is not detecting the voice.

[0011] The information processing device may further include a voice detection unit that detects voice uttered by the user. The information processing device may further include an image data sharing unit that causes the display device and the external device to display image data in real time. The data may be voice data of the voice detected by the voice detection unit and may include voice data that the information processing device transmits to the external device during communication between the external device and the information processing device. The data may include image data that the information processing device transmits to the external device during communication between the external device and the information processing device. The arrival status notification unit may cause the display device to display the arrival status of the voice data and the arrival status of the image data, respectively.

[0012] The information processing device may further include a transmission amount acquisition unit that acquires a transmission amount of image data transmitted by the information processing device to the external device during communication between the external device and the information processing device. The arrival status notification unit may estimate a time lag time for the image data to be displayed on the display device and the external device based on the future communication state predicted by the communication state prediction unit and the transmission amount acquired by the transmission amount acquisition unit. The arrival status notification unit may display the time lag time estimated by the arrival status estimation unit on the display device together with the arrival status of the image data.

[0013] In a second aspect of the present invention, a vehicle is provided. The vehicle may include any one of the information processing devices described above. The vehicle may include at least one display device selected from the group consisting of a meter and a head-up display.

[0014] In a third aspect of the present invention, there is provided an information processing method executed by an information processing device that communicates with an external device via a communication network. The information processing method may include a communication state measurement step of measuring a state of communication between the external device and the information processing device in real time. The information processing method may include a communication state prediction step of predicting a future state of communication between the external device and the information processing device based on the state of communication measured in the communication state measurement step. The information processing method may include a delivery status estimation step of estimating a future delivery status of data transmitted from the information processing device to the external device during communication between the external device and the information processing device based on the future state of communication predicted in the communication state prediction step. The information processing method may include a delivery status notification step of notifying a user of the information processing device of the delivery status estimated in the delivery status estimation step.

[0015] In a fourth aspect of the present invention, a program is provided. The program may cause a computer that communicates with an external device via a communication network to execute a communication state measurement procedure that measures a state of communication between the external device and the computer. The program may cause the computer to execute a communication state prediction procedure that predicts a future state of communication between the external device and the computer based on the state of communication measured in the communication state measurement procedure. The program may cause the computer to execute a delivery status estimation procedure that estimates a future delivery status of data transmitted from the computer to the external device during communication between the external device and the computer based on the future state of communication predicted in the communication state prediction procedure. The program may cause the computer to execute a delivery status notification procedure that notifies a user of the computer of the delivery status estimated in the delivery status estimation procedure.

[0016] The above summary of the invention does not list all of the necessary features of the present invention. Also, subcombinations of these features may also be inventions. [Brief description of the drawings]

[0017] [Figure 1] 2 shows a schematic diagram of a usage pattern of a vehicle 50 according to an embodiment. [Diagram 2] 2 illustrates a schematic functional configuration of a vehicle 50. [Diagram 3] 13 shows an example of a graph of time series data of the amount of voice data, that is, the communication state. [Figure 4] An example of a display on the screen 27 of the display device 26 is shown. [Diagram 5] Another display example on the screen 27 of the display device 26 is shown. [Figure 6] 11 shows yet another example of display on the screen 27 of the display device 26. [Figure 7] 2 illustrates a schematic diagram of data flows between some functional blocks of an information processing device 200. [Figure 8] 2 shows a flowchart relating to an information processing method executed by the information processing device 200. [Figure 9] An example implementation of a control system 1000 in a vehicle 50 is shown. [Figure 10] An example of a computer 2000 is shown. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0019] FIG. 1 is a schematic diagram showing a usage pattern of vehicles 50a and 50b according to an embodiment. The vehicles 50a and 50b are, for example, automobiles. The vehicles 50a and 50b may be automobiles equipped with internal combustion engines, electric vehicles, fuel cell vehicles (FCVs), etc. The vehicles 50a and 50b are examples of transportation equipment. In this embodiment, one of the vehicles 50a and 50b may be referred to as "vehicle 50" and the other may be referred to as "external vehicle 50."

[0020] The vehicle 50a and the vehicle 50b are respectively equipped with an information processing device 200a and an information processing device 200b. In this embodiment, one of the information processing device 200a and the information processing device 200b may be referred to as an "information processing device 200", and the other may be referred to as an "external device".

[0021] The information processing device 200a may perform data communication with the control device 200b of the external vehicle 50b, the external device 30a, the external device 30b, etc. In this embodiment, the control device 200b of the external vehicle 50b, the external device 30a, the external device 30b, etc. may be collectively referred to as the "external device 30".

[0022] The information processing device 200 communicates with the external device 30 via a communication network 90 and a wireless communication system 92. The information processing device 200 may communicate unidirectionally with the external device 30. The communication network 90 includes an IP network such as the Internet, a P2P network, a dedicated line including a VPN, a virtual network, and the like. In this embodiment, the wireless communication system 92 is a mobile communication network connected to the communication network 90. ​​For example, the wireless communication system 92 includes a wireless access network and a core network.

[0023] The external device 30a includes, for example, a server that provides services to the occupant of the vehicle 50. For example, the external device 30a includes a server that stores content data such as videos, a server that provides SNS (social network service), and the like. The information processing device 200 may receive video data from the external device 30a in response to an instruction from the occupant of the vehicle 50. Furthermore, the information processing device 200 may receive text information, audio information, image information, video information, and the like as an SNS message from the external device 30a in response to an instruction from the occupant of the vehicle 50. Furthermore, the information processing device 200 may transmit text information, audio information, image information, video information, and the like as an SNS message from the occupant of the vehicle 50 to the external device 30a in response to an instruction from the occupant of the vehicle 50.

[0024] The external device 30b is, for example, a server that provides services related to the control of the vehicle 50. The external device 30b may include, for example, a server that collects control system-related information of the vehicle 50. The control-related information collected by the external device 30 can be exemplified by LIDAR data used for the automatic driving of the vehicle 50. The external device 30b may include, for example, a server that provides control system-related information to the vehicle 50. The control system-related information provided by the external device 30b may include map data used for the automatic driving of the vehicle 50. The information processing device 200 may transmit LIDAR data acquired for automatic driving control to the external device 30b. The information processing device 200 may receive map data from the external device 30b regardless of an instruction from an occupant of the vehicle 50.

[0025] The information processing device 200 may control the state of communication with the external device 30 according to the priority of data communication. For example, data communication such as SNS data has a lower priority than data communication of the control-related information of the vehicle 50. The information processing device 200 predicts a future state of communication based on time-series data of the state of communication. When the information processing device 200 predicts that the state of communication in the future will be low, the information processing device 200 may delay data communication with the external device 30a, which has a lower priority than the control-related information of the vehicle 50, to a degree that allows a minimum service quality to be maintained. In this way, the communication state of the data communication of the control-related information of the vehicle 50 may be maintained. In addition, when the information processing device 200 predicts that the state of communication will be further deteriorated and that it is predicted that the minimum service quality cannot be maintained with the external device 30a, the information processing device 200 may stop data communication with the external device 30a and maintain the communication state of the data communication of the control-related information of the vehicle 50. In this way, the information processing device 200 may increase the possibility of continuing data communication of high priority by restricting communication of data of low priority. In the following description, the state of communication may be referred to as a "communication state".

[0026] FIG. 2 shows a schematic functional configuration of the vehicle 50. The vehicle 50 includes an information processing device 200 and a display device 26. The vehicle 50 in this embodiment further includes a control device 24a, a control device 24b, a device 25a, a device 25b, and an in-vehicle network 29. The information processing device 200 includes a communication state measurement unit 210, a communication state prediction unit 220, an arrival status estimation unit 224, and an arrival status notification unit 225. The information processing device 200 in this embodiment further includes a communication unit 202, a band control unit 230, a control target determination unit 240, and a priority control unit 250. The information processing device 200 in this embodiment further includes a voice detection unit 226, an image data sharing unit 227, and a transmission amount acquisition unit 228. Note that FIG. 2 shows functional blocks related to this embodiment. The vehicle 50 and the information processing device 200 may include functional blocks other than the functional blocks shown in FIG. 2.

[0027] The information processing device 200, the control device 24a, the control device 24b, and the display device 26 are connected to each other via an in-vehicle network 29. The information processing device 200 in this embodiment communicates with the display device 26. The in-vehicle network 29 may include an Ethernet (registered trademark) network. The in-vehicle network 29 may include a CAN (Controller Area Network).

[0028] The control devices 24a and 24b control the devices 25a and 25b, respectively. The control devices 24a and 24b may each be an ECU (Electronic Control Unit). The devices 25a and 25b include, for example, drive system devices such as an engine, and information and communication system devices. A specific example of an embodiment of the control devices 24 and 25 will be described with reference to FIG. 9 and the like. The control devices 24a and 24b may be collectively referred to as "control devices 24". The devices 25a and 25b may be collectively referred to as "devices 25".

[0029] The communication unit 202 communicates with the external device 30 via a mobile communication network. The communication status measurement unit 210 measures the communication status between the external device 30 and the information processing device 200. The communication status includes either the bandwidth or the throughput. The communication status measurement unit 210 may measure the one-way communication status in the upload direction from the communication unit 202 to the external device 30. The communication status measurement unit 210 may measure the one-way communication status in the download direction from the external device 30 to the communication unit 202. The communication status prediction unit 220 predicts the future communication status between the external device 30 and the information processing device 200 based on the communication status measured by the communication status measurement unit 210. The "future" here may refer to, for example, several seconds ahead from the current time, and specifically, may refer to about 3 to 10 seconds ahead from the current time. The same applies to the following explanation, and duplicate explanations will be omitted.

[0030] The arrival status estimation unit 224 estimates an arrival status of data transmitted from the information processing device 200 to the external device 30 during communication between the external device 30 and the information processing device 200, based on the future communication state predicted by the communication state prediction unit 220. An example of the data is voice data or image data. The arrival status estimation unit 224 may estimate the current arrival status of data transmitted from the information processing device 200 to the external device 30 during the communication, or may estimate the future arrival status of the data.

[0031] The arrival status notification unit 225 notifies the user of the information processing device 200 of the arrival status estimated by the arrival status estimation unit 224. The arrival status notification unit 225 may notify the user of the arrival status by, for example, an image or sound indicating the arrival status. As an example, the arrival status notification unit 225 may notify the user of the arrival status of the data by displaying the arrival status of the data on the display device 26. Note that the display device 26 may be at least one of a meter, a head-up display, a display audio, and a screen audio in the vehicle 50, but is preferably provided in the meter and / or the head-up display in consideration of driver distraction.

[0032] The band control unit 230 adjusts the communication state between the external device 30 and the information processing device 200. In other words, the band control unit 230 executes band control of data, for example, voice data, transmitted and received between the external device 30 and the information processing device 200, that is, data amount control. In this case, the communication state measurement unit 210 may measure the communication state adjusted by the band control unit 230. In this case, the communication state prediction unit 220 may predict the future communication state based on the communication state after the adjustment. In other words, the communication state prediction unit 220 may predict the future data amount based on the data amount after the adjustment. In this case, the delivery status estimation unit 224 may estimate the future data delivery status based on the future communication state, that is, the future data amount. In addition, the band control unit 230 is an example of a communication state adjustment unit.

[0033] The bandwidth control unit 230 may control data communication with the external device 30 based on the communication state predicted by the communication state prediction unit 220. Specifically, the bandwidth control unit 230 may control data communication with the external device 30 by controlling the communication unit 202. When audio data or image data is input, the bandwidth control unit 230 transmits the audio data, etc. to the external device 30 via the communication unit 202.

[0034] The control target determination unit 240 may determine the type of data communication with the external device 30. The priority control unit 250 may set communication priorities for a plurality of data communications based on the type determined by the control target determination unit 240. When the future communication state falls below a predetermined threshold, the band control unit 230 may restrict the communication state of data communication with a low priority set by the priority control unit 250 in comparison with data communication with a high priority set by the priority control unit 250. This may increase the possibility of continuous communication of high priority data. Note that, when the future communication state temporarily falls below a predetermined threshold, the band control unit 230 may not restrict the communication state of data communication with a low priority. For example, when the time during which the future communication state falls below a predetermined threshold is equal to or shorter than a predetermined time, the band control unit 230 may not restrict the communication state of data communication with a low priority. When the time during which the future communication state falls below a predetermined threshold exceeds a predetermined time, the band control unit 230 may restrict the communication state of data communication with a low priority. The predetermined threshold may be a variable value. The bandwidth control unit 230 may determine the threshold value based on the state of data communication with the external device 30. For example, the bandwidth control unit 230 may determine the threshold value based on the communication state required to provide a minimum service quality in data communication with the external device 30. The bandwidth control unit 230 may determine the threshold value as a value obtained by multiplying the communication state required to provide the minimum service quality by a predetermined coefficient. The predetermined coefficient may be any value equal to or greater than 1. The predetermined coefficient may be any value less than 1. The predetermined threshold value may be a fixed value rather than a variable value.

[0035] The bandwidth control unit 230 may restrict the communication state by delaying data communication with a low priority set by the priority control unit 250 compared to data communication with a high priority set by the priority control unit 250. The bandwidth control unit 230 may delay the data communication by buffering data communicated in the low priority data communication. Since high priority data is not delayed, the possibility that high priority data can be continuously communicated can be increased. The bandwidth control unit 230 may restrict the communication state by reducing the amount of data communication with a low priority. The bandwidth control unit 230 may restrict the communication state by reducing the bit rate of the low priority data communication. When the data transmitted by the low priority data communication is image data, the bandwidth control unit 230 may restrict the communication state by reducing the image quality of the image to be transmitted.

[0036] The communication state prediction unit 220 may predict the future communication state by using the delay amount of the low-priority data communication delayed by the bandwidth control unit 230. Since the communication state prediction unit 220 predicts the future communication state taking into account the delay information, it is possible to improve the accuracy of the future prediction.

[0037] The control target determination unit 240 may determine whether the type of data communication is data communication related to the control of the vehicle 50. The priority control unit 250 may set the priority of the predetermined data communication related to the control of the vehicle 50 higher than the priority of other data communication. This allows data communication related to the control of the vehicle 50 to be performed continuously, thereby improving the safety of the running of the vehicle 50. When the band control unit 230 cannot secure a predetermined value necessary for continuing the service provision based on the data communication related to the control system of the vehicle 50 as the communication state of the data communication related to the control system of the vehicle 50, the band control unit 230 may stop the other predetermined data communication. Note that the control target determination unit 240 may determine whether the type of data communication is data communication related to the control of the vehicle 50 or multimedia data communication. The priority control unit 250 may set the priority of the data communication related to the control of the vehicle 50 higher than the priority of the multimedia data communication.

[0038] The bandwidth control unit 230 may limit the communication state of the low priority data communication to a predetermined value necessary for continuing the service provision based on the low priority data communication. This can reduce the possibility that the data communication will be completely cut off even for the low priority data communication.

[0039] The voice detection unit 226 includes, for example, a microphone, and detects a voice uttered by a user. When the voice detection unit 226 detects a voice, it outputs voice data of the detected voice to the band control unit 230 and notifies the arrival status notification unit 225 of the fact. The voice data is an example of data that the information processing device 200 transmits to the external device 30 during communication between the external device 30 and the information processing device 200. In this case, the arrival status notification unit 225 may determine whether or not a voice is detected depending on whether or not a notification is input from the voice detection unit 226. Alternatively, when the voice detection unit 226 no longer detects a voice, it may notify the arrival status notification unit 225 of the fact. In this case, the arrival status notification unit 225 may determine whether or not a voice is detected depending on the notification content from the voice detection unit 226.

[0040] The image data sharing unit 227 includes, for example, a memory for storing image data, and causes the display device 26 and the external device 30 to display the image data in real time. The image data may be, for example, a camera image of a drive recorder, a driver monitor camera, or the like. Note that the image data is an example of data that the information processing device 200 transmits to the external device 30 during communication between the external device 30 and the information processing device 200.

[0041] The transmission amount acquisition unit 228 acquires, from the communication unit 202, the amount of image data transmitted by the information processing device 200 to the external device 30 during communication between the external device 30 and the information processing device 200. The transmission amount acquisition unit 228 may also acquire the amount of other data, such as audio data, transmitted by the information processing device 200 to the external device 30 during the communication. The transmission amount acquisition unit 228 notifies the delivery status estimation unit 224 of the acquired transmission amount.

[0042] Figure 3 shows an example of a graph of the amount of voice data, i.e., the communication status, over time. The horizontal axis of the graph indicates time, and the vertical axis indicates the amount of voice data, i.e., the communication status. The graph shows the change in the communication status over time with a thick line.

[0043] The graph also shows the current time with a thin line, and the future time Δt from the current time with a similar thin line. The graph also shows the communication state threshold with a dashed line. The graph also shows time periods when the communication state is equal to or greater than the threshold with a rectangular area with a diagonal line diagonally downwards to the left. The graph also shows time periods when the communication state is less than the threshold with a rectangular area with vertical stripes. The graph also shows time periods when the communication state is 0 with a rectangular area with a diagonal line diagonally downwards to the right.

[0044] The arrival status notifying unit 225 may notify the user of the arrival status estimated by the arrival status estimating unit 224 in different modes depending on which of the three regions shown in Fig. 3 the future communication state predicted by the communication state predicting unit 220 after a time Δt from the current time point is included in. In other words, the arrival status notifying unit 225 may notify the user of the arrival status in different modes depending on whether the predicted communication state is (1) equal to or greater than a predetermined threshold, (2) less than the threshold and greater than 0, or (3) 0.

[0045] In addition, in Fig. 3, an example of a method of notifying the arrival status of the amount of voice data has been described, but the arrival status of the amount of image data may also be notified to the user by a notification method similar to that in Fig. 3. Furthermore, the arrival status notifying unit 225 may use different thresholds for the amount of voice data and the amount of image data. Furthermore, the arrival status notifying unit 225 may use two or more thresholds for one type of communication state, for example, for the amount of voice data. Furthermore, the threshold may be set by the user or may be set by the information processing device 200.

[0046] 4 shows an example of a display on the screen 27 of the display device 26. On the screen 27, (1) is an icon indicating that the user of the information processing device 200 is in a call with the user of the external device 30. In addition, (2) is an icon indicating the arrival status estimated by the arrival status estimation unit 224.

[0047] The arrival status notification unit 225 may notify the user of the arrival status by displaying an icon indicating the arrival status on the display device 26. The arrival status notification unit 225 may further display, on the display device 26, an icon whose display form differs depending on the state of communication.

[0048] As a specific example, the icon (2) on the screen 27 may be displayed in green when the future communication state after a time Δt from the current point in time, as predicted by the communication state prediction unit 220, is equal to or greater than the threshold value described in Fig. 3. Displaying the icon (2) in green may indicate that, during communication between the external device 30 and the information processing device 200, current data has arrived at the external device 30, or that future data will arrive at the external device 30.

[0049] Also, the icon (2) on the screen 27 may be displayed in yellow when the future communication state is less than the threshold and greater than 0. Displaying the icon (2) in yellow may indicate that, during communication between the external device 30 and the information processing device 200, it is becoming difficult for current data to reach the external device 30, or that it will become difficult for future data to reach the external device 30.

[0050] Furthermore, the icon (2) on the screen 27 may be displayed in a flashing red color when the future communication state is 0. The icon (2) flashing red may indicate that, during communication between the external device 30 and the information processing device 200, data has not currently arrived at the external device 30, or that data will not arrive at the external device 30 in the future.

[0051] 4 is merely an example, and the arrival status notifying unit 225 may notify the user of the arrival status in other display modes on the screen 27 of the display device 26. For example, the arrival status notifying unit 225 may cause the display device 26 to display the arrival status of the voice data while the voice detection unit 226 is detecting voice, and may not cause the display device 26 to display the arrival status of the voice data while the voice detection unit 226 is not detecting voice.

[0052] Also, for example, when two or more thresholds are used for one type of communication state, the reachability notification unit 225 may display the icon (2) in four different display modes. Also, the display modes may be set by the user.

[0053] Also, for example, the length of the arrow of the icon (2) may be changed depending on the communication state. More specifically, the better the communication state, the longer the arrow of the icon (2) may be displayed.

[0054] Fig. 5 shows another display example on screen 27 of display device 26. In the example shown in Fig. 5, the current voice data arrival status is shown by icon (1) on the upper side of screen 27, and the future voice data arrival status is shown by icon (2) on the lower side of screen 27. The display method of icons (1) and (2) may be the same as the display method in Fig. 4, or may be different. Also, the display modes of icons (1) and (2) may be the same as each other, or may be different.

[0055] The delivery status estimation unit 224 may estimate the current delivery status of data based on the state of communication measured by the communication status measurement unit 210. As shown in Fig. 5, the delivery status notification unit 225 may cause the display device 26 to display the future delivery status and the current delivery status estimated by the delivery status estimation unit 224.

[0056] Fig. 6 shows yet another display example on screen 27 of display device 26. In the example shown in Fig. 6, the audio data arrival status is indicated by icon (1) on the upper side of screen 27, and the image data arrival status is indicated by icon (2) on the lower side of screen 27. Also, a field (3) is shown to the lower right of icon (2) to display the time lag when image data is displayed on display device 26 and external device 30. The display method of icons (1) and (2) may be the same as the display method in Fig. 4, or may be different. Also, the display mode of icons (1) and (2) may be the same as each other, or may be different.

[0057] As shown in Fig. 6, the arrival status notification unit 225 may display the arrival status of the voice data and the arrival status of the image data on the display device 26. In this case, the arrival status estimation unit 224 may estimate a time lag time when the image data is displayed on the display device 26 and the external device 30 based on the future communication state predicted by the communication state prediction unit 220 and the transmission amount acquired by the transmission amount acquisition unit 228. In this case, the arrival status notification unit 225 may display the time lag time estimated by the arrival status estimation unit 224 on the display device 26 together with the arrival status of the image data. The arrival status notification unit 225 can display on the screen 27 of the display device 26 whether or not a time lag occurs when consecutive images are transmitted in real time, such as during a video call.

[0058] FIG. 7 is a schematic diagram showing the flow of data between some of the functional blocks of the information processing device 200. As shown in FIG.

[0059] The bandwidth control unit 230 monitors transmission data sent from the control device 24. The bandwidth control unit 230 judges whether or not data communication for a new service has started based on a combination of an IP address and a port number. When a new communication has started, the bandwidth control unit 230 notifies the control target determination unit 240 of communication information including the IP address and the port number. In response to a request from the communication status measurement unit 210, the bandwidth control unit 230 transmits information indicating the amount of communication data between the external device 30 to the communication status measurement unit 210.

[0060] The control object determination unit 240 determines the type of data communication based on the communication information. For example, the control object determination unit 240 determines the type of data communication based on an IP address and a port number. The control object determination unit 240 determines the type of data communication based on the data communication information. The control object determination unit 240 notifies the communication status measurement unit 210 and the priority control unit 250 of the control object information including the type of data communication.

[0061] The communication status measuring unit 210 measures the communication status between the communication unit 202 and the external device 30. The communication status measuring unit 210 calculates the current communication status based on the communication data volume notified by the bandwidth control unit 230. The communication status measuring unit 210 may measure the communication status for each control target information. The communication status measuring unit 210 may measure the total communication status. The communication status measuring unit 210 notifies the priority control unit 250 and the communication status prediction unit 220 of the measured communication status of the control target.

[0062] The communication state prediction unit 220 predicts a future communication state based on the communication state measured by the communication state measurement unit 210. For example, the communication state prediction unit 220 identifies a prediction model of time series data based on the time series data of the communication state. The identified prediction model may be any model as long as it can predict future time series data from past time series data. For example, the identified prediction model may be a time series model such as an AR model (AutoRegressive Model) or a stochastic differential equation model such as a Vasicek model. As an example, when the Vasicek model is used, a model parameter of a general solution of the stochastic differential equation of the Vasicek model may be identified using a general solution of the stochastic differential equation of the Vasicek model and time series data using a method such as a maximum likelihood estimation method. The communication state prediction unit 220 calculates a probability distribution of the time series data of the future communication state based on the identified prediction model. The communication state prediction unit 220 may predict a future communication state based on the probability distribution of the time series data of the future communication state. The communication state prediction unit 220 may calculate the probability distribution of the time series data of the future communication state by using the methods described in the above Patent Documents 1 and 2. As described in Japanese Patent Nos. 6337881 and 6390167, the time series data may be corrected to remove the influence of the transient characteristics by using a correction factor calculated based on a communication model that models the transient characteristics after the start of communication of a communication protocol such as TCP communication, and a prediction model of the time series data may be identified based on the corrected time series data.

[0063] The communication state prediction unit 220 may predict the communication state based on the communication state fed back from the external device 30. The communication state prediction unit 220 may predict the future communication state for each communication state control target. Examples of the communication state fed back from the external device 30 include a network transfer delay and a packet loss rate. The communication state prediction unit 220 notifies the delivery status estimation unit 224 and the priority control unit 250 of the predicted future communication state. The communication state prediction unit 220 may calculate the future communication state based on delay information set in the priority control unit 250 as described later.

[0064] The arrival status estimation unit 224 estimates the arrival status of data transmitted from the information processing device 200 to the external device 30 during communication between the external device 30 and the information processing device 200 based on the future communication state predicted by the communication state prediction unit 220, and notifies the arrival status notification unit 225.

[0065] The priority control unit 250 sets a priority for each data communication and determines the communication state of each data communication. The priority control unit 250 sets a priority for each type of data communication based on the control target information for each type of data communication notified by the control target determination unit 240, the type of data communication to be controlled notified by the control target determination unit 240, and the predicted communication state notified by the communication state prediction unit 220, and sets the communication state according to the priority. The priority control unit 250 may set a delay amount of the data communication such that the set communication state is obtained. The priority control unit 250 may notify the communication state prediction unit 220 of the set delay amount of the data communication.

[0066] The priority control unit 250 notifies the bandwidth control unit 230 of the set communication state. The bandwidth control unit 230 delays the transmission data for each type of data communication according to the communication state for each type of data communication notified by the priority control unit 250. The priority control unit 250 also notifies the control device 24 of the amount of input communication data per unit time corresponding to the set communication state. The control device 24 restricts the transmission of the transmission data for each type of data communication according to the amount of input communication data notified by the priority control unit 250. For example, the control device 24 restricts the amount of data to be transmitted to the external device 30 for each service determined by a port number. This makes it possible to appropriately restrict the communication state according to the priority of the data communication.

[0067] Fig. 8 shows a flowchart relating to an information processing method executed by the information processing device 200. The flow in Fig. 8 starts when the information processing device 200 and the external device 30 start communication, for example.

[0068] The information processing device 200 predicts a future communication state (step S101), and starts encoding audio and video and transmitting the audio and video to the external device 30 (step S103). The information processing device 200 estimates a future arrival status of the audio data based on the future communication state, and causes the display device 26 to display an icon indicating the estimated future arrival status (step S105).

[0069] When the information processing device 200 detects the user's voice, i.e., speech (step S107: YES), it does not display an icon indicating the future arrival status of the voice data on the display device 26, but displays an icon indicating the current arrival status of the voice data estimated based on the current communication state on the display device 26 (step S109), and returns to step S107. That is, when the information processing device 200 detects the user's speech, it switches the icon indicating the future arrival status to an icon indicating the current arrival status, and while it is detecting the speech, it displays the icon indicating the current arrival status without displaying the icon indicating the future arrival status.

[0070] When the information processing device 200 no longer detects the user's speech (step S107: NO), it determines whether communication is continuing between the information processing device 200 and the external device 30 (step S111), and if communication is continuing, it returns to step S105, and if communication is not continuing, it ends the flow.

[0071] As described in this flow, the arrival status estimation unit 224 may further estimate the current arrival status of the data based on the state of communication measured by the communication status measurement unit 210. Furthermore, the arrival status notification unit 225 may cause the display device 26 to display the future arrival status and the current arrival status estimated by the arrival status estimation unit 224. As a more specific example, the arrival status notification unit 225 may cause the display device 26 to display the current arrival status of the voice data while the voice detection unit 226 is detecting voice, and cause the display device 26 to display the future arrival status of the voice data while the voice detection unit 226 is not detecting voice.

[0072] As a comparative example of the information processing device 200 according to the present embodiment, an interactive communication tool is used in which the other party of a call transmits a response signal when receiving a voice, so that the user can check whether the other party of the call can hear the voice without asking the other party. In the comparative example, a time lag occurs between the user and the other party of the call. In addition, a part of the communication band is used for transmitting and receiving the response signal, which adversely affects the throughput of voice data.

[0073] In contrast, the information processing device 200 according to the present embodiment can perform arrival confirmation with high usability by providing the configuration described above. More specifically, for example, if the communication state estimated by the information processing device 200 is less than a predetermined threshold, it can estimate that the arrival status of the data to be transmitted to the external device 30 is poor, and can prompt the user in real time to wait until the arrival status improves. Furthermore, if no conversation is taking place while sharing image data, the information processing device 200 can prevent the icon of the arrival status of the voice data from being displayed. That is, the information processing device 200 can display or not display the icon of the arrival status of the voice data on the display device 26 in accordance with the user's speech. Furthermore, the information processing device 200 can change the icon displayed on the display device 26 depending on the arrival status of the data, allowing the user to have a smooth conversation.

[0074] 9 shows an implementation example of a control system 1000 of a vehicle 50. The control system 1000 includes a core ECU 1010, a TCU 1020, an AD / ADAS ECU 1021, an information system ECU 1022, an area ECU 1023, an area ECU 1024, a sensor device 1040, an information system device 1041, a drive system device 1030, a comfort system device 1031, an alarm system device 1032, a visibility system device 1033, an advanced safety system device 1034, an anti-theft system device 1035, a lighting system device 1036, a door system device 1037, a drive position system device 1038, an opening / closing system device 1039, a communication network 1080, a communication network 1081, a communication network 1082, a communication network 1084, and a communication network 1085. The AD / ADAS ECU1021 is an ECU that controls autonomous driving (AD) and advanced driver assistance systems (ADAS).

[0075] The TCU 1020 is a telematics control unit. The TCU 1020 is an example of the above-mentioned information processing device 200. The TCU 1020 and the core ECU 1010 may cooperate with each other to function as the above-mentioned information processing device 200. The AD / ADAS ECU 1021, the information system ECU 1022, the area ECU 1023, and the area ECU 1024 are each an example of the above-mentioned control device 24.

[0076] The communication network 1080, the communication network 1081, the communication network 1082, the communication network 1084, and the communication network 1085 are an implementation example of the in-vehicle network 29. The communication network 1080, the communication network 1081, the communication network 1082, the communication network 1084, and the communication network 1085 may include an Ethernet (registered trademark) network. The TCU 1020, the core ECU 1010, the AD / ADAS ECU 1021, the information system ECU 1022, the area ECU 1023, and the area ECU 1024 may be capable of IP communication via the communication network 1080, the communication network 1081, the communication network 1082, the communication network 1084, and the communication network 1085. Note that the communication network 1084 and the communication network 1085 may include a CAN.

[0077] The sensor device 1040 includes sensors including a camera, a radar, and a LIDAR. The AD / ADAS ECU 1021 is connected to each sensor included in the sensor device 1040 via a bus, controls each sensor included in the sensor device 1040, and acquires information detected by each sensor.

[0078] The information device 1041 includes devices including a meter device, a display device, a tuner, a player, a DSRC (Dedicated Short Range Communication) system, a wireless charger, and a USB port. The information ECU 1022 is connected to each device included in the information device 1041 via a bus and controls each device included in the information device 1041. The information device 1041 includes information and communication devices, multimedia-related devices, and user interface devices.

[0079] The drive system device 1030 includes devices including an electric parking brake (EPB), an electric power steering system (EPS), a vehicle stability control system (VSA), a shifter (SHIFTER), a power drive unit (PDU), an intelligent power unit (IPU), and a fuel injection device (FI). The drive system device 1030 is connected to each device included in the drive system device 1030 through a bus and controls each device included in the drive system device 1030.

[0080] The area ECU 1024 is connected via a bus to comfort system devices 1031, alarm system devices 1032, visibility system devices 1033, advanced safety system devices 1034, anti-theft system devices 1035, lighting system devices 1036, door system devices 1037, drive position system devices 1038, and opening / closing system devices 1039, and controls the devices provided in the comfort system devices 1031, alarm system devices 1032, visibility system devices 1033, advanced safety system devices 1034, anti-theft system devices 1035, lighting system devices 1036, door system devices 1037, drive position system devices 1038, and opening / closing system devices 1039. The vehicle 50 is connected to a comfort system device 1031, an alarm system device 1032, a visibility system device 1033, an advanced safety system device 1034, an anti-theft system device 1035, a lighting system device 1036, a door system device 1037, a drive position system device 1038, and an opening / closing system device 1039. The comfort system device 1031, the alarm system device 1032, the visibility system device 1033, the advanced safety system device 1034, the anti-theft system device 1035, the lighting system device 1036, the door system device 1037, the drive position system device 1038, and the opening / closing system device 1039 mainly include auxiliary devices of the vehicle 50.

[0081] The drive system devices 1030, the sensor devices 1040, the comfort system devices 1031, the alarm system devices 1032, the visibility system devices 1033, the advanced safety system devices 1034, the anti-theft system devices 1035, the lighting system devices 1036, the door system devices 1037, the drive position system devices 1038, and the opening / closing system devices 1039 are control system devices of the vehicle 50. The information system device 1041 is a non-control system device.

[0082] Data communication relating to the devices included in the sensor devices 1040, drive system devices 1030, comfort system devices 1031, alarm system devices 1032, visibility system devices 1033, advanced safety system devices 1034, anti-theft system devices 1035, lighting system devices 1036, door system devices 1037, drive position system devices 1038, and opening / closing system devices 1039 may have a lower priority than data communication relating to the devices included in the information system devices 1041.

[0083] The vehicle 50 is an example of a moving body. Examples of moving bodies include automobiles such as passenger cars and buses, saddle-type vehicles, aircraft, ships, and other transportation equipment. The moving body is not limited to transportation equipment, and may be any equipment that can be moved.

[0084] As described above, in the information processing device 200 and an implementation example of the information processing device 200, the possibility of continuing high-priority data communication may be increased by restricting low-priority data communication. In general, when multiple data communications are performed in a device mounted on a mobile object, the communications must be performed within a communication speed (also called a communication band). However, an appropriate communication speed is not always available for all of the multiple data communications. For example, when the communication speed is reduced due to a deterioration in the communication environment, there is a problem that high-priority data communication may be restricted. In response to this, the above-mentioned information processing device 200 may alleviate such a problem.

[0085] 10 shows an example of a computer 2000 in which multiple embodiments of the present invention may be embodied in whole or in part. A program installed in the computer 2000 can cause the computer 2000 to function as an apparatus such as an information processing apparatus according to an embodiment or each part of the apparatus, execute operations associated with the apparatus or each part of the apparatus, and / or execute a process or steps of the process according to an embodiment. Such a program can be executed by the CPU 2012 to cause the computer 2000 to execute specific operations associated with some or all of the blocks of the processing procedures and block diagrams described herein.

[0086] The computer 2000 according to this embodiment includes a CPU 2012 and a RAM 2014, which are connected to each other by a host controller 2010. The computer 2000 also includes a ROM 2026, a flash memory 2024, a communication interface 2022, and an input / output chip 2040. The ROM 2026, the flash memory 2024, the communication interface 2022, and the input / output chip 2040 are connected to the host controller 2010 via the input / output controller 2020.

[0087] The CPU 2012 operates according to the programs stored in the ROM 2026 and RAM 2014, thereby controlling each unit.

[0088] The communication interface 2022 communicates with other electronic devices via a network. The flash memory 2024 stores programs and data used by the CPU 2012 in the computer 2000. The ROM 2026 stores a boot program and the like executed by the computer 2000 upon activation, and / or a program that depends on the hardware of the computer 2000. The input / output chip 2040 may also connect various input / output units, such as a keyboard, mouse, and monitor, to the input / output controller 2020 via input / output ports, such as a serial port, a parallel port, a keyboard port, a mouse port, a monitor port, a USB port, an HDMI port, and the like.

[0089] The programs are provided via a computer-readable storage medium such as a CD-ROM, a DVD-ROM, or a memory card, or a network. The RAM 2014, the ROM 2026, or the flash memory 2024 are examples of computer-readable storage media. The programs are installed in the flash memory 2024, the RAM 2014, or the ROM 2026, and executed by the CPU 2012. Information processing described in these programs is read by the computer 2000, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by implementing an operation or processing of information according to the use of the computer 2000.

[0090] For example, when communication is performed between the computer 2000 and an external device, the CPU 2012 may execute a communication program loaded in the RAM 2014 and instruct the communication interface 2022 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 2012, the communication interface 2022 reads transmission data stored in a transmission buffer processing area provided in a recording medium such as the RAM 2014 and the flash memory 2024, transmits the read transmission data to a network, and writes reception data received from the network to a reception buffer processing area or the like provided on the recording medium.

[0091] Furthermore, the CPU 2012 may cause all or a necessary portion of a file or database stored on a recording medium such as the flash memory 2024 to be read into the RAM 2014, and perform various types of processing on the data on the RAM 2014. The CPU 2012 then writes the processed data back to the recording medium.

[0092] Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and subjected to information processing. The CPU 2012 may execute various types of processing, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., described herein and specified by the instruction sequence of the program, on the data read from the RAM 2014, and write back the results to the RAM 2014. The CPU 2012 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 2012 may search for an entry that matches a condition in which an attribute value of the first attribute is specified from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0093] The above-described programs or software modules may be stored in a computer-readable storage medium on the computer 2000 or in the vicinity of the computer 2000. A recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as the computer-readable storage medium. The programs stored in the computer-readable storage medium may be provided to the computer 2000 via a network.

[0094] A program installed in the computer 2000 and causing the computer 2000 to function as the information processing device 200 may act on the CPU 2012, etc., to cause the computer 2000 to function as each unit of the information processing device 200. When the information processing described in these programs is read into the computer 2000, it functions as each unit of the information processing device 200, which is a specific means in which the software and the above-mentioned various hardware resources work together. Then, by implementing calculation or processing of information according to the intended use of the computer 2000 in this embodiment by these specific means, a specific information processing device 200 according to the intended use is constructed.

[0095] Various embodiments have been described with reference to block diagrams or the like. In the block diagrams, each block may represent (1) a stage of a process where an operation is performed or (2) a portion of an apparatus responsible for performing an operation. Particular stages and portions may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuitry and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuitry including logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logical operations, memory elements such as flip-flops, registers, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like.

[0096] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon constitutes at least a portion of a product that includes instructions that can be executed to provide a means for performing the operations specified in a process or block diagram. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray (RTM) disks, memory sticks, integrated circuit cards, etc.

[0097] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0098] The computer readable instructions may be provided to a processor or programmable circuitry of a general purpose computer, special purpose computer, or other programmable data processing apparatus, either locally or over a wide area network (WAN) such as a local area network (LAN), the Internet, etc., to cause the computer readable instructions to execute means for performing operations specified in the process steps or block diagrams described. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0099] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the description of the claims that such modifications and improvements can also be included in the technical scope of the present invention.

[0100] For example, in the above embodiment, the information processing device 200 has been described as being implemented in the vehicle 50. The information processing device 200 is preferably implemented in a moving body such as the vehicle 50, which is subject to large fluctuations in the communication environment. Alternatively, the information processing device 200 may be implemented in a personal computer or a mobile terminal.

[0101] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and may be realized in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is explained using "first," "next," etc. for convenience, it does not mean that it is essential to perform the process in this order. [Explanation of symbols]

[0102] 24 Control device 25 Equipment 26 Display device 27 Screens 29 In-vehicle network 30 External device 50 vehicles 90 Communication Network 92 Wireless communication systems 200 Information processing device 202 Communications Department 210 Communication status measurement unit 220 Communication Status Prediction Unit 224 Arrival Status Estimation Unit 225 Arrival status notification section 226 Voice detection unit 227 Image Data Sharing Section 228 Transmission volume acquisition unit 230 Bandwidth control section 240 Control object discrimination unit 250 Priority control section 1000 Control System 1010 Core ECU 1020 TCU 1021 AD / ADAS ECU 1022 Information system ECU 1023 Area ECU 1024 Area ECU 1030 Drive system equipment 1031 Comfort equipment 1032 Alarm equipment 1033 Vision equipment 1034 Advanced safety equipment 1035 Anti-theft equipment 1036 Lighting system equipment 1037 Door equipment 1038 Drive position equipment 1039 Switching equipment 1040 Sensor Equipment 1041 Information equipment 1080 Communication Network 1081 Communication Network 1082 Communication Network 1084 Communication Network 1085 Communication Network 2000 Computer 2010 Host Controller 2012 CPU 2014 RAM 2020 Input / Output Controller 2022 Communication Interface 2024 Flash Memory 2026 ROM 2040 Input / Output Chip

Claims

1. An information processing device that communicates with an external device via a communication network, a communication status measurement unit that measures a status of communication between the external device and the information processing device; a communication state prediction unit that predicts a future state of communication between the external device and the information processing device based on the state of the communication measured by the communication state measurement unit; a delivery status estimation unit that estimates a future delivery status of data transmitted from the information processing device to the external device during communication between the external device and the information processing device, based on the future communication status predicted by the communication status prediction unit; a reach status notifying unit that notifies a user of the information processing device of the future reach status estimated by the reach status estimating unit; An information processing device comprising:

2. The communication state includes any one of a bandwidth and a throughput. The information processing device according to claim 1 .

3. a communication state adjustment unit that adjusts a state of the communication between the external device and the information processing device; The communication state measurement unit measures the state of the communication adjusted by the communication state adjustment unit.

3. The information processing device according to claim 1 or 2.

4. The information processing device communicates with an external display device, The arrival status notification unit notifies the user of the arrival status by displaying the arrival status on the display device. The information processing device according to claim 1 .

5. the arrival status notification unit notifies the user of the arrival status by causing the display device to display an icon indicating the arrival status; the arrival status notifying unit causes the display device to display the icon in a different display manner depending on a state of the future communication. The information processing device according to claim 4.

6. The delivery status estimation unit further estimates a current delivery status of the data based on the communication status measured by the communication status measurement unit; the arrival status notification unit causes the display device to display the future arrival status and the current arrival status estimated by the arrival status estimation unit, respectively.

6. The information processing device according to claim 4 or 5.

7. A voice detection unit that detects a voice uttered by the user is further provided, the data includes voice data of a voice detected by the voice detection unit, the voice data being transmitted from the information processing device to the external device during communication between the external device and the information processing device; the arrival status notification unit causes the display device to display the current arrival status of the voice data while the voice detection unit is detecting the voice, and causes the display device to display the future arrival status of the voice data while the voice detection unit is not detecting the voice. The information processing device according to claim 6.

8. A voice detection unit that detects a voice uttered by the user is further provided, the data includes voice data of a voice detected by the voice detection unit, the voice data being transmitted from the information processing device to the external device during communication between the external device and the information processing device; the arrival status notification unit causes the display device to display the arrival status of the voice data while the voice detection unit is detecting the voice, and does not cause the display device to display the arrival status of the voice data while the voice detection unit is not detecting the voice.

6. The information processing device according to claim 4 or 5.

9. a voice detection unit for detecting a voice uttered by the user; an image data sharing unit for displaying image data on the display device and the external device in real time; Further comprising: The data is voice data of a voice detected by the voice detection unit, the voice data being transmitted from the information processing device to the external device during communication between the external device and the information processing device; The image data transmitted by the information processing device to the external device during communication between the external device and the information processing device; Including, the arrival status notification unit causes the display device to display the arrival status of the voice data and the arrival status of the image data, respectively.

6. The information processing device according to claim 4 or 5.

10. a transmission amount acquisition unit that acquires a transmission amount of the image data transmitted by the information processing device to the external device during communication between the external device and the information processing device; the delivery status estimation unit estimates a time lag between when the image data is displayed on the display device and the external device, based on the future communication state predicted by the communication state prediction unit and the transmission amount acquired by the transmission amount acquisition unit; the arrival status notifying unit causes the display device to display the time lag estimated by the arrival status estimating unit together with the arrival status of the image data. The information processing device according to claim 9.

11. An information processing device according to any one of claims 4 to 10; At least one of the display devices, which are a meter and a head-up display; A vehicle equipped with.

12. An information processing method executed by an information processing device that communicates with an external device via a communication network, comprising: a communication status measurement step of measuring a status of communication between the external device and the information processing device; a communication state prediction step of predicting a future communication state between the external device and the information processing device based on the communication state measured in the communication state measurement step; a communication status estimation step of estimating a future communication status of data transmitted from the information processing device to the external device during communication between the external device and the information processing device based on the future communication status predicted in the communication status prediction step; a reach status notifying step of notifying a user of the information processing device of the reach status estimated in the reach status estimating step; An information processing method comprising:

13. A computer that communicates with an external device via a communication network, a communication status measurement procedure for measuring a communication status between the external device and the computer; a communication state prediction step of predicting a future communication state between the external device and the computer based on the communication state measured in the communication state measurement step; a delivery status estimation step of estimating a future delivery status of data transmitted from the computer to the external device during communication between the external device and the computer, based on the future communication status predicted in the communication status prediction step; a reach status notifying step of notifying a user of the computer of the reach status estimated in the reach status estimating step; A program for executing.

Images