COMMUNICATION SYSTEM, COMMUNICATION DEVICE, SERVER DEVICE, COMMUNICATION METHOD, COMMUNICATION PROGRAM, AND STORAGE MEDIUM

Abstract

This communication system for performing audio and video communication to transmit audio and video of a moving body, acquired by a first device which moves together with the moving body, to a second device comprises: a connection information providing unit for providing connection information which is used to connect to the audio and video communication and which has a validity period; and a display control unit which, upon accepting access from the second device to the connection information, causes the second device to display ride status information indicating whether an operator is riding in the moving body, in a period corresponding to the validity period.

Description

[Technical field]

[0001] The present invention relates to a communication system, a communication device, a server device, a communication method, a communication program, and a storage medium, and more particularly to a communication system, a communication device, a server device, a communication method, a communication program, and a storage medium capable of providing a user with video and audio from a mobile object, for example. [Background technology]

[0002] 2. Description of the Related Art There is a communication system that performs communication between an on-board device mounted in a vehicle and an external terminal located outside the vehicle.

[0003] For example, Patent Document 1 discloses a system in which a voice call is made between a driver of a vehicle and an operator of an external terminal, and while the voice call is being made, image data showing an image in front of the vehicle is transmitted from an in-vehicle device to the external terminal, and the image is displayed on the external terminal. Patent Document 1 discloses that, based on receiving a call start notification, the in-vehicle device starts a process of transmitting data such as a call and an image, transmits an audio signal of the contents of the speech of the driver of the vehicle to the external terminal, and also transmits vehicle information including forward image data to the external terminal. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-213791 A Summary of the Invention [Problem to be solved by the invention]

[0005] In a system such as that described in Patent Document 1, for example, when a call start notification is sent from an external vehicle terminal to an onboard unit, there may be cases where the driver is not in the vehicle in which the onboard unit is installed. In such cases, the connection attempt by sending the call start notification is wasted, resulting in unnecessary effort, which is one of the issues.

[0006] One possible solution is to inform the user of the external terminal of the driver's riding status before attempting a connection, but one of the issues is that if the riding status is made available without restriction, it could raise concerns about the driver's privacy.

[0007] The present invention has been made in consideration of the above-mentioned points, and one of its objectives is to provide a communication system, a communication device, a server device, a communication method, a communication program, and a storage medium that enable efficient and smooth communication between a first device inside a moving body and a second device outside the moving body by suppressing unnecessary connection attempts from the second device to the first device while taking into consideration the privacy of the operator of the moving body. [Means for solving the problem]

[0008] The invention described in claim 1 is a communication system for audio-visual communication in which audio and video of a moving body acquired by a first device moving with the moving body is transmitted to a second device, and is characterized in having a connection information providing unit that provides connection information used for connecting the audio-visual communication and having an expiration date, and a display control unit that, upon receiving access to the connection information from the second device, causes the second device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date.

[0009] The invention described in claim 7 is a communication method executed by a communication system that performs audio-visual communication in which audio and video of a moving body acquired by a first device moving together with the moving body are transmitted to a second device, and is characterized in that it includes a connection information providing step of providing connection information used for connecting the audio-visual communication and having an expiration date, and a display control step of, upon receiving access to the connection information from the second device, causing the second device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date.

[0010] The invention described in claim 8 is a communication program executed by a communication system that has a computer and performs audio-visual communication, in which audio and video of a moving body acquired by a first device moving together with the moving body are transmitted to a second device, the communication program causing the computer to execute a connection information providing step of providing connection information used for connecting the audio-visual communication and having an expiration date, and a display control step of, when access to the connection information from the second device is received, causing the second device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date.

[0011] The invention described in claim 9 is a computer-readable storage medium storing a communication program for causing a communication system for audio-visual communication, which has a computer and transmits audio and video from a moving body acquired by a first device moving with the moving body to a second device, to execute a connection information providing step of providing connection information used for connecting the audio-visual communication and having an expiration date, and a display control step of, when access to the connection information from the second device is accepted, causing the second device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date.

[0012] The invention described in claim 10 is a communication device that moves together with a moving body and performs audio-visual communication by acquiring audio and video from the moving body and transmitting the audio and video to another device, characterized in that it has a connection information providing unit that provides connection information used for connecting the audio-visual communication and having an expiration date, and a display control unit that, upon receiving access to the connection information from the other device, causes the other device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date.

[0013] The invention described in claim 11 is a server device that performs audio-visual communication by transmitting audio and video of a moving body acquired by a first device moving with the moving body to a second device, and is characterized in that it has a connection information providing unit that provides connection information used for connecting the audio-visual communication and having an expiration date, and a display control unit that, upon receiving access to the connection information from the second device, causes the second device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date. [Brief description of the drawings]

[0014] [Figure 1] 1 is a schematic diagram illustrating an overview of a communication system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing a configuration of a front seat portion of a vehicle according to the first embodiment. [Diagram 3] 1 is a block diagram showing an example of a configuration of an in-vehicle device according to a first embodiment. [Figure 4] FIG. 2 is a block diagram illustrating an example of a configuration of a server device according to the first embodiment. [Diagram 5] FIG. 2 is a front view of the external device according to the first embodiment. [Figure 6] 2 is a block diagram showing an example of a configuration of an external device according to the first embodiment; FIG. [Figure 7] FIG. 2 is a sequence diagram illustrating an example of communication performed in the communication system according to the first embodiment. [Figure 8] FIG. 2 is a sequence diagram illustrating an example of communication performed in the communication system according to the first embodiment. [Figure 9] 4 is a flowchart illustrating an example of a routine executed by the server device according to the first embodiment. [Figure 10] FIG. 4 is a diagram illustrating an example of a display screen displayed on an external device according to the first embodiment. [Figure 11] FIG. 4 is a diagram illustrating an example of a display screen displayed on an external device according to the first embodiment. [Figure 12] FIG. 4 is a diagram illustrating an example of a display screen displayed on an external device according to the first embodiment. [Figure 13] FIG. 13 is a block diagram showing an example of a configuration of an in-vehicle device according to a modified example of the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description and accompanying drawings, substantially the same or equivalent parts are designated by the same reference numerals. EXAMPLES

[0016] [1. System configuration] A configuration of a communication system 100 including an in-vehicle device 10 according to a first embodiment will be described with reference to the accompanying drawings.

[0017] Fig. 1 shows a communication system 100 according to a first embodiment of the present invention. As shown in Fig. 1, the communication system 100 includes an in-vehicle device 10, a server 30, and an external device 40. Fig. 1 shows a case in which the in-vehicle device 10 is mounted on an automobile M as an example of a moving body. Fig. 1 also shows a smartphone as an example of the external device 40.

[0018] The in-vehicle device 10, the server 30, and the external device 40 can transmit and receive data to and from each other via a network NW using a communication protocol such as TCP / IP or UDP / IP. The network NW can be constructed, for example, by a mobile communication network, wireless communication such as Wi-Fi (registered trademark), and Internet communication including wired communication.

[0019] In the communication system 100, audio and video communication is possible in which audio and video captured in the automobile M by an in-vehicle device 10 as a first device moving together with the automobile M is transmitted to an external device 40 as a second device.

[0020] In the communication system 100 of this embodiment, after a voice call is established between the in-car device 10 and the external device 40, a video captured in the automobile M is distributed from the in-car device 10 to the external device 40.

[0021] In the following description, the above-described communication mode in which the in-car device 10 distributes the video captured in the automobile M to the external device 40 while establishing a voice call between the in-car device 10 and the external device 40 is referred to as video communication as one mode of audio / video communication. In this embodiment, the in-car device 10 and the external device 40 perform video communication via the server 30.

[0022] By performing such video communication, the user of the external device 40 watching the video transmitted from the in-vehicle device 10 can feel as if he or she is riding in the vehicle M with the driver of the vehicle M who is the operator of the moving object. In other words, the video communication can realize a virtual ride with the user of the external device 40 in the vehicle M. In addition, a system such as the communication system 100 of this embodiment that can realize such video communication is also called a virtual ride-in system.

[0023] Hereinafter, in the first embodiment, the in-vehicle device 10 is described as a car navigation device. Also, in the first embodiment, the in-vehicle device 10 is described as a terminal device of a so-called cloud-type car navigation device that receives a destination to which the user wants guidance from the user, transmits the destination to the server 30, and the server 30 generates a route to the destination.

[0024] In this embodiment, as an example of a mode of starting video communication, a case will be described in which an invitation for video communication is first made from the in-car device 10 to the external device 40, and connection information for the video communication is provided at the time of the invitation. In this embodiment, when a connection attempt is made from the external device 40 using the connection information, the process of starting the video communication proceeds.

[0025] Fig. 2 is a perspective view showing the vicinity of the front seat of an automobile M equipped with an in-vehicle device 10 as a video transmission device or a video generation device. Fig. 1 shows, as an example of an installation, a case in which the in-vehicle device 10 is installed inside a dashboard DB of the front seat of the automobile M.

[0026] The GPS receiver 11 is a device that receives signals (GPS signals) from GPS (Global Positioning System) satellites. The GPS receiver 11 is arranged, for example, on a dashboard DB. The GPS receiver 11 may be arranged anywhere as long as it can receive GPS signals. The GPS receiver 11 can transmit the received GPS signals to the in-vehicle device 10.

[0027] The exterior camera 13 is an imaging device that captures an image in front of the automobile M. In this embodiment, the exterior camera 13 is disposed on the dashboard DB so that the image capture direction is the front. For example, the exterior camera 13 is a wide-angle camera that can capture an image of a wide area in front of the automobile M through the windshield. The exterior camera 13 may be provided on the rearview mirror RM, or may be attached to the inside of the windshield FG.

[0028] The in-vehicle camera 15 is an imaging device that captures images of the interior of the automobile M. In this embodiment, the in-vehicle camera 15 is provided at the top end of the windshield FG or on the ceiling near the top end, and is capable of capturing images of the driver of the automobile M.

[0029] During video communication, video captured by the exterior camera 13 or the interior camera 15 is distributed to the external device 40.

[0030] The touch panel 17 is, for example, a touch panel monitor that combines a display such as a liquid crystal display capable of displaying images with a touch pad. The touch panel 17 is disposed, for example, on the center console CC of the dashboard DB. The touch panel 17 may be disposed in a location that is visible to the driver and within the driver's reach. For example, the touch panel 17 may be attached on the dashboard DB.

[0031] The touch panel 17 is capable of displaying a screen based on the control of the in-vehicle device 10. Furthermore, the touch panel 17 is capable of transmitting a signal representing an input operation to the touch panel 17 received from a user to the in-vehicle device 10. For example, the touch panel 17 may display a guide for car navigation. Furthermore, operations related to the car navigation function, such as setting a destination, may be possible via the touch panel 17.

[0032] Furthermore, information regarding video communication may be displayed on the touch panel 17, and an operation reception screen for making a connection for video communication (hereinafter also referred to as a video connection) may be displayed on the touch panel 17. An occupant of the automobile M may perform an operation for connecting the video communication by inputting an input operation on the touch panel 17.

[0033] The speaker 19 is provided, for example, on the interior side of an A-pillar AP. The speaker 19 can emit sounds such as music and voices under the control of the in-vehicle device 10. During video communication, the speaker 19 emits sound from the external device 40 during voice communication.

[0034] The microphone 21 is a microphone device that receives sounds inside the vehicle, and is arranged, for example, on the dashboard DB. The microphone 21 may be arranged anywhere, such as on the rearview mirror RM or the steering wheel, as long as it can receive sounds inside the vehicle. During video communication, the voice collected by the microphone 21 is transmitted to the external device 40 as the voice of the voice call. Also, an operation input related to the start of video communication may be performed by voice via the microphone 21.

[0035] 3 is a block diagram showing the configuration of the in-vehicle device 10. For example, the in-vehicle device 10 is a device in which a storage unit 24, a control unit 25, and a communication unit 27 cooperate with each other via a system bus.

[0036] The seating sensor 22 is a sensor that can actually detect whether or not the driver of the automobile M is in the car (hereinafter also referred to as "boarding"), and can output, for example, a signal indicating the presence or absence of the detected driver. The seating sensor 22 is, for example, provided on the seat surface or back of the driver's seat of the automobile M, and is a sensor that detects load. Note that the driver may be detected by image recognition of the image from the in-car camera 15, or by directly detecting the driver himself using another photoelectric sensor such as an infrared sensor.

[0037] The automobile M is also equipped with an acceleration sensor 23. The acceleration sensor 23 may be, for example, a MEMS acceleration sensor capable of measuring the acceleration of the automobile M and outputting a signal indicating the measured acceleration. The acceleration sensor 23 may be an inertial measurement unit (IMU). The acceleration sensor 23 may be built into the in-vehicle device 10.

[0038] The storage unit 24 is a storage device configured by, for example, a hard disk drive, a solid state drive (SSD), a flash memory, etc. The storage unit 24 stores various programs executed in the in-vehicle device 10, such as an operating system and software for terminals.

[0039] The various programs may be acquired, for example, from another server device or the like via a network, or may be recorded on a recording medium and read via various drive devices. In other words, the various programs stored in the storage unit 24 can be transmitted via a network, and can be recorded on a computer-readable recording medium and transferred.

[0040] The storage unit 24 also stores map information including a road map, and information indicating the contact information of the external device 40 as a video communication partner, such as a telephone number or an email address.

[0041] The control unit 25 is composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and functions as a computer. The control unit 25 realizes various functions by the CPU reading and executing various programs stored in the ROM and the storage unit 24. In this embodiment, the control unit 25 realizes functions such as a function of presenting information regarding the start and end of video communication to the driver, a video distribution function during video communication, and a car navigation function.

[0042] The control unit 25 is connected to be able to communicate with the exterior camera 13, the interior camera 15, the touch panel 17, the speaker 19, the microphone 21, the seating sensor 22, and the acceleration sensor 23 provided in the in-vehicle device 10.

[0043] The control unit 25 sequentially acquires images captured by the exterior camera 13 and the interior camera 15. The control unit 25 also sequentially acquires information indicating whether or not a driver is in the vehicle, which is detected by the seating sensor 22. The control unit 25 also sequentially acquires a signal from the GPS receiver 11 and a signal indicating acceleration measured by the acceleration sensor 23.

[0044] The communication unit 27 is a communication device that transmits and receives data to and from external devices in accordance with instructions from the control unit 25. The communication unit 27 is, for example, a network interface card (NIC) for connecting to the network NW.

[0045] The communication unit 27 is connected to the above-mentioned network NW, and transmits and receives various data to and from the server 30. In addition, the communication unit 27 transmits and receives various data to and from the external device 40 via the server 30.

[0046] The communication unit 27 transmits, for example, information such as an image of the outside or inside of the automobile M, current location information, and a travel route to the server 30. In addition, the communication unit 27 receives, for example, information to be displayed on the touch panel 17 regarding video communication from the server 30.

[0047] During video communication, the control unit 25 sequentially transmits images captured by the exterior camera 13 or the interior camera 15 to the server 30 via the communication unit 27 .

[0048] The control unit 25 receives display information related to the start and end of video communication from the server 30 via the communication unit 27, and displays it on the touch panel 17. The control unit 25 may also output information related to the start and end of video communication by sound from the speaker 19.

[0049] For example, the control unit 25 of the in-vehicle device 10 can transmit, via the communication unit 27, to the server 30, position identification information as position data capable of identifying the current position of the in-vehicle device 10, that is, in this embodiment, information on the current position of the automobile M. Also, for example, the control unit 25 can transmit information including a destination input by a user to the server 30 via the communication unit 27, and receive route information or navigation information to the destination from the server 30.

[0050] The control unit 25 can transmit audio data of the audio picked up by the microphone 21 to the external device 40 via the communication unit 27 for audio communication in the video communication. Also, the control unit 25 can receive audio data of the audio input to the external device 40 via the communication unit 27 for audio communication in the video communication.

[0051] 4 is a block diagram showing the configuration of the server 30. For example, the server 30 is a device in which a storage unit 31, a communication unit 33, and a control unit 35 cooperate with each other via a system bus.

[0052] The server 30 has a function similar to that of a SIP server that establishes a voice call between the in-car device 10 and the external device 40 during video communication and transfers data of the voice call.

[0053] The server 30 also has the function of receiving from the in-vehicle device 10 the location identification information of the automobile M and information on a destination set by a user who is an occupant of the automobile M, and generating a route to the destination based on the location identification information and the destination information.

[0054] The storage unit 31 is configured with, for example, a hard disk device and an SSD (solid state drive), and stores various programs such as an operating system and software for the server 30.

[0055] The various programs may be acquired, for example, from another server device or the like via a network, or may be recorded on a recording medium and read via various drive devices. That is, the various programs stored in the storage unit 31 can be transmitted via a network, and can be recorded on a computer-readable recording medium and transferred.

[0056] The storage unit 31 stores, for example, a communication program for the server 30 to control connections for video communication in the communication system 100.

[0057] The storage unit 31 also stores a map information database (not shown) in which map information including road maps is stored. The map information in the map information database is a database that has information equivalent to the map information used in a navigation device, for example.

[0058] The communication unit 33 is connected to the above-mentioned network NW, and transmits and receives various data between the in-vehicle device 10 and the external device 40.

[0059] The control unit 35 is configured with a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and functions as a computer. The CPU reads out and executes various programs stored in the ROM and the storage unit 31 to realize various functions.

[0060] The control unit 35 realizes control related to video communication connections in the communication system 100 by executing the above-mentioned communication program.

[0061] The control unit 35 includes a connection information providing unit 36, a boarding information acquiring unit 37, and a display control unit 38.

[0062] The connection information providing unit 36 ​​is a functional unit that executes a connection information providing step of providing the external device 40 with a URL (Uniform Resource Locator) as connection information that is used for connecting when the external device 40 performs video communication with the in-car device 10 and has an expiration date, in response to a request from the in-car device 10.

[0063] For example, when the connection information providing unit 36 ​​receives a request from the in-car device 10 to send a URL for inviting the external device 40 to video communication, the connection information providing unit 36 ​​generates a URL with an expiration date and provides the URL to the external device 40 by transmitting the URL with the expiration date to the external device 40.

[0064] The connection information providing unit 36 ​​performs management such as generating a URL used for connecting video communication, storing the URL in a database in association with the expiration date of the URL, and denying access to the page via the URL when the expiration date arrives. The database is stored in the storage unit 31, for example.

[0065] The connection information providing unit 36 ​​may obtain a URL having an expiration date from an external device such as a server.

[0066] The expiration date of the above URL is set to, for example, a time when a predetermined time has elapsed since the request was made from the in-vehicle device 10. For example, the expiration date is a few hours to 24 hours from the time of the request, and may be a few days.

[0067] The driver may be allowed to set the URL expiration date for each user of the external device 40. This allows the driver of the automobile M, for example, to set a long expiration date for users with whom he or she frequently performs video communication, such as close users, and can save the driver the trouble of sending an invitation every time a video communication is performed. Also, for users with whom he or she does not perform video communication very frequently, a short expiration date can be set, and access from such users that is unnecessary for the driver can be prevented.

[0068] The boarding information acquisition unit 37 is a functional unit that acquires boarding status information indicating whether the driver is in the automobile M or not.

[0069] The boarding status information is, for example, information based on a result of actually detecting whether or not the driver is in the automobile M. For example, the boarding information acquisition unit 37 acquires from the in-vehicle device 10 an image of an area including the driver's seat of the automobile M captured by the in-vehicle camera 15, and actually detects whether or not the driver is in the driver's seat by performing image recognition on the image. Based on the detection result, the boarding information acquisition unit 37 acquires boarding status information indicating whether or not the driver is in the automobile M.

[0070] In addition, for example, the boarding information acquisition unit 37 actually detects whether or not a driver is present in the driver's seat by acquiring the detection results from the seating sensor 22 provided in the automobile M, and acquires boarding status information indicating whether or not the driver is in the vehicle based on the detection results.

[0071] The boarding status information is information based on whether the in-vehicle device 10 is connected to a network NW, which is a communication network used for video communication. The boarding information acquisition unit 37 acquires the boarding status information by detecting whether the in-vehicle device 10 is connected to the network NW.

[0072] Furthermore, the boarding status information may be information based on, for example, whether or not the accessory power supply of the automobile M is turned on.

[0073] For example, a monitoring device capable of detecting whether the accessory power supply is ON / OFF may be installed inside the automobile M, and the boarding information acquisition unit 37 may acquire information indicating whether the accessory power supply is ON or OFF from the monitoring device.

[0074] The boarding status information is information indicating, for example, the driver's level of leeway while driving. In other words, the level of leeway is determined by how busy the driver is while driving or how high the workload is. The boarding information acquisition unit 37 acquires boarding status information indicating the driver's level of leeway while driving, for example, by using information from the in-vehicle camera 15, the out-vehicle camera 13, the acceleration sensor 23, etc. In other words, the level of leeway can be said to be a state of whether the driver has the leeway to have a video communication and conversation while driving.

[0075] The display control unit 38 is a functional unit that, upon receiving access to a URL provided by the connection information providing unit 36, executes a display control step of causing an external device 40 to display boarding status information indicating whether or not a driver is in the automobile M for a period corresponding to the expiration date of the URL.

[0076] For example, in the display control step, the display control unit 38 determines whether or not the URL for which access has been accepted is within the validity period, and if it is within the validity period, causes the external device 40 to display the boarding status information. For example, if the URL is outside the validity period, the display control unit 38 causes the external device 40 to display a message indicating that the URL is invalid.

[0077] For example, if the URL is within its validity period, in the display control step, the display control unit 38 refers to the boarding status information acquired by the boarding information acquisition unit and determines whether or not a driver is in the automobile M. If the result of the determination shows that a driver is in the automobile M, the display control unit 38 causes the external device 40 to display, for example, a display indicating that the driver is in the automobile M. If the result of the determination shows that a driver is not in the automobile M, the display control unit 38 causes the external device 40 to display, for example, a display indicating that the driver is getting off the automobile M.

[0078] The user of the external device 40 can know before attempting a connection whether the driver is in the vehicle, i.e., whether video communication between the in-vehicle device 10 and the external device 40 is impossible. Therefore, when the driver is out of the vehicle, it is possible to avoid a situation where a connection attempt is not made and unnecessary trouble such as having to retry the connection multiple times.

[0079] The control unit 35 also acquires location information indicating the current location of the automobile M from the in-vehicle device 10 via the communication unit 33. The control unit 35 also acquires destination information input to the in-vehicle device 10 by an occupant of the automobile M from the in-vehicle device 10 via the communication unit 33. The control unit 35 generates a route to the destination based on the location information and the destination information, and transmits information indicating the route to the in-vehicle device 10.

[0080] In addition, the control unit 35 transfers the video and audio received from the in-car device 10 to the external device 40 via the communication unit 33. The control unit 35 transfers the audio received from the external device 40 to the in-car device 10 via the communication unit 33.

[0081] 5 is a front view of the external device 40. As described above, in this embodiment, the external device 40 is a smartphone.

[0082] The touch panel 41 is, for example, a touch panel monitor in which a display such as a liquid crystal display capable of displaying an image and a touch pad are combined. The touch panel 41 is capable of generating a signal representing an input operation to the touch panel 41 received from a user. In this embodiment, an image distributed from the in-vehicle device 10 is displayed on the touch panel 41.

[0083] Furthermore, information about the video communication and a screen for accepting an operation to start a video communication connection are displayed on the touch panel 41. The user of the external device 40 can perform an input operation to start the video communication by inputting information to the touch panel 41.

[0084] The speaker 43 is capable of emitting sounds such as music, voice, etc. During video communication, the speaker 43 emits the sound from the in-car device 10 during voice communication.

[0085] The microphone 45 is a microphone device that receives sounds emitted toward the external device 40. During video communication, the voices collected by the microphone 45 are transmitted to the in-car device 10 via the server 30 as voice of the voice call.

[0086] 6 is a block diagram showing an example of the configuration of the external device 40. For example, the external device 40 is a device in which a storage unit 47, a control unit 49, and a communication unit 51 cooperate with each other via a system bus (not shown).

[0087] The storage unit 47 is configured with, for example, a hard disk device, a solid state drive (SSD), a flash memory, etc., and stores various programs such as an operating system and software for the external device 40.

[0088] The various programs may be acquired from other server devices or the like via a network, or may be recorded on a recording medium and read via various drive devices. That is, the various programs stored in the storage unit 47 can be transmitted via a network, and can be transferred by recording on a computer-readable recording medium.

[0089] The control unit 49 is configured with a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and functions as a computer. The CPU reads out and executes various programs stored in the ROM and the storage unit 47 to realize various functions.

[0090] The control unit 49 is communicatively connected to the touch panel 41, the speaker 43, and the microphone 45.

[0091] The control unit 49 can receive a signal indicating an input operation to the touch panel 41 and a voice input signal from the microphone 45. For example, the control unit 49 can accept a request to start video communication made by a user via the touch panel 41 and the microphone 45.

[0092] Furthermore, the control unit 49 can transmit a video or image signal to the touch panel 41 to cause it to display, and transmit an audio signal to the speaker 43 to cause it to output sound.

[0093] For example, the control unit 49 causes the touch panel 41 to display a start screen for accepting a request for attempting a video communication connection, a screen indicating whether the driver of the automobile M is in the automobile M, or a screen indicating that the URL is invalid.

[0094] Also, for example, the control unit 49 causes the touch panel 41 to display an image during video communication, and causes the speaker 43 to output audio collected in the automobile M during video communication.

[0095] The communication unit 51 is connected to the above-mentioned network NW, and transmits and receives various data to and from the server 30. In addition, the communication unit 51 transmits and receives various data, including the video transmitted from the in-vehicle device 10, to and from the in-vehicle device 10 via the server 30.

[0096] The control unit 49 of the external device 40 can receive information via the communication unit 51 for displaying a start screen for accepting a request for an attempt to connect to video communication, a screen indicating whether the driver of the automobile M is in the car, or a screen indicating that the URL is invalid.

[0097] Furthermore, the control unit 49 can transmit audio data of the audio picked up by the microphone 45 to the in-car device 10 via the communication unit 51 for audio communication in video communication. Furthermore, the control unit 49 can receive audio data transmitted from the in-car device 10 via the communication unit 51 for audio communication in video communication.

[0098] For example, the control unit 49 of the external device 40 can receive, via the communication unit 51, location identification information capable of identifying the current location of the automobile M transmitted from the in-vehicle device 10 from the server 30. In addition, for example, the control unit 49 can receive route information or navigation information of the automobile M from the server 30 via the communication unit 51.

[0099] [2. Sequence when URL is valid] 7 is a sequence diagram showing an example of communication performed between the in-vehicle device 10 and the external device 40 via the server 30 when the URL is valid and video communication is started in the communication system 100. Hereinafter, a case will be described in which a driver who is a user of the in-vehicle device 10 plans to perform video communication with a virtual passenger who is a user of the external device 40 while driving the automobile M.

[0100] As shown in FIG. 7, the driver registers in advance the contact information of a virtual passenger who is to be the other party in video communication with the external device 40 (step S11).

[0101] In registering a virtual passenger, registration information including a pair of a name capable of identifying the virtual passenger, such as a nickname, and information indicating a destination, such as an email address or a telephone number, required for sending information to the virtual passenger, is transmitted to the server 30 and held by the server 30. The registration information includes, for example, an identifier capable of identifying the in-vehicle device 10.

[0102] The virtual passenger is registered via the touch panel 41 of the in-vehicle device 10, but is not limited to this and may also be registered by sending input information to a terminal device other than the in-vehicle device 10, such as a smartphone used by the driver of the automobile M, to the server 30.

[0103] The timing for the driver to register the contact information of the virtual passenger in advance may be, for example, the day before or before the day on which video communication is planned while driving the automobile M, or may be immediately before the video communication.

[0104] Thereafter, for example, when the driver starts driving the automobile M, the driver performs an input operation on the in-vehicle device 10 to instruct the sending of an invitation email to the external device 40. The input operation may be performed via the touch panel 17 of the in-vehicle device 10, or may be performed by voice via the microphone 21. Moreover, the input operation to instruct the sending of the invitation email may be performed before starting to drive the automobile M.

[0105] By an input operation by the driver, an invitation mail sending request for sending an invitation mail to the external device 40 is sent to the server 30 (step S12). The invitation mail sending request includes information indicating a destination such as an email address used by a virtual passenger registered in advance or a telephone number of the external device 40, and a nickname by which the virtual passenger can be identified.

[0106] When the server 30 receives the invitation mail transmission request, the server 30 transmits the invitation mail to the address of the external device 40 included in the invitation mail transmission request (step S13). The invitation mail includes a URL for opening a start screen for the virtual passenger to perform video communication.

[0107] For example, the connection information providing unit 36 ​​of the server 30 generates a URL with an expiration date, generates an invitation email including a message inviting a user of the external device 40 to video communication and the URL with an expiration date, and sends the invitation email to the external device 40.

[0108] After the server 30 transmits the invitation email, when the virtual passenger opens the invitation email using the external device 40 and taps the URL (step S14A), the server 30 checks the expiration date of the URL.

[0109] If the URL is within its validity period and is valid (step S15A), a browser is launched on the touch panel 41 of the external device 40, and a riding status screen showing the riding status of the driver is displayed (step S16A).

[0110] For example, when the driver is in the vehicle, the riding status screen may display a message indicating that the driver is in the vehicle, as well as a start button, which is a display area that can be operated by a virtual passenger to accept a request to start video communication if the virtual passenger wishes to start video communication.

[0111] When the virtual passenger taps the start button, the operation of the start button by the user is accepted (step S17), and a request to start video communication is transmitted to the server 30 (step S18).

[0112] When the server 30 receives the request to start video communication, the server 30 notifies the in-car device 10 that a request to start video communication has been made from the external device 40 (step S19).

[0113] In step S19, for example, when the in-car device 10 receives a notification from the server 30, a selection button for whether or not to accept the start of the video communication is displayed on the touch panel 17. For example, when the driver taps the accept button, information indicating that the driver has accepted the start of the video communication is transmitted to the server 30 (step S20).

[0114] When the server 30 receives information indicating that the driver has agreed to the start of video communication, it establishes a voice call between the in-vehicle device 10 and the external device 40 and starts video communication in which the video captured in the automobile M is distributed from the in-vehicle device 10 to the external device 40 (step S21).

[0115] In this way, if the URL is within the valid period and the driver is in the vehicle, the in-vehicle device 10 and the external device 40 start video communication via the server 30.

[0116] [3. Sequence when URL is invalid] Fig. 8 is a diagram showing an example of a sequence when the validity period of a URL accessed from external device 40 has expired. In Fig. 8, steps S11 to S13 proceed in the same manner as in the sequence of Fig. 7, and then, after the validity period has expired, steps from step S14B onwards proceed. In Fig. 8, for example, the validity period of the URL is set to 24 hours.

[0117] In step S14B, when the virtual passenger uses the external device 40 to open the invitation email received in step S13 and taps the URL, the server 30 checks the expiration date of the URL.

[0118] If it is determined in the confirmation of the expiration date that the URL is outside its expiration date and the URL is invalid (step S15B), the server 30 causes the external device 40 to display a page indicating that the URL is invalid (step S16B). In step S16B, for example, an expiration screen indicating that the URL has expired is displayed on the touch panel 41 of the external device 40. After that, the sequence in FIG. 8 ends.

[0119] [4. Server operation] A control routine of the server 30 for realizing the operation of the communication system 100 of the embodiment will be described below. In the following description, it is assumed that the boarding information acquisition unit 37 acquires boarding status information as needed and holds the latest boarding status information after, for example, the server 30 receives a request to send an invitation email (FIG. 7, step S12).

[0120] 9 is a flowchart showing a display control routine RT1 executed by the display control unit 38 of the server 30. When an invitation email is sent from the server 30 to the external device 40, for example, the display control unit 38 starts the display control routine RT1.

[0121] When the display control routine RT1 starts, the display control unit 38 determines whether or not a URL included in the invitation email has been accessed (step S101). In step S101, for example, when the virtual passenger opens the invitation email using the external device 40 and taps the URL included in the invitation email, the external device 40 accesses the URL.

[0122] In step S101, when the display control unit 38 determines that the URL has not been accessed (step S101: NO), it ends the display control routine RT1, starts the next display control routine RT1, and executes step S101 again.

[0123] In step S101, when the display control unit 38 determines that the URL has been accessed (step S101: YES), it determines whether the URL is within its validity period (step S102).

[0124] In step S102, for example, the display control unit 38 refers to a database in which URLs and expiration dates are stored in association with each other, and determines whether the accessed URL is within its expiration date.

[0125] In step S102, when the display control unit 38 determines that the URL is within the validity period (step S102: YES), the display control unit 38 refers to the boarding status information successively acquired and stored by the boarding information acquisition unit 37 (step S103). In step S103, for example, information indicating whether or not the driver is on board is referred to.

[0126] Also, for example, in step S103, information indicating whether the in-vehicle device 10 is connected to the network NW may be referenced, and information indicating the ON / OFF state of a seating sensor provided in the driver's seat of the automobile M may be referenced.

[0127] After executing step S103, the display control unit 38 determines whether or not the driver is in the vehicle, based on the boarding status information referred to in step S102 (step S104).

[0128] In step S104, when the display control unit 38 determines that the driver is in the vehicle (step S104: YES), it causes the external device 40 to display a screen including a message indicating that the driver is in the vehicle (step S105).

[0129] Fig. 10 is a diagram showing an example of a during-boarding screen displayed on the touch panel 41 of the external device 40 in step S105. As shown in Fig. 10, the during-boarding screen displays a message indicating that the driver is currently in the vehicle.

[0130] 10 may display a message urging the user to start a video communication call and a start button in addition to a message indicating that the driver is in the vehicle. The start button may be displayed on a screen different from the in-vehicle screen. For example, a button such as "Go to start screen" for proceeding to a screen for starting video communication may be displayed on the in-vehicle screen, and when the button is pressed, a start screen including the start button may be displayed.

[0131] In addition, a PIN input field for identity verification may be displayed on the in-ride screen or the start screen. For example, identity verification may be performed by inputting the last four digits of a phone number in the input field.

[0132] In addition, the terms of use and privacy policy regarding video communication may be able to be viewed from the in-car screen or the start screen, and, for example, a message may be displayed indicating that pressing the start button indicates agreement to the terms of use and privacy policy.

[0133] In step S104, when the display control unit 38 determines that the driver is not in the vehicle (step S104: NO), the display control unit 38 causes the external device 40 to display a screen including a message indicating that the driver is getting off the vehicle (step S106).

[0134] Fig. 11 is a diagram showing an example of a getting-off screen displayed on the touch panel 41 of the external device 40 in step S106. As shown in Fig. 11, a message indicating that the driver is getting off is displayed on the getting-off screen. Also, as shown in Fig. 11, a message indicating that video communication cannot be started may be displayed on the getting-off screen.

[0135] In the example shown in Fig. 11, the display related to the start of video communication, such as the start button, is shaded, and the start button is not functional. Note that the display related to the start of video communication, including the start button, may not be displayed at all on the disembarking screen.

[0136] When the display control unit 38 determines in step S102 that the URL is not yet within its validity period (step S102: NO), it causes the external device 40 to display a screen including a message indicating that the URL has expired (step S107).

[0137] Fig. 12 is a diagram showing an example of an expiration screen displayed on the touch panel 41 of the external device 40 in step S107. As shown in Fig. 12, in step S107, since the screen related to the video communication cannot be accessed, the expiration screen displays a message saying "URL has expired" as a message indicating that the URL is invalid.

[0138] For example, the expiration screen may further display a message indicating that video communication cannot be started, or a message indicating that a new invitation email needs to be received in order to start video communication.

[0139] In steps S104 to S107, the display control unit 38 executes a display control step of causing the external device 40 to display boarding status information indicating whether or not a pilot is on board the moving object for a period according to the expiration date of the URL serving as connection information.

[0140] After executing step S105, step S106, or step S107, the display control unit 38 ends the display control routine RT1 and starts the next display control routine RT1.

[0141] According to the control routine RT1, the in-vehicle screen as shown in Fig. 10 or the out-of-vehicle screen as shown in Fig. 11 is displayed, so that the virtual passenger can know whether the driver is in the vehicle M or not before attempting to connect to video communication. Therefore, the virtual passenger can avoid making unnecessary connection attempts.

[0142] Furthermore, according to the control routine RT1, it is possible to set an expiration date for the URL, and control the boarding status information to be displayed on the external device 40 only within the expiration date, and not to display the boarding status information on the external device 40 outside the expiration date. Therefore, the boarding status information is not known to the virtual passengers indefinitely, and the privacy of the driver can be protected. For example, it is possible to prevent the boarding status information from being repeatedly known even after the scheduled video communication has ended.

[0143] Furthermore, outside the validity period, a message such as that shown in FIG. 12 is displayed to the effect that the URL is invalid, thereby preventing the virtual passenger from accessing unnecessary connection information.

[0144] In step S103 of the above control routine RT1, the driver's state of leeway while driving may be referenced in addition to or instead of the driver's riding status, and if the driver is in a vehicle but is in a situation where he or she is not relaxed, a message may be displayed indicating that video communication cannot be started.

[0145] As described above, the communication system 100 of this embodiment is capable of establishing a voice call between the in-vehicle device 10 as a first device and the external device 40 as a second device via the server 30, while also performing video communication in which an image of the automobile M in which the in-vehicle device 10 is mounted is transmitted to the external device 40.

[0146] The communication system 100 of this embodiment has a connection information providing unit that provides connection information used to connect audio-visual communications including video communications and that has an expiration date, and a display control unit that, upon receiving access to the connection information from the external device 40, causes the external device 40 to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date of the connection information.

[0147] According to this embodiment, the user of the external device 40 can know whether or not a pilot is on board before attempting to connect audio and video communication. It is clear that audio and video communication cannot be connected if the pilot is not on board, and the user of the external device 40 can avoid making a pointless connection attempt when the pilot is not on board.

[0148] According to this embodiment, for example, the display control unit can display the boarding status information only within the validity period of the connection information. This makes it possible to prevent the user of the external device 40 from knowing the pilot's boarding status indefinitely, and to protect the pilot's privacy.

[0149] Therefore, according to this embodiment, it is possible to provide a communication system, a communication device, a server device, a communication method, a communication program, and a storage medium that enable efficient and smooth communication between a first device inside a moving body and a second device outside the moving body by suppressing unnecessary connection attempts from the second device to the first device while taking into consideration the privacy of the operator of the moving body.

[0150] [Variations] 13 is a block diagram showing an example of the configuration of an in-vehicle device 60 in a modified example of the communication system 100 in the embodiment 1 and the embodiment 2. In this modified example, the in-vehicle device 60 has the functions of the connection information providing unit 36, the boarding information acquiring unit 37, and the display control unit 38 that the server 30 has in the above embodiment.

[0151] Specifically, the control unit 61 of the in-vehicle device 60 has a connection information providing unit 63, a boarding information acquiring unit 64, and a display control unit 65.

[0152] The memory unit 67 stores a communication program that is executed by the control unit 61 to provide a URL that is used to connect to video communication and has an expiration date, and when access to the URL is received from the external device 40, to control the display of boarding status information indicating whether or not a driver is in the automobile M for a period corresponding to the expiration date of the ULR.

[0153] For example, when the connection information providing unit 63 of the in-vehicle device 60 receives an operational input from the driver instructing the sending of an invitation email to the external device 40, the connection information providing unit 63 generates a URL with an expiration date and sends an invitation email including the URL to the external device 40 via the communication unit 27.

[0154] The boarding information acquisition unit 64 sequentially acquires boarding status information indicating whether or not the driver is boarding the automobile M based on the detection result by the in-vehicle camera 15 or the seating sensor 22, for example.

[0155] When the display control unit 65 receives access to the URL from the external device 40, it controls the external device 40 to display boarding status information indicating whether or not a driver is in the automobile M for a period corresponding to the validity period of the ULR.

[0156] According to this modification, video communication between the external device 40 and the in-vehicle device 60 is possible for displaying boarding status information without going through the server 30. For example, control and video communication for displaying boarding status information in this modification may be performed directly between the in-vehicle device 10 and the external device 40 by P2P (Peer to Peer) communication or the like without going through the server 30.

[0157] The configurations, routines, etc. of the in-vehicle device 10, the in-vehicle device 60, the server 30, and the external device 40 in the above-described embodiment and modified examples are merely examples, and can be appropriately selected or changed depending on the application, etc.

[0158] For example, in the above embodiments and variants, the boarding status information may include, in addition to information indicating whether the driver is on board, information indicating whether or not video communication cannot be started even if the driver is on board.

[0159] For example, if the driver is in video communication with a device other than external device 40, if there is a passenger in automobile M, if the driving load is high, or if the driver is in the middle of a conversation with a passenger or the communication partner, it is presumed that the driver is in a situation where he or she would not be able to respond even if video communication was started, or would not want to transmit video images inside or outside the vehicle or audio from inside automobile M to external device 40.

[0160] In such a case, the driver's riding status may be treated as a status in which video communication cannot be started even if the driver is riding in the vehicle. In this case, for example, a message indicating that video communication cannot be started may be displayed on the riding screen indicating that the driver is riding in the vehicle.

[0161] For example, the automobile M may be provided with seating sensors in seats other than the driver's seat, and the presence or absence of a passenger, which is used to determine the driver's riding status, may be detected by the seating sensors.

[0162] For example, the magnitude of the driving load used to determine the driver's riding condition may be calculated by workload estimation using images from the exterior camera 13 or the interior camera 15.

[0163] In the above embodiment, a screen indicating that the URL is invalid is displayed on the external device 40 if the URL has not yet reached its expiration date. However, this is not limited to this, and the page identified by the URL may be made inaccessible by deleting it.

[0164] In the above embodiment and modified example, the start request from the external device 40 is received by tapping the start button displayed on the touch panel 41, but the request is not limited to this. The start request may be received by, for example, a voice input operation.

[0165] In the above embodiment and modified example, an example of performing video communication in the communication system 100 has been described, but the present invention is not limited to this. The present invention is applicable to a case where audio / video communication is performed in the communication system 100, in which audio and video in the automobile M acquired by the in-car device 10 as a first device moving together with the automobile M is transmitted to the external device 40 as a second device. In other words, the present invention is also applicable to communication in a mode in which audio is not transmitted from the external device 40.

[0166] Furthermore, the in-car device 10 and the external device 40 do not necessarily need to be able to perform voice communication. For example, the communication mode between the in-car device 10 and the external device 40 may be a mode in which video and audio are simply distributed from the in-car device 10 to the external device 40 without two-way voice communication, such as YouTube (registered trademark) or Niconico Live Broadcast (registered trademark).

[0167] In the above embodiment, the in-car device 10 and the external device 40 perform video communication via the server 30. However, the video communication may be performed directly between the in-car device 10 and the external device 40.

[0168] In addition, while the above-mentioned video distribution is being performed from the in-car device 10 to the external device 40 via the communication system 100, a voice call may be established between the in-car device 10 and the external device 40 in parallel via a path separate from the communication system 100.

[0169] In the above embodiment and modified example, the in-vehicle device 10 is an in-vehicle navigation device. However, the in-vehicle device 10 may simply be capable of distributing video from the exterior camera 13 or the interior camera 15.

[0170] For example, the in-vehicle device 10 may be configured by integrating a terminal device having a configuration similar to that of the in-vehicle device 10 with the outside camera 13 and the touch panel 17. Specifically, for example, the in-vehicle device 10 may be a terminal device such as a smartphone, tablet, or PC with a camera equipped with an app that performs the same functions as the in-vehicle device 10. In this case, the in-vehicle device 10 may be attached to the dashboard DB by, for example, a cradle or the like so that the built-in camera can capture an image of the front of the automobile M through the windshield of the automobile M.

[0171] Furthermore, the in-vehicle device 10 may be configured not to display a screen to be presented to the driver of the automobile M. For example, the in-vehicle device 10 may have a configuration like a drive recorder, and may be a device integrated with the exterior camera 13. Specifically, the in-vehicle device 10 may be a device in which hardware for performing the above-mentioned video communication function of the in-vehicle device 10 is built into the housing of the exterior camera 13. In this case, the in-vehicle device 10 may not perform various display outputs as described above.

[0172] In the above embodiment and modified example, the external device 40 is described as a smartphone, but is not limited thereto. The external device 40 is a terminal device that can be used by a virtual passenger for video communication, and is configured to be capable of displaying or presenting messages related to video communication, receiving operation inputs required for video communication, transmitting and receiving audio data, and receiving and displaying video. For example, the external device 40 may be a terminal device such as a tablet, a PC, or a wearable terminal.

[0173] In the above embodiment and modified example, the in-vehicle device 10 and the in-vehicle device 60 are mounted on the automobile M. However, the in-vehicle device 10 may be mounted on other moving objects such as a bicycle, a motorcycle, or a ship. The in-vehicle device 10 may be a terminal device with a built-in camera such as a smartphone, which is held by a person and may distribute video images by performing video communication while walking, for example. In that case, for example, information indicating whether the user of the terminal device is holding the terminal device may be displayed on the external device 40, instead of whether the driver is on the moving object. [Explanation of symbols]

[0174] 10 Onboard equipment 13. Exterior camera 15 In-car camera 17 Touch Panel 19 Speaker 21. Mike 23 Memory section 25 Control Unit 27 Communications Department 30 Servers 31 Storage section 33 Communications Department 35 Control section 36, 63 Connection Information Department 37, 64 Boarding status information acquisition section 38, 65 Display control unit 40 External device 41 Touch Panel 43 Speaker 45 Mike 47 Memory section 49 Control Unit 51 Communications Department

Claims

1. A communication system for performing audio-visual communication in which audio and video of a moving object captured by a first device moving together with the moving object is transmitted to a second device, a connection information providing unit that provides connection information for accessing time-limited information including an indication used for connecting the audiovisual communication and having an expiration date related to the indication; A communication system characterized in that it has a display control unit that, when access to the time-limited information using the connection information from the second device is accepted, causes the second device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date.

2. The communication system described in Claim 1, characterized in that the connection information is a URL for accessing a web page on which the time-limited information is posted.

3. A communication system as described in claim 1 or 2, characterized in that the connection information providing unit provides the connection information to the second device specified by the first device.

4. The communication system according to any one of claims 1 to 3, characterized in that the boarding status information includes information based on the results of detection by a camera or sensor as to whether or not the pilot is on board the moving body.

5. The communication system according to any one of claims 1 to 4, characterized in that the boarding status information includes information based on whether the first device is connected to a communication network used for the audiovisual communication.

6. the moving object is a vehicle, The communication system according to claim 1 , wherein the boarding status information includes information based on whether an accessory power source of the vehicle is turned on.

7. 7. The communication system according to claim 1, wherein the display control unit displays the boarding status information only within the validity period.

8. The communication system according to any one of claims 1 to 7, characterized in that the display control unit causes the second device to display a message indicating that the connection information is invalid when the expiration date has passed.

9. A communication method executed by a communication system that performs audio-video communication in which audio and video of a moving object captured by a first device moving together with the moving object are transmitted to a second device, the method comprising: a connection information providing step of providing connection information for accessing time-limited information including an indication used for connecting the audiovisual communication and having an expiration date for the indication; A communication method characterized by including a display control step of, when access to the time-limited information using the connection information from the second device is accepted, causing the second device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date.

10. A communication program executed by a communication system for performing audio-video communication, the communication system including a computer, the first device moving together with a mobile object, and transmitting audio and video captured by the first device at the mobile object to a second device, the communication program comprising: a connection information providing step of providing connection information for accessing time-limited information including an indication used for connecting the audiovisual communication and having an expiration date for the indication; a display control step of, when receiving access to the time-limited information from the second device using the connection information, displaying on the second device boarding status information indicating whether or not a pilot is on board the moving object for a period corresponding to the expiration date; A communications program for executing the above.

11. A communication system for performing audio-video communication, comprising: a first device that moves together with a mobile object, and transmits audio and video captured by the first device at the mobile object to a second device; a connection information providing step of providing connection information for accessing time-limited information including an indication used for connecting the audiovisual communication and having an expiration date for the indication; a display control step of, when receiving access to the time-limited information from the second device using the connection information, displaying on the second device boarding status information indicating whether or not a pilot is on board the moving object for a period corresponding to the expiration date; A computer-readable storage medium storing a communication program for executing the above-mentioned program.

12. A communication device that moves with a moving object, acquires audio and video in the moving object, and transmits the audio and video to another device, the communication device performing audio and video communication comprising: a connection information providing unit that provides connection information for accessing time-limited information including an indication used for connecting the audiovisual communication and having an expiration date related to the indication; A communication device characterized in that it has a display control unit that, when it accepts access to the time-limited information using the connection information from the other device, causes the other device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date.

13. A server device that performs audio / video communication to transmit audio and video captured by a first device moving together with a moving object to a second device, a connection information providing unit that provides connection information for accessing time-limited information including an indication used for connecting the audiovisual communication and having an expiration date related to the indication; A server device characterized in that it has a display control unit that, when it accepts access to the time-limited information using the connection information from the second device, causes the second device to display boarding status information indicating whether or not a pilot is on board the moving body for a period corresponding to the expiration date.

Images