COMMUNICATION SYSTEM, VEHICLE, COMMUNICATION METHOD, COMPUTER PROGRAM, AND SERVER

Abstract

To provide a communication system that can supply communication opportunity between a driver and the unspecified majority.SOLUTION: A system according to an embodiment is a communication system comprising: a first acquisition unit which acquires driver information on a behavior of a driver DVR of a vehicle VCL and vehicle information on the vehicle VCL; an arithmetic operation unit which outputs face information of the driver DVR corresponding to the driver information and vehicle information; a second acquisition unit acquiring first phonetic information of the driver; a first generation unit generating information of a driver model which operates on the basis of the face information and the vehicle information; a second generation unit generating vehicle video image information corresponding to an environment which is based on the vehicle information and in which the vehicle travels; and a communication unit which supplies the information of the driver model, the vehicle video image information and the first phonetic information to an external platform 300 and supplies second phonetic information acquired from the external platform 300 to the driver DVR.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a communication system, a vehicle, a communication method, a computer program, a terminal device, and a server. [Background technology]

[0002] Conventionally, methods have been proposed for vehicle drivers to communicate with the outside world while driving. For example, Patent Document 1 proposes a server that provides information to the driver by selecting a speaker that outputs only audio or a screen that outputs audio and images, and that realizes real-time two-way communication with a caller outside the vehicle by using a microphone. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-175895 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when it is difficult to talk to a specific person during a long drive or a late-night break, the driver may not be able to find someone to communicate with. In such cases, the driver cannot enjoy his or her time while driving.

[0005] For example, if a driver can have the opportunity to communicate with an unspecified number of people, he or she can enjoy driving even when he or she cannot talk to specific individuals. In addition, communication participants can be provided with the opportunity to feel as if they are enjoying a drive together with the driver.

[0006] The present invention has been made in consideration of the above-mentioned circumstances, and aims to provide a communication system, vehicle, communication method, computer program, terminal device, and server that can provide communication opportunities between a driver and an unspecified number of people. [Means for solving the problem]

[0007] A communication system according to a first aspect of the present invention includes a first acquisition unit that acquires driver information related to a behavior of a driver of a vehicle and vehicle information related to the vehicle, a calculation unit that outputs face information of the driver detected using the driver information and the vehicle information, a second acquisition unit that acquires first voice information of the driver, a first generation unit that generates information of a driver model that operates based on the face information and the vehicle information, a second generation unit that generates vehicle image information corresponding to an environment in which the vehicle runs based on the vehicle information, and a communication unit that supplies the information of the driver model, the vehicle image information, and the first voice information to an external platform, and supplies second voice information acquired from the external platform to the driver. The vehicle information includes operation information of the vehicle by the driver, and the first generation unit creates motion information of the driver model using the operation information and provides the motion information to the external platform. do. A vehicle according to a second aspect of the present invention comprises a sensor for detecting driver information relating to the behaviour of a driver of the vehicle and vehicle information relating to said vehicle, and a communication system according to the first aspect.

[0008] A communication method according to a third aspect of the present invention includes generating face information of a detected driver of a vehicle using driver information related to a behavior of the driver, generating information of a driver model that operates based on the face information and vehicle information related to the vehicle, generating vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information, providing the information of the driver model, the vehicle image information, and first voice information of the driver to an external platform, and providing second voice information acquired from the external platform to the driver. It is a method , The vehicle information includes operation information of the vehicle by the driver, and motion information of the driver model is generated using the operation information and provided to the external platform. .

[0010] A computer program according to a fifth aspect of the present invention is a program for causing a computer to execute the communication method according to the third aspect. A server according to a seventh aspect of the present invention comprises an acquisition unit that acquires first voice information of a driver of a vehicle, facial information of the driver, and vehicle information related to the vehicle, a first generation unit that generates information of a driver model that operates based on the facial information and the vehicle information, a second generation unit that generates vehicle video information corresponding to the environment in which the vehicle is traveling based on the vehicle information, and a communication unit that supplies the information of the driver model, the vehicle video information, and the first voice information to an external platform, and supplies second voice information acquired from the external platform to the driver, wherein the vehicle information includes operation information of the vehicle by the driver, and the first generation unit creates movement information of the driver model using the operation information and supplies it to the external platform. Effect of the Invention

[0011] According to the present invention, it is possible to provide a communication system, a vehicle, a communication method, a computer program, a terminal device, and a server that are capable of providing communication opportunities between a driver and an unspecified number of people. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram illustrating an example of a configuration of a communication system according to an embodiment. [Diagram 2] FIG. 2 is a diagram for explaining an example of the operation of the communication system according to the embodiment. [Diagram 3] FIG. 3 is a block diagram illustrating an example of another configuration of the communication system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] A communication system according to an embodiment will be described in detail below with reference to the drawings. FIG. 1 is a block diagram illustrating an example of a configuration of a communication system according to an embodiment. The communication system of this embodiment includes a controller 100 and a server 200.

[0014] The controller 100 is, for example, a terminal device having at least one processor and a memory in which a program executed by the processor is recorded, and can realize various functions described below by software or a combination of software and hardware.

[0015] The memory includes, for example, a main storage unit and an auxiliary storage unit. The main memory unit may include, for example, a read-only memory (ROM) and a random-access memory (RAM). The ROM is a non-volatile memory used exclusively for reading data, and can store data and various setting values ​​used by the processor when performing various processes. The RAM may be used as a so-called work area for temporarily storing data when the processor performs various processes.

[0016] The secondary storage unit is a non-transitory computer-readable storage medium of a processor-based computer, such as an EEPROM (registered trademark), an HDD (hard disk drive), or an SSD (solid state drive). The auxiliary memory unit can store data used by the processor when performing various processes, data generated by the processes in the processor, various setting values, and the like.

[0017] The controller 100 is capable of communicating with various sensors (or ECU (electronic control unit) that acquires information from the various sensors) such as a camera CMR and a position measuring device SS mounted on the vehicle VCL via a network. The controller 100 includes a first acquisition unit 101 and a calculation unit 102 . The first acquisition unit 101 can acquire information (vehicle information) about the vehicle VCL and information (driver information) about the behavior of the driver DVR of the vehicle VCL from various sensors. The controller 100 may be mounted on the vehicle VCL or may be configured to be attachable to the vehicle VCL. The controller 100 can also communicate with an external server 200 via a network.

[0018] The vehicle information includes, for example, operation information by the driver DVR, such as the accelerator opening, brake pressure, and steering angle, position information of the vehicle VCL measured by the position measuring device SS, and information used for communication of the vehicle VCL (for example, CAN information, etc.). The position information of the vehicle VCL measured by the position measuring device SS is position information measured using, for example, a GPS (global positioning system), and includes the position coordinates and time of the vehicle VCL.

[0019] The driver information includes video (camera information) including the driver DVR captured by the camera CMR. The camera CMR is installed in at least one location inside the vehicle VCL, in a position where it can capture video including the face of the driver DVR. Multiple cameras CMR may be installed in multiple locations in the vehicle VCL, and the information on the behavior of the driver DVR may include multiple videos capturing the facial expressions and actions of the driver DVR from various angles. The calculation unit 102 detects face information of the driver using the driver information, and outputs the face information corresponding to the driver information and the vehicle information to the server 200 via the network.

[0020] The server 200 includes at least one processor and a memory in which a program executed by the processor is recorded, and can realize various functions described below by software or a combination of software and hardware.

[0021] The server 200 is capable of communicating with, for example, a microphone and speaker attached to a driver DVR, the controller 100, and the platform 300 via a network.

[0022] The microphone of the driver DVR is, for example, a microphone mounted on the mobile terminal 1 (such as a smartphone or tablet terminal) used by the driver DVR, a microphone of a headset worn by the driver DVR, or a microphone mounted on the vehicle. The speaker of the driver DVR is, for example, a speaker of a headset worn by the driver DVR, a speaker mounted on the vehicle, or a speaker mounted on the mobile terminal 1 used by the driver DVR. The microphone and speaker of the headset worn by the driver DVR may be configured to be able to communicate with the mobile terminal 1 by, for example, short-range wireless communication, and can transmit and receive audio information to and from the server 200 via the communication function of the mobile terminal 1. In this embodiment, the microphone and speaker of the driver DVR are mounted on the mobile terminal 1 used by the driver DVR. The microphone and speaker of the driver DVR are capable of transmitting and receiving audio information to and from the server 200 via the communication function of the mobile terminal 1.

[0023] The server 200 includes a second acquisition unit 201, a first generation unit 202, a second generation unit 203, and a communication unit 204. The second acquisition unit 201 acquires the first voice information of the driver DVR, and the driver face information and vehicle information output from the controller 100. The first generating unit 202 generates facial expression and motion information of the driver model based on the face information and the vehicle information. For example, the server 200 can generate facial expression information of the driver model from the positions and shapes of the facial features (eyes, nose, mouth, eyebrows) included in the face information of the driver DVR. The facial expression information of the driver model may be information indicating the emotions and states of the driver DVR, such as joy, anger, sorrow, happiness, surprise, hesitation, impatience, fatigue, etc., or may be information specifically indicating the size, position, and movement of the facial features.

[0024] The first generating unit 202 can generate motion information such as the movement of the limbs of the driver model, the direction of the face of the driver model, and the position of the head, based on the face information and the operation information. The motion information of the driver model may include, for example, the position coordinates and angles of representative joints of the driver model. The server 200 may generate the position coordinates and angles of the ankle and knee joints of the driver model from, for example, information on the accelerator opening and the brake pedal force. The server 200 may also generate the position of the hands of the driver model gripping the steering wheel, the rotation direction of the steering wheel, and the position coordinates and angles of the wrist and elbow joints of the driver model accompanying the rotation of the steering wheel from, for example, information on the steering angle. The server 200 may also generate the rotation angle, tilt angle, and position coordinates of the head of the driver model from the positions and shapes of the facial parts (eyes, nose, mouth, eyebrows) included in the face information of the driver DVR.

[0025] The second generating unit 203 determines the environment in which the vehicle VCL is traveling based on the position information included in the vehicle information, and generates vehicle image information corresponding to the traveling environment. The vehicle image information generated by the second generating unit 203 may be image information that reproduces the environment of the position where the vehicle VCL is actually traveling, or may be image information that reproduces the characteristics of the position where the vehicle VCL is traveling. In the latter case, the second generating unit 203 may generate vehicle image information so as to reproduce, for example, the characteristics of the place where the vehicle VCL is traveling (city, mountain, seaside, highway, residential area, tunnel, etc.), the characteristics of the environment at the time included in the position information (night view, brightness corresponding to the time, etc.), and the characteristics of nearby objects (intersections, railroad crossings, high-rise buildings, towers, temples and shrines, parks, bridges, overpasses, rivers, seas, forests, theme parks, etc.).

[0026] The vehicle image information does not necessarily have to reproduce the actual driving environment of the vehicle VCL. For example, the vehicle image information may be an image from which pedestrians and oncoming vehicles that are actually present in the place where the vehicle VCL is traveling have been removed, or may be an image including objects such as pedestrians and oncoming vehicles that do not actually exist, or may be an image of a non-existent environment. In this case, the vehicle VCL may have a camera CMR2 that captures the surroundings of the vehicle VCL and the scenery seen from the vehicle window, and the vehicle image information may be generated based on the image captured by the camera CMR2 (external vehicle environment information). Note that the camera CMR2 is not a required component, and if the vehicle image information does not reproduce the actual driving environment, the camera CMR2 may be omitted.

[0027] In either case, the second generation unit 203 generates vehicle video information corresponding to the environment viewed from each of the front, rear, left and right windows of the driver DVR of the vehicle VCL, based on at least one of the position, direction of travel, driving speed and time of the vehicle VCL based on the position information of the vehicle VCL. The server 200 may include a database in which image data and object data for generating vehicle image information are stored, or the server 200 may acquire the image data and object data from a database external to the server 200.

[0028] The communication unit 204 associates the driver model information, the vehicle image information, and the first audio information and supplies them to the platform 300, and also supplies the second audio information acquired from the platform 300 to a speaker attached to the driver DVR (or a speaker mounted on the vehicle VCL). Note that the second audio information may be supplied from the server 200 to the in-vehicle speaker via an external service.

[0029] The controller 100 and the server 200 may set an identifier (travel ID) for each trip from the departure point to the destination, and use the travel ID to associate the driver model information, the vehicle image information, and the first audio information. In this case, the travel ID is also assigned to the second audio signal supplied from the platform 300, and the server 200 can recognize the driver DVR that should supply the second audio signal by the travel ID. In the communication system of the present embodiment, at least a part of the functions of the server 200 may be realized by the controller 100, or the controller 100 and the server 200 may be integrated and mounted on the vehicle VCL.

[0030] Platform 300 is a system that uses information generated by server 200 to supply virtual space information that combines, for example, video, driver models, and audio to one or more user terminals, and provides a service of supplying audio information from the user terminals to server 200.

[0031] The platform 300 can communicate with the server 200. As a specific example, communication can be performed between the server (sending side) 200 and the platform (receiving side) 300 by OSC (Open Sound Control), and information generated by the server 200 can be supplied to the platform 300.

[0032] The platform 300 uses the facial expression information of the driver model to adjust the positions and shapes of the facial features (eyes, nose, mouth, eyebrows, etc.) of the driver model to generate the facial expression of the driver model. The platform 300 may have in advance information on the positions and shapes of the facial features corresponding to the emotion or state of the driver DVR, for example, and when the facial expression information of the driver model indicates the emotion or state of the driver DVR, the platform 300 adjusts the positions and shapes of the facial features of the driver model as set.

[0033] Furthermore, the platform 300 uses the information on the motion of the driver model to adjust the positions and angles of the joints of the limbs, head, and trunk of the driver model to generate the motion of the driver model. The model corresponding to the driver DVR may be a three-dimensional model that reproduces the actual appearance of the driver DVR in a virtual reality space, or may be a three-dimensional model that reproduces the appearance of a virtual driver, such as a person or robot, different from the driver DVR in a virtual reality space.

[0034] The platform 300 uses the vehicle image information to generate the vehicle VCL and the environment viewed through the windows of the vehicle VCL in a virtual reality space. The platform 300 generates virtual space information so that the movement and facial expression of the driver model, the first voice information, and an environmental image in which the vehicle VCL is traveling are synchronized, and supplies the generated virtual space information to a user terminal 400 connected to the platform 300. Furthermore, when the platform 300 acquires voice information (second voice information) from the user terminal 400 to which the virtual space information has been provided, the platform 300 transmits the voice information to the server 200 with the corresponding running ID attached thereto.

[0035] The virtual space presented to the user by the user terminal 400 may have a viewpoint set so that the driver DVR is viewed from inside the vehicle VCL (such as the passenger seat), and may be movable to any viewpoint position and direction within the vehicle VCL by operating the user terminal 400. In the latter case, the platform 300 moves the viewpoint position and direction within the virtual space provided to the user terminal 400 based on operation information acquired from the user terminal 400.

[0036] Fig. 2 is a diagram for explaining an example of the operation of the communication system according to the embodiment. In Fig. 2, the server 200 generates vehicle image information using the position information of the vehicle VCL, and does not use the outside environment information captured by the camera CMR2. First, an initial setting is performed between the controller 100, the server 200, and the mobile terminal 1 equipped with a microphone and speaker of the driver DVR. For example, the microphone and speaker may be installed in the vehicle or inside the vehicle VCL near the driver. In the initial setting, an identifier (driving ID) required for information handled by the controller 100, the server 200, and the mobile terminal 1 is set so that the information acquired by the controller 100, the audio information supplied from the microphone of the mobile terminal 1, and the audio information supplied to the speaker of the mobile terminal 1 can be associated with each other.

[0037] For example, the server 200 determines whether the vehicle VCL, the microphone, and the speaker are used by a common driver DVR, based on the position information of the vehicle VCL supplied from the controller 100 and the position information of a device (e.g., the mobile terminal 1) equipped with the microphone and the speaker. Then, based on the result of the determination, the server 200 can associate the information acquired by the controller 100, the audio information supplied from the microphone of the mobile terminal 1, and the audio information supplied to the speaker of the mobile terminal 1.

[0038] After the initial settings are completed, the controller 100 acquires vehicle information acquired from the vehicle VCL and driver information related to the behavior of the driver DVR, and generates face information of the driver DVR by face tracking using the driver information (block ST1). Specifically, the controller 100 converts the camera information (driver information) into face tracking information (face information). The controller 100 outputs the face information corresponding to the driver information and the vehicle information to the server 200 via the network. Note that, if the controller 100 can acquire face tracking information instead of (or in addition to) the driver information, the operation of detecting the face tracking information (face information) can be omitted.

[0039] The server 200 acquires the vehicle information and face information from the controller 100, and acquires the first voice information from a microphone attached to the driver DVR. The server 200 associates the vehicle information and face information acquired from the controller 100 with the first voice information acquired from the microphone by common identification information (block ST2).

[0040] The server 200 converts the vehicle information and the face information into a movement of the driver model (block ST3), and generates information of the driver model that operates based on the movement and face information of the driver model (including information on the movement of the driver model toward the platform 300 and the facial expression of the driver model toward the platform 300). The server 200 also determines the scenery of the vehicle's traveling position from the position information included in the vehicle information, and creates vehicle image information (projected image of the car window in the virtual space) that corresponds to the environment in which the vehicle VCL is traveling (block ST4). The server 200 associates the driver model information, the vehicle image information, and the first audio information with each other by the common identification information, and supplies the information to the platform 300.

[0041] The platform 300 associates the driver model information, vehicle image information, and first audio information supplied from the server 200 with each other using identification information, generates three-dimensional virtual space information and audio information so that the driver model's movements and facial expressions, the first audio information, and the environmental image in which the vehicle VCL is traveling are synchronized, and supplies the information to the user terminal connected to the platform 300. The number of user terminals 400 connected to the platform 300 may be multiple or zero.

[0042] The user terminal 400 may be, but is not limited to, an electronic device such as a computer, for example, a PC (Personal Computer), a mobile terminal (for example, a tablet, a smartphone, a laptop, a feature phone, a portable game console, etc.), an HMD (Head Mounted Display), a game console, a television receiver (including an Internet television), etc. The user terminal 400 provides the user with a virtual reality space image generated from the supplied virtual space information in a viewable manner.

[0043] The user terminal 400 can be operated to move the user's viewpoint position and orientation in the virtual reality space by the user's button operation, the user's head movement, etc. The user terminal 400 also includes a microphone, and acquires audio information (second audio information) including the user's voice, and transmits the acquired information to the platform 300 with an identifier.

[0044] The platform 300 transmits the second voice information acquired from the user terminal 400 to the server 200. Based on the identifier of the acquired second voice information, the server 200 associates the second voice information with information of the mobile terminal 1 of the driver DVR of the corresponding trip (block ST2), and provides the second voice information to the driver DVR via the mobile terminal 1. In addition, the platform 300 may check the identifier of the second audio information acquired from the user terminal 400, and provide the second audio information to the driver DVR of the corresponding trip. The server 200 or the platform 300 may supply the second audio information to an in-vehicle speaker of the vehicle VCL via an external service, for example, to a speaker attached to the driver DVR (or installed near the driver inside the vehicle VCL).

[0045] As described above, the communication system and method of the present embodiment allow the driver to have the opportunity to communicate with an unspecified number of people. Also, communication participants (users) can obtain information about the driver's operating status and the location where the vehicle is traveling without actually getting into the vehicle and without being limited by the number of participants. As a result, according to the communication system and communication method of the present embodiment, even when the driver is driving alone, the driver can reduce the sense of loneliness by, for example, listening to and talking with many people, and can enjoy driving through communication via the system. Also, the communication participants (users of the platform 300) can be provided with an experience as if they were riding on a tourist bus, enjoying the view from the window, or enjoying a drive together with the driver.

[0046] That is, according to the present embodiment, it is possible to provide a communication system, a communication method, and a computer program capable of providing communication opportunities between a driver and an unspecified number of people.

[0047] (Modification) FIG. 3 is a block diagram illustrating an example of another configuration of the communication system according to the embodiment. In this example, the controller 100 acquires first audio information via an in-vehicle microphone or the like and outputs the acquired first audio information to the server 200. The communication unit 204 also supplies second audio information output from the platform 300 to the controller 100, and the controller 100 supplies the second audio information to the driver DVR via the in-vehicle speaker. According to this example, the same effects as those of the above-mentioned embodiment can be obtained, and the driver DVR can enjoy the audio coming from the in-vehicle speaker, for example, as if listening to the radio or music. Furthermore, since audio information is transmitted and received between the controller 100 and the server 200, it is only necessary to perform initial settings by the controller 100 and the server 200, and initial settings in the mobile terminal 1 are not required. That is, according to the modification shown in FIG. 3, it is possible to provide a communication system, a communication method, and a computer program capable of providing communication opportunities between a driver and an unspecified number of people, similar to the above-described embodiment.

[0048] In the above embodiment, the platform 300 provides the user with three-dimensional virtual reality space information, but the present invention is not limited to this, and a two-dimensional image of the virtual reality space may be provided to the user terminal. Even in this case, the same effects as those of the above embodiment can be obtained. Also, for example, when the driver DVR listens to the sound of many people talking as background music while driving, the supply of the first audio information to the server 200 and the platform 300 may be omitted.

[0049] Furthermore, the number of users who can access the platform 300 for each trip may be limited, and access may be permitted only to specific users. When multiple users are accessing the platform 300, the volume of the audio for each user may be adjusted when the second audio information is supplied from the server 200 to the driver DVR. Also, when the driver DVR is not driving, such as when the driver DVR has parked the vehicle VCL in a parking lot, the user's video and avatar may be displayed on a display mounted on the vehicle VCL. For example, when the vehicle is parked, the controller 100 may transmit a signal requesting the user's video to the server 200, and the server 200 may obtain the user's video information and avatar information from the platform 300 and supply them to the controller 100.

[0050] The present invention is not limited to the above-mentioned embodiment, and can be modified in various ways without departing from the gist of the present invention. The embodiments may be combined as appropriate, and in that case, the combined effect can be obtained. Furthermore, the above-mentioned embodiment includes various inventions, and various inventions can be extracted by combinations selected from the multiple components disclosed. For example, if the problem can be solved and the effect can be obtained even if some components are deleted from all the components shown in the embodiment, the configuration from which the components are deleted can be extracted as an invention. [Appendix 1] A first acquisition unit that acquires driver information related to a behavior of a driver of a vehicle and vehicle information related to the vehicle; A calculation unit that outputs face information of the driver corresponding to the behavior of the driver and the vehicle information; A second acquisition unit that acquires first voice information of the driver; A first generation unit that generates information of a driver model that operates based on the face information and the vehicle information; a second generation unit that generates vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information; A communication system comprising: a communication unit that supplies the driver model information, the vehicle image information, and the first audio information to an external platform, and supplies second audio information obtained from the external platform to the driver. [Appendix 2] The driver information includes a driver image including a face of the driver, the calculation unit outputs the face information including facial expression information related to positions and sizes of the driver's facial features by face tracking using the driver video; 2. The communication system according to claim 1, wherein the first generation unit outputs information about the driver model including information associating the facial expression information with identification information of the driver model. [Appendix 3] The vehicle information includes operation information of the vehicle by the driver, The communication system according to claim 1, wherein the first generation unit creates motion information of the driver model using the operation information and supplies the motion information to the external platform. [Appendix 4] A controller including the first acquisition unit and the calculation unit; 2. The communication system according to claim 1, further comprising: a server including the second acquisition unit, the first generation unit, the second generation unit, and the communication unit. [Appendix 5] A controller including the first acquisition unit, the calculation unit, and the second acquisition unit; 2. The communication system according to claim 1, further comprising: a server having the first generation unit, the second generation unit, and the communication unit. [Appendix 6] A communication system according to claim 1; and a sensor for detecting the driver information and the vehicle information. [Appendix 7] obtaining driver information relating to the behavior of a driver of a vehicle and vehicle information relating to said vehicle; generating face information of the driver corresponding to the driver information; generating information of a driver model that operates based on the face information and the vehicle information; generating vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information; Providing the driver model information, the vehicle image information, and the first voice information of the driver to an external platform; and providing second audio information obtained from the external platform to the driver. [Appendix 8] outputting, to an external platform, information for configuring, in a virtual space, a driver model that reproduces the actions and facial expressions of the driver in the vehicle and an environment in which the vehicle travels, based on driver information related to a behavior of the driver of the vehicle, vehicle information related to the vehicle, and first voice information of the driver; and providing second audio information obtained from the external platform to the driver. [Appendix 9] A computer program for causing a computer to execute the communication method according to claim 7 or 8. [Appendix 10] An acquisition unit that acquires driver information related to a behavior of a driver of a vehicle and vehicle information related to the vehicle; A terminal device having a calculation unit that outputs face information of the driver corresponding to the driver information and the vehicle information. [Appendix 11] An acquisition unit that acquires first voice information of a driver of a vehicle, face information of the driver, and vehicle information related to the vehicle; A first generation unit that generates information of a driver model that operates based on the face information and the vehicle information; a second generation unit that generates vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information; A server comprising: a communication unit that supplies the driver model information, the vehicle image information, and the first audio information to an external platform, and supplies second audio information obtained from the external platform to the driver. [Explanation of symbols]

[0051] 100…Controller 101…First acquisition part 102...Arithmetic section 200...Server 201…Second acquisition part 202...1st generation section 203...Second generation section 204…Communications Department 300…Platform DVR…Driver VCL…Vehicle CMR…Camera SS…Position measuring device

Claims

1. A first acquisition unit that acquires driver information related to a behavior of a driver of a vehicle and vehicle information related to the vehicle; A calculation unit that outputs face information of the driver corresponding to the behavior of the driver and the vehicle information; A second acquisition unit that acquires first voice information of the driver; A first generation unit that generates information of a driver model that operates based on the face information and the vehicle information; a second generating unit that generates vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information; a communication unit that supplies the driver model information, the vehicle image information, and the first voice information to an external platform, and supplies second voice information acquired from the external platform to the driver; The vehicle information includes operation information of the vehicle by the driver, The first generation unit creates motion information of the driver model using the operation information and supplies the motion information to the external platform.

2. The driver information includes a driver image including a face of the driver, the calculation unit outputs the face information including facial expression information related to positions and sizes of the driver's facial features by face tracking using the driver video; The communication system according to claim 1 , wherein the first generator outputs the information on the driver model including information associating the facial expression information with identification information of the driver model.

3. A controller including the first acquisition unit and the calculation unit; The communication system according to claim 1 , further comprising: a server including the second acquisition unit, the first generation unit, the second generation unit, and the communication unit.

4. a controller including the first acquisition unit, the calculation unit, and the second acquisition unit; The communication system according to claim 1 , further comprising: a server including the first generation unit, the second generation unit, and the communication unit.

5. A communication system according to claim 1; and a sensor for detecting the driver information and the vehicle information.

6. obtaining driver information relating to the behavior of a driver of a vehicle and vehicle information relating to said vehicle; generating face information of the driver corresponding to the driver information; generating information of a driver model that operates based on the face information and the vehicle information; generating vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information; Providing the driver model information, the vehicle image information, and the first voice information of the driver to an external platform; A method for providing second audio information obtained from the external platform to the driver, comprising: The vehicle information includes operation information of the vehicle by the driver, a communication method in which movement information of the driver model is created using the operation information and supplied to the external platform.

7. outputting, to an external platform, information for configuring, in a virtual space, a driver model that reproduces the actions and facial expressions of the driver in the vehicle and an environment in which the vehicle travels, based on driver information related to a behavior of a driver of a vehicle, vehicle information related to the vehicle, and first voice information of the driver; A method for providing second audio information obtained from the external platform to the driver, comprising: The vehicle information includes operation information of the vehicle by the driver, a communication method in which movement information of the driver model is created using the operation information and supplied to the external platform.

8. A computer program for causing a computer to execute the communication method according to claim 6 or 7.

9. an acquisition unit that acquires first voice information of a driver of a vehicle, face information of the driver, and vehicle information related to the vehicle; A first generation unit that generates information of a driver model that operates based on the face information and the vehicle information; a second generating unit that generates vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information; a communication unit that supplies the driver model information, the vehicle image information, and the first voice information to an external platform, and supplies second voice information acquired from the external platform to the driver; The vehicle information includes operation information of the vehicle by the driver, The first generation unit creates motion information of the driver model using the operation information and provides the motion information to the external platform.

Images