Electronic conference support system, electronic conference support method, and program

Abstract

To support a participant outside a moving object who is in an electronic conference with a driver of a moving object to perform smooth communication with the driver.SOLUTION: An electronic conference support system 1 comprises: a movement status information acquiring unit 13 that acquires movement status information indicating a movement status of a moving object 50; a conference responding difficulty determining unit 16 that determines a difficulty of a driver D to respond to an electronic conference based on the movement status information; and a conference responding difficulty information providing unit 17 that transmits conference responding difficulty information indicating the difficulty to terminal devices 101 and 111 used by external participants to participate in the electronic conference when an electronic conference participation recognizing unit 12 recognizes that the electronic conference is held between the driver D and the external participants.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an electronic conference support system, an electronic conference support method, and a program. [Background technology]

[0002] In recent years, efforts to provide access to sustainable transportation systems that take into consideration vulnerable transport participants such as the elderly, people with disabilities, and children have been gaining momentum. To achieve this, we are focusing on research and development to further improve transport safety and convenience through development of vehicle livability. For example, Patent Document 1 discloses a configuration in which, when a vehicle occupant participates in an electronic conference, output from the in-vehicle speakers is switched on and off and the sensitivity of the microphone for the occupant's voice is adjusted depending on the state of the vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-174693 A Summary of the Invention [Problem to be solved by the invention]

[0004] In terms of vehicle comfort, when a vehicle driver is participating in an electronic conference, the driver needs to handle both the driving of the vehicle and the electronic conference. However, depending on the vehicle's driving conditions, the driver's response to the electronic conference may be limited in order to prioritize the driving of the vehicle. In this case, it becomes difficult for other participants outside the vehicle who are participating in the electronic conference to maintain smooth communication with the driver. Therefore, the present application aims to support smooth communication between the driver and the participants outside the vehicle who are participating in the electronic conference and holding the electronic conference with the driver of the vehicle. In order to solve the above problems, the present application aims to provide an electronic conference support system, an electronic conference support method, and a program that can support smooth communication between a driver of a mobile object such as a vehicle and an external participant who is holding an electronic conference with the driver of the mobile object, thereby contributing to the development of a sustainable transportation system. [Means for solving the problem]

[0005] A first aspect for achieving the above-mentioned object is an electronic conference support system comprising: an electronic conference participation recognition unit that recognizes that a driver of a mobile body is holding an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit that acquires movement status information indicating the movement status of the mobile body; a conference response difficulty determination unit that determines the degree of difficulty of the driver in handling the electronic conference based on the movement status information; and a conference response difficulty information provision unit that, when the electronic conference participation recognition unit recognizes that the driver is holding the electronic conference with the external participant, transmits conference response difficulty information indicating the degree of difficulty to a terminal device used by the external participant to participate in the electronic conference.

[0006] The above electronic conference support system may be configured to include a driving status information acquisition unit that acquires driving status information indicating the driving status of the mobile body, and the conference response difficulty determination unit may be configured to determine the difficulty level based on the moving status information and the driving status information.

[0007] The electronic conference support system may be configured to include a biometric information acquisition unit that acquires biometric information of the driver, and the conference handling difficulty determination unit may be configured to determine the difficulty level based on the travel status information and the biometric information.

[0008] The above electronic conference support system may be configured to include a driving status information acquisition unit that acquires driving status information indicating the driving status of the mobile body, and the conference response difficulty determination unit may be configured to determine the difficulty level based on the moving status information, the biometric information, and the driving status information.

[0009] In the electronic conference support system, the movement status information may include at least one of the movement speed of the moving object and the operation status of a traffic light present in front of the moving object.

[0010] In the above electronic conference support system, the driving status information may be configured to include at least one of the driving operation status of the mobile body by the driver, the operation status of a driving assistance function provided in the mobile body, and the operation status of an automatic driving function provided in the mobile body.

[0011] In the above electronic conference support system, the driving status information may include a frequency of operation of the driving operation unit of the mobile body by the driver, and the conference response difficulty judgment unit may be configured to judge that the higher the frequency of operation of the driving operation unit recognized from the driving status information, the higher the difficulty level.

[0012] In the above electronic conference support system, the biometric information may include at least one of the direction of the driver's gaze recognized from an image of the driver captured by a camera mounted on the mobile body and detection information of a biometric sensor mounted on the mobile body.

[0013] A second aspect for achieving the above object is an electronic conference support method executed by a computer, the electronic conference support method including: an electronic conference participation recognition step for recognizing that a driver of a mobile body is holding an electronic conference with an external participant outside the mobile body; a movement status information acquisition step for acquiring movement status information indicating the movement status of the mobile body; a conference handling difficulty determination step for determining the degree of difficulty of the driver in handling the electronic conference based on the movement status information; and a conference handling difficulty information provision step for, when it is recognized by the electronic conference participation recognition step that the driver is holding the electronic conference with the external participant, sending conference handling difficulty information indicating the degree of difficulty to a terminal device used by the external participant to participate in the electronic conference.

[0014] A third aspect for achieving the above object includes a program that causes a computer to function as an electronic conference participation recognition unit that recognizes that a driver of a mobile body is holding an electronic conference with an external participant outside the mobile body, a movement status information acquisition unit that acquires movement status information indicating the movement status of the mobile body, a conference response difficulty determination unit that determines the degree of difficulty of the driver in handling the electronic conference based on the movement status information, and a conference response difficulty information providing unit that, when the electronic conference participation recognition unit recognizes that the driver is holding the electronic conference with the external participant, sends conference response difficulty information indicating the degree of difficulty to a terminal device used by the external participant to participate in the electronic conference. Effect of the Invention

[0015] According to the above electronic conference support system, electronic conference support method, and program, it is possible to support smooth communication between a participant outside a mobile body such as a vehicle and the driver of the mobile body who is holding an electronic conference with the driver. [Brief description of the drawings]

[0016] [Figure 1]FIG. 1 is a configuration diagram of a vehicle equipped with an electronic conference support and telephone call support system. [Diagram 2] FIG. 2 is a flowchart of a process for providing conference handling difficulty level information. [Diagram 3] FIG. 3 is an explanatory diagram of a teleconference screen displayed on a terminal device outside the vehicle. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] [1. Configuration of electronic meeting support system] The configuration of an electronic conference support system 1 of the present disclosure will be described with reference to Fig. 1. Fig. 1 illustrates a situation in which the electronic conference support system 1 supports an electronic conference held between a driver D of a vehicle 50 and other participants P1 and P2 outside the vehicle 50. The vehicle 50 corresponds to a moving body of the present disclosure. The participants P1 and P2 correspond to external participants of the present disclosure.

[0018] The vehicle 50 is equipped with an ECU (Electronic Control Unit) 51 that controls the operation of the vehicle 50, a communication unit 52 that communicates with the electronic conference support system 1 and the like via the communication network 200, a front camera 53 that photographs the area in front of the vehicle 50, a radar 54 that detects the position of objects in front of the vehicle 50, an in-vehicle camera 55 that photographs the driver D, biosensors (vital sensors) 56 that are installed in the driver's seat or the like and detect the biometric information of the driver D (heart rate, pulse, sweat, etc.), operation unit sensors 57 that detect the operation state of the driving operation units (accelerator pedal, brake pedal, steering wheel, etc.), driving condition sensors 58 that detect the driving conditions of the vehicle 50 (speed, acceleration, yaw rate, etc.), a navigation device 59 that provides route guidance based on map information, a touch panel display 60, and a microphone 61.

[0019] The ECU 51 is composed of one or more ECUs, and the driver D uses an electronic conference app (application program) executed by the ECU 51 to access the electronic conference support system 1 and participate in the electronic conference. The driver D can also participate in the electronic conference using an electronic conference app installed on a mobile terminal 70. The mobile terminal 70 is a smartphone, a mobile phone, a tablet terminal, or the like. The driver D visually checks the electronic conference screen displayed on the display 60 and touches the display 60 to communicate with the other participants P1 and P2.

[0020] The ECU 51 is equipped with an automatic driving function that controls the automatic driving of the vehicle 50 based on an image of the front of the vehicle 50 captured by the front camera 53, the position of objects in front of the vehicle 50 detected by the radar 54, etc., and a driving assist function that assists the driver D in driving the vehicle 50.

[0021] When the driver D is participating in an electronic conference, the ECU 51 transmits, at a predetermined timing, to the electronic conference support system 1, travel status information Msi indicating the travel status of the vehicle 50, driving status information Dsi indicating the driving status of the vehicle 50, and biometric information Bmi of the driver D. The travel status information Msi includes the speed, acceleration, yaw rate, etc. of the vehicle 50 detected by the driving status sensors 58, the operation status of traffic lights ahead of the vehicle 50 recognized from an image captured by the front camera 53, the status of the road on which the vehicle 50 is traveling (general roads in urban areas, mountain roads, vehicle-only roads, etc.) recognized by the navigation device 59, and the like.

[0022] The driving status information Dsi includes the driving status of the vehicle 50 (manual driving, whether or not the driving assist function is being used, automatic driving), and the operation amount and operation frequency of the accelerator pedal, brake pedal, steering wheel, etc. detected by the operation unit sensors 57. The biometric information Bmi includes the direction of the driver D's gaze recognized from the image captured by the in-vehicle camera 55, and the driver D's heart rate, pulse rate, sweat level, etc. detected by the biometric sensors 56.

[0023] A participant P1 operates a terminal device 101 from a house 100 such as his / her home to use an electronic conference app, thereby accessing the electronic conference support system 1 and participating in the electronic conference. The terminal device 101 is a personal computer, a tablet device, a smartphone, or the like, and has a function of communicating via a communication network 200. While visually checking the electronic conference screen displayed on the display unit of the terminal device 101, the participant P1 operates the terminal device 101 to communicate with the driver D and the participant P2. Similarly, the participant P2 operates the terminal device 111 from a house 110 to access the electronic conference support system 1 to participate in the electronic conference, and communicates with the driver D and the participant P2.

[0024] The electronic conference support system 1 is a computer system including a processor 10, a memory 20, a communication unit 30, etc. The memory 20 stores a program 21 for controlling the electronic conference support system 1 and a conference handling difficulty map 22 for determining the difficulty level of a conference, which will be described later. The program 21 may be read from a recording medium (magnetic disk, optical disk, flash memory, etc.) and stored in the memory 20, or may be downloaded from an external server or the like via a communication network 200 and stored in the memory 20.

[0025] The processor 10 reads and executes the program 21 to function as an electronic conference control unit 11, an electronic conference participation recognition unit 12, a travel status information acquisition unit 13, a driving status information acquisition unit 14, a biometric information acquisition unit 15, a conference handling difficulty level determination unit 16, and a conference handling difficulty level information provision unit 17. The process executed by the electronic conference participation recognition unit 12 corresponds to an electronic conference participation recognition step in the electronic conference support method of the present disclosure, and the process executed by the travel status information acquisition unit 13 corresponds to a travel status information acquisition step in the electronic conference support method of the present disclosure. The process executed by the conference handling difficulty level determination unit 16 corresponds to a conference handling difficulty level determination step in the electronic conference support method of the present disclosure, and the process executed by the conference handling difficulty level information provision unit 17 corresponds to a conference handling difficulty level information provision step in the electronic conference support method of the present disclosure.

[0026] The electronic conference control unit 11 provides a service for holding an electronic conference with the driver D, the participant P1, and the participant P2 by communicating with the vehicle 50 (more specifically, the ECU 51), the terminal device 101, and the terminal device 111 via the communication network 200. The electronic conference participation recognition unit 12 recognizes that the driver D is participating in the electronic conference from the control status of the electronic conference by the electronic conference control unit 11.

[0027] The travel status information acquisition unit 13 receives and acquires the travel status information Msi transmitted from the vehicle 50 via the communication unit 30. The driving status information acquisition unit 14 receives and acquires the driving status information Dsi transmitted from the vehicle 50 via the communication unit 30. The biometric information acquisition unit 15 receives and acquires the biometric information Bmi transmitted from the vehicle 50 via the communication unit 30.

[0028] The conference handling difficulty determination unit 16 determines the degree of difficulty of the driver D in handling the electronic conference based on the movement status information Msi, the driving status information Dsi, and the biological information Bmi. Specifically, the conference handling difficulty determination unit 16 executes the following process to obtain a conference handling difficulty score Cds indicating the degree of difficulty of the driver D in handling the electronic conference.

[0029] (1. Calculation of mobility status score) The conference handling difficulty determination unit 16 sets a movement situation score Mss corresponding to the movement situation information Msi according to the following rules (1-1) to (1-4). The movement situation score Mss is set higher as the difficulty of the driver D in handling the electronic conference increases. (1-1) The higher the traveling speed of the vehicle 50, the higher the movement status score Mss is set. (1-2) Regarding the operation status of the traffic light ahead of the vehicle 50, the movement status score Mss is set higher when the traffic light is green than when the traffic light is red. (1-3) With regard to the roads on which the vehicle 50 is traveling, the travel situation score Mss is set to be higher when the vehicle 50 is traveling on mountain roads than when the vehicle 50 is traveling on urban roads. (1-4) The movement situation score Mss is increased when the vehicle 50 is traveling within an intersection, traveling on a narrow road, traveling on a road with many blind spots, passing other vehicles on a narrow road, traveling in the rain (determined by the wiper operating speed or a raindrop sensor), traveling on poor road conditions (determined by an acceleration sensor for frequent up and down movement), when there is a lot of noise around the vehicle 50, when an emergency vehicle is approaching the vehicle 50, when the distance from the vehicle 50 to the vehicle in front is less than a predetermined distance (variable depending on the speed of the vehicle 50), and when the position and relative speed of a motorcycle traveling near the vehicle 50 with respect to the vehicle 50 satisfy predetermined approach conditions.

[0030] (2. Calculation of driving situation score) The conference handling difficulty determination unit 16 sets a driving situation score Dss corresponding to the driving situation information Dsi according to the following rules (2-1) to (2-4). The driving situation score Dss is set higher as the driver D has a higher difficulty in handling the electronic conference. (2-1) The driving situation score Dss is increased in the following order: automatic driving → manual driving (with driving assistance) → manual driving (without driving assistance). (2-2) The greater the amount of operation of the operating parts (accelerator pedal, brake pedal, steering wheel), the higher the driving situation score Dss is set. (2-3) The driving situation score Dss is increased as the frequency of operation of the operation unit increases. (2-4) When the safety features of the vehicle 50 (emergency braking, lane departure warning, etc.) are activated and when the driver D is using voice control (while the Assistant app is running), the driving situation score Dss is increased.

[0031] (3. Calculation of Biometric Score) The conference handling difficulty determination unit 16 sets a biological information score Bms corresponding to the biological information Bmi according to the following rules (3-1) to (3-4). The biological information score Bms is set higher as the driver D has a higher difficulty in handling the teleconference. (3-1) The more stable the direction of the driver D's gaze (the more the driver D focuses on a specific object), the higher the biometric score Bms is set. (3-2) The higher the heart rate or pulse rate of the driver D, the higher the vital sign score Bms is set. (3-3) The more the driver D sweats, the higher the vital sign score Bms is set. (3-4) The stronger the glare felt by driver D from the sun or the headlights of oncoming vehicles (determined by calculating the solar radiation angle or by images from the in-vehicle camera 55 (driver monitoring camera)), the higher the bioinformation score Bms. The greater the electrocardiogram disturbance (arrhythmia) of driver D, the higher the bioinformation score Bms. The greater the emotional excitement of driver D as recognized from the tone of voice of driver D (which conveys emotions such as irritation to others), the higher the bioinformation score Bms.

[0032] The conference handling difficulty determination unit 16 calculates a conference handling difficulty score Cds by applying the movement state score Mss, the driving state score Dss, and the biological information score Bms to a conference handling difficulty map 22. The conference handling difficulty map 22 is a three-dimensional map that outputs a conference handling difficulty score Cds in response to input of the movement state score Mss, the driving state score Dss, and the biological information score Bms, as shown in balloon B in FIG.

[0033] The conference handling difficulty map 22 is, for example, a map of the calculation result according to the following formula (1). Cds=W1×Mss+W2×Dss+W3×Bms...(1) where Cds: movement status score, Dss: driving status score, Bms: vital sign score, W1 to W3: weighting coefficients. W1 to W3 are set by demonstration experiments and computer simulations.

[0034] [2. Provision of meeting handling difficulty information] The procedure for providing information on the difficulty level of handling a conference executed by the electronic conference support system 1 will be described with reference to the flowchart shown in Fig. 2. The electronic conference support system 1 repeatedly executes the process according to the flowchart shown in Fig. 2 when the driver D is using the vehicle 50 (shown as the target vehicle in Fig. 2).

[0035] 2, the electronic conference participation recognition unit 12 recognizes whether or not the driver of the vehicle 50 is participating in the electronic conference, based on the execution status of control of the electronic conference by the electronic conference control unit 11. In the following step S2, the electronic conference participation recognition unit 12 advances the process to step S3 if the driver D is participating in the electronic conference, and advances the process to step S8 if the driver D is not participating in the electronic conference.

[0036] In step S3, the travel status information acquisition unit 13 receives and acquires the travel status information Msi from the vehicle 50 via the communication network 200. In the following step S4, the driving status information acquisition unit 14 receives and acquires the driving status information Dsi from the vehicle 50 via the communication network 200. In the following step S5, the biometric information acquisition unit 15 receives and acquires the biometric information Bmi from the vehicle 50 via the communication network 200.

[0037] In the next step S6, the conference handling difficulty determination unit 16 calculates the moving situation score Mss, the driving situation score Dss, and the biological information score Bms from the moving situation information Msi, the driving situation information Dsi, and the biological information Bmi as described above. Then, the conference handling difficulty determination unit 16 applies the moving situation score Mss, the driving situation score Dss, and the biological information score Bms to the conference handling difficulty map 22 to calculate the conference handling difficulty score Cds.

[0038] In the next step S7, the conference management difficulty information provider 17 transmits the conference management difficulty information Cdi including the conference management difficulty score Cds to the terminals 101 and 111 used by the other participants P1 and P2 of the electronic conference.

[0039] 3 shows an electronic conference screen 300 displayed on the display unit of the terminal device 101, 111. On the electronic conference screen 300, an image 310 of a driver D participating in the electronic conference, an image 311 of another participant P1, an image 312 of another participant P2, a conference end button 320 for instructing to leave the electronic conference, a microphone button 321 for instructing to turn the microphone on and off, and a camera button 322 for instructing to turn the camera on and off are displayed.

[0040] When the terminal devices 101, 111 receive the conference handling difficulty information Cdi transmitted from the electronic conference support system 1, the electronic conference application displays a conference handling difficulty notification image 330 displaying a 10-level indicator 331 corresponding to the conference handling difficulty score Cds near the image 310 of the driver D. The display range of the indicator 331 becomes longer (the number of displayed blocks increases) as the conference handling difficulty score Cds becomes higher (as the driver D's difficulty in handling the electronic conference becomes higher).

[0041] 3 shows an example in which the conference handling difficulty level notification image 330 displays driving state information of "Manual driving, no driving assistance", which is a factor taken into consideration when calculating the conference handling difficulty level score Cds, together with an indicator 331. In addition, the driving speed of the vehicle 50, the operating state of the traffic light ahead of the vehicle 50, the amount of accelerator pedal operation by the driver D, etc. may be displayed on the conference handling difficulty level notification image 330.

[0042] The other participants P1 and P2 can intuitively and quickly recognize the degree of difficulty the driver D has in handling the electronic conference from the length of the indicator 331. The other participants P1 and P2 can then decide the timing of displaying the shared and visually viewable materials on the electronic conference screen 300 and the timing of asking questions to the driver D, taking into consideration the degree of difficulty the driver D has in handling the electronic conference. This makes it possible for the other participants P1 and P2 to support smooth communication with the driver D.

[0043] 3. Other embodiments In the above embodiment, the driving situation information acquisition unit 14 and the biometric information acquisition unit 15 are provided, and the conference handling difficulty determination unit 16 determines the conference handling difficulty level (conference handling difficulty level score Cds) based on the movement situation information Msi, the driving situation information Dsi, and the biometric information Bmi. As another embodiment, only either the driving situation information acquisition unit 14 or the biometric information acquisition unit 15 may be provided, and the conference handling difficulty level may be determined based on the movement situation information Msi and the driving situation information Dsi, or based on the movement situation information Msi and the biometric information Bmi. In addition, the driving situation information acquisition unit 14 and the biometric information acquisition unit 15 may be omitted, and the conference handling difficulty determination unit 16 may determine the conference handling difficulty level based only on the movement situation information Msi.

[0044] In the above embodiment, the electronic conference support system 1 is configured by one computer system that communicates with the vehicle 50 and the terminal devices 101, 111. As another embodiment, a part or all of the electronic conference support system 1 may be provided in the ECU 51 of the vehicle 50. For example, the electronic conference participation recognition unit 12, the moving situation information acquisition unit 13, the driving situation information acquisition unit 14, the biological information acquisition unit 15, and the conference handling difficulty determination unit 16 may be configured as functions of the ECU 51, and the vehicle 50 may perform the determination of the conference handling difficulty level and transmit the conference handling difficulty level information Cdi to the electronic conference support system 1. In this case, the electronic conference support system of the present disclosure is configured by the electronic conference support system 1 and the ECU 51. Furthermore, the conference handling difficulty level information provision unit 17 may also be configured as a function of the ECU 51. In this case, the electronic conference support system of the present disclosure is configured by only the ECU 51 of the vehicle 50, and the conference handling difficulty level information Cdi is transmitted from the vehicle 50 to the terminal devices 101, 111.

[0045] In the above embodiment, the driver D participated in the electronic conference using an electronic conference app executed by the ECU 51, but when participating in the electronic conference using an electronic conference app executed by the mobile terminal 70, the electronic conference control unit 11 recognizes, for example, the moving speed of the mobile terminal 70 from the position information of the mobile terminal 70 transmitted from the mobile terminal 70, and recognizes that the driver D is participating in the electronic conference. In this case, the moving status information Msi, the driving status information Dsi, and the biological information Bmi may be transmitted from the ECU 51 to the mobile terminal 70, and the moving status information Msi, the driving status information Dsi, and the biological information Bmi may be transmitted from the mobile terminal 70 to the electronic conference support system 1 via the communication network 200.

[0046] In the above embodiment, the vehicle 50 is shown as the moving body of the present disclosure, but the moving body of the present disclosure may be an aircraft, a ship, or the like.

[0047] 1 is a schematic diagram showing the configuration of the electronic conference support system 1 divided according to the main processing contents in order to facilitate understanding of the present invention, and the configuration of the electronic conference support system 1 may be divided in other ways. Furthermore, the processing of each component may be executed by one hardware unit or by multiple hardware units. Furthermore, the processing of each component shown in FIG. 2 may be executed by one program or by multiple programs.

[0048] [4. Configuration supported by the above embodiment] The above embodiment is a specific example of the following configuration.

[0049] (Configuration 1) An electronic conference support system comprising: an electronic conference participation recognition unit that recognizes that a driver of a mobile body is holding an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit that acquires movement status information indicating the movement status of the mobile body; a conference response difficulty determination unit that determines the degree of difficulty of the driver to handle the electronic conference based on the movement status information; and a conference response difficulty information providing unit that, when the electronic conference participation recognition unit recognizes that the driver is holding the electronic conference with the external participant, sends conference response difficulty information indicating the degree of difficulty to a terminal device used by the external participant to participate in the electronic conference. According to the electronic conference support system of configuration 1, it is possible to support smooth communication between a participant outside a moving object such as a vehicle and the driver of the moving object who is holding an electronic conference with the driver.

[0050] (Configuration 2) An electronic conference support system as described in Configuration 1, comprising a driving status information acquisition unit that acquires driving status information indicating the driving status of the moving body, and the conference response difficulty determination unit determines the difficulty level based on the moving status information and the driving status information. According to the electronic conference support system of configuration 2, the degree of difficulty of the driver to respond to the electronic conference can be determined based on the driving conditions of the mobile body that affect the driver's response to the electronic conference.

[0051] (Configuration 3) An electronic conference support system as described in Configuration 1, further comprising a biometric information acquisition unit that acquires biometric information of the driver, and the conference handling difficulty determination unit determines the difficulty level based on the travel status information and the biometric information. According to the electronic conference support system of configuration 3, the degree of difficulty of the driver in responding to the electronic conference can be determined based on the driver's biological information that affects the driver's response to the electronic conference.

[0052] (Configuration 4) An electronic conference support system as described in Configuration 3, comprising a driving status information acquisition unit that acquires driving status information indicating the driving status of the moving body, and the conference response difficulty determination unit determines the difficulty level based on the moving status information, the biometric information, and the driving status information. According to the electronic conference support system of configuration 4, the degree of difficulty of the driver to respond to the electronic conference can be accurately determined based on the movement status of the mobile object, which affects the driver's response to the video conference, the driver's biometric information, and the driving status of the mobile object.

[0053] (Configuration 5) An electronic conference support system described in any one of configurations 1 to 4, wherein the movement status information includes at least one of the movement speed of the moving body and the operation status of a traffic light located in front of the moving body. According to the electronic conference support system of configuration 5, the degree of difficulty that the driver will have in responding to an electronic conference can be determined by taking into consideration the speed of the moving body or the operation status of traffic lights ahead of the moving body, which affect the degree to which the driver is alerted to the surroundings of the moving body.

[0054] (Configuration 6) An electronic conference support system as described in Configuration 2 or Configuration 4, wherein the driving status information includes at least one of the driving operation status of the moving body by the driver, the operation status of a driving assistance function provided in the moving body, and the operation status of an automatic driving function provided in the moving body. According to the electronic conference support system of configuration 6, the degree of difficulty of the driver in responding to the electronic conference can be determined according to the driving load of the vehicle by the driver.

[0055] (Configuration 7) An electronic conference support system as described in Configuration 2 or Configuration 4, in which the driving status information includes a frequency of operation of the driving operation unit of the mobile body by the driver, and the conference handling difficulty judgment unit judges that the higher the frequency of operation of the driving operation unit recognized from the driving status information, the higher the difficulty. According to the electronic conference support system of configuration 7, when the driver frequently operates the driving control unit of the vehicle and the driving load on the driver is high, it is assumed that the driver has a low level of ability to respond to an electronic conference. It is possible to determine that the driver has a high level of difficulty in responding to an electronic conference.

[0056] (Configuration 8) An electronic conference support system as described in Configuration 3 or Configuration 4, wherein the biometric information includes at least one of the direction of the driver's gaze recognized from an image of the driver captured by a camera provided on the moving body and detection information of a biometric sensor provided on the moving body. According to the electronic conference support system of configuration 8, the degree of difficulty of the driver in responding to the electronic conference can be determined based on the actual physical condition of the driver.

[0057] (Configuration 9) An electronic conference support method executed by a computer, comprising: an electronic conference participation recognition step of recognizing that a driver of a mobile body is holding an electronic conference with an external participant outside the mobile body; a movement status information acquisition step of acquiring movement status information indicating the movement status of the mobile body; a conference response difficulty determination step of determining the degree of difficulty of the driver to handle the electronic conference based on the movement status information; and a conference response difficulty information providing step of, when it is recognized by the electronic conference participation recognition step that the driver is holding the electronic conference with the external participant, sending conference response difficulty information indicating the degree of difficulty to a terminal device used by the external participant to participate in the electronic conference. By executing the electronic conference support method of configuration 9 by a computer, the same effects as those of the electronic conference support system of configuration 1 can be obtained.

[0058] (Configuration 10) A program that causes a computer to function as an electronic conference participation recognition unit that recognizes that a driver of a mobile body is holding an electronic conference with an external participant outside the mobile body, a movement status information acquisition unit that acquires movement status information indicating the movement status of the mobile body, a conference response difficulty determination unit that determines the degree of difficulty of the driver to handle the electronic conference based on the movement status information, and a conference response difficulty information providing unit that, when the electronic conference participation recognition unit recognizes that the driver is holding the electronic conference with the external participant, sends conference response difficulty information indicating the degree of difficulty to a terminal device used by the external participant to participate in the electronic conference. By executing the program of configuration 10 by a computer, the configuration of the electronic conference support system of configuration 1 can be realized. [Explanation of symbols]

[0059] 1...Electronic conference support system, 10...Processor, 11...Electronic conference control unit, 12...Electronic conference participation recognition unit, 13...Movement status information acquisition unit, 14...Driving status information acquisition unit, 15...Biometric information acquisition unit, 16...Conference response difficulty determination unit, 17...Conference response difficulty information provision unit, 20...Memory, 21...Program, 22...Conference response difficulty map, 50...Vehicle (mobile body), 51...ECU, 52...Communication unit, 53...Front camera, 54...Radar , 55...in-vehicle camera, 56...biometric sensors, 57...operation unit sensors, 58...driving condition sensors, 59...navigation device, 60...display, 61...microphone, 70...mobile terminal, 101, 111...terminal device, 200...communication network, 300...electronic conference screen, 310...image of driver, 311, 312...images of other participants, 330...conference response difficulty notification image, 331...indicator, D...driver, P1, P2...other participants.

Claims

1. an electronic conference participation recognition unit that recognizes that a driver of a mobile body is participating in an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit that acquires movement status information indicating a movement status of the moving object; a conference attendance difficulty determination unit that determines a difficulty level of the driver attending the electronic conference based on the travel status information; a conference handling difficulty information providing unit that transmits conference handling difficulty information indicating the difficulty to a terminal device that the external participant is using to participate in the electronic conference when the electronic conference participation recognition unit recognizes that the driver is holding the electronic conference with the external participant; An electronic conference support system comprising:

2. A driving status information acquisition unit that acquires driving status information indicating a driving status of the moving body, The conference attendance difficulty level determination unit determines the difficulty level based on the travel status information and the driving status information. The electronic conference support system according to claim 1 .

3. A biometric information acquisition unit for acquiring biometric information of the driver, The conference handling difficulty level determination unit determines the difficulty level based on the movement status information and the biological information. The electronic conference support system according to claim 1 .

4. A driving situation information acquisition unit that acquires driving situation information indicating a driving situation of the moving body, The conference attendance difficulty level determination unit determines the difficulty level based on the travel status information, the biological information, and the driving status information. The electronic conference support system according to claim 3 .

5. The moving condition information includes at least one of a moving speed of the moving object and an operation condition of a traffic light present in front of the moving object. The electronic conference support system according to any one of claims 1 to 4.

6. The driving status information includes at least one of a driving operation status of the moving body by the driver, an operation status of a driving assistance function provided in the moving body, and an operation status of an automatic driving function provided in the moving body. The electronic conference support system according to claim 2 or 4.

7. The driving situation information includes a frequency of operation of a driving operation unit of the moving body by the driver, The conference handling difficulty determination unit determines that the conference handling difficulty level is higher as the operation frequency of the driving operation unit recognized from the driving situation information is higher. The electronic conference support system according to claim 2 or 4.

8. The biometric information includes at least one of the driver's gaze direction recognized from an image of the driver captured by a camera provided on the moving body and detection information of a biometric sensor provided on the moving body.

5. The electronic conference support system according to claim 3 or 4.

9. 1. A computer-implemented method for supporting electronic conferencing, comprising: an electronic conference participation recognition step of recognizing that a driver of a mobile body is participating in an electronic conference with an external participant outside the mobile body; a movement status information acquisition step of acquiring movement status information indicating a movement status of the moving object; a conference response difficulty determination step of determining a difficulty level of the driver in responding to the electronic conference based on the travel status information; a conference handling difficulty information providing step of transmitting conference handling difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference when it is recognized by the electronic conference participation recognition step that the driver is holding the electronic conference with the external participant; A method for supporting electronic meetings, including:

10. Computer, an electronic conference participation recognition unit that recognizes that a driver of a mobile body is participating in an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit that acquires movement status information indicating a movement status of the moving object; a conference attendance difficulty determination unit that determines a difficulty level of the driver attending the electronic conference based on the travel status information; a conference handling difficulty information providing unit that transmits conference handling difficulty information indicating the difficulty to a terminal device that the external participant is using to participate in the electronic conference when the electronic conference participation recognition unit recognizes that the driver is holding the electronic conference with the external participant; A program that makes it work.

Images