Electronic conference support system, electronic conference support method, and recording medium

By identifying the electronic meeting situation between the driver and external participants in the electronic meeting support system, obtaining and analyzing the vehicle's movement and driving status information, and combining the biological information to judge the difficulty, the driver's difficulties in the electronic meeting are solved. The problem of this achieves smooth communication with external participants.

CN119449507APending Publication Date: 2025-02-14HONDA MOTOR CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202410957493.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-07-31
Filing Date
2024-07-17
Publication Date
2025-02-14

AI Technical Summary

Technical Problem

In the living nature of the vehicle, drivers need to take into account both the driving of the vehicle and the electronic meeting when attending the electronic meeting, resulting in restrictions on the response to the electronic meeting and it is difficult for participants outside the vehicle to maintain smooth communication with the driver.

Method used

An electronic conference support system was designed to identify the electronic conference situation between the driver and external participants, obtain the mobile status and driving status information of the mobile body, and combine the biological information to judge the difficulty of the driver in dealing with the electronic conference. And send this information to external participants so that they can adjust their communication methods.

Benefits of technology

It supports smooth communication between drivers and external participants when vehicle driving and electronic meetings are conducted simultaneously, and improves the response efficiency and convenience of electronic meetings.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119449507A_ABST
    Figure CN119449507A_ABST
Patent Text Reader

Abstract

The invention provides an electronic conference support system, an electronic conference support method, and a recording medium, which support smooth communication with a driver for participants outside a moving body who are performing an electronic conference with the driver of the moving body. An electronic conference support system (1) is provided with: a movement status information acquisition unit (13) that acquires movement status information indicating the movement status of a moving body (50); a conference response difficulty determination unit (16) that determines the difficulty of the driver (D) in response to the electronic conference on the basis of the movement status information; and a conference response difficulty degree information provision unit (17) that, when the electronic conference participation recognition unit (12) recognizes that the driver (D) is performing the electronic conference with the external participant, transmits conference response difficulty degree information indicating the degree of difficulty to terminal devices (101, 111) used by the external participant for participating in the electronic conference.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an electronic conference supporting system, an electronic conference supporting method and a recording medium. Background Art

[0002] In recent years, efforts have been actively made to provide sustainable transportation systems that take into account the use of vulnerable groups such as the elderly, the disabled, and children among traffic participants. To achieve this, we are working on research and development related to the habitability of vehicles to further improve the safety and convenience of transportation.

[0003] For example, Patent Document 1 discloses a configuration in which, when a vehicle passenger participates in an electronic conference, output and non-output from a speaker in the vehicle are switched and the sensitivity of a microphone for the passenger's voice is adjusted according to the state of the vehicle.

[0004] [Prior art literature]

[0005] [Patent Document]

[0006] [Patent Document 1]

[0007] Japanese Patent Publication No. 2019-174693 Summary of the invention

[0008] [Problems to be Solved by the Invention]

[0009] However, in the habitability of a vehicle, when the driver of the vehicle participates in an electronic conference, he needs to deal with both driving the vehicle and the electronic conference. However, depending on the driving conditions of the vehicle, the response to the electronic conference is sometimes limited in order to give priority to driving the vehicle. In addition, in this case, it is difficult for other participants outside the vehicle who participate in the electronic conference to maintain smooth communication with the driver. Therefore, the subject of this application is to support smooth communication between the driver and the participants outside the vehicle who participate in the electronic conference and hold an electronic conference with the driver of the vehicle.

[0010] In order to solve the above problems, the present application aims to provide an electronic conference support system, an electronic conference support method and a recording medium, which can support smooth communication between the external participants of a mobile body such as a vehicle and the driver of the mobile body in an electronic conference, and further contribute to the development of a sustainable transportation system.

[0011] [Methods for solving the problem]

[0012] As a first method for achieving the above-mentioned purpose, there can be cited an electronic conference support system, comprising: an electronic conference participation identification unit, which identifies that a driver of a mobile body is conducting an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit, which acquires movement status information indicating the movement status of the mobile body; a meeting response difficulty judgment unit, which judges the difficulty of the driver in coping with the electronic conference based on the movement status information; and a meeting response difficulty information providing unit, which, when the electronic conference participation identification unit identifies that the driver is conducting the electronic conference with the external participant, sends meeting response difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference.

[0013] The electronic conference support system may include a driving condition information acquisition unit that acquires driving condition information indicating a driving condition of the mobile body, and the conference handling difficulty determination unit determines the difficulty based on the mobile condition information and the driving condition information.

[0014] The electronic conference support system may further include a biological information acquisition unit that acquires biological information of the driver, and the conference handling difficulty determination unit may determine the difficulty based on the movement status information and the biological information.

[0015] The electronic conference support system may include a driving condition information acquisition unit that acquires driving condition information indicating the driving condition of the mobile body, and a conference response difficulty determination unit that determines the difficulty based on the mobile condition information, the biological information, and the driving condition information.

[0016] In the electronic conference supporting system, the moving state information may include at least one of a moving speed of the moving body and an operating condition of a traffic signal existing in front of the moving body.

[0017] In the electronic conference support system, the driving state information may include at least any one of the driving operation status of the mobile body by the driver, the operating status of a driving assistance function of the mobile body, and the operating status of an automatic driving function of the mobile body.

[0018] In the electronic conference support system, the driving state information may include the driver's operation frequency of the driving operation unit of the mobile body, and the conference handling difficulty determination unit determines the difficulty to be higher as the operation frequency of the driving operation unit recognized from the driving state information is higher.

[0019] In the above-mentioned electronic conference support system, the following structure can also be adopted, that is, the biometric information includes at least one of the direction of the driver's line of sight and the detection information of the biometric sensor installed in the mobile body, and the direction of the driver's line of sight is identified from the image of the driver taken by the camera installed in the mobile body.

[0020] According to a second aspect for achieving the above-mentioned purpose, there is provided an electronic conference support method executed by a computer, the electronic conference support method comprising: an electronic conference participation identification step of identifying that a driver of a mobile body is conducting an electronic conference with an external participant outside the mobile body; a movement status information acquisition step of acquiring movement status information indicating the movement status of the mobile body; a meeting response difficulty judgment step of judging the difficulty of the driver in coping with the electronic conference based on the movement status information; and a meeting response difficulty information providing step of sending the meeting response difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference when it is identified through the electronic conference participation identification step that the driver is conducting the electronic conference with the external participant.

[0021] As a third method for achieving the above-mentioned purpose, a non-volatile recording medium is recorded with a program executed by a computer, wherein the program enables the computer to function as: an electronic conference participation identification unit, which identifies that the driver of a mobile body is conducting an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit, which acquires movement status information indicating the movement status of the mobile body; a meeting response difficulty judgment unit, which judges the difficulty of the driver to cope with the electronic conference based on the movement status information; and a meeting response difficulty information providing unit, which, when the electronic conference participation identification unit identifies that the driver is conducting the electronic conference with the external participant, sends the meeting response difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference.

[0022] [Effects of the invention]

[0023] According to the electronic conference support system, the electronic conference support method, and the recording medium, it is possible to support smooth communication between a participant outside a mobile body such as a vehicle and the driver of the mobile body who is holding an electronic conference with the driver. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a structural diagram of a vehicle equipped with an electronic conference support system.

[0025] Figure 2This is a flow chart of the process of providing meeting response difficulty information.

[0026] Figure 3 This is an explanatory diagram of an electronic conference screen displayed on a terminal device outside a vehicle. DETAILED DESCRIPTION

[0027] [1. Structure of the electronic conference support system]

[0028] Reference Figure 1 , the structure of the electronic conference support system 1 of the present disclosure is explained. Figure 1 The electronic conference support system 1 is exemplified as supporting an electronic conference between a driver D of a vehicle 50 and other participants P1 and P2 outside the vehicle 50. The vehicle 50 corresponds to the mobile body of the present disclosure. The participants P1 and P2 correspond to the external participants of the present disclosure.

[0029] The vehicle 50 includes: an ECU (Electronic Control Unit) 51 that controls the operation of the vehicle 50; a communication unit 52 that communicates with the electronic conference support system 1 and the like via the communication network 200; a front camera 53 that captures the front of the vehicle 50; a radar 54 that detects the position of an object that exists in front of the vehicle 50; an in-vehicle camera 55 that captures the driver D; a biosensor (life sensor) 56 that is provided on a driver's seat and the like and detects the biometric information (heart rate, pulse, sweat, etc.) of the driver D; an operating unit sensor 57 that detects the operating state of a driving operating unit (accelerator pedal, brake pedal, steering wheel, etc.); a driving condition sensor 58 that detects the driving condition (speed, acceleration, yaw rate, etc.) of the vehicle 50; a navigation device 59 that provides route guidance based on map information; a display 60 of touch panel specification; and a microphone 61.

[0030] The ECU 51 is composed of a single or multiple ECUs, and the driver D uses the electronic conference application (application program) executed by the ECU 51 to access the electronic conference support system 1 and participate in the electronic conference. In addition, the driver D can also participate in the electronic conference using the electronic conference application installed in the portable terminal 70. The portable terminal 70 is a smart phone, a mobile phone, a tablet terminal, etc. The driver D visually confirms the electronic conference screen displayed on the display 60 while performing a touch operation on the display 60 to communicate with other participants P1 and P2.

[0031] ECU51 has an automatic driving function and a driving assistance function. The automatic driving function performs automatic driving control of the vehicle 50 based on the captured image in front of the vehicle 50 captured by the front camera 53, the position of the object in front of the vehicle 50 detected by the radar 54, etc., and the driving assistance function assists the driving operation of the vehicle 50 performed by the driver D.

[0032] When the driver D participates in the electronic conference, the ECU 51 transmits the movement status information Msi indicating the movement status of the vehicle 50, the driving status information Dsi indicating the driving status of the vehicle 50, and the biological information Bmi of the driver D to the electronic conference support system 1 at a predetermined timing. The movement status information Msi includes the speed, acceleration, yaw rate, etc. of the vehicle 50 detected by the driving status sensor 58, the operating status of the traffic light in front of the vehicle 50 recognized from the image captured by the front camera 53, and the status of the road (general road in the city, mountain road, vehicle-only road, etc.) on which the vehicle 50 is traveling recognized by the navigation device 59.

[0033] The driving condition information Dsi includes the driving condition of the vehicle 50 (manual driving, use of the driving assist function, automatic driving), the operation amount and frequency of the accelerator pedal, brake pedal, steering wheel, etc. detected by the operation unit sensor 57. The biometric information Bmi includes the direction of the driver D's line of sight recognized from the image captured by the in-vehicle camera 55, and the heart rate, pulse, and sweat level of the driver D detected by the biometric sensor 56.

[0034] Participant P1 operates terminal device 101 from house 100 such as his own home and uses the electronic conference application, thereby accessing the electronic conference support system 1 and participating in the electronic conference. Terminal device 101 is a personal computer, a tablet terminal, a smart phone, etc., and has a function of communicating via communication network 200. Participant P1 communicates with driver D and participant P2 while visually checking the electronic conference screen displayed on the display unit of terminal device 101. Similarly, participant P2 operates terminal device 111 from house 110, participates in the electronic conference by accessing the electronic conference support system 1, and communicates with driver D and participant P1.

[0035] The electronic conference support system 1 is a computer system including a processor 10, a memory 20, a communication unit 30, etc. A program 21 for controlling the electronic conference support system 1 and a conference handling difficulty map 22 for determining the conference handling difficulty described later are stored in the memory 20. The program 21 may be read from a recording medium (a magnetic disk, an optical disk, a flash memory, etc.) and stored in the memory 20, or may be downloaded from an external server, etc., via a communication network 200 and stored in the memory 20.

[0036] The processor 10 reads and executes the program 21, thereby functioning as an electronic conference control unit 11, an electronic conference participation recognition unit 12, a movement status information acquisition unit 13, a driving status information acquisition unit 14, a biological information acquisition unit 15, a conference handling difficulty determination unit 16, and a conference handling difficulty information providing unit 17. The processing performed by the electronic conference participation recognition unit 12 is equivalent to the electronic conference participation recognition step in the electronic conference support method of the present disclosure, and the processing performed by the movement status information acquisition unit 13 is equivalent to the movement status information acquisition step in the electronic conference support method of the present disclosure. The processing performed by the conference handling difficulty determination unit 16 is equivalent to the conference handling difficulty determination step in the electronic conference support method of the present disclosure, and the processing performed by the conference handling difficulty information providing unit 17 is equivalent to the conference handling difficulty information providing step in the electronic conference support method of the present disclosure.

[0037] The electronic conference control unit 11 communicates with the vehicle 50 (more specifically, the ECU 51), the terminal device 101, and the terminal device 111 via the communication network 200, thereby providing a service of an electronic conference implemented by the driver D, the participants P1, and the participants P2. The electronic conference participation identification unit 12 identifies that the driver D is participating in the electronic conference based on the control state of the electronic conference by the electronic conference control unit 11.

[0038] The movement status information acquisition unit 13 receives and acquires the movement status information Msi transmitted from the vehicle 50 via the communication unit 30. The driving status information acquisition unit 14 receives and acquires the driving status information Dsi transmitted from the vehicle 50 via the communication unit 30. The biometric information acquisition unit 15 receives and acquires the biometric information Bmi transmitted from the vehicle 50 via the communication unit 30.

[0039] The conference handling difficulty determination unit 16 determines the difficulty of the driver D handling the electronic conference based on the movement status information Msi, the driving status information Dsi and the biological information Bmi. Specifically, the conference handling difficulty determination unit 16 performs the following processing to obtain a conference handling difficulty score Cds indicating the difficulty of the driver D handling the electronic conference.

[0040] (1. Calculation of movement status score)

[0041] The conference handling difficulty determination unit 16 sets the movement condition score Mss corresponding to the movement condition information Msi according to the following rules (1-1) to (1-4). The higher the difficulty for the driver D to handle the electronic conference, the higher the movement condition score Mss is set. (1-1) The higher the driving speed of the vehicle 50, the higher the movement condition score Mss. (1-2) Regarding the operating condition of the traffic light in front of the vehicle 50, the movement condition score Mss is increased when the traffic light is green compared to the case where the traffic light is red. (1-3) Regarding the road on which the vehicle 50 is traveling, the movement condition score Mss is increased when the vehicle 50 is traveling on a mountain road compared to the case where the vehicle is traveling on an urban road. (1-4) When vehicle 50 is traveling at an intersection, traveling on a narrow road, traveling on a road with many blind spots, meeting other vehicles on a narrow road, traveling in the rain (the wiper movement speed is determined by a raindrop sensor), or traveling in poor road conditions (a lot of up and down movement is determined by an acceleration sensor), when there is a lot of noise around vehicle 50, when an emergency vehicle is approaching vehicle 50, when the distance from vehicle 50 to the vehicle in front is less than a specified distance (which can change according to the speed of vehicle 50), or when the position and relative speed of a motorcycle traveling near vehicle 50 relative to vehicle 50 meet specified approach conditions, the movement condition score Mss is increased.

[0042] (2. Calculation of driving condition score)

[0043] The conference handling difficulty judgment unit 16 sets a driving condition score Dss corresponding to the driving condition information Dsi according to the following rules (2-1) to (2-4). The higher the difficulty for the driver D to handle the electronic conference, the higher the driving condition score Dss is set. (2-1) The driving condition score Dss is increased in the order of automatic driving → manual driving (with driving assistance) → manual driving (without driving assistance). (2-2) The greater the operation amount of the operating part (accelerator pedal, brake pedal, steering wheel), the higher the driving condition score Dss. (2-3) The higher the operation frequency of the operating part, the higher the driving condition score Dss. (2-4) The driving condition score Dss is increased when the safety function of the vehicle 50 (emergency braking, lane departure warning, etc.) is in operation and when the driver D uses voice operation (Assistant application is activated).

[0044] (3. Calculation of biological information score)

[0045] The conference handling difficulty determination unit 16 sets the biometric information score Bms corresponding to the biometric information Bmi according to the following rules (3-1) to (3-4). The higher the difficulty of the driver D in handling the electronic conference, the higher the biometric information score Bms is set. (3-1) The more stable the direction of the driver D's line of sight (the more the driver D focuses on a specific object), the higher the biometric information score Bms. (3-2) The higher the heart rate or pulse rate of the driver D, the higher the biometric information score Bms. (3-3) The more the driver D sweats, the higher the biometric information score Bms. (3-4) The stronger the glare of the sun or the headlights of the oncoming vehicle felt by the driver D (determined based on the calculated sun angle or the image of the in-vehicle camera 55 (driver monitoring camera)), the higher the biometric information score Bms. The greater the disturbance (irregular heartbeat) of the electrocardiogram of the driver D, the higher the biometric information score Bms. The higher the degree of excitement of the driver D recognized from the tone of the driver D's voice (emotions such as anxiety are conveyed to the other party), the higher the biological information score Bms is made.

[0046] The meeting handling difficulty determination unit 16 applies the movement condition score Mss, the driving condition score Dss, and the biological information score Bms to the meeting handling difficulty map 22 to calculate the meeting handling difficulty score Cds. Figure 2 As shown in the dialog box B, the meeting handling difficulty map 22 is a three-dimensional map that outputs the meeting handling difficulty score Cds for the input of the movement condition score Mss, the driving condition score Dss, and the biological information score Bms.

[0047] The conference handling difficulty map 22 is obtained by mapping the calculation result of the following formula (1), for example.

[0048] Cds=W1×Mss+W2×Dss+W3×Bms·····(1)

[0049] Among them, Mss: moving condition score, Dss: driving condition score, Bms: biological information score, W1~W3: weighting coefficients.

[0050] W1 to W3 are set through verification experiments and computer simulations.

[0051] [2. Provision of meeting response difficulty information]

[0052] according to Figure 2 The flowchart shown in FIG. 1 illustrates the execution steps of the process of providing conference handling difficulty information executed by the electronic conference supporting system 1. The electronic conference supporting system 1 is used by the driver D to drive the vehicle 50 (in Figure 2 If the target vehicle is displayed in Figure 2The process of the flowchart shown.

[0053] exist Figure 2 In step S1, the electronic conference participation identification unit 12 identifies whether the driver D of the vehicle 50 is participating in the electronic conference based on the execution state of the control of the electronic conference by the electronic conference control unit 11. In the next step S2, the electronic conference participation identification unit 12 advances the processing to step S3 when the driver D is participating in the electronic conference, and advances the processing to step S8 when the driver D is not participating in the electronic conference.

[0054] In step S3, the movement status information acquisition unit 13 receives and acquires the movement status information Msi from the vehicle 50 via the communication network 200. In the next step S4, the driving status information acquisition unit 14 receives and acquires the driving status information Dsi from the vehicle 50 via the communication network 200. In the next step S5, the biometric information acquisition unit 15 receives and acquires the biometric information Bmi from the vehicle 50 via the communication network 200.

[0055] In the next step S6, the meeting handling difficulty determination unit 16 calculates the movement condition score Mss, the driving condition score Dss, and the biological information score Bms as described above based on the movement condition information Msi, the driving condition information Dsi, and the biological information Bmi. Then, the meeting handling difficulty determination unit 16 applies the movement condition score Mss, the driving condition score Dss, and the biological information score Bms to the meeting handling difficulty map 22 to calculate the meeting handling difficulty score Cds.

[0056] In the next step S7 , the conference handling difficulty information providing unit 17 transmits the conference handling difficulty information Cdi including the conference handling difficulty score Cds to the terminal devices 101 and 111 used by the other participants P1 and P2 of the electronic conference.

[0057] Here, Figure 3 The electronic conference screen 300 displayed on the display units of the terminal devices 101 and 111 is shown. The electronic conference screen 300 displays an image 310 of the driver D who is participating in the electronic conference, an image 311 of another participant P1, an image 312 of another participant P2, a conference end button 320 for instructing to exit from the electronic conference, a microphone button 321 for instructing to turn on / off a microphone, and a camera button 322 for instructing to turn on / off a camera.

[0058] When the terminal devices 101 and 111 receive the conference handling difficulty information Cdi transmitted from the electronic conference support system 1, the electronic conference application displays a conference handling difficulty report image 330 near the image 310 of the driver D. The conference handling difficulty report image 330 displays 10-stage indicators 331 corresponding to the conference handling difficulty score Cds. The indicator 331 displays a longer range (the number of displayed blocks increases) as the conference handling difficulty score Cds increases (as the difficulty of the driver D handling the electronic conference increases).

[0059] In addition, Figure 3 , an example is shown in which information on the driving state of "manual driving without driving assistance" which is an element considered in calculating the meeting handling difficulty score Cds is displayed together with the indicator 331 in the meeting handling difficulty report image 330. In addition, the driving speed of the vehicle 50, the operating state of the traffic light in front of the vehicle 50, the operation amount of the accelerator pedal by the driver D, etc. may also be displayed in the meeting handling difficulty report image 330.

[0060] The other participants P1 and P2 can intuitively and quickly recognize the difficulty of the driver D in coping with the electronic conference based on the length of the indicator 331. Then, the other participants P1 and P2 can consider the difficulty of the driver D in coping with the electronic conference and decide the timing of displaying the shared and visually confirmed data on the electronic conference screen 300 and the timing of asking the driver D. In this way, the smooth communication between the other participants P1 and P2 and the driver D can be supported.

[0061] [3. Other embodiments]

[0062] In the above-mentioned embodiment, the driving condition information acquisition unit 14 and the biological information acquisition unit 15 are provided, and the meeting handling difficulty determination unit 16 determines the meeting handling difficulty (the meeting handling difficulty score Cds) based on the movement condition information Msi, the driving condition information Dsi, and the biological information Bmi. As another embodiment, only one of the driving condition information acquisition unit 14 or the biological information acquisition unit 15 may be provided, and the meeting handling difficulty may be determined based on the movement condition information Msi and the driving condition information Dsi, or based on the movement condition information Msi and the biological information Bmi. In addition, the driving condition information acquisition unit 14 and the biological information acquisition unit 15 may be omitted, and the meeting handling difficulty determination unit 16 may determine the meeting handling difficulty based only on the movement condition information Msi.

[0063] In the above-mentioned embodiment, the electronic conference support system 1 is constituted by a computer system that communicates with the vehicle 50 and the terminal devices 101 and 111. As another embodiment, a part or all of the electronic conference support system 1 may be set in the ECU 51 of the vehicle 50. For example, the electronic conference participation identification unit 12, the mobile status information acquisition unit 13, the driving status information acquisition unit 14, the biological information acquisition unit 15, and the conference handling difficulty judgment unit 16 may be constituted as functions of the ECU 51, and the vehicle 50 performs the judgment until the conference handling difficulty, and transmits the conference handling difficulty information Cdi to the electronic conference support system 1. In this case, the electronic conference support system of the present disclosure is constituted by the electronic conference support system 1 and the ECU 51. In addition, the conference handling difficulty information providing unit 17 may be constituted as a function of the ECU 51. In this case, the electronic conference support system of the present disclosure is constituted only by the ECU 51 of the vehicle 50, and the conference handling difficulty information Cdi is transmitted from the vehicle 50 to the terminal devices 101 and 111.

[0064] In the above-mentioned embodiment, the driver D uses the electronic conference application executed by the ECU 51 to participate in the electronic conference. However, when the driver D uses the electronic conference application executed by the portable terminal 70 to participate in the electronic conference, the electronic conference control unit 11 recognizes the moving speed of the portable terminal 70 based on the position information of the portable terminal 70 transmitted from the portable terminal 70, thereby recognizing that the driver D is participating in the electronic conference. In this case, the movement status information Msi, the driving status information Dsi, and the biological information Bmi may be transmitted from the ECU 51 to the portable terminal 70, and the movement status information Msi, the driving status information Dsi, and the biological information Bmi may be transmitted from the portable terminal 70 to the electronic conference support system 1 via the communication network 200.

[0065] In the above-described embodiment, the vehicle 50 is shown as the mobile object of the present disclosure, but the mobile object of the present disclosure may be an aircraft, a ship, or the like.

[0066] in addition, Figure 1 This is a schematic diagram showing the structure of the electronic conference support system 1 according to the main processing contents for easy understanding of the present invention. The structure of the electronic conference support system 1 may be configured by other divisions. In addition, the processing of each component may be performed by one hardware unit or by multiple hardware units. Figure 2 The processing of each component shown may be executed by one program or by a plurality of programs.

[0067] [4. Structure supported by the above-mentioned embodiment]

[0068] The above-mentioned embodiment is a specific example of the following structure.

[0069] (Structure 1) An electronic conference support system, the electronic conference support system comprising: an electronic conference participation identification unit, which identifies that a driver of a mobile body is conducting an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit, which acquires movement status information indicating the movement status of the mobile body; a meeting response difficulty judgment unit, which judges the difficulty of the driver to cope with the electronic conference based on the movement status information; and a meeting response difficulty information providing unit, which, when the electronic conference participation identification unit identifies that the driver is conducting the electronic conference with the external participant, sends the meeting response difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference.

[0070] According to the electronic conference support system of the configuration 1, it is possible to support smooth communication between a participant who is outside a mobile body and a driver of a mobile body such as a vehicle and the driver of the mobile body through electronic conference with the driver.

[0071] (Structure 2) An electronic conference support system according to Structure 1, wherein the electronic conference support system comprises a driving condition information acquisition unit which acquires driving condition information indicating the driving condition of the mobile body, and the conference response difficulty judgment unit judges the difficulty based on the mobile condition information and the driving condition information.

[0072] According to the electronic conference support system of the second configuration, it is possible to determine the degree of difficulty of the driver in coping with the electronic conference based on the driving condition of the mobile object that affects the driver's coping with the electronic conference.

[0073] (Structure 3) The electronic conference support system according to Structure 1,

[0074] The electronic conference support system includes a biological information acquisition unit that acquires biological information of the driver, and the conference handling difficulty determination unit determines the difficulty based on the movement status information and the biological information.

[0075] According to the electronic conference support system of the third configuration, it is possible to determine the degree of difficulty of the driver in coping with the electronic conference based on the biological information of the driver that affects the driver's coping with the electronic conference.

[0076] (Structure 4) An electronic conference support system according to Structure 3, wherein the electronic conference support system comprises a driving condition information acquisition unit, which acquires driving condition information indicating the driving condition of the mobile body, and the conference response difficulty judgment unit judges the difficulty based on the mobile condition information, the biological information and the driving condition information.

[0077] According to the electronic conference support system of configuration 4, the difficulty of the driver's handling of the electronic conference can be determined with high accuracy based on the movement status of the mobile body that affects the driver's handling of the electronic conference, the driver's biological information, and the driving status of the mobile body.

[0078] (Structure 5) The electronic conference support system according to any one of Structures 1 to 4, wherein the movement status information includes at least one of a movement speed of the moving body and an operating status of a traffic signal existing in front of the moving body.

[0079] According to the electronic conference support system of configuration 5, the difficulty of the driver in coping with the electronic conference can be determined by taking into account the speed of the moving body or the operating conditions of the traffic lights in front of the moving body, which affect the degree to which the driver's attention is called to the surroundings of the moving body.

[0080] (Structure 6) An electronic conference support system according to Structure 2 or Structure 4, wherein the driving status information includes at least any one of the driver's driving operation status of the mobile body, the working status of a driving assistance function of the mobile body, and the working status of an automatic driving function of the mobile body.

[0081] According to the electronic conference support system of configuration 6, it is possible to determine the degree of difficulty of the driver in coping with the electronic conference based on the driving load of the driver on the mobile body.

[0082] (Structure 7) An electronic conference support system according to Structure 2 or 4, wherein the driving condition information includes the driver's operation frequency of the driving operation unit of the mobile body, and the higher the operation frequency of the driving operation unit identified from the driving condition information, the higher the difficulty will be judged by the conference response difficulty judgment unit.

[0083] According to the electronic conference support system of configuration 7, when the driver's operation frequency of the driving operation unit of the mobile body is high and the driver's driving load is high, it is assumed that the margin for electronic conference is reduced, and it can be determined that the driver has high difficulty in coping with the electronic conference.

[0084] (Structure 8) An electronic conference support system according to Structure 3 or Structure 4, wherein the biometric information includes at least either the direction of the driver's line of sight and detection information of a biometric sensor arranged in the moving body, and the direction of the driver's line of sight is identified from an image of the driver taken by a camera arranged in the moving body.

[0085] According to the electronic conference support system of Configuration 8, it is possible to determine the degree of difficulty of the driver in coping with the electronic conference based on the actual physical condition of the driver.

[0086] (Structure 9) An electronic conference support method, which is executed by a computer, and includes: an electronic conference participation identification step, identifying that a driver of a mobile body is conducting an electronic conference with an external participant outside the mobile body; a movement status information acquisition step, acquiring movement status information indicating the movement status of the mobile body; a meeting response difficulty judgment step, judging the difficulty of the driver in coping with the electronic conference based on the movement status information; and a meeting response difficulty information providing step, in a case where it is identified through the electronic conference participation identification step that the driver is conducting the electronic conference with the external participant, sending the meeting response difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference.

[0087] By executing the electronic conference support method of configuration 9 by a computer, the same operational effects as those of the electronic conference support system of configuration 1 can be obtained.

[0088] (Structure 10) A recording medium, which is a non-volatile recording medium recording a program executed by a computer, wherein the program causes the computer to function as: an electronic conference participation identification unit, which identifies that a driver of a mobile body is conducting an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit, which acquires movement status information indicating the movement status of the mobile body; a meeting response difficulty judgment unit, which judges the difficulty of the driver to cope with the electronic conference based on the movement status information; and a meeting response difficulty information providing unit, which, when the electronic conference participation identification unit identifies that the driver is conducting the electronic conference with the external participant, sends the meeting response difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference.

[0089] By executing the program of configuration 10 on a computer, the configuration of the electronic conference support system of configuration 1 can be realized.

[0090] Description of Reference Numerals

[0091] 1…electronic conference support system, 10…processor, 11…electronic conference control unit, 12…electronic conference participation identification unit, 13…moving status information acquisition unit, 14…driving status information acquisition unit, 15…biological information acquisition unit, 16…conference response difficulty determination unit, 17…conference response difficulty information provision unit, 20…memory, 21…program, 22…conference response difficulty map, 50…vehicle (mobile body), 51…ECU, 52…communication unit, 53…front camera, 54…radar , 55…In-vehicle camera, 56…Biological sensors, 57…Operation unit sensors, 58…Driving condition sensors, 59…Navigation device, 60…Display, 61…Microphone, 70…Portable terminal, 101, 111…Terminal device, 200…Communication network, 300…Electronic conference screen, 310…Image of the driver, 311, 312…Images of other participants, 330…Conference response difficulty report image, 331…Indicator, D…Driver, P1, P2…Other participants.

Claims

1. An electronic conference support system, comprising: an electronic conference participation recognition unit that recognizes that a driver of the mobile body is conducting an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit that acquires movement status information indicating a movement status of the moving object; a conference handling difficulty determination unit configured to determine a difficulty level for the driver to handle the electronic conference based on the movement status information; as well as A conference handling difficulty information providing unit transmits conference handling difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference when the electronic conference participation identifying unit identifies that the driver is holding the electronic conference with the external participant.

2. The electronic conference support system according to claim 1, wherein: The electronic conference support system includes a driving status information acquisition unit that acquires driving status information indicating a driving status of the mobile object. The conference handling difficulty determination unit determines the difficulty based on the movement status information and the driving status information.

3. The electronic conference support system according to claim 1, wherein: The electronic conference support system includes a biological information acquisition unit that acquires biological information of the driver. The conference handling difficulty determination unit determines the difficulty based on the movement status information and the biological information.

4. The electronic conference support system according to claim 3, wherein: The electronic conference support system includes a driving status information acquisition unit that acquires driving status information indicating a driving status of the mobile object. The conference handling difficulty determination unit determines the difficulty based on the movement status information, the biological information, and the driving status information.

5. The electronic conference support system according to any one of claims 1 to 4, wherein: The movement status information includes at least one of a movement speed of the moving body and an operation status of a traffic signal existing in front of the moving body.

6. The electronic conference support system according to claim 2 or 4, wherein: The driving condition information includes at least any one of a driving operation condition of the driver on the mobile body, an operating condition of a driving assist function of the mobile body, and an operating condition of an automatic driving function of the mobile body.

7. The electronic conference support system according to claim 2 or 4, wherein: The driving condition information includes the frequency of the driver's operation on the driving operation unit of the mobile body. The conference handling difficulty determination unit determines that the difficulty is higher as the operation frequency of the driving operation unit recognized from the driving situation information is higher.

8. The electronic conference support system according to claim 3 or 4, wherein: The biometric information includes at least one of the direction of the driver's line of sight and detection information of a biometric sensor installed in the mobile body, and the direction of the driver's line of sight is recognized from an image of the driver taken by a camera installed in the mobile body.

9. An electronic conference support method, the electronic conference support method being executed by a computer, The electronic meeting support method includes: an electronic conference participant identification step of identifying that a driver of the mobile body is conducting an electronic conference with an external participant outside the mobile body; A moving state information obtaining step of obtaining moving state information indicating a moving state of the moving body; A conference handling difficulty determination step, determining the difficulty of the driver handling the electronic conference based on the movement status information; as well as The conference handling difficulty information providing step transmits conference handling difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference when the electronic conference participation identifying step identifies that the driver is holding the electronic conference with the external participant.

10. A recording medium, the recording medium being a non-volatile recording medium having recorded thereon a program executed by a computer, wherein: The program causes the computer to function as: an electronic conference participation recognition unit that recognizes that a driver of the mobile body is conducting an electronic conference with an external participant outside the mobile body; a movement status information acquisition unit that acquires movement status information indicating a movement status of the moving object; a conference handling difficulty determination unit configured to determine a difficulty level for the driver to handle the electronic conference based on the movement status information; as well as A conference handling difficulty information providing unit transmits conference handling difficulty information indicating the difficulty to a terminal device used by the external participant to participate in the electronic conference when the electronic conference participation identifying unit identifies that the driver is holding the electronic conference with the external participant.

Citation Information

Patent Citations

  • Display system, control unit, control method, program, and movable body

    JP2019174693A