Conference assistance system and conference assistance method

Abstract

A conference assistance system and a conference assistance method are provided. The purpose of the present invention is to improve operability pertaining to various functional operations pertaining to an online conference performed in a moving body, and to prevent operations pertaining to the online conference from affecting manipulation operations of the moving body. A conference assistance system assists a user who participates in an online conference from the interior of a moving body, i.e., an operator of the moving body, to execute function operations which are operations relating to various functions related to the online conference, the conference assistance system comprising: a detection unit that detects a user action which is an action of the user; a registration unit that stores in a storage device correspondence information in which a predetermined user action and a function operation are associated and registers the correspondence information; and an execution unit that, on the basis of the user action detected by the detection unit, refers to the correspondence information, and executes a function operation corresponding to the detected user action.

Description

Technical Field

[0001] The invention relates to a conference assistance system and a conference assistance method. Background Art

[0002] In recent years, research and development for assisting users' communications has been developed.

[0003] Patent Document 1 discloses a car phone device. In this phone device, a phone number input unit and an input unit for instructions such as answering a call are arranged on the back of a grip portion of a vehicle steering wheel, a display for confirming phone numbers is arranged on a dashboard, and hands-free calls can be made through a microphone and a speaker arranged in front of a driver's seat.

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2005-348123 Summary of the invention

[0007] Problems to be solved by the invention

[0008] In addition, there is a problem of preventing operations related to an online conference conducted in a mobile body from affecting the operation of operating the mobile body.

[0009] The present application is used to solve the above-mentioned problems, and its purpose is to improve the operability of various functional operations involved in online meetings conducted in mobile bodies. In addition, it further improves traffic safety and can contribute to the development of sustainable transportation systems.

[0010] Means for solving problems

[0011] One embodiment of the present invention is a conference assistance system that assists an operator of a mobile body, i.e., a user, who participates in an online conference from indoors in the mobile body, in performing operations related to various functions involved in the online conference, i.e., functional operations, wherein the conference assistance system comprises: a detection unit that detects user actions as actions of the user; a registration unit that stores corresponding information that corresponds the specified user actions to the functional operations in a storage device for registration; and an execution unit that executes the functional operation corresponding to the detected user action based on the user action detected by the detection unit and with reference to the corresponding information.

[0012] According to another embodiment of the present invention, the registration unit stores common correspondence information and individual correspondence information in the storage device for registration, the common correspondence information being the correspondence information shared by a plurality of users who use the mobile body as operators, and the individual correspondence information being the correspondence information generated individually for a plurality of users who use the mobile body as operators and applied individually to the corresponding users, and the execution unit executes the functional operation corresponding to the detected user action with reference to the common correspondence information and the individual correspondence information related to the current user who uses the mobile body as an operator.

[0013] According to another aspect of the present invention, the correspondence information is stored in a storage device included in the moving object.

[0014] According to another aspect of the present invention, the correspondence information is stored in a storage device provided in a server device outside the mobile body.

[0015] According to another aspect of the present invention, the predetermined user action corresponding to the functional operation in the correspondence information includes an operation of a switch provided on a device included in the mobile object.

[0016] According to another aspect of the present invention, the moving object is a vehicle, and the operation of the switch is the operation of a switch provided on a steering wheel of the moving object.

[0017] According to another aspect of the present invention, the predetermined user action corresponding to the functional operation in the correspondence information includes a predetermined gesture action performed by the user.

[0018] According to another aspect of the present invention, the functional operation corresponding to the predetermined user action in the corresponding information includes a message sending operation of sending a predetermined message to other participants other than the user participating in the online conference.

[0019] According to another aspect of the present invention, the message is a message notifying the user of a situation in which the user is currently unable to speak.

[0020] According to another aspect of the present invention, the functional operation corresponding to the specified user action in the corresponding information includes an operation of turning on / off a microphone function, where the microphone function is used to send the user's voice to other participants of the online conference.

[0021] According to another aspect of the present invention, the correspondence information includes information for associating a plurality of the functional operations with one of the predetermined user actions.

[0022] Another embodiment of the present invention is a conference assistance method, which is a mobile conference assistance method executed by a computer of a conference assistance system, wherein the conference assistance system assists an operator of a mobile body, i.e., a user, who participates in an online conference from indoors in the mobile body, in performing operations related to various functions involved in the online conference, i.e., functional operations, wherein the conference assistance method includes: a detection step of detecting a user action as an action of the user; a registration step of storing corresponding information that corresponds the specified user action to the functional operation in a storage device for registration; and an execution step of executing the functional operation corresponding to the detected user action based on the user action detected by the detection step and referring to the corresponding information.

[0023] Effects of the Invention

[0024] According to the present invention, the operability related to various functional operations related to an online conference conducted in a mobile body can be improved so that the operations related to the online conference do not affect the manipulation operations of the mobile body. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 This is a diagram showing an example of a usage scenario of the conference support system according to one embodiment of the present invention.

[0026] Figure 2 It is a diagram showing the indoor configuration of a mobile object equipped with a conference support system.

[0027] Figure 3 It is a diagram showing the structure of a conference support system.

[0028] Figure 4 The flowchart shows the procedure of a conference support method executed by a computer of the conference support system.

[0029] Figure 5 This is a diagram showing an example of an initial screen displayed by the meeting support system.

[0030] Figure 6 This is a diagram showing an example of a conference screen displayed by the conference support system.

[0031] Figure 7 This is a diagram showing an example of a registration selection screen displayed by the conference support system.

[0032] Figure 8 This is a diagram showing an example of a registration screen displayed by the conference support system.

[0033] Fig. 9 This is a diagram showing an example of a registration screen displayed by the conference support system.

[0034] Fig.10This is a diagram showing a display example of messages from other participants in an online conference.

[0035] Description of Reference Numerals

[0036] 1: conference support system, 2: mobile body, 3: conference management server, 3a: computer, 3b: storage device, 4: communication device, 5: communication network, 6: touch panel, 7: microphone, 8: speaker, 9: steering wheel, 10: indoor camera, 11: instrument panel, 12: first steering switch, 13: second steering switch, 20: processor, 21: memory (storage device), 22: participation program, 23: auxiliary program, 24: corresponding information, 24a: common corresponding information, 24b: individual corresponding information, 25: participation unit, 26: auxiliary unit, 27: detection unit, 28: registration unit, 29: execution unit, 40, 52: Title, 41: Meeting join button, 42: Registration start button, 43, 81: Participant icon, 44: Operation button, 50: Shared button, 51: Individual button, 53: ID display, 54: Action list, 55: Up and down buttons, 56: Function list, 57: Message list, 58: Posture button, 59: OK button, 60: Cancel button, 61: Registration button, 62: End button, 63: Image frame, 64, 65: Slider, 66: Time bar, 67: Recording button, 68: Stop button, 69: Device operation registration button, 80: Display device, 82: Chat message, U: User. DETAILED DESCRIPTION

[0037] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0039] [1.1 Overall structure]

[0040] Figure 1 This is a diagram showing an example of a usage scenario of a conference support system 1 according to an embodiment of the present invention. The conference support system 1 is mounted on a mobile body 2. In the present embodiment, the mobile body 2 is, for example, a vehicle. The mobile body 2 is not limited to a vehicle, and may be any mobile body operated by a human operator. For example, the mobile body 2 may be a marine mobile body such as a ship or a submarine, or an aerial mobile body including an eVTOL (Electric Vertical Take-Off and Landing aircraft), in addition to a land mobile body such as a passenger car, a bus, or a taxi.

[0041] The conference support system 1 communicates with the conference management server 3 to provide passengers of the moving object 2 with a function for participating in an online conference from inside the moving object 2. The conference management server 3 includes a computer 3a and a storage device 3b, and provides an online conference service according to the conventional technology.

[0042] In the present embodiment, the conference support system 1 supports the user U, who is the operator of the mobile object 2 and participates in the online conference from inside the mobile object 2, in performing operations related to various functions involved in the online conference, namely, functional operations.

[0043] The conference support system 1 of the mobile body 2 communicates with the conference management server 3 disposed outside the mobile body 2 via the communication device 4 provided in the mobile body 2 and via the communication network 5 external to the mobile body 2. In addition, the conference support system 1 communicates with a start key (not shown) such as an FOB key for starting the mobile body 2, which is held by a user U as an operator riding on the mobile body 2, via the communication device 4, and obtains a user ID for identifying the user U.

[0044] The conference support system 1 supports an online conference using various in-vehicle devices provided in a mobile body 2 .

[0045] Figure 2 It is a diagram showing the indoor structure of the moving object 2.

[0046] Inside the vehicle 2, a touch panel 6 and a speaker 8 are provided at the center and upper right side of the instrument panel 11 in the vehicle width direction. In addition, an indoor camera 10 is provided above the touch panel 6. The indoor camera 10 is, for example, a DMC (driver monitoring camera) and captures a user U as an operator.

[0047] A microphone 7 is provided at the steering column of the steering wheel 9. A first steering switch 12 and a second steering switch 13 are provided at the steering wheel 9. The first steering switch 12 is, for example, a physical switch, and the second steering switch 13 is, for example, a touch switch that detects contact with a part of the user U's body.

[0048] [1.2 Meeting support system]

[0049] Figure 3 1 is a diagram showing the configuration of the conference support system 1 .

[0050] In the present embodiment, the conference support system 1 functions as a client device of the conference management server 3 that provides online conference services, and enables passengers of the mobile body 2 to participate in the online conference from the interior of the mobile body 2. In the present embodiment, in particular, the conference support system 1 assists the operator of the mobile body 2, i.e., the user U, who participates in the online conference from the interior of the mobile body 2, to perform operations related to various functions involved in the above-mentioned online conference, i.e., functional operations.

[0051] The conference support system 1 includes a processor 20 and a memory 21. The memory 21 is a storage device (or storage device) composed of, for example, a volatile and / or non-volatile semiconductor memory and / or a hard disk device. The memory 21 stores a participation program 22 and a support program 23 as software programs. The memory 21 also stores correspondence information 24 described later.

[0052] The processor 20 is, for example, a computer including a CPU (Central Processing Unit), etc. The processor 20 may have a ROM (Read Only Memory) in which a program is written, a RAM (Random Access Memory) for temporarily storing data, and the like.

[0053] The processor 20 includes a participating section 25 and an auxiliary section 26 as functional elements or functional units. Furthermore, the auxiliary section 26 includes a detecting section 27, a registering section 28, and an executing section 29 as functional elements or functional units.

[0054] For example, the participating unit 25 and the supporting unit 26 are realized by the processor 20 as a computer executing the participating program 22 and the supporting program 23 stored in the memory 21 , respectively.

[0055] For example, the auxiliary program 23 for realizing the auxiliary unit 26 may be an additional program for realizing the participating program 22 for realizing the participating unit 25 .

[0056] In addition, the participation program 22 and the auxiliary program 23 can be stored in advance in any computer-readable storage medium.

[0057] Instead of the above-described embodiment, all or part of the functional elements included in the processor 20 may be configured by hardware each including one or more electronic circuit components.

[0058] The participant unit 25 communicates with the conference management server 3 according to the prior art, and provides a platform for the user U to participate in the online conference indoors in the mobile body 2. The participant unit 25 receives a convening notification email sent in advance by the convenor of the online conference. The participant unit 25 displays a login screen for logging into the online conference notified by the convening notification email on the touch panel 6.

[0059] Figure 5 1 is a diagram showing an example of an initial screen displayed on the touch panel 6 by the conference supporting system 1 . Figure 5 The initial screen also serves as a login screen. For example, a conference participation button 41 indicating the latest online conference is displayed under the title 40 of "Participate in an online conference". The user U can press the conference participation button 41 to start participating in the online conference.

[0060] By pressing the conference participation button 41, the participation unit 25 displays Figure 6 The participant unit 25 displays participant icons 43 indicating participants participating in the online conference on the conference screen, and can perform voice communication with the participants through the microphone 7 and the speaker 8.

[0061] In addition, the participation unit 25 displays operation buttons 44 for performing operations related to various functions related to the online conference on the touch panel 6. Here, "functions related to the online conference" refer to functions provided in the online conference (for example, functions such as message sending), functions for turning on / off the voice transmission and reception required for participating in the online conference (for example, functions for turning on / off the transmission of microphone voice, etc.).

[0062] In addition, the participant 25 displays a logout button for logging out of the online conference as one of the operation buttons 44 on the touch panel 6. Figure 6 The touch panel 6 is arranged in the upper right corner of the diagram on the screen.

[0063] Participating unit 25 detects operation of operating button 44 displayed on touch panel 6 by user U and executes a function corresponding to operated operating button 44. Participating unit 25 also executes an instructed function according to an instruction from executing unit 29 of auxiliary unit 26 described later.

[0064] The detection unit 27 of the auxiliary unit 26 detects the user motion, that is, the motion of the user U. Here, the user U is the operator of the mobile object 2 and a participant of the above-mentioned online conference.

[0065] The detection unit 27 detects, for example, the operation of a switch provided on a device provided in the mobile body 2 by the user U as a user action. In the present embodiment, the detection unit 27 detects the operation of the first steering switch 12 and / or the second steering switch 13 provided on the steering wheel 9 as an in-vehicle device as a user action.

[0066] The user's operation on the first turn switch 12 may be, for example, a single press operation of briefly pressing the first turn switch 12 once (for example, within 0.3 seconds), a double press operation of briefly pressing the first turn switch 12 twice in succession, a long press operation of continuously pressing the first turn switch 12 for a specified time (for example, more than 1.5 seconds), etc. Similarly, the user's operation on the second turn switch 13 may be, for example, a single touch operation of briefly touching once, a double touch operation of briefly touching twice in succession, a long press touch operation of continuously pressing for a specified time, etc.

[0067] In addition, the detection unit 27 detects a predetermined gesture action performed by the user U as a user action from the action of the user U captured by the indoor camera 10. The predetermined gesture action to be detected by the detection unit 27 is specified by the corresponding information 24 stored in the memory 21 by the registration unit 28 described later. The detection unit 27 extracts the gesture action specified in the corresponding information 24 from the action of the user U captured by the indoor camera 10 and detects it.

[0068] The detection unit 27 notifies the execution unit 29 described later of information on the detected user action.

[0069] The registration unit 28 stores and registers the corresponding information 24 in a storage device or storage apparatus (hereinafter collectively referred to as a storage device) according to an instruction from the user U. The corresponding information 24 indicates the relationship between a predetermined user action and a functional operation related to the online conference to be executed when the user action is detected.

[0070] In the present embodiment, the storage device is the memory 21 of the conference support system 1 included in the mobile object 2 .

[0071] The predetermined user action corresponding to the functional operation in the correspondence information 24 includes, for example, the operation of a switch provided on a device included in the mobile object 2 .

[0072] Thus, a simple switch operation is used as a predetermined user action, and thus the operability of the functional operation related to the online conference can be further improved.

[0073] The switch operation is, for example, an operation by the user U on the first steering switch 12 and / or the second steering switch 13 provided on the steering wheel 9 as the vehicle-mounted equipment.

[0074] Thus, the operation of the switch provided on the steering wheel 9 which is easily accessible to the operator of the mobile body 2 is detected as a user action, so that the influence of the action of the user U performed for the function operation of the online conference on the operation operation of the mobile body 2 can be more appropriately reduced.

[0075] In addition, the predetermined user actions corresponding to the functional operation in the corresponding information 24 include, for example, predetermined gesture actions performed by the user U. The gesture actions performed by the user U may be, for example, facial actions such as waving, head movements, and blinking of the user U within the range that the indoor camera 10 can capture.

[0076] As a result, the functional operation of the online conference can be performed without performing hardware operations such as switch operations, so the influence of the functional operation on the operating operation can be further reduced.

[0077] In addition, the functional operation corresponding to the specified user action in the corresponding information 24 includes a message sending operation of sending a predetermined message to other participants other than the user U participating in the online conference (specifically, "to the terminal device of other participants" is the same below). The message sending may also include sending the voice of the message. The voice can be a pre-recorded voice of the user U or others, or a synthesized voice.

[0078] As a result, the user U can communicate with other participants through simple user actions without uttering any words.

[0079] The above-mentioned message may be, for example, a message notifying a situation such as “unable to speak”, indicating that the user U is currently in a situation where he cannot speak.

[0080] As a result, the user U, who is the operator of the mobile object, can immediately inform other conference participants of the intention to interrupt the speech according to the traffic conditions, thereby achieving communication with other participants while minimizing the influence on the operating operation.

[0081] In addition, the functional operation corresponding to the predetermined user action in the corresponding information 24 includes an operation of turning on / off a microphone function for transmitting the voice of the user U to other participants in the online conference.

[0082] As a result, user U can quickly switch the microphone function on / off according to the ever-changing traffic environment, thereby effectively preventing participation in the online meeting from affecting the operation of user U and preventing unnecessary sound from being sent to other participants of the online meeting.

[0083] Furthermore, the correspondence information 24 may also include information that associates multiple function operations with a specified user action. For example, the correspondence information 24 may associate the double-pressing operation of the first steering switch 12 as a specified user action, and associate the double-pressing operation with two operations, namely, an operation to turn off the microphone function and an operation to send a message such as "cannot speak".

[0084] Thus, a plurality of functional operations can be executed as a group through one user action, thereby improving the convenience for the user U.

[0085] The correspondence information 24 may include common correspondence information 24a and individual correspondence information 24b. The common correspondence information 24a is correspondence information shared by a plurality of users U who use the mobile body 2 as operators. In addition, the individual correspondence information 24b is correspondence information generated individually for each of the plurality of users U who use the mobile body 2 as operators and applied individually to a corresponding specific user U (for example, applied only to a corresponding specific user U).

[0086] The registration unit 28 can store and register the common correspondence information 24a and the individual correspondence information 24b in the memory 21. Figure 3 In order to simplify the drawing and make it easier to understand, only one individual corresponding information 24b is shown, but in fact, at least the same number of individual corresponding information 24b as the number of users is stored in the memory 21 in association with the user IDs of multiple users who use the mobile body 2 as operators.

[0087] The registration unit 28 stores the user ID for identifying each user U and the individual corresponding information 24 b related to the user U in association with each other in the memory 21 .

[0088] Specifically, the registration unit 28 generates the corresponding information 24 and stores it in the memory 21 in the following manner, for example.

[0089] exist Figure 5 In the initial screen shown, when the user U presses the registration start button 42 with "Correspondence information registration" written on it, the registration unit 28 starts the process for registering the correspondence information. First, the registration unit 28 displays Figure 7 The registration selection screen shown. The registration selection screen displays a common button 50 for starting the registration process of the common correspondence information 24a and an individual button 51 for starting the registration process of the individual correspondence information 24b. The user U presses the common button 50 or the individual button 51 to cause the registration unit 28 to start the registration process of the common correspondence information 24a or the registration process of the individual correspondence information 24b.

[0090] The registration process of the common correspondence information 24 a is the same as the registration process of the individual correspondence information 24 b , and therefore the registration process of the individual correspondence information 24 b will be described below as an example.

[0091] Figure 8 2 is an example of a registration screen displayed on the touch panel 6 by the registration unit 28 when the individual button 51 is pressed. Figure 8 In the registration screen, an ID display 53 is displayed on the right side of the title "Individual Correspondence Information Registration" 52, and the ID display 53 shows the user ID of the operator U who is to register the individual correspondence information 24b. The registration unit 28 can obtain the user ID of the user U from the starter key (for example, FOB key) of the user U who is the operator on the moving body 2 through the communication device 4, for example.

[0092] exist Figure 8In the registration screen, an action list 54 for selecting a user action and a function list 56 for selecting a function operation corresponding to the user action selected in the action list are also displayed. In the action list 54, candidates for user actions such as "first ST-SW: single" are listed. For example, "first ST-SW: single", "first ST-SW: double" and "first ST-SW: long press" refer to a single press operation, a double press operation and a long press operation of the first turn switch 12, respectively.

[0093] The user U can use the up and down buttons 55 to move the rectangular cursor displayed in the action list 54 and select any user action.

[0094] A list of various functional operations related to the online conference is displayed in the function list 56. After selecting a user action, the user U selects a functional operation corresponding to the selected user action in the function list 56. The selection of a functional operation is similar to the selection of a user action. The selection can be made by moving the rectangular cursor using the up and down buttons displayed on the right side of the function list. Multiple functional operations can be selected for one user action. Figure 8 In the example of FIG. 5 , a desired function operation can be selected by aligning the rectangular cursor with the desired function operation in the function list 56 and pressing the confirmation button 59. Then, the cursor is moved to the next desired function operation and the confirmation button 59 is pressed to select the function. The selected function operation can be canceled by moving the rectangular cursor to the function operation to be canceled and pressing the cancel button 60.

[0095] When "Send message" is selected in the function list 56, a message list 57 for selecting a message is displayed on the right side of the function list 56. A list of fixed messages such as "Unable to talk" and "Busy" is displayed in the message list 57. The user U can use the up and down buttons on the right side of the message list 57 to move the rectangular cursor to a desired message and select the message.

[0096] When the user U presses the registration button 61, the registration unit 28 generates one individual correspondence information 24b according to the setting on the screen, and stores the generated individual correspondence information 24b in the memory 21 in association with the user ID shown in the ID display 53. Then, the user U can repeat the same operation as above to register other individual correspondence information 24b.

[0097] The user U presses the end button 62 to end the registration process of the individual corresponding information 24b.

[0098] In addition, Figure 8 In the example shown, only a fixed message is selected as the message, but the user U may also input a specific message.

[0099] exist Figure 8 In the registration screen shown, a gesture button 58 for gesture registration is displayed below the action list 54. When the user U presses the gesture button 58, the registration unit 28 displays, for example, Fig. 9 The registration screen is shown. Fig. 9 In the registration screen shown, individual correspondence information 24b is generated and registered, which associates the gesture of the user U as a user action with the function operation. Fig. 9 In the registration screen shown, Figure 8 The same components as those in the registration screen shown in FIG. Figure 8 Related instructions.

[0100] exist Fig. 9 In the example, an image frame 63 is displayed instead of the action list 54, and the image frame 63 displays the gesture image. In addition, the up and down buttons 55 are not displayed, but a time bar 66, a recording button 67, and a stop button 68 are displayed. In addition, a device operation registration button 69 is displayed instead of the gesture button 58. The device operation registration button 69 is used to return to Figure 8 The screen shown.

[0101] exist Fig. 9 In the registration screen shown, when the user U presses the record button 67, the registration unit 28 starts recording the image from the indoor camera 10 and displays the recorded image in the image frame 63. The user U records the desired posture while watching the image displayed in the image frame 63. Then, by the user U pressing the stop button 68, the registration unit 28 stops the above recording and repeatedly displays the recorded image in the image frame. The user U adjusts the position of the sliders 64 and 65 of the time bar 66 to adjust the start and end of the posture image to be registered. Then, the user U can Figure 8 By the same operation as the above operation, a function operation and a message are selected from the function list 56 and the message list 57, and individual corresponding information 24b is generated that associates the gesture action as the user action with the function operation, and the individual corresponding information 24b is registered in the memory 21.

[0102] Reference Figure 3 , the execution unit 29 executes the function operation corresponding to the user action detected by the detection unit 27 with reference to the corresponding information 24. For example, when the function operation corresponding to the double-press operation of the first turn switch 12 in the corresponding information 24 (for example, the shared corresponding information 24a) is a message such as "Busy", when the detection unit 27 detects the double-press operation of the first turn switch 12, the execution unit 29 instructs the participation unit 25 to send the message "Busy" to other participants of the online conference. The message sent can be, for example, Fig.10 As shown, the chat message 82 is displayed next to the participant icon 81 representing the user U on the display device 80 of the terminal device of the other participant.

[0103] Thus, the operability of various functional operations related to the online conference performed in the mobile object 2 can be improved, so that the operations related to the online conference will not affect the manipulation operations of the mobile object 2.

[0104] When the correspondence information 24 includes the common correspondence information 24a and the individual correspondence information 24b, the execution unit 29 may refer to the common correspondence information 24a and the individual correspondence information 24b associated with the user ID of the current user U and execute the functional operation corresponding to the user action detected by the detection unit 27.

[0105] Therefore, for user U who is not accustomed to performing functional operations of online conferences through user actions, general shared corresponding information 24a can be used to assist. On the other hand, for user U who is accustomed to performing functional operations through user actions, individual corresponding information 24b can also be used to enable the use of user actions inherent to the user, which can further improve operability.

[0106] [1.3 Operation of the conference support system]

[0107] Next, the operation of the conference supporting system 1 will be described. Figure 4 1 is a flowchart showing the procedure of a conference support method executed by the processor 20 which is a computer of the conference support system 1 . Figure 4 The processing shown is started when the power of the conference supporting system 1 is turned on, and is repeatedly executed until the power is turned off.

[0108] Reference Figure 4 When the process starts, the auxiliary unit 26 of the conference auxiliary system 1 determines whether the online conference has started (S100). Specifically, for example, the auxiliary unit 26 notifies the user U of the information displayed on the touch panel 6 by the participation unit 25. Figure 5 When the conference participation button 41 is pressed on the initial screen shown, it is determined that the online conference has started.

[0109] When the online conference has not started (step S100, "No"), the registration unit 28 of the auxiliary unit 26 determines whether there is an instruction from the user U to perform the registration process of the corresponding information (step S102). The instruction to perform the registration process of the corresponding information is, for example, provided by the user U in Figure 5 The display shown is provided by pressing the registration start button 42 in the initial screen of the touch panel 6 .

[0110] Furthermore, when there is an instruction to perform the registration process of the correspondence information (S102, Yes), the registration unit 28 stores the correspondence information 24 that associates the predetermined user action with the function operation in the memory 21 as a storage device and registers it (S104) according to the instruction from the user U. Thereafter, the registration unit 28 returns the process to step S100. As described above, the registration unit 28 can register the common correspondence information 24a shared by all users U and / or the individual correspondence information 24b applied to a specific user U as the correspondence information 24.

[0111] On the other hand, when there is no instruction to execute the registration process of the corresponding information in step S102 (S102, No), the registration unit 28 returns to step S100 to repeat the process.

[0112] On the other hand, when the online conference has started in step S100 (S100, Yes), the detection unit 27 determines whether a predetermined user action is detected (S106). Here, the predetermined user action refers to the action of the user U corresponding to any function operation in the corresponding information 24.

[0113] Then, when a user action is detected ( S106 , Yes), the execution unit 29 refers to the corresponding information 24 based on the user action detected by the detection unit 27 , and executes the function operation corresponding to the detected user action ( S108 ).

[0114] Next, the auxiliary unit 26 determines whether the online conference being held has ended (S110). Specifically, when the auxiliary unit 26 receives a notification from the participating unit 25 that the online conference being held has ended, it can determine that the online conference has ended. Figure 6 When the "Exit" operation button 44 displayed on the upper right part of the conference screen shown is pressed / when an exit operation instruction is received from the execution unit 29 to exit from the ongoing online conference, or when an end notification of the online conference is received from the conference management server 3, a notification of the end of the online conference is sent to the auxiliary unit 26.

[0115] Then, when the ongoing online conference ends ( S110 , YES), the support unit 26 ends the present process.

[0116] On the other hand, when the ongoing online conference has not ended ( S110 , No), the detection unit 27 returns to step S106 to repeat the process.

[0117] On the other hand, when the predetermined user action is not detected in step S106 ( S106 , No), the detection unit 27 shifts the process to step S110 .

[0118] Here, in Figure 4In the embodiment, step S104 corresponds to the registration step in the present disclosure. In addition, steps S106 and S108 correspond to the detection step and the execution step in the present disclosure, respectively.

[0119] [5. Other embodiments]

[0120] In the above-mentioned embodiment, since the corresponding information 24 is stored in the memory 21 possessed by the mobile body 2, unlike the case where the corresponding information 24 is stored in an external device, the functional operation associated with the user action can be properly performed even when the communication environment with the external device is not good.

[0121] However, storing the corresponding information 24 in a storage device provided in the mobile body 2 is only an example, and the registration unit 28 may store the corresponding information 24 in a storage device provided in a server device provided outside the mobile body for registration. In this case, for example, when the user changes to a mobile body of the same type with the same onboard equipment that can be operated by the user, the corresponding information that is commonly used and stored in the server device can be used even in the changed mobile body to improve the operability of the online conference.

[0122] For example, the registration unit 28 can send the corresponding information 24 to the conference management server 3, and store and register it in the storage device 3b of the conference management server 3. Specifically, the registration unit 28 can send the common corresponding information 24a to which the mobile ID for identifying the mobile body 2 is attached and / or the individual corresponding information 24b to which the user ID is attached to the conference management server 3. The computer 3a of the conference management server 3 can receive these information, associate the mobile body ID and the user ID with the common corresponding information 24a and the individual corresponding information 24b, respectively, and store the common corresponding information 24a and the mobile body ID, and the individual corresponding information 24b and the user ID in the storage device 3b.

[0123] In this case, when a specified user action is detected, the execution unit 29 can refer to the common corresponding information 24a associated with the mobile body ID of the mobile body 2 and / or the individual corresponding information 24b associated with the user ID of the current user U of the mobile body 2 stored in the storage device 3b of the conference management server 3, and perform the functional operation corresponding to the above-mentioned detected user action.

[0124] Here, for example, when transferring to a moving body 2 of the same type, by using the same moving body ID in the previous moving body 2 and the moving body 2 to transfer to, the same common correspondence information 24 a can be used in the moving body to transfer to.

[0125] In addition, in this case, the execution unit 29 may also be provided in the computer 3a of the conference management server 3. The detection unit 27 of the mobile body 2 can transmit the detected predetermined user action to the conference management server 3 in association with the mobile body ID of the mobile body 2 and / or the user ID of the user U. The execution unit 29 of the conference management server 3 can refer to the corresponding information 24 stored in the storage device 3b, and perform the functional operation associated with the user action detected by the execution unit 29 for the conference function related to the user U in the corresponding online conference in the computer 3a of the conference management server 3. In addition, when the conference management server 3 is provided with the execution unit 29, the conference support system 1 is composed of the auxiliary unit 26 (excluding the execution unit 29) of the mobile body 2 and the execution unit 29 of the conference management server 3.

[0126] In the above-mentioned embodiment, the conference support system 1 includes the participation unit 25 that provides a platform for participating in an online conference, but the participation unit 25 may be provided in another device different from the conference support system 1. In this case, the conference support system 1 is able to communicate with the other device and provide the participation unit 25 of the other device with an execution instruction of a functional operation associated with a user action.

[0127] In addition, the present invention is not limited to the configurations of the above-described embodiments, and can be implemented in various forms within the scope not departing from the gist of the present invention.

[0128] [6. Structure supported by the above-mentioned embodiment]

[0129] The above-mentioned embodiment supports the following structure.

[0130] (Structure 1) A conference assistance system that assists an operator of a mobile object, i.e., a user, who participates in an online conference from a room of the mobile object, in performing operations related to various functions involved in the online conference, i.e., functional operations, wherein the conference assistance system comprises: a detection unit that detects a user action as an action of the user; a registration unit that stores corresponding information that corresponds the specified user action to the functional operation in a storage device for registration; and an execution unit that executes the functional operation corresponding to the detected user action based on the user action detected by the detection unit and with reference to the corresponding information.

[0131] According to the conference support system of configuration 1, it is possible to improve the operability of various functional operations related to an online conference conducted in a mobile body, so that the operations related to the online conference do not affect the manipulation operations of the mobile body.

[0132] (Structure 2) A conference assistance system according to Structure 1, wherein the registration unit stores common correspondence information and individual correspondence information in the storage device for registration, the common correspondence information being the correspondence information shared by a plurality of users who use the mobile body as operators, and the individual correspondence information being the correspondence information generated separately for a plurality of users who use the mobile body as operators and applied separately to the corresponding users, and the execution unit refers to the common correspondence information and the individual correspondence information related to the current user who uses the mobile body as an operator, and executes the functional operation corresponding to the detected user action.

[0133] According to the conference assistance system of structure 2, users who are not accustomed to performing functional operations of online conferences through user actions can be assisted through general shared corresponding information. On the other hand, users who are accustomed to performing functional operations through user actions can also use user-specific user actions through individual corresponding information, which can further improve operability.

[0134] (Configuration 3) The conference support system according to Configuration 1 or 2, wherein the correspondence information is stored in a storage device included in the mobile object.

[0135] According to the conference support system of structure 3, the corresponding information is stored in the storage device possessed by the mobile body. Therefore, unlike the case where the corresponding information is stored in an external device, even when the communication environment with the external device is not good, the functional operation associated with the user action can be properly performed.

[0136] (Configuration 4) The conference support system according to Configuration 1 or 2, wherein the correspondence information is stored in a storage device provided in a server device provided outside the mobile body.

[0137] According to the conference assistance system of structure 4, since the corresponding information is stored in the server device outside the mobile body, for example, when switching to a mobile body of the same type with the same onboard equipment that can be used for user actions, the corresponding information that was previously used can be used in the switched mobile body to improve the operability of the online meeting.

[0138] (Configuration 5) The conference support system according to any one of Configurations 1 to 4, wherein the predetermined user action corresponding to the functional operation in the correspondence information includes an operation of a switch provided on a device included in the mobile object.

[0139] According to the conference support system of configuration 5, since a simple switch operation is used as a predetermined user action, the operability of the functional operation related to the online conference can be further improved.

[0140] (Structure 6) The conference assisting system according to Structure 5, wherein the moving body is a vehicle, and the operation of the switch is an operation of a switch provided on a steering wheel of the moving body.

[0141] According to the conference support system of configuration 6, since the switch operation of the steering wheel that is easy for the operator of the mobile body to approach is detected as the user action, the influence of the user's action for operating the function of the online conference on the operation of the mobile body can be more appropriately reduced.

[0142] (Structure 7) The conference assisting system according to any one of Structures 1 to 6, wherein the prescribed user action corresponding to the functional operation in the correspondence information includes a prescribed gesture action performed by the user.

[0143] According to the conference support system of configuration 7, the functional operation of the online conference can be performed without performing hardware operations such as switch operations, so the influence of the functional operation on the manipulation operation can be further reduced.

[0144] (Structure 8) A conference assistance system according to any one of Structures 1 to 7, wherein the functional operation corresponding to the specified user action in the corresponding information includes a message sending operation of sending a predetermined message to other participants other than the user participating in the online conference.

[0145] According to the conference support system of Configuration 8, the user can communicate with other participants through simple user actions without uttering a word.

[0146] (Structure 9) The conference assisting system according to Structure 8, wherein the message is a message notifying a situation in which the user is currently unable to speak.

[0147] According to the conference support system of configuration 9, the user who is the operator of the mobile object can immediately inform other conference participants when a call should be interrupted according to traffic conditions, thereby enabling communication with other participants while minimizing the impact on the operating operation.

[0148] (Structure 10) A conference assistance system according to any one of Structures 1 to 9, wherein the functional operation corresponding to the specified user action in the corresponding information includes an operation of turning on / off a microphone function, which is used to send the user's voice to other participants of the online meeting.

[0149] According to the conference assisting system of structure 10, the user can quickly switch the microphone function on / off according to the ever-changing traffic environment, thereby effectively preventing the participation in the online conference from affecting the user's operation actions and preventing unnecessary voice from being sent to other participants of the online conference.

[0150] (Structure 11) The conference support system according to any one of Structures 1 to 10, wherein the correspondence information includes information that associates a plurality of the functional operations with one of the prescribed user actions.

[0151] According to the conference support system of Configuration 11, a plurality of functional operations can be executed as a group through one user action, thereby improving convenience for the user.

[0152] (Structure 12) A conference assistance method, which is a mobile conference assistance method, is executed by a computer of a conference assistance system, and the conference assistance system assists the operator of the mobile body, i.e., the user, who participates in an online conference from the indoor room of the mobile body to perform operations related to various functions involved in the online conference, i.e., functional operations, wherein the conference assistance method includes: a detection step, detecting a user action as an action of the user; a registration step, storing corresponding information that corresponds the specified user action to the functional operation in a storage device for registration; and an execution step, based on the user action detected by the detection step, referring to the corresponding information, executing the functional operation corresponding to the detected user action.

[0153] According to the conference assisting method of configuration 12, it is possible to improve the operability of various functional operations related to an online conference conducted in a mobile body, so that the operations related to the online conference do not affect the manipulation operations of the mobile body.

Claims

1. A conference assistance system that assists an operator of a mobile object, i.e., a user, who participates in an online conference from a room of the mobile object, in performing operations related to various functions involved in the online conference, i.e., functional operations, wherein: The conference auxiliary system has: a detection unit that detects a user action as an action of the user; a registering unit for registering the correspondence information obtained by associating the predetermined user action with the functional operation in a storage device; as well as An execution unit refers to the corresponding information based on the user action detected by the detection unit and executes the functional operation corresponding to the detected user action.

2. The conference assistance system according to claim 1, wherein: The registration unit stores and registers common correspondence information and individual correspondence information in the storage device, wherein the common correspondence information is the correspondence information shared by a plurality of users who use the mobile body as operators, and the individual correspondence information is the correspondence information generated individually for each of the plurality of users who use the mobile body as operators and applied individually to the corresponding users. The execution unit refers to the common correspondence information and the individual correspondence information related to the current user who uses the mobile body as an operator, and executes the functional operation corresponding to the detected user motion.

3. The conference assistance system according to claim 1, wherein: The corresponding information is stored in a storage device included in the mobile object.

4. The conference assistance system according to claim 1, wherein: The correspondence information is stored in a storage device provided in a server device provided outside the mobile body.

5. The conference assistance system according to claim 1, wherein: The predetermined user action corresponding to the functional operation in the corresponding information includes an operation of a switch provided on a device included in the mobile object.

6. The conference assistance system according to claim 5, wherein: The moving object is a vehicle, and the operation of the switch is the operation of a switch provided on a steering wheel of the moving object.

7. The conference assistance system according to claim 1, wherein: The predetermined user action corresponding to the functional operation in the corresponding information includes a predetermined gesture action performed by the user.

8. The conference assistance system according to claim 1, wherein: The functional operation corresponding to the specified user action in the corresponding information includes a message sending operation of sending a predetermined message to other participants other than the user participating in the online conference.

9. The conference assistance system according to claim 8, wherein: The message is a message notifying the user of a situation in which the user is currently unable to speak.

10. The conference assistance system according to claim 1, wherein: The functional operation corresponding to the specified user action in the corresponding information includes an operation of turning on / off a microphone function, where the microphone function is used to send the user's voice to other participants of the online conference.

11. The conference assistance system according to any one of claims 1 to 10, wherein: The correspondence information includes information for associating a plurality of the functional operations with one of the predetermined user actions.

12. A conference assistance method, which is a mobile conference assistance method, executed by a computer of a conference assistance system, wherein the conference assistance system assists an operator of the mobile body, i.e., a user, who participates in an online conference from a room of the mobile body to perform operations related to various functions involved in the online conference, i.e., functional operations, wherein: The conference assistance method comprises: a detecting step of detecting a user action as an action of the user; a registration step of storing correspondence information obtained by associating the prescribed user action with the functional operation in a storage device for registration; and An execution step, based on the user action detected by the detection step, referring to the corresponding information, and executing the functional operation corresponding to the detected user action.

Images