Information processing device

Abstract

To support the management of materials shared between participants regarding an online meeting.SOLUTION: An information processing device according to an embodiment comprises a database, a sharing unit, and a management unit. Each database includes image data displayed in other information processing devices communicably connected in an online meeting, and can store a plurality of presentation material data associated with a plurality of indexes. The sharing unit outputs the plurality of presentation material data for prior distribution to the other information processing devices, and outputs information indicative of a target index associated with the image data shared on a screen during the online meeting to the other information processing devices. When it accepts the change of presentation material data for prior distribution during the online meeting, the management unit updates the presentation material data stored in the database using post-change presentation material data. The sharing unit further outputs the presentation material data changed during the online meeting to the other information processing devices.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information processing device. [Background technology]

[0002] Conventionally, in an online conference, conference materials are shared among the conference participants, for example, from the host side to the guest side, and the conference proceeds while referring to the shared conference materials. For example, Patent Document 1 discloses an online conference support device that supports switching of materials shared among the conference participants. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6886750 Summary of the Invention [Problem to be solved by the invention]

[0004] In this situation, in online conferences, meeting materials were sometimes distributed in advance among participants. However, there were cases where discrepancies arose between the materials distributed in advance and the materials shared during the conference, such as when the materials distributed in advance contained undecided matters or were missing materials. In such cases, the participant who shared the materials had to resend the revised materials after the conference. In addition, if a participant who received the materials took notes directly on the materials distributed in advance, they had to manage them in duplicate, along with the resent materials after the conference. For these reasons, there was room for improvement in the management of materials shared among participants in online conferences.

[0005] One object of the present invention is to provide support for managing materials shared among participants in an online conference. [Means for solving the problem]

[0006] The information processing device according to the embodiment includes a first database, a first sharing unit, and a first management unit. The first database can store a plurality of presentation material data linked to a plurality of indexes, each of which includes image data to be displayed on another information processing device communicatively connected in an online conference. The first sharing unit outputs the plurality of presentation material data for advance distribution to the other information processing device, and outputs information indicating a target index linked to a target presentation material data including the image data to be screen-shared among the plurality of presentation material data for advance distribution to the other information processing device during the online conference. When the first management unit receives a change to the presentation material data for advance distribution during the online conference, it updates the presentation material data stored in the first database with the presentation material data after the change. The first sharing unit further outputs the presentation material data after the change to the other information processing device during the online conference. Effect of the Invention

[0007] According to the above-described aspects of the present invention, it is possible to assist in the management of materials shared among participants in an online conference. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of the user terminal of FIG. [Diagram 3] FIG. 3 is a diagram illustrating an example of a data configuration of a transmission-side DB according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a data configuration of a receiving-side DB according to the embodiment. [Diagram 5] FIG. 5 is a sequence diagram showing an example of the flow of information processing executed in the information processing system according to the embodiment. [Figure 6]FIG. 6 is a diagram showing an example of a display screen displayed on a user terminal on the transmitting side in the information processing according to the embodiment. [Figure 7] FIG. 7 is a flowchart showing an example of the flow of the advance material creation process of the information processing of FIG. [Figure 8] FIG. 8 is a sequence diagram showing an example of the flow of information processing executed in the information processing system according to the embodiment. [Figure 9] FIG. 9 is a diagram showing an example of a display screen displayed on a receiving user terminal in the information processing according to the embodiment. [Figure 10] FIG. 10 is a sequence diagram showing an example of the flow of information processing executed in the information processing system according to the embodiment. [Figure 11] FIG. 11 is a flowchart showing an example of the flow of information processing executed in a transmitting user terminal according to the embodiment. [Figure 12] FIG. 12 is a diagram for explaining post-event materials output in the information processing system according to the embodiment. [Figure 13] FIG. 13 is a flowchart showing an example of the flow of information processing executed in the receiving user terminal according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Exemplary embodiments of the present invention are disclosed below. The configurations of the embodiments described below, and the actions, results, and effects brought about by the configurations are merely examples. The present invention can also be realized with other configurations disclosed in the following embodiments, and it is possible to obtain at least one of various effects and derivative effects based on the basic configuration.

[0010] FIG. 1 is a diagram showing an example of a configuration of an information processing system 1 according to an embodiment. The information processing system 1 includes a plurality of user terminals 3. The plurality of user terminals 3 are communicatively connected to each other via a network. This network is, for example, a telecommunication line such as the Internet or a LAN (Local Area Network). Here, each of the plurality of user terminals 3 according to the embodiment is an example of an information processing device. Note that communication between the plurality of user terminals 3 may be performed via another information processing device.

[0011] 1 illustrates three user terminals 3, a first user terminal 3a, a second user terminal 3b, and a third user terminal 3c, as examples of the multiple user terminals 3, but is not limited to this. The number of user terminals 3 may be two, or may be four or more.

[0012] Each of the multiple user terminals 3 is an information processing device used by multiple participants of the online conference. As each of the multiple user terminals 3, various types of computers such as a smartphone, a personal computer (PC), a tablet PC, and an electronic paper can be appropriately used.

[0013] Each of the multiple user terminals 3 is configured to function as at least one of a transmitting user terminal 3 that transmits conference materials to be distributed to participants, i.e., shared materials shared among participants, in an online conference, and a receiving user terminal 3 that receives the transmitted conference materials. In the following description, the first user terminal 3a is assumed to be a user terminal 3 that transmits shared materials in an online conference. Also, the second user terminal 3b and the third user terminal 3c are assumed to be user terminals 3 that receive shared materials in an online conference. Also, when the second user terminal 3b and the third user terminal 3c are not distinguished from each other, the second user terminal 3b will be used as an example for the receiving user terminal 3.

[0014] Fig. 2 is a diagram showing an example of the configuration of each of the plurality of user terminals 3 in Fig. 1. Each of the plurality of user terminals 3 has a hardware configuration similar to that of a general PC (Personal Computer).

[0015] 2, each of the multiple user terminals 3 includes a processor 31, a memory 33, an HMI (Human Machine Interface) 35, and a communication I / F (Interface) 37. The processor 31, the memory 33, the HMI 35, and the communication I / F 37 are connected to each other so as to be able to communicate with each other via a bus 39, for example.

[0016] The processor 31 is a processing circuit configured to control the entirety of each of the multiple user terminals 3. As an example, the processor 31 loads a control program 331 stored in a ROM (Read Only Memory) of the memory 33 into a Random Access Memory and executes it to realize each function of the user terminal 3 including the content management unit 311 and the sharing management unit 312. The processor 31 may include at least one dedicated circuit configured to be able to realize at least a part of each function of the user terminal 3 including the content management unit 311 and the sharing management unit 312.

[0017] For example, various processors such as a central processing unit (CPU), a graphics processing unit (GPU), a multiplex (Mux), a micro processing unit (MPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), etc. may be appropriately used as the processor 31. Furthermore, the processor 31 may be a combination of two or more types of circuit elements.

[0018] When the content management unit 311 of the first user terminal 3a receives a change to the presentation material data 401 (see FIG. 3) regarding the shared material distributed in advance during the online conference, the content management unit 311 updates the presentation material data 401 of the shared material stored in the transmission side DB 332 of the first user terminal 3a with the changed presentation material data 401. Here, the content management unit 311 of the first user terminal 3a according to the embodiment is an example of a first management unit.

[0019] In addition, the content management unit 311 of the first user terminal 3a updates the capture data (image data) of the presentation material data 401 linked to one of the multiple indexes of the shared materials for pre-distribution (see Figures 3 and 8).

[0020] In addition, the content management unit 311 of the first user terminal 3a adds an index to multiple indexes of the shared materials for pre-distribution, and adds the capture data linked to the added index as presentation material data 401 (see Figures 3 and 10).

[0021] When the content management unit 311 of the second user terminal 3b receives changed presentation material data 401 from another user terminal 3 during an online conference, the content management unit 311 updates the presentation material data 401 (see FIG. 4) stored in the receiving side DB 333 of the second user terminal 3b with the changed presentation material data 401. Here, the content management unit 311 of the second user terminal 3b according to the embodiment is an example of a second management unit.

[0022] Furthermore, the content management unit 311 of the second user terminal 3b outputs a post-event material 60b (see FIG. 12) that compiles the capture data on which the memo data is superimposed for each of the multiple indexes.

[0023] Furthermore, the content management unit 311 of the second user terminal 3b outputs the after-event material 60b that summarizes the capture data, after deleting the indexes whose flag information has a value indicating that saving is not possible from among the multiple indexes.

[0024] The shared management unit 312 generates a display screen to be displayed on the display of the HMI 35 .

[0025] The sharing management unit 312 of the first user terminal 3a outputs multiple presentation material data 401 linked to multiple indexes of the shared materials distributed in advance to the other user terminals 3, and outputs information indicating target indexes linked to the presentation material data 401 to be screen-shared among the shared materials distributed in advance to the other user terminals 3 during the online conference.

[0026] Furthermore, the sharing management unit 312 of the first user terminal 3a further outputs the changed presentation material data 401 to the other user terminals 3 during the online conference.

[0027] In addition, the sharing management unit 312 of the first user terminal 3a outputs the target presentation material data 401 among the multiple presentation material data 401 linked to the multiple indexes of the shared materials received from the other user terminals 3 to the display of the HMI 35 in accordance with information indicating the target index from the other user terminals 3.

[0028] The memory 33 stores various programs executed by the processor 31, including a control program 331, and parameters of the various programs. The memory 33 also stores a transmission side DB (database) 332 and a reception side DB 333. The memory 33 also temporarily stores data being processed when the processor 31 executes arithmetic processing.

[0029] For example, various types of memory such as a ROM, a hard disk drive (HDD), or a solid state drive (SSD) can be appropriately used as the memory 33. In addition to a non-volatile memory, a volatile memory such as a RAM used as a working memory can also be used as the memory 33. The memory 33 may also be a combination of two or more types of circuit elements.

[0030] The transmission side DB332 of the first user terminal 3a can store a plurality of presentation material data 401, each of which is associated with capture data (image data) for a plurality of indexes to be displayed on another user terminal 3 (e.g., the second user terminal 3b) communicatively connected in an online conference. Here, the transmission side DB332 of the first user terminal 3a according to the embodiment is an example of a first database. FIG. 3 is a diagram illustrating an example of a data configuration of the transmission side DB332 according to the embodiment. The transmission side DB332 stores at least one conference material (shared material) data, which is transmitted (distributed) to other participants and shared among the participants, for example, for each online conference. FIG. 3 illustrates any conference material data 40a related to any online conference. The conference material data 40a (shared material) includes the presentation material data 401 and related data 403 for each of the plurality of indexes.

[0031] The presentation material data 401 includes, for example, items of "Index", "ID", "Capture" and "Processing Flag". The "Index" item is, for example, index information corresponding to the page number of the conference material represented by the presentation material data 401. The "ID" item is, for example, an identifier (Identification) for uniquely identifying the "Index" item. The "Capture" item is, for example, display image data corresponding to the "Index" item of the conference material represented by the presentation material data 401. Note that the "Capture" item may store, for example, information indicating a storage destination of the display image data in the first user terminal 3a of the transmitting side. The "Processing Flag" item is, for example, flag information indicating whether or not a capture can be performed on a display screen on which the display image data corresponding to the "Index" item is displayed, or whether or not the display image data can be included in the post-event material and saved. Here, the flag information according to the embodiment is an example of flag data. In this way, the transmission-side DB 332 of the first user terminal 3a can further store flag information, which is further linked to each of the multiple indexes and indicates whether or not the capture data can be saved.

[0032] The related data 403 includes, for example, an item of "material path". The item of "material path" is, for example, information indicating the storage destination of the material that is the source of the display image data stored as the "capture" item in the first user terminal 3a on the sending side, i.e., the data of the material used to capture the display image data. As an example, the item of "material path" is information indicating the storage destination of the material selected by file selection on the sending side screen (see display screen 50a in FIG. 6) displayed on the first user terminal 3a on the sending side. Note that the item of "material path" may store the data itself of the material that is the source of the display image data.

[0033] The receiving DB 333 of the second user terminal 3b can store presentation material data 401 received from another user terminal 3 (for example, the first user terminal 3a). Here, the receiving DB 333 of the second user terminal 3b according to the embodiment is an example of a second database. FIG. 4 is a diagram showing an example of a data configuration of the receiving DB 333 according to the embodiment. The receiving DB 333 stores at least one conference material (shared material) data received (distributed) from another participant for each online conference, for example. FIG. 4 illustrates any conference material data 40b related to any online conference, which corresponds to the conference material data 40a distributed from another participant. The conference material data 40b (shared material) includes the presentation material data 401 and related data 405 for each of a plurality of indexes.

[0034] The items of the related data 405 include, for example, items of "memo (text)", "memo (handwritten)", "memo (audio data)", and "memo (transcription)". The items of "memo (text)", "memo (handwritten)", "memo (audio data)", and "memo (transcription)" are, for example, information indicating a user's memo for a page of the conference material corresponding to the item of "index" in the second user terminal 3b on the receiving side. The item of "memo (text)" is, for example, text data indicating the result of a user's typing input received via an input I / F of the HMI 35 such as a keyboard or a touch panel. The item of "memo (handwritten)" is, for example, binary data indicating the result of a user's handwriting input received via an input I / F of the HMI 35 such as a touch panel or an electronic pen. The item of "memo (audio data)" is, for example, audio data indicating the result of a user's audio input received via an input I / F of the HMI 35 such as a microphone. The item of "memo (transcription)" is, for example, text data indicating the content of a speech included in the audio data generated based on the audio data. As an example, the items "Memo (text)", "Memo (handwritten)", "Memo (audio data)", and "Memo (transcription)" are information indicating the input contents for the material being displayed on the receiving side screen (see display screen 50b in FIG. 9) displayed on the receiving side second user terminal 3b. Note that the items "Memo (text)", "Memo (handwritten)", "Memo (audio data)", and "Memo (transcription)" may store information indicating the storage destination in the receiving side second user terminal 3b, for example.

[0035] In this way, the receiving DB 333 of the second user terminal 3b can further store memo data for the captured data, which is further linked to each of the multiple indexes. Also, the receiving DB 333 of the second user terminal 3b can further store flag information, which is further linked to each of the multiple indexes and indicates whether the captured data can be saved.

[0036] Note that the various programs executed by the processor 31, such as the control program 331, do not necessarily need to be recorded in the memory 33. For example, the user terminal 3 may read and execute a program recorded in a computer-readable recording medium. Examples of recording media readable by the user terminal 3 include CD-ROMs, DVD disks, USB (Universal Serial Bus) memories, flash memories (semiconductor memories) such as SSDs, and HDDs. Also, various programs may be stored in devices connected to public lines, the Internet, LANs, etc., and the user terminal 3 may read and execute the various programs from these.

[0037] The HMI 35 is an interface for accepting various user operations related to creating, updating, or adding documents, or inputting notes on documents, presenting various display screens to the user, and inputting and outputting voice.

[0038] For example, the output I / F of the HMI 35 includes a display and a speaker, and is configured to be capable of outputting images, videos, and audio. As the display, a liquid crystal display (LCD), an organic EL (Electro Luminescence) display, a projector, or the like can be used as appropriate. The display may be configured as a touch panel display integrated with a touch panel serving as the input I / F. Here, the display serving as the output I / F of the HMI 35 is an example of a display unit.

[0039] For example, the input I / F of the HMI 35 includes any one of a touch panel, a keyboard, a mouse, an electronic pen, a button, a dial, and a switch, and a microphone, and is configured to be able to receive operation input and voice input from the user.

[0040] It is not necessary for a display to be provided in each of the multiple user terminals 3. In this case, the HMI 35 may be configured as an output I / F that outputs images and videos to an external display communicatively connected to any one of the multiple user terminals 3.

[0041] The input I / F does not have to be provided in each of the multiple user terminals 3. In this case, the HMI 35 may be configured as an input I / F that accepts input of data related to operations and voice from an external information processing device communicably connected to any of the multiple user terminals 3.

[0042] For example, the HMI 35 may be a display terminal or an operation terminal capable of transmitting or receiving signals from outside each of the multiple user terminals 3, such as a tablet terminal, a smartphone, a smart watch, a remote controller, an external display, or a television. The HMI 35 may be shared by the multiple user terminals 3.

[0043] The communication I / F 37 is an interface for transmitting and receiving data. For example, a communication circuit for wired communication, a communication circuit for wireless communication, or a combination of these can be appropriately used as the communication I / F 37. As the communication circuit for wireless communication, a communication circuit compatible with various standards such as 3G, 4G, 5G, Wi-Fi (registered trademark), Li-Fi, and Bluetooth (registered trademark) can be appropriately used.

[0044] Next, a description will be given of the flow of information processing executed by the information processing system 1 configured as above. Note that in the information processing described below, the order of processing steps can be changed, and additions and deletions can be made as appropriate.

[0045] (Regarding preparation and sending of materials prior to the meeting) First, the preparation of advance materials, that is, the preparation of meeting materials carried out before a meeting, will be described. Fig. 5 is a sequence diagram showing an example of the flow of information processing executed in the information processing system 1 according to the embodiment. When the flow of Fig. 5 is started, it is assumed that the first user terminal 3a is executing an online meeting application in advance material preparation mode by executing its control program 331. Here, the advance materials are presentation material data 401 for distribution in advance.

[0046] The content management unit 311 of the first user terminal 3a displays a sending side screen (see FIG. 6) on, for example, the display of the HMI 35 (S101). The sending side screen will be described later. The content management unit 311 of the first user terminal 3a also executes an advance material creation process (see FIG. 7) (S102). The advance material creation process will be described later. Thereafter, the shared management unit 312 of the first user terminal 3a transmits the presentation material data 401 of the target index, which has been created in the advance material creation process and stored in the sending side DB 332, to the second user terminal 3b (S103).

[0047] Furthermore, the sharing management unit 312 of the second user terminal 3b stores the presentation material data 401 of the target index received from the first user terminal 3a in the receiving DB 333 (S104).

[0048] Here, a transmission side screen related to the advance material creation will be described. Fig. 6 is a diagram showing an example of a display screen 50a displayed on the first user terminal 3a on the transmission side in the information processing according to the embodiment. The display screen 50a illustrates a transmission side screen including a display area 51 of a material index corresponding to the "index" item of the material being created, and a display area 53 of the material selected by file selection and the captured data obtained by capturing the material being displayed. In addition, this transmission side screen includes a display of an operation button as an input I / F of the HMI 35.

[0049] The “Select Materials” button 551 is an operation button for instructing the display of materials using file selection that references files stored inside the first user terminal 3a, such as in the memory 33, or in an external information processing device communicatively connected to the first user terminal 3a, or in a server on the Internet.

[0050] The "Share" button 552 is an operation button for instructing, for example, adding an index to or updating the presentation material data 401 by capturing the displayed material, or sending the same. As an example, on a sending side screen related to the preparation of advance materials, the "Share" button 552 is an operation button for instructing the creation of presentation material data 401 based on adding an index to or updating the presentation material data 401 by capturing the displayed material.

[0051] The "Cannot save" button 553 is an operation section for specifying whether or not to capture the selected index, i.e., the page of the conference material being displayed (presentation material data 401), or whether or not to save the image data for display as part of the post-event material. In other words, the "Cannot save" button 553 is an operation button for specifying the value of flag information in the "Processing flag" item of the presentation material data 401.

[0052] The "Export" button 554 is an operation button for instructing the output of advance materials, meeting materials, and post-event materials 60a (see Figs. 11 and 12). As an example, the "Export" button 554 on the transmission side screen related to the creation of advance materials may be an operation button for instructing the output of advance materials based on the presentation material data 401, with pressing the button as a trigger. For example, advance materials are meeting materials (shared materials) created on the transmission side screen related to the creation of advance materials, and can be used, for example, for confirmation or approval prior to an online conference. Note that the "Export" button 554 is not an essential component on the transmission side screen related to the creation of advance materials, and may not be displayed, or may be displayed in a disabled state.

[0053] The "Update" button 555 is an operation button for instructing updating of the capture data for the selected index of the shared material, that is, the page of the conference material being displayed (presentation material data 401).

[0054] The "End" button 556 is an operation button for instructing the creation of shared materials, the addition or updating of an index (presentation material data 401), and the end of an online conference. As an example, the "End" button 556 on the transmission side screen related to the preparation of advance materials is an operation button for instructing the end of the advance preparation of shared materials when pressed, with the press of the button being a trigger.

[0055] Here, the advance material creation process (S102 in FIG. 5) will be described. FIG 7 is a flowchart showing an example of the flow of the advance material creation process in the information processing in FIG.

[0056] The content management unit 311 of the first user terminal 3a determines whether the "Select a Material" button 551 has been pressed (S201). If the "Select a Material" button 551 has not been pressed (S201: No), the flow of Fig. 7 proceeds to the process of S203. On the other hand, if the "Select a Material" button 551 has been pressed (S201: Yes), the content management unit 311 displays the material selected by file selection in the display area 53 (S202).

[0057] The content management unit 311 of the first user terminal 3a determines whether the "Share" button 552 has been pressed (S203). If the "Share" button 552 has not been pressed (S203: No), the flow of FIG. 7 proceeds to the process of S206. On the other hand, if the "Share" button 552 has been pressed (S203: Yes), the content management unit 311 acquires capture data of the material being displayed in the display area 53 (S204). In addition, the content management unit 311 adds an index and an ID to the acquired capture data and adds it to the transmission-side DB 332 as presentation material data 401 (S205).

[0058] The content management unit 311 of the first user terminal 3a judges whether the "Cannot save" button 553 has been pressed (S206). If the "Cannot save" button 553 has not been pressed (S206: No), the flow of Fig. 7 proceeds to the process of S208. On the other hand, if the "Cannot save" button 553 has been pressed (S206: Yes), the content management unit 311 sets a processing flag for designating that the captured data of the material being displayed in the display area 53 cannot be saved (S207).

[0059] Thereafter, the content management unit 311 of the first user terminal 3a judges whether to end the creation of the advance materials (S208). In this judgment, it is judged that the creation of the advance materials is to end when, for example, the "End" button 556 is pressed. If the creation of the advance materials is not to end (S208: No), the flow in FIG. 7 returns to the process of S201. On the other hand, if the creation of the advance materials is to end (S208: Yes), the flow in FIG. 7 ends.

[0060] The designation of the value of the processing flag relating to whether or not to save, i.e., the processing of S206 and S207, may be executed prior to the processing of S203 to S205 relating to the addition of the capture data. In this case, the content management unit 311 of the first user terminal 3a may hold the value of the processing flag by an application until the "Share" button 552 is pressed, and store the value in the presentation material data 401 of the target index when the "Share" button 552 is pressed.

[0061] (Regarding updating materials during a meeting) Next, a case will be described where capture data of the conference material is updated during a conference, for example, when an online conference is being held based on conference materials distributed in advance.

[0062] Fig. 8 is a sequence diagram showing an example of the flow of information processing executed in the information processing system 1 according to the embodiment. The flow in Fig. 8 illustrates an example of processing in the case where the "Update" button 555 is pressed during a conference to update the capture data, and then the "Share" button 552 is pressed to share the updated conference material among the participants. It is assumed that when the flow in Fig. 8 starts, the control program 331 of the user terminal 3 is executing an online conference application in the online conference mode.

[0063] The content management unit 311 of the first user terminal 3a on the transmitting side of the conference material displays the transmitting side screen during the conference (S301) in the same manner as the process of S101 in FIG. 5, for example. The transmitting side screen during the conference is the same as the display screen 50a in FIG. 6. As an example, the "Share" button 552 on the transmitting side screen during the conference is an operation button for instructing the updating of the presentation material data 401 of the target index to the shared material by capturing the displayed material and transmitting the same. As an example, the "Export" button 554 on the transmitting side screen during the conference may be an operation button for instructing the output of the conference material based on the presentation material data 401 by pressing the "Export" button. Note that the "Export" button 554 on the transmitting side screen during the conference is not an essential configuration, and may not be displayed, or may be displayed in a disabled state.

[0064] Furthermore, the content management unit 311 of the second user terminal 3b on the receiving side of the conference material displays the receiving side screen, for example, on the display of the HMI 35 (S302). FIG. 9 is a diagram showing an example of a display screen 50b displayed on the second user terminal 3b on the receiving side in the information processing according to the embodiment. The display screen 50b illustrates a receiving side screen including a display area 51 of a material index corresponding to the "index" item of the material shared during the conference, and a display area 53 of capture data of the target index of the material shared during the conference and notes during the conference. Furthermore, this receiving side screen includes a display of operation buttons as an input I / F of the HMI 35.

[0065] The "Memo" button 558 is an operation button for instructing the start of input operations for notes taken during a meeting for shared meeting materials, such as at least one of the following items: "Memo (text)", "Memo (handwritten)", "Memo (audio data)", and "Memo (transcription)".

[0066] The "Export" button 554 is an operation button for instructing the output of pre-event materials, conference materials, and post-event materials 60b (see FIGS. 12 and 13). As an example, on the receiving side screen during a conference, the "Export" button 554 may be an operation button for instructing the output of conference materials based on the presentation material data 401, with pressing the button as a trigger. Note that the "Export" button 554 is not a required component on the receiving side screen during a conference, and may not be displayed, or may be displayed in a disabled state.

[0067] Furthermore, in the display area 53 of the receiving side screen during the conference, if the target index being displayed is an index for which a processing flag designating unsaveable is set, an icon 57 indicating that saving is unsaveable is displayed. Note that the information indicating that saving is unsaveable is not limited to the icon 57, and may be expressed on the receiving side screen during the conference in other display modes such as text, figures, the color of the frame of the display area 53, or image data separately prepared in advance.

[0068] The sharing management unit 312 of the first user terminal 3a on the transmitting side shares the conference materials (shared materials) distributed in the process related to the advance material creation and shared among the participants according to their indexes (S303). At this time, the sharing management unit 312 of the first user terminal 3a transmits and receives audio data to and from the second user terminal 3b, and notifies the second user terminal 3b of the target index being displayed in the display area 53 of the transmitting side screen (display screen 50a) each time (S304). Here, the notification of the target index being displayed is an example of information indicating the target index linked to the presentation material data 401 to be screen-shared.

[0069] Then, the sharing management unit 312 of the second user terminal 3b on the receiving side displays in the display area 53 the capture data of the presentation material data 401 linked to the target index of the pre-distributed conference material in accordance with the notified index, i.e., the information indicating the target index (S305).

[0070] Furthermore, the content management unit 311 of the second user terminal 3b accepts a memo input for the capture data of the target index being displayed on the receiving side screen, for example, in response to pressing of the "Memo" button 558 (S306). The result of the accepted memo input is stored in the receiving side DB 333 in association with the target index, as shown in FIG.

[0071] Here, it is assumed that the first user terminal 3a on the sending side accepts the pressing of the "Update" button 555 (S307). In this case, the content management unit 311 of the first user terminal 3a on the sending side updates the material of the material path of the target index by displaying it in the display area 53 of the sending side screen (S308). Thereafter, it is assumed that the first user terminal 3a on the sending side accepts the pressing of the "Share" button 552 (S309). In this case, the content management unit 311 of the first user terminal 3a acquires capture data of the material being displayed (S310), and updates the capture data of the presentation material data 401 linked to the target index in the sending side DB 332 of the first user terminal 3a (S311).

[0072] Thereafter, the sharing management unit 312 of the first user terminal 3a transmits the presentation material data 401, which has been updated during the conference and stored in the transmission side DB 332, to the second user terminal 3b (S312). The sharing management unit 312 of the second user terminal 3b also updates the presentation material data 401 of the target index in the reception side DB 333 with the presentation material data 401 received from the first user terminal 3a (S313). Note that the entire updated shared material may be transmitted and received between the user terminals 3, or only the presentation material data 401 for the updated target index may be transmitted and received.

[0073] Note that memo input for the captured data of the target index being displayed may be accepted not only on the receiving side screen during the conference, but also on the receiving side screen before or after the conference. Also, the conference materials distributed in advance may be displayed on the receiving side screen prior to the conference.

[0074] (Adding materials during a meeting) Next, a case will be described in which capture data is added to conference materials during a conference, for example, when an online conference is being held based on conference materials distributed in advance.

[0075] Fig. 10 is a sequence diagram showing an example of the flow of information processing executed in the information processing system 1 according to the embodiment. Here, differences from Fig. 9 will be mainly described, and overlapping descriptions will be omitted as appropriate.

[0076] After the second user terminal 3b on the receiving side starts displaying the conference materials distributed in advance according to the index notified from the first user terminal 3a on the transmitting side (S305), the first user terminal 3a on the transmitting side accepts pressing of the "Select material" button 551 (S401). In this case, the content management unit 311 of the first user terminal 3a on the transmitting side displays the materials selected by file selection in the display area 53 in the same manner as in the process of S202 in FIG. 7 (S402).

[0077] Thereafter, it is assumed that the first user terminal 3a on the transmitting side accepts pressing of the "Share" button 552 (S309). In this case, the content management unit 311 of the first user terminal 3a acquires capture data of the material being displayed (S310), and adds an index and an ID to the acquired capture data in the same manner as in the process of S205 in Fig. 7, and adds the data to the transmitting side DB 332 as presentation material data 401 (S403).

[0078] Thereafter, the sharing management unit 312 of the first user terminal 3a transmits the presentation material data 401 stored in the transmission side DB 332 due to the addition of the capture data during the conference to the second user terminal 3b (S312). Furthermore, the sharing management unit 312 of the second user terminal 3b adds the presentation material data 401 received from the first user terminal 3a to the reception side DB 333 as presentation material data 401, and updates the reception side DB 333 (S404). Note that, between the user terminals 3, the entire shared material to which the capture data (presentation material data 401) has been added may be transmitted and received, or only the presentation material data 401 for the added target index may be transmitted and received.

[0079] (Printing out post-meeting materials) Next, the creation of post-event materials, that is, the creation of meeting materials carried out after a meeting, will be described. Fig. 11 is a flowchart showing an example of the flow of information processing executed in the first user terminal 3a on the sending side according to the embodiment. Fig. 12 is a diagram for explaining post-event materials output in the information processing system 1 according to the embodiment. The flow of Fig. 11 is assumed to be a flow that starts in a state where an online meeting application is executed in the online meeting mode and transitions to the post-event material creation mode.

[0080] The content management unit 311 of the first user terminal 3a on the transmitting side determines whether the online conference has ended (S501). If the online conference has not ended (S501: No), the flow of Fig. 11 returns to the process of S501. On the other hand, if the online conference has ended (S501: Yes), the content management unit 311 of the first user terminal 3a deletes the capture data for which the processing flag is specified as unsaveable in the presentation material data 401 of the transmitting side DB 332 (S502).

[0081] Also, the content management unit 311 of the first user terminal 3a on the transmitting side judges whether the "Export" button 554 has been pressed (S503). If the "Export" button 554 has not been pressed (S503: No), the flow of FIG. 11 ends. On the other hand, if the "Export" button 554 has been pressed (S503: Yes), the content management unit 311 of the first user terminal 3a generates and outputs a post-event material 60a by combining and summarizing the presentation material data 401 of each index of the shared material, including the presentation material data 401 from which the capture data specified as unsaveable by the processing flag has been deleted (S504). As an example, the content management unit 311 of the first user terminal 3a generates and outputs a post-event material 60a by combining and summarizing the indexes of the shared material, with the capture data of each index of the shared material as each page, except for the capture data specified as unsaveable by the processing flag. Thereafter, the flow of FIG. 11 ends.

[0082] In addition, on the sending side screen for creating post-event materials, the "Select Materials" button 551, the "Share" button 552, the "Do Not Save" button 553 and the "Update" button 555 are not essential components and may not be displayed or may be displayed in a disabled state.

[0083] Fig. 13 is a flowchart showing an example of the flow of information processing executed in a receiving user terminal according to the embodiment. When the flow of Fig. 13 starts, the second user terminal 3b executes an online conference application in a post-event material creation mode by executing its control program 331. Here, differences from Fig. 11 are mainly described, and overlapping descriptions are omitted as appropriate.

[0084] When the "Export" button 554 is pressed (S503: Yes), the content management unit 311 of the receiving second user terminal 3b generates and outputs a post-event material 60b that combines and summarizes each index, including memo data (S601). As an example, the content management unit 311 of the receiving second user terminal 3b generates and outputs the post-event material 60b based on multiple presentation material data 401 of multiple indexes in the receiving DB 333 of the second user terminal 3b, including presentation material data 401 from which capture data designated as unsaveable by a processing flag has been deleted. Thereafter, the flow of FIG. 13 ends.

[0085] The post-event material 60b, which is a compilation of indexes including memo data and which includes the memo data, includes capture data 61 on which input memo data 63 is superimposed or combined, as shown in FIG. 12. In the post-event material 60b, for an index of captured data deleted according to a processing flag, only memo data 67 linked to the index is output. For example, the memo data 67 may be superimposed with an icon 65 indicating that saving is not possible, as shown in FIG. 12. Note that the information indicating that saving is not possible may be expressed in the memo data 67 in other display forms, such as text, figures, the color of the document frame, or image data prepared separately in advance, without being limited to the icon 65 indicating that saving is not possible.

[0086] In addition, as the post-event materials 60b, or in addition to the above-mentioned post-event materials 60b, post-event materials not including memo data 67 may be output, similar to the post-event materials 60a output by the first user terminal 3a on the sending side, for use, for example, as evidence of the meeting.

[0087] It should be noted that the "Memo" button 558 is not an essential component on the receiving side screen for creating post-event materials, and may not be displayed, or may be displayed in a disabled state.

[0088] 11 and 13 can be executed at any timing after the conference, not limited to when switching from the online conference mode. In this case, when each of the flows in Fig. 11 and 13 is started, the online conference application may be executed in the post-conference material creation mode by executing the control program 331 in each user terminal 3.

[0089] Note that a part or all of the information processing according to the above-described embodiment may be executed in a server device communicatively connected to the user terminal 3. That is, the information processing system according to the embodiment may further include a server device configured to be able to execute a part or all of the information processing according to the above-described embodiment. This server device may be configured, for example, by omitting the HMI 35 from the user terminal 3 according to the embodiment, or may have the same configuration as the user terminal 3. In this case, the user terminal 3 may be configured as a display device that accepts an operational input from a user and displays the above-described various display screens on a web browser or an application.

[0090] As described above, the information processing system 1 according to the embodiment executes an online conference application for transmitting and receiving audio data while sharing a screen display during a conference based on conference materials (plurality of presentation material data 401) distributed in advance by transmitting streaming data or notifying a target index, as shown in Fig. 12, for example. In this situation, a first user terminal 3a that transmits the conference materials in the information processing system 1 manages data of capture data, processing flags, and material paths linked to an index in a pre-creation process that creates the conference materials prior to the conference. Also, a second user terminal 3b that receives the conference materials manages data of capture data, processing flags, and memos linked to an index.

[0091] Specifically, the first user terminal 3a includes a transmission DB 332, a content management unit 311, and a sharing management unit 312. The transmission DB 332 of the first user terminal 3a can store a plurality of presentation material data 401 linked to a plurality of indexes, each of which includes capture data to be displayed on another user terminal 3 communicatively connected in an online conference. The sharing management unit 312 of the first user terminal 3a outputs a plurality of presentation material data 401 for advance distribution to the other user terminal 3, and outputs information indicating a target index linked to a target presentation material data 401 including capture data to be screen-shared among the plurality of presentation material data 401 for advance distribution during the online conference to the other user terminal 3. When the content management unit 311 of the first user terminal 3a accepts a change to the presentation material data 401 for advance distribution during the online conference, the content management unit 311 updates the presentation material data 401 stored in the transmission DB 332 of the first user terminal 3a with the presentation material data 401 after the change. The sharing management unit 312 of the first user terminal 3a further outputs the changed presentation material data 401 to the other user terminals 3 during the online conference.

[0092] The second user terminal 3b also includes a receiving DB 333, a content management unit 311, and a sharing management unit 312. The receiving DB 333 of the second user terminal 3b can store a plurality of presentation material data 401 received from other user terminals 3. The sharing management unit 312 of the second user terminal 3b outputs capture data of the target presentation material data 401 corresponding to the information indicating the target index from the other user terminal 3, among the plurality of presentation material data 401 received from the other user terminals 3, to the display of the HMI 35. When the content management unit 311 of the second user terminal 3b receives the changed presentation material data 401 from the other user terminal 3 during the online conference, it updates the presentation material data 401 stored in the receiving DB 333 of the second user terminal 3b with the changed presentation material data 401.

[0093] As an example, the content management unit 311 of the first user terminal 3a updates the capture data of the presentation material data 401 linked to one of multiple indexes for multiple presentation material data 401 for pre-distribution stored in the transmission side DB 332 of the first user terminal 3a.

[0094] As an example, the content management unit 311 of the first user terminal 3a adds an index to multiple indexes of multiple presentation material data 401 for pre-distribution in the sending side DB 332 of the first user terminal 3a, and adds the presentation material data 401 including the capture data linked to the added index.

[0095] With these configurations, the presentation material data 401 can be updated as needed during the conference and sent to the conference participants. This eliminates the need to resend the materials after the conference, reducing the effort required for managing the materials. In other words, the above configurations can assist in managing materials shared between participants in online conferences.

[0096] As an example, the receiving-side DB 333 of the second user terminal 3b can further store memo data for the captured data, which is further linked to each of the multiple indexes.

[0097] As an example, the content management unit 311 of the second user terminal 3b outputs a post-event material 60b that compiles the capture data on which the memo data is superimposed for each of the multiple indexes.

[0098] According to these configurations, by managing notes taken during a conference by linking them to handouts, even if the presentation material data 401 is updated during the conference, the notes can be managed by linking them to the updated presentation material data 401. This eliminates the need to resend the materials after the conference, reducing the effort required for managing the materials.

[0099] For example, the sending DB 332 of the first user terminal 3a can further store flag information associated with each of the multiple indexes, which indicates whether the captured data can be saved. Similarly, the receiving DB 333 of the second user terminal 3b can further store flag information associated with each of the multiple indexes, which indicates whether the captured data can be saved.

[0100] As an example, the content management unit 311 of the second user terminal 3b outputs the after-event material 60b that summarizes the capture data after deleting, from among the multiple indexes, indexes whose flag information has a value indicating that saving is not possible.

[0101] These configurations realize a mechanism that prevents undecided matters during a meeting or materials that will only be shared on the spot from being saved, thereby reducing the effort involved in managing undecided matters during a meeting or materials that will only be shared on the spot.

[0102] The information processing program executed by the processor of each device in the information processing system 1 of this embodiment may be configured to be provided by recording it on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk) in an installable or executable format file.

[0103] Furthermore, the information processing program may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the information processing program executed in the present embodiment may be provided or distributed via a network such as the Internet.

[0104] According to at least one of the embodiments described above, it is possible to assist in managing materials shared among participants in an online conference.

[0105] Although the embodiment and the modified example of the present invention have been described, the embodiment and the modified example are presented as examples and are not intended to limit the scope of the invention. The novel embodiment and the modified example can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. The embodiment and the modified example are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims.

[0106] (Additional Note) (1) a first database capable of storing a plurality of presentation material data linked to a plurality of indexes, each of which includes image data to be displayed on another information processing device communicatively connected in an online conference; a first sharing unit that outputs the plurality of presentation material data for advance distribution to the other information processing device, and outputs information indicating a target index linked to a target presentation material data including the image data to be screen-shared among the plurality of presentation material data for advance distribution during the online conference to the other information processing device; a first management unit that, when a change to the presentation material data for advance distribution is received during the online conference, updates the presentation material data stored in the first database with the presentation material data after the change; The first sharing unit further outputs the presentation material data after the change during the online conference to the other information processing device. Information processing device. (2) the first management unit updates the image data of the presentation material data linked to any one of the indexes for the plurality of presentation material data for advance distribution stored in the first database; The information processing device according to (1) above. (3) the first management unit adds an index to the plurality of indexes of the plurality of presentation material data for advance distribution in the first database, and adds presentation material data including image data in association with the added index; The information processing device according to (1) or (2) above. (4) a second database capable of storing the plurality of presentation material data received from the other information processing device; a second sharing unit that outputs image data of a target presentation material data corresponding to information indicating the target index from the other information processing device, among the plurality of presentation material data received from the other information processing device, to a display unit; and a second management unit that updates the presentation material data stored in the second database with the changed presentation material data when the changed presentation material data is received from the other information processing device during the online conference. An information processing device according to any one of (1) to (3) above. (5) The second database can further store memo data for the image data, the memo data being further linked to each of the plurality of indexes. The information processing device according to (4) above. (6) The second management unit outputs a post-event material summarizing the image data on which the memo data is superimposed for each of the plurality of indexes. The information processing device according to (5) above. (7) The first database is capable of further storing flag data, which is linked to each of the plurality of indexes and indicates whether the image data can be saved. An information processing device according to any one of (4) to (6) above. (8) the second management unit outputs a post-event material summarizing the image data after deleting an index having a value indicating that the flag data cannot be saved from among the plurality of indexes. The information processing device according to (7) above. (9) storing a plurality of presentation material data linked to a plurality of indexes, each of which includes image data to be displayed on another information processing device communicatively connected in an online conference; outputting the plurality of presentation material data for advance distribution to the other information processing device, and outputting information indicating a target index linked to a target presentation material data including the image data to be screen-shared among the plurality of presentation material data for advance distribution during the online conference to the other information processing device; when a change to the presentation material data for pre-distribution is received during the online conference, updating the presentation material data stored in the first database with the presentation material data after the change; and further outputting the presentation material data after the change to the other information processing device during the online conference. Information processing methods. (10) A program for causing an information processing device (computer) to execute the information processing method according to (9) above. (11) A recording medium (Computer Program Product) having recorded thereon the program described in (10) above, which is executable by a computer. [Explanation of symbols]

[0107] 1. Information Processing Systems 3. User terminal 31 Processors 33 Memory 35 HMI 37 Communication I / F 311 Content Management Department 312 Shared Management Department

Claims

1. a first database capable of storing a plurality of presentation material data linked to a plurality of indexes, each of which includes image data to be displayed on another information processing device communicatively connected in an online conference; a first sharing unit that outputs the plurality of presentation material data for advance distribution to the other information processing device, and outputs information indicating a target index linked to a target presentation material data including the image data to be screen-shared among the plurality of presentation material data for advance distribution during the online conference to the other information processing device; a first management unit that, when a change to the presentation material data for advance distribution is received during the online conference, updates the presentation material data stored in the first database with the presentation material data after the change; The first sharing unit further outputs the presentation material data after the change during the online conference to the other information processing device. Information processing device.

2. the first management unit updates the image data of the presentation material data linked to any one of the indexes for the plurality of presentation material data for advance distribution stored in the first database; The information processing device according to claim 1 .

3. the first management unit adds an index to the plurality of indexes of the plurality of presentation material data for advance distribution in the first database, and adds presentation material data including image data in association with the added index; The information processing device according to claim 1 .

4. a second database capable of storing the plurality of presentation material data received from the other information processing device; a second sharing unit that outputs image data of a target presentation material data corresponding to information indicating the target index from the other information processing device, among the plurality of presentation material data received from the other information processing device, to a display unit; and a second management unit that updates the presentation material data stored in the second database with the changed presentation material data when the changed presentation material data is received from the other information processing device during the online conference. The information processing device according to claim 1 .

5. the second database is capable of further storing memo data for the image data, the memo data being further linked to each of the plurality of indexes; The information processing device according to claim 4.

6. the second management unit outputs a post-event material summarizing the image data on which the memo data is superimposed for each of the plurality of indexes. The information processing device according to claim 5 .

7. the first database is capable of further storing flag data, which is linked to each of the plurality of indexes and indicates whether the image data can be saved; The information processing device according to claim 4.

8. the second management unit outputs a post-event material summarizing the image data after deleting an index having a value indicating that the flag data cannot be saved from among the plurality of indexes. The information processing device according to claim 7.

Images