Conference assistance method and conference assistance apparatus

Abstract

The present disclosure relates to the field of computers, and relates to a conference assistance method, a conference assistance apparatus, a computer-readable storage medium, and a computer program product. The conference assistance method comprises: during a conference, receiving indication information of a user, wherein the indication information comprises a question related to current content of the conference; acquiring conference data of the conference; on the basis of the conference data, determining target data related to the indication information; and on the basis of the target data and the indication information of the user, using a machine learning model to generate a reply corresponding to the indication information.

Description

Meeting support methods and meeting support devices Technical Field

[0001] This disclosure relates to the field of computers, and in particular to a meeting assistance method, a meeting assistance device, a computer-readable storage medium, and a computer program product. Background Technology

[0002] Artificial intelligence (AI) is a branch of computer science that aims to create machines or software capable of performing human intelligent activities, such as learning, reasoning, problem-solving, perception, and language understanding. AI technology is widely used in fields such as speech recognition, image recognition, natural language processing, and robotics, with the aim of simulating, extending, and expanding human intelligence.

[0003] Among related technologies, applying artificial intelligence to record meeting content during the meeting process and generate a summary after the meeting can effectively improve meeting efficiency.

[0004] However, among the aforementioned technologies, the interaction between AI assistants and users is poor, which affects the user experience. Summary of the Invention

[0005] In view of this, embodiments of the present disclosure provide a meeting assistance method, a meeting assistance device, a computer-readable storage medium, and a computer program product, which can, during a meeting, determine data related to instruction information provided by the user, and then use a machine learning model to generate a response to the instruction information, thereby realizing real-time question and answer during the meeting and improving the user experience.

[0006] According to some embodiments of this disclosure, a meeting assistance method is provided, comprising: during a meeting, receiving instruction information from a user, the instruction information including questions related to the current content of the meeting; acquiring meeting data; determining target data related to the instruction information based on the meeting data; and generating a response corresponding to the instruction information using a machine learning model based on the target data and the user's instruction information.

[0007] According to some other embodiments of this disclosure, a meeting assistance device is provided, comprising: a receiving module configured to receive instruction information from a user during a meeting, the instruction information including questions related to the current content of the meeting; an acquisition module configured to acquire meeting data; a determination module configured to determine target data related to the instruction information based on the meeting data; and a generation module configured to generate a response corresponding to the instruction information using a machine learning model based on the target data and the user's instruction information.

[0008] According to further embodiments of the present disclosure, a conference assist device is provided, comprising: a memory; and a processor coupled to the memory, the processor being configured to perform the methods of any of the embodiments described in the present disclosure based on instructions stored in the memory.

[0009] According to further embodiments of the present disclosure, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, performs a meeting assistance method according to any embodiment of the present disclosure.

[0010] According to other embodiments of this disclosure, a computer program product is provided that, when run on a computer, causes the computer to implement the meeting assistance method of any embodiment described in this disclosure.

[0011] Other features, aspects, and advantages of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0012] Embodiments of this disclosure are described below with reference to the accompanying drawings. It should be understood that the drawings described below are merely illustrative of some embodiments of this disclosure and are not intended to limit the scope of this disclosure. In the drawings:

[0013] Figure 1 shows a flowchart of a meeting assistance method according to some embodiments of the present disclosure;

[0014] Figure 2A illustrates a flowchart of receiving user instruction information according to some embodiments of the present disclosure;

[0015] Figure 2B illustrates a flowchart of receiving user instruction information according to other embodiments of the present disclosure;

[0016] Figure 3 illustrates a flowchart of obtaining meeting data according to some embodiments of the present disclosure;

[0017] Figure 4 illustrates a flowchart of determining target data according to some embodiments of the present disclosure;

[0018] Figure 5 shows a block diagram of a conference assisting device according to some embodiments of the present disclosure;

[0019] Figure 6 shows a block diagram of a meeting assistance device according to some other embodiments of the present disclosure;

[0020] Figure 7 shows a block diagram of an electronic device according to some embodiments of the present disclosure. Detailed Implementation

[0021] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. It should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein.

[0022] It should be understood that the various steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement of components and steps set forth in these embodiments should be interpreted as merely exemplary and does not limit the scope of this disclosure.

[0023] As used in this disclosure, the term "comprising" and its variations are open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to". The term "based on" means "at least partially based on".

[0024] It should be noted that the concepts of "first," "second," etc., used in this disclosure are used only to distinguish different devices, modules, or units, and are not intended to define the order of functions performed by these devices, modules, or units or their interdependencies. Unless otherwise specified, the concepts of "first," "second," etc., are not intended to imply that the objects described herein must be in a given temporal, spatial, rank, or any other given order.

[0025] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0026] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0027] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data shall comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals shall be provided for users to choose to authorize or refuse.

[0028] The embodiments of this disclosure are described in detail below with reference to the accompanying drawings; however, this disclosure is not limited to these specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. Furthermore, in one or more embodiments, specific features, structures, or characteristics can be combined in any suitable manner that will be apparent to those skilled in the art from this disclosure.

[0029] It should be understood that this disclosure does not limit how the image to be applied / processed is obtained. In some embodiments of this disclosure, it can be obtained from a storage device, such as internal memory or external storage device. In other embodiments of this disclosure, a camera component can be invoked to capture an image. It should be noted that the acquired image can be a captured image or a frame from a captured video, and is not particularly limited to these.

[0030] In the context of this disclosure, "image" can refer to any of a variety of images, such as color images, grayscale images, etc. It should be noted that the type of image is not specifically limited in the context of this specification. Furthermore, an image can be any suitable image, such as a raw image obtained by a camera device, or an image from which specific processing has been performed, such as preliminary filtering, dealiasing, color adjustment, contrast adjustment, normalization, etc. It should be noted that preprocessing operations may also include other types of preprocessing operations known in the art, which will not be described in detail here.

[0031] The meeting assistance functions in related technologies cannot achieve real-time Q&A regarding the current content of the meeting, resulting in a poor user experience. To improve the user experience, this disclosure provides a new meeting assistance method that, during the meeting, after determining the data related to the instructions sent by the user, uses a machine learning model to generate a response to the instructions, thereby achieving real-time Q&A during the meeting.

[0032] Figure 1 shows a schematic flowchart of a meeting assistance method according to some embodiments of the present disclosure.

[0033] As shown in Figure 1, the meeting assistance method includes: step S11, receiving user instruction information during the meeting, the instruction information including questions related to the current content of the meeting; step S12, acquiring meeting data; step S13, determining target data related to the instruction information based on the meeting data; and step S14, generating a response corresponding to the instruction information using a machine learning model based on the target data and the user instruction information.

[0034] In the aforementioned meeting support methods, user instructions can be received in real time during the meeting. These instructions may include questions related to the current content of the meeting, such as questions about the current meeting progress.

[0035] The meeting data mentioned above refers to the data generated during the meeting, such as the speakers' remarks and the shared screens displayed during the meeting.

[0036] The aforementioned machine learning models include, for example, Large Language Models (LLMs) or other natural language processing (NLP) models. For instance, variational autoencoders (VAEs), convolutional neural networks (CNNs), and transformers can be used to determine responses to user instructions through analysis of target data.

[0037] The aforementioned meeting assistance methods can be implemented by artificial intelligence products such as AI assistants. Meeting assistance, for example, is implemented as a function within such AI products.

[0038] The meeting assistance method disclosed herein, by determining the data related to the instructions sent by the user during the meeting, and then using a machine learning model to generate a response to the instructions, enables real-time question and answer during the meeting, thereby improving the user experience.

[0039] The meeting assistance method according to embodiments of the present disclosure will now be described in further detail. First, the specific flow of receiving user instruction information in the meeting assistance method will be introduced with reference to Figures 2A and 2B. Figure 2A shows a schematic flowchart of receiving user instruction information according to some embodiments of the present disclosure.

[0040] As shown in Figure 2A, in some embodiments, step S11, receiving user instruction information during the meeting, includes: step S111, during the meeting, in response to the meeting meeting meeting a preset condition, sending a reminder message corresponding to the preset condition to the user; step S112, receiving instruction information determined by the user based on the reminder message.

[0041] In step S111, if the meeting meets the preset conditions, a reminder message corresponding to the preset conditions is sent to the user to inform the user that the conditions have been met.

[0042] In some embodiments, the preset conditions may include at least one of the following: the duration of the meeting reaches a preset duration, the speaker of the meeting changes, the topic of the meeting changes, or the display screen of the meeting changes.

[0043] Correspondingly, the reminder messages include change reminders such as "The meeting has lasted for half an hour" or "The speaker of the meeting has changed from A to B", or status reminders or guiding reminders such as "I am recording the meeting content for you. You can also ask me any questions related to the meeting at any time".

[0044] Once the aforementioned preset conditions are met, it likely signifies the end of a certain phase of the meeting, and users are more likely to want to obtain information or ask questions. Sending reminder messages to users when these preset conditions are met can further enhance the user experience.

[0045] The preset conditions mentioned above can be set by the user or automatically determined. These preset conditions may also include criteria such as keywords to further enhance the functionality of meeting support and thus improve the user experience.

[0046] In step S112, the user can determine the instruction information and send it based on the above reminder information.

[0047] For example, a notification message might indicate a change in the speaker at a meeting. Based on this notification, users can send instructions that include questions related to the current content of the meeting, such as "What is the background of the new speaker?", making it easier for users to ask questions.

[0048] In some embodiments, the current content of the meeting includes at least one of the current speaker, the current topic, and the current display screen.

[0049] The meeting support method provided in this disclosure enables real-time interaction with users, allowing them to ask questions during the current meeting, thus improving the user experience.

[0050] Furthermore, the instruction information may include at least one of the following: questions related to the current progress of the meeting, questions related to the historical content of the meeting, questions related to the current speaker of the meeting, questions related to the current topic of the meeting, questions related to the current display screen of the meeting, and instructions to obtain non-meeting materials related to the current content of the meeting.

[0051] In addition, to prevent conflicts with the audio recording during the meeting, the aforementioned instructions can be text or image information, rather than audio information.

[0052] The foregoing description, based on Figure 2A, outlines the process for receiving user instruction information in some embodiments of this disclosure, whereby the user can send instruction information based on reminder messages. The following description, based on Figure 2B, outlines the process for receiving user instruction information in other embodiments of this disclosure. Figure 2B illustrates a schematic flowchart of the process for receiving user instruction information according to other embodiments of this disclosure.

[0053] As shown in Figure 2B, step S11, during the meeting, receiving user instruction information includes: step S111', during the meeting, in response to the meeting meeting meeting a preset condition, sending a reminder message corresponding to the preset condition to the user; step S112', displaying at least one recommended instruction message related to the reminder message; step S113', receiving the recommended instruction message selected by the user as the instruction message.

[0054] Step S111' is similar to step S111, and will not be repeated here. The following will focus on describing steps S112' and S113'.

[0055] In step S112', recommended instruction information related to the reminder information can be displayed, that is, recommended instruction information related to the preset conditions, so as to guide the user to determine the instruction information and send it.

[0056] Specifically, the recommended instruction information includes at least one of the following: questions related to the current progress of the meeting, questions related to the historical content of the meeting, questions related to the current speaker of the meeting, questions related to the current topic of the meeting, questions related to the current display screen of the meeting, questions related to preset conditions, and instructions for obtaining non-meeting materials related to the current content of the meeting.

[0057] The content of the recommended instructions is similar to that of the instructions themselves. Recommended instructions may also include questions related to the current content of the meeting. Furthermore, recommended instructions may include questions related to pre-defined conditions. For example, if the pre-defined condition is a change in the speaker at the meeting, the recommended instructions might be something like, "You may ask me, what is the background of the new speaker?"

[0058] In step S113', the user can select from the recommended instructions, and the user's selected recommended instructions will be used as the instructions sent by the user.

[0059] In the above process, users do not need to edit the content of the instruction information themselves; they can interact by making selections, which further improves the user experience.

[0060] The specific steps for receiving instruction information sent by a user in the meeting assistance method provided in this disclosure have been described above with reference to Figures 2A and 2B. Below, with reference to Figure 3, the specific steps for acquiring meeting data in the meeting assistance method of some embodiments of this disclosure will be described. Figure 3 shows a schematic flowchart of acquiring meeting data according to some embodiments of this disclosure.

[0061] As shown in Figure 3, step S12, acquiring the meeting data of the meeting, includes: step S12A, in response to detecting the start of the meeting, acquiring the meeting data of the meeting using device audio and / or external input audio; and / or step S12B, in response to detecting the start of the meeting, acquiring the meeting data of the meeting using the display screen of the meeting.

[0062] Meeting data can include audio conference data or text-based conference data, which can be further divided into text conference data and image conference data.

[0063] In step S12A, the audio data of the meeting can be obtained using the device's audio or external input audio.

[0064] For example, when users participate in offline meetings, audio data can be acquired using external audio input, such as a microphone. When users participate in online meetings, audio data can be acquired using device audio, such as computer audio or mobile device audio.

[0065] In step S12B, the conference's text and image data can be obtained using the conference's display screen.

[0066] The meeting's display screen can be a PowerPoint presentation, a projected image, or other similar content. For example, the meeting can be recorded to capture the displayed screen.

[0067] After acquiring the displayed screen, the screen can be analyzed. For example, frames from the recorded meeting video can be extracted at certain intervals, and the display of these frames can be analyzed to obtain the image and text meeting data from the meeting.

[0068] The aforementioned data acquisition can be performed automatically after the start of the meeting. For example, at the start of the meeting, meeting data can be automatically acquired according to the user's past settings, eliminating the need for secondary confirmation by the user and improving the user experience.

[0069] Furthermore, obtaining the meeting data may also include: obtaining the meeting data based on the user's authorization. Obtaining meeting data only after user authorization effectively protects user privacy.

[0070] For example, at the start of a meeting, you can proactively ask users if they need meeting assistance features. After obtaining the user's authorization, you can start acquiring meeting data, such as recording meeting data and obtaining text, images, audio, or video meeting data.

[0071] The above section, with reference to Figure 3, described the specific process for acquiring meeting data in this embodiment of the disclosure. Through the above specific settings, meeting data can be acquired flexibly and accurately for subsequent analysis and generation of responses to user instructions. Below, we will describe how the meeting assistance method provided in this disclosure determines the target data.

[0072] In some embodiments, step S13, determining target data related to the instruction information based on the meeting data, includes: determining first target data based on the semantic understanding of the instruction information, wherein the first target data includes real-time meeting data corresponding to the current content.

[0073] Semantic understanding of instructions involves steps such as text processing, keyword extraction, and semantic role identification. Through semantic understanding, the meaning of user-sent instructions can be accurately understood, allowing for a proper response.

[0074] Specifically, the first target data refers to data directly related to the instruction information. As mentioned above, the instruction information may include questions related to the current content of the meeting. Therefore, the first target information may include real-time meeting data corresponding to the current content, serving as the target data most relevant to the instruction information. Real-time meeting data may include, for example, the current display screen data of the meeting, the current speaking data, and other data.

[0075] By following the steps above, we can identify the key parts of the instructions sent by the user, so as to determine the target data most relevant to the instructions and generate a more accurate response.

[0076] In other embodiments, determining the target data may further include determining a second target data in addition to determining the first target data. The specific steps for determining the target data in the meeting support method provided by this disclosure will now be described with reference to FIG4. FIG4 shows a schematic flowchart of the process for determining target data according to some embodiments of this disclosure.

[0077] As shown in Figure 4, step S13, which determines the target data related to the instruction information based on the meeting data, includes: step S131, determining the first target data based on the semantic understanding of the instruction information, wherein the first target data includes real-time meeting data corresponding to the current content; and step S132, determining the second target data based on the semantic understanding of the meeting data, wherein the second target data includes meeting data related to the first target data.

[0078] The process of determining the first target data in step S131 has been described in detail above and will not be repeated here. The following focuses on how to determine the second target data in step S132.

[0079] In step S132, the semantic understanding of the meeting data is similar to that of the semantic understanding of the instruction information, and also includes steps such as text processing, keyword extraction, and semantic role identification. Through semantic understanding of the meeting data, the theme and content category of the meeting can be further understood, thereby identifying content relevant to the user's instructions as target content.

[0080] Specifically, the second target data refers to the meeting data related to the first data, determined based on the understanding of the meeting content; in other words, it is data indirectly related to the instruction information.

[0081] In some embodiments, the content of the second target data may include at least one of the following: meeting data related to the topic of the first target data, meeting data related to the tasks in the first target data, meeting data related to the display screen of the first target data, meeting data related to the time of the first target data, meeting data related to the people in the first target data, and meeting data related to the keywords of the first target data.

[0082] Data related to the theme of the first objective data refers to data that is related to the first objective data in terms of the event or topic dimension of the meeting. For example, the second objective data may have the same theme as the first objective data, such as the project budget.

[0083] Data related to the tasks in the first target data refers to data that is related to the first target data in terms of the follow-up processing of the meeting. For example, the second target data may have the same tasks as the first target data, both of which require further investigation.

[0084] Data related to the display of the first target data refers to data that is related to the first target data in the image dimension of the meeting. For example, the second target data may have a similar image to the display of the first target data, such as statistical charts from different periods.

[0085] The time-related data of the first target data refers to the data that is related to the first target data in the time stamp dimension of the meeting. For example, the timestamp of the second target data can be within a certain range (e.g., five minutes) of the timestamp of the first target data.

[0086] Data related to the people in the first target data refers to data that is related to the first target data in the dimension of the people in the meeting. For example, the speaker in the second target data can be the same as the speaker in the first target data.

[0087] Data related to the keywords of the first target data refers to data that is related to the first target data in the keyword dimension of the meeting. For example, the keywords in the second target data may be the same as the keywords in the first target data.

[0088] In other words, the judgment criteria related to the first target data can include at least one of the aforementioned dimensions. By using these dimensions as a framework, the second target data related to the first target data can be effectively identified, thereby generating an accurate response.

[0089] Furthermore, the aforementioned judgment criteria can also be determined based on the type of meeting. Different judgment criteria can be established for different types of meetings, thereby improving the efficiency of determining the second target data.

[0090] For example, for departmental mobilization meetings, since personal issues are not involved, the relevance of the theme can be used as a criterion to further improve the efficiency of determining the second target data.

[0091] On the other hand, the second target data may take the form of at least one of the following: historical meeting data prior to receiving the user's instruction information, or reference materials from the meeting.

[0092] The aforementioned historical meeting data refers to meeting data other than real-time meeting data, such as meeting data from the start of the meeting to two minutes before the user sent an instruction message.

[0093] As mentioned above, historical meeting data can be obtained by recording the meeting. For example, at the start of a meeting, after obtaining the user's authorization, recording of the meeting content can begin, which may include audio or video content.

[0094] The reference materials mentioned above refer to the materials and data provided during the meeting that can be used for reference, such as the meeting agenda and introduction. By analyzing the reference materials, questions such as "What is the current progress of the meeting?" and "What topics will be discussed later in the meeting?" can be answered.

[0095] In step S132, by semantic understanding of the meeting content, second target data related to the first target data, that is, target data indirectly related to the user's instruction information, can be determined, thereby generating a more accurate response.

[0096] The foregoing section described methods for determining target data in some embodiments of this disclosure. By analyzing meeting data, first target data and second target data are determined, thereby improving the accuracy of the generated responses. In other embodiments of this disclosure, non-meeting data, i.e., third target data, can also be combined to further improve the accuracy of the generated responses.

[0097] In other embodiments, step S13, determining the target data related to the instruction information based on the conference data, includes: determining third target data based on the semantic understanding of the instruction information, wherein the third target data includes non-conference data related to the instruction information, and the non-conference data includes at least one of network data and local data outside the conference data.

[0098] The aforementioned non-meeting data refers to content outside of meetings, such as internet content. Non-meeting data can also be analyzed during the generation of responses to user instructions, leading to more accurate replies.

[0099] For example, if a user's instruction is "explain the basic principles of the formula being discussed in the meeting," and the formula is relatively basic, it may not have been discussed in the meeting. In this case, a response can be generated by searching for interpretations related to the formula on the internet to answer the user's question.

[0100] In summary, the meeting assistance method provided in this disclosure can realize real-time interaction during the meeting process and generate responses corresponding to user instructions, thereby improving the user experience.

[0101] The above describes a meeting assistance method provided by embodiments of this disclosure. A meeting assistance apparatus according to embodiments of this disclosure is described below with reference to FIGS. 5 and 6, used to perform any of the above-described meeting assistance methods. FIG. 5 shows a block diagram of a meeting assistance apparatus according to some embodiments of this disclosure.

[0102] As shown in Figure 5, the meeting assistance device 5 includes: a receiving module 51 configured to receive user instruction information during the meeting, the instruction information including questions related to the current content of the meeting; an acquisition module 52 configured to acquire meeting data; a determination module 53 configured to determine target data related to the instruction information based on the meeting data; and a generation module 54 configured to generate a response corresponding to the instruction information using a machine learning model based on the target data and the user instruction information.

[0103] The receiving module 51 of the conference support device 5 can be used to perform step S11 of FIG1. ​​The acquiring module 52 of the conference support device 5 can be used to perform step S12 of FIG1. ​​The determining module 53 of the conference support device 5 can be used to perform step S13 of FIG1. ​​The generating module 54 of the conference support device 5 can be used to perform step S14 of FIG1.

[0104] Figure 6 shows a block diagram of a meeting aid device according to some other embodiments of the present disclosure.

[0105] As shown in FIG6, the conference assist device 6 includes: a memory 61; and a processor 62 coupled to the memory 61, the processor 62 being configured to execute the conference assist method described in any of the foregoing embodiments based on instructions stored in the memory 61.

[0106] Memory 61 is used to store one or more computer-readable instructions. Memory 61 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory, including but not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory. Memory 61 may, for example, store operating systems, application programs, boot loaders, databases, and other programs, as well as various application programs and various data.

[0107] The processor 62 is configured to execute computer-readable instructions to implement the meeting assistance method described in any of the foregoing embodiments. Specific implementations of each step of the method can be found in the above embodiments; repeated details will not be elaborated upon here.

[0108] Processor 62 can be configured to execute the steps shown in Figures 1 through 4. Processor 62 can be various processing devices, such as a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The central processing unit (CPU) can be based on x86 or ARM architectures, etc.

[0109] The processor 62 and the memory 61 can communicate with each other directly or indirectly. For example, the processor 62 and the memory 61 can communicate via a network. The network can include wireless networks, wired networks, and / or any combination of wireless and wired networks. The processor 62 and the memory 61 can also communicate with each other via a system bus, which is not limited in this disclosure.

[0110] It should be noted that the components of the conference aid device 6 shown in Figure 6 are exemplary and not limiting. Depending on the specific application requirements, the conference aid device 6 may also have other components. The processor 62 can control other components in the conference aid device 6 to perform desired functions.

[0111] The conference support device 6 can be implemented by software, firmware and / or hardware, and can be integrated into a device with the relevant application installed.

[0112] The meeting assistance apparatus according to embodiments of the present disclosure has been described above with reference to Figures 5 and 6. Next, with reference to Figure 7, an electronic device according to embodiments of the present disclosure will be described for performing any of the aforementioned meeting assistance methods.

[0113] Figure 7 shows a block diagram of an electronic device according to some embodiments of the present disclosure.

[0114] The electronic device 7 shown in Figure 7 can be a computer system with a dedicated hardware structure, capable of performing corresponding functions when relevant applications are installed.

[0115] Electronic devices include, but are not limited to, mobile terminals such as smartphones, laptops, personal digital assistants (PDAs), tablet computers (PCs), PMPs (portable multimedia players), in-vehicle terminals (such as in-vehicle navigation terminals), wearable devices, and fixed terminals such as digital televisions and desktop computers.

[0116] As shown in Figure 7, the Central Processing Unit (CPU) 71 executes various processes based on programs stored in the Read-Only Memory (ROM) 72 or programs loaded from the storage section 78 into the Random Access Memory (RAM) 73. The RAM 73 stores data required as needed when the CPU 71 executes various processes. The CPU is merely exemplary and can also be other types of processors, such as the various processors described above. The ROM 72, RAM 73, and storage section 78 can be various forms of computer-readable storage media. It should be noted that although the ROM 72, RAM 73, and storage section 78 are shown separately in Figure 7, one or more of them can be combined or located in the same or different memories or storage modules.

[0117] CPU 71, ROM 72 and RAM 73 are interconnected via bus 74. Input / output interface 75 is also connected to bus 74.

[0118] The following components are connected to the input / output interface 75: input section 76, such as a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output section 77, including displays such as cathode ray tube (CRT), liquid crystal display (LCD), speakers, vibrators, etc.; storage section 78, including hard disks, magnetic tapes, etc.; and communication section 79, including network interface cards such as LAN cards, modems, etc. The communication section 79 allows communication processing to be performed via a network such as the Internet. It is readily understood that although parts of the electronic device 7 shown in Figure 7 communicate via bus 74, they can also communicate via a network or other means, wherein the network can include wireless networks, wired networks, and / or any combination of wireless and wired networks.

[0119] As needed, drive 710 is also connected to input / output interface 75. Removable media 711, such as disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on drive 710 as needed, so that computer programs read from them can be installed into storage section 78 as needed.

[0120] When the above series of processes are implemented through software, the program constituting the software can be installed from a network such as the Internet or a storage medium such as a removable medium 711.

[0121] According to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product that, when run on a computer, causes the computer to perform the methods described in any of the foregoing embodiments. The computer program product includes computer instructions carried on a computer-readable medium, comprising program code for performing the methods shown in the flowcharts. In such embodiments, the computer instructions can be downloaded and installed from a network via communication section 79, or installed from storage section 78, or installed from ROM 72. When the computer program is executed by CPU 71, the methods of embodiments of this disclosure are performed.

[0122] It should be noted that, in the context of this disclosure, a computer-readable medium can be a tangible medium that may contain or store programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0123] A computer-readable medium may be a computer-readable storage medium, a computer-readable signal medium, or any combination thereof.

[0124] Computer-readable storage media include, but are not limited to, systems, apparatuses, or devices that are electrical, magnetic, optical, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. Computer instructions are stored on the computer-readable storage medium that, when executed by a processor, implement the methods described in any of the foregoing embodiments.

[0125] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0126] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0127] In some embodiments, a computer program is also provided, comprising: instructions that, when executed by a processor, cause the processor to perform the methods described in any of the foregoing embodiments. For example, the instructions may be embodied in computer program code.

[0128] In embodiments of this disclosure, computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0129] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0130] The functions described above can be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that can be used include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0131] While specific embodiments of this disclosure have been described in detail by way of example, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of this disclosure. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of this disclosure. The scope of this disclosure is defined by the appended claims.

Claims

1. A meeting support method, comprising: During the meeting, the system receives instructions from users, including questions related to the current content of the meeting. Obtain the meeting data of the meeting; Based on the meeting data, determine the target data related to the instruction information; Based on the target data and the user's instructions, a machine learning model is used to generate a response corresponding to the instructions.

2. The meeting assistance method according to claim 1, wherein, Based on the meeting data, the target data related to the instruction information includes: Based on the semantic understanding of the instruction information, a first target data is determined, which includes real-time conference data corresponding to the current content.

3. The meeting assistance method according to claim 2, wherein, Based on the meeting data, determining the target data related to the instruction information further includes: Based on the semantic understanding of the meeting data, a second target data is determined, which includes meeting data related to the first target data.

4. The meeting assistance method according to claim 3, wherein, The second target data includes at least one of the following: meeting data related to the theme of the first target data, meeting data related to the tasks in the first target data, meeting data related to the display screen of the first target data, meeting data related to the time of the first target data, meeting data related to the people in the first target data, and meeting data related to the keywords of the first target data.

5. The meeting assistance method according to claim 3, wherein, The second target data includes at least one of the following: historical meeting data prior to receiving the user's instruction information, and reference materials from the meeting.

6. The meeting assistance method according to claim 1, wherein, Based on the meeting data, the target data related to the instruction information includes: Based on the semantic understanding of the instruction information, a third target data is determined. The third target data includes non-conference data related to the instruction information. The non-conference data includes at least one of network data and local data other than the conference data.

7. The meeting assistance method according to any one of claims 1 to 6, wherein, Obtaining the meeting data of the meeting includes: In response to detecting the start of the meeting, the meeting data is acquired using device audio and / or externally input audio; and / or In response to the detection that the meeting has started, the meeting data is obtained using the meeting's display screen.

8. The meeting assistance method according to any one of claims 1 to 7, wherein, During the meeting, the user's instructions received include: During the meeting, in response to the meeting meeting meeting a preset condition, a reminder message corresponding to the preset condition is sent to the user; Receive the instruction information determined by the user based on the reminder information.

9. The meeting assistance method according to claim 8, wherein, The preset conditions include at least one of the following: the meeting duration reaches a preset duration, the speaker of the meeting changes, the topic of the meeting changes, or the display screen of the meeting changes.

10. The meeting assistance method according to any one of claims 1 to 7, wherein, During the meeting, the user's instructions received include: During the meeting, in response to the meeting meeting meeting a preset condition, a reminder message corresponding to the preset condition is sent to the user; Display at least one recommended instruction related to the reminder message; Receive the recommended instruction information selected by the user, and use it as the instruction information.

11. The meeting assistance method according to claim 10, wherein, The recommended instructions include at least one of the following: questions related to the current progress of the meeting, questions related to the historical content of the meeting, questions related to the current speaker of the meeting, questions related to the current topic of the meeting, questions related to the current display screen of the meeting, questions related to preset conditions, and instructions to obtain non-meeting materials related to the current content of the meeting.

12. The meeting assistance method according to any one of claims 1 to 11, wherein, The current content of the meeting includes at least one of the following: the current speaker, the current topic, and the current display screen.

13. The meeting assistance method according to any one of claims 1 to 12, wherein: The instruction information includes text or image information, but excludes voice information; and / or The instruction information includes at least one of the following: questions related to the current progress of the meeting, questions related to the historical content of the meeting, questions related to the current speaker of the meeting, questions related to the current topic of the meeting, questions related to the current display screen of the meeting, and instructions to obtain non-meeting materials related to the current content of the meeting.

14. The meeting assistance method according to any one of claims 1 to 13, wherein, Obtaining the meeting data of the meeting includes: Based on the user's authorization, obtain the meeting data of the meeting.

15. A conference support device, comprising: The receiving module is configured to receive user instructions during the meeting, the instructions including questions related to the current content of the meeting; The acquisition module is configured to acquire the meeting data of the meeting; The determination module is configured to determine target data related to the instruction information based on the meeting data; The generation module is configured to generate a response corresponding to the indication information based on the target data and the user's indication information using a machine learning model.

16. A conference support device, comprising: Memory; as well as A processor coupled to the memory, the processor being configured to execute the conference assistance method as described in any one of claims 1 to 14 based on instructions stored in the memory.

17. A computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the meeting assistance method according to any one of claims 1 to 14.

18. A computer program product that, when run on a computer, causes the computer to implement the meeting assistance method according to any one of claims 1 to 14.

Images