Conference memory enhancement method and equipment for conference tablet and medium

Abstract

The invention discloses a conference memory enhancement method and device for a conference tablet and a medium, and relates to the technical field of intelligent conference equipment, and the method comprises the steps: collecting multi-modal data in real time based on a preset data collection technology, and coding the multi-modal data into a space-time event stream according to the time sequence of the multi-modal data; identifying handwritten characters on the conference tablet, and extracting a key tag in a speech in combination with a pre-trained natural language processing model to construct a conference knowledge graph corresponding to the current conference; comparing the conference knowledge graph with a historical conference knowledge graph, determining conflict content, and superposing a virtual information layer on a physical interface of the conference tablet; and querying query association information corresponding to the semantic query request based on the conference knowledge graph and the time-space time stream to determine semantic contradictions, and displaying a historical conference evidence chain of the semantic contradictions based on the virtual information layer.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent conference equipment, and in particular to a conference memory enhancement method, equipment and medium for a conference tablet. Background Art

[0002] In the context of the deep integration of digital transformation and intelligent collaborative office, conference tablets, as the core carrier of enterprise-level intelligent interactive terminals, have gradually become the key infrastructure for information sharing and real-time collaboration in modern conference scenarios. With the surge in demand for hybrid office models and remote collaboration, the multimodal data generated during meetings has grown exponentially.

[0003] Although the current mainstream conference tablets have realized basic content collection and storage functions, their technical architecture remains at the primary stage of single-dimensional data recording. Specifically, the handwriting tracks, voice clips and electronic documents in the existing technology adopt independent storage mechanisms and lack association mapping based on spatiotemporal features. For example, users cannot trace the corresponding whiteboard annotation position when a certain voice discussion occurred, resulting in a break in the meeting context information chain. Traditional keyword matching technology is difficult to parse the implicit logical relationship in the meeting content. For example, for complex semantic queries such as "objections to project risk assessment", the system cannot identify similar decision paths across meetings. Topics, decision items and to-do tasks generated by different meetings exist in the form of isolated nodes. Neither a cross-meeting knowledge evolution model has been constructed, nor has the discussion progress of repeated topics been automatically identified. There is a perception gap between the physical writing layer and the digital information layer, and it is impossible to achieve deep interactive functions such as dynamic content annotation and real-time floating layer display of related information through augmented reality technology.

[0004] Existing technologies have also proposed meeting minutes generation solutions based on speech recognition, but have not established a spatiotemporal alignment model for multi-source heterogeneous data, resulting in the inability to accurately match the timestamps of handwritten annotations with the corresponding speech paragraphs. There is also a lack of a dynamic update mechanism based on knowledge graphs, which makes it impossible to track the evolution of specific topics in different meetings. Moreover, the interaction level is still limited to two-dimensional plane display, and spatial computing technology has not been integrated to achieve three-dimensional enhanced presentation of meeting content, resulting in insufficient utilization of corporate meeting knowledge assets, which seriously restricts the continuous improvement of organizational decision-making quality and operational efficiency. Summary of the invention

[0005] The embodiments of the present application provide a conference memory enhancement method, device and medium for a conference tablet to solve the above-mentioned technical problems.

[0006] On the one hand, an embodiment of the present application provides a conference memory enhancement method for a conference tablet, comprising: Based on a preset data collection technology, multimodal data is collected in real time, and the multimodal data is encoded into a spatiotemporal event stream according to the time sequence of the multimodal data; the multimodal data includes touch data, voice data and perception data; Recognize handwritten text on the conference tablet and extract key tags in the speech by combining it with a pre-trained natural language processing model to build a conference knowledge graph corresponding to the current meeting; Comparing the conference knowledge graph with the historical conference knowledge graph, determining conflicting content, and overlaying a virtual information layer on the physical interface of the conference tablet; Based on the conference knowledge graph and the spatiotemporal time flow, query association information corresponding to the semantic query request is queried to determine the semantic contradiction, and the historical conference evidence chain of the semantic contradiction is displayed based on the virtual information layer.

[0007] In one implementation of the present application, multimodal data is collected in real time based on a preset data collection technology, specifically including: The writing track, note pressure and erasing operation on the conference tablet are collected in real time through the preset touch note tracking technology; the touch note tracking technology includes electromagnetic induction or capacitive touch technology; The direction of the sound source is detected through beamforming technology, and combined with the coordinate positioning of the infrared sensor, the identity of the speaker to be bound is determined, and the speaker's voice features are extracted; Comparing the voice feature with the pre-stored voiceprint template of the speaker identity to be bound, so as to complete the identity binding of the speaker when the similarity is greater than the confidence threshold, and associating and storing the bound voice segment and whiteboard operation record according to the timestamp; Through the camera and infrared sensor integrated in the conference tablet, the speaker and the speaker's corresponding gesture operations are identified, and the spatial distribution of each participant is determined.

[0008] In one implementation of the present application, the key tags in the speech are extracted in combination with a pre-trained natural language processing model to construct a conference knowledge graph corresponding to the current conference, specifically including: Using a pre-trained natural language processing model, the meeting topics and task trigger words in the speech are identified to extract the task items and the corresponding task responsible persons, and the task responsible persons are bound to the task items; Perform sentiment analysis on the speech, determine the controversial issues, meeting decisions and corresponding responsible persons in the speech, and mark the controversial issues as controversial; Construct a conference knowledge graph based on a graph neural network, and integrate the conference knowledge graph with the enterprise database; The meeting agenda, meeting decisions, responsible persons and related documents of the current meeting are embedded into corresponding nodes in the meeting knowledge graph, a dependency chain is generated, and each node is associated with the corresponding historical task node.

[0009] In one implementation of the present application, the conference knowledge graph is compared with the historical conference knowledge graph to determine the conflicting content, specifically including: When the identified meeting topics, meeting decisions and task items of the current meeting are associated with the historical topics corresponding to the historical meetings, the corresponding associated content is pushed to the sidebar of the conference tablet; Perform semantic comparison between the key entities of the current meeting decision and the historical meeting decision, and calculate the difference between the current meeting decision and the historical meeting decision; the difference includes budget value, time node and responsible person allocation; When the difference exceeds a preset threshold, a conflict node is generated to mark the conflict relationship between the current meeting decision and the historical meeting decision on the conference tablet, and display the corresponding conflict content.

[0010] In one implementation of the present application, based on the conference knowledge graph and the spatiotemporal time flow, query association information corresponding to the semantic query request is queried to determine the semantic contradiction, and the historical conference evidence chain of the semantic contradiction is displayed based on the virtual information layer, specifically including: Based on the intelligent retrieval interface on the conference tablet, a semantic query request is received, and based on the conference knowledge graph and spatiotemporal event flow in the enterprise database, the corresponding request association information is queried; the request association information includes the associated whiteboard screen, voice clip and task status; Determine the semantic contradiction between the discussion content of the current meeting and the historical decision according to the associated whiteboard screen, the voice clip and the task status, and display the disputed clips with semantic contradictions in a heat map on the virtual information layer; Based on the similarity of topics between the current meeting and historical meetings, a meeting sequence report is generated to visualize the knowledge evolution path.

[0011] In one implementation of the present application, a virtual information layer is superimposed on the physical interface of the conference tablet, specifically including: Through the built-in projection or external virtual device of the conference tablet, a virtual information layer is superimposed on the physical interface of the conference tablet, and the relevant content of the historical meeting is highlighted through the virtual information layer; Acquire the task status indication in the current meeting in real time, and visualize the task status indication in the virtual information layer; the task status indication includes task completion degree, approval status and overdue mark; The entire version change history of the whiteboard content is recorded on the virtual information layer, and the entire version change history can be slid back according to the time axis.

[0012] In one implementation of the present application, before comparing the conference knowledge graph with the historical conference knowledge graph to determine the conflicting content, the method further includes: Map the meeting responsible person to the corresponding employee ID in the employee data table in the enterprise database to perform entity alignment; The meeting decision dependencies are associated with the financial budget table and the project schedule, and the current decision is compared with the constraints of the enterprise database to generate corresponding risk path prompts.

[0013] In one implementation of the present application, after constructing the conference knowledge graph corresponding to the current conference, the method further includes: Analyze the responsible persons, deadlines and dependencies in the task items of the current meeting, and associate the task items with the corresponding whiteboard images and voice clips; The task ID of the project management in the associated enterprise database is used to generate a clickable hyperlink to jump to the task details, and the clickable hyperlink is embedded in the meeting minutes document.

[0014] On the other hand, the embodiment of the present application further provides a conference memory enhancement device for a conference tablet, the device comprising: at least one processor; and, a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the conference memory enhancement method for a conference tablet as described above.

[0015] On the other hand, an embodiment of the present application further provides a non-volatile computer storage medium storing computer executable instructions, which, when executed, implement a conference memory enhancement method for a conference tablet as described above.

[0016] The present application embodiment provides a conference memory enhancement method, device and medium for a conference tablet, which at least includes the following beneficial effects: By collecting, structuring and associating multimodal data during the meeting, users can easily trace the basis and process of meeting decisions. The integration of historical meeting records, relevant documents, task status and other information makes every link of the decision-making process traceable, greatly improving the traceability of the decision. By using real-time data analysis and semantic understanding capabilities, it is possible to quickly identify content that conflicts with historical decisions or existing task status during meeting discussions. Once a conflict is detected, it helps users to adjust the discussion direction in a timely manner to avoid invalid decisions. The relevant information is directly superimposed on the virtual information layer interface of the conference tablet. Users do not need to switch between multiple applications or documents to find information. The intuitive information presentation method reduces the cognitive load of users in the process of information retrieval and understanding, allowing users to focus more on the meeting discussion itself. Accurately identify and associate related topics, decisions and tasks between different meetings, provide users with a coherent knowledge system, and improve meeting efficiency and knowledge inheritance effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings: Figure 1 A schematic diagram of a flow chart of a conference memory enhancement method for a conference tablet provided in an embodiment of the present application; Figure 2 A schematic diagram of a system architecture provided for an embodiment of the present application; Figure 3 A schematic diagram of a flow chart of another conference memory enhancement method for a conference tablet provided in an embodiment of the present application; Figure 4 A schematic diagram of the internal structure of a conference memory enhancement device for a conference tablet provided in an embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0019] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0020] Figure 1 A flowchart of a conference memory enhancement method for a conference tablet provided in an embodiment of the present application.

[0021] The analysis method involved in the embodiments of the present application can be implemented by a terminal device or a server, and the present application does not impose any special restrictions on this. For the convenience of understanding and description, the following embodiments are described in detail by taking a server as an example.

[0022] It should be noted that the server may be a single device or a system consisting of multiple devices, that is, a distributed server, and this application does not make any specific limitation on this.

[0023] like Figure 1 As shown, a conference memory enhancement method for a conference tablet provided in an embodiment of the present application includes: 101. Based on the preset data collection technology, multimodal data is collected in real time, and the multimodal data is encoded into a spatiotemporal event stream according to the time sequence of the multimodal data.

[0024] It should be noted that the multimodal data in the embodiment of the present application includes touch data, voice data and perception data.

[0025] Figure 2 A schematic diagram of a system architecture provided in an embodiment of the present application. Figure 2 As shown, the present application discloses a system that can integrate multimodal conference data in real time, automatically construct a knowledge network of a structured conference knowledge graph, and realize dynamic backtracking of conference memory and decision assistance through augmented reality technology, including a multimodal acquisition layer corresponding to a multimodal data acquisition module, an intelligent processing layer corresponding to an intelligent processing center, an AR interaction layer corresponding to an augmented reality interaction module, and a memory enhancement layer corresponding to a memory enhancement service module.

[0026] The multimodal acquisition layer includes a touch note tracking unit, a voice directional acquisition unit and an environmental perception unit. The intelligent processing layer includes a spatiotemporal alignment engine, content structured processing and incremental knowledge management modules. The AR interaction layer includes an AR overlay unit and a dynamic version controller. The memory enhancement layer includes an intelligent retrieval interface, a decision conflict warning unit and a cross-conference association engine.

[0027] Specifically, in one embodiment of the present application, the multimodal data acquisition module includes a touch pen tracking unit, a voice directional acquisition unit and an environmental perception unit. During the meeting, the touch pen tracking unit records the writing trajectory, pen pressure and erasing operation through electromagnetic induction or capacitive touch technology. The voice directional acquisition unit uses a beamforming microphone array to distinguish different speakers and associate them with the whiteboard operation timeline. The environmental perception unit recognizes user gesture operations based on the built-in camera of the conference tablet, such as area circling and tapping reminders. The infrared sensor detects the location distribution of the participants. The voice directional acquisition unit maps and matches the sound source direction detected by beamforming with the personnel position identified by infrared detection. The system can bind the voice signal to a specific speaker.

[0028] In one embodiment, beamforming detects that the direction of the sound source is 45°, that is, right front, with coordinates of (6m, 3m). Infrared detection finds that the coordinate corresponds to ID002, which is Li Si. Voiceprint verification extracts voice features and compares them with Li Si's voiceprint template with a confidence level of 92%. Finally, the system outputs the whiteboard operation record with a timestamp of 10:15. Li Si circles the whiteboard area and speaks, and the content of his speech is "It is recommended to modify the third part."

[0029] In one embodiment, based on the spatiotemporal alignment engine of the intelligent processing center, a unified timestamp is established for each collected touch data, voice data, and perception data, and the handwriting, voice, and gesture operations are encoded into corresponding spatiotemporal event streams in the order of occurrence.

[0030] 102. Recognize handwritten text on the conference tablet, and combine it with a pre-trained natural language processing model to extract key tags in the speech to build a conference knowledge graph corresponding to the current meeting.

[0031] Specifically, in one embodiment of the present application, the content structuring processor uses optical character recognition (OCR) technology to recognize handwritten text on the conference tablet, and combines the natural language processing (NLP) model to extract task items, decision points and controversial issues in the speech. For example, the topic node: product 2025-Q2 function development priority. Discussion process: Speech A: "AI assistant must be added, controversy: insufficient resources". Specifically, sentiment analysis is performed on speech A to determine the controversial issues corresponding to speech A, and controversial issues are marked. Speech B: "It is decided to launch the payment module first, and Wang is responsible." Task items are extracted based on speech B, and the corresponding responsible person is determined, and then the task items are bound to the corresponding responsible person. Whiteboard writing: "Conclusion: Payment module priority P0", so that the conclusion node is recognized by optical characters and the meeting decision of the current meeting is determined.

[0032] The meeting knowledge graph is constructed based on the graph neural network. The nodes in the meeting knowledge graph include "topic-decision-responsible person-related documents", and the related documents are such as the historical resolution "Resource Quota for 2024". The meeting knowledge graph is integrated with the enterprise database, and the meeting topics, meeting decisions, responsible persons and related documents of the current meeting are embedded into the corresponding nodes in the meeting knowledge graph, a dependency chain is generated, and each node is associated with the corresponding historical task node.

[0033] In one embodiment, after constructing the meeting knowledge graph corresponding to the current meeting, a clickable hyperlink is created to associate the task item with the corresponding whiteboard screen and discussion recording. Specifically, the responsible person, deadline, and dependency in the task item of the current meeting are parsed, and the task item is associated with the corresponding whiteboard screen and voice clip. Then, the task ID of the project management in the enterprise database is associated, a clickable hyperlink to jump to the task details is generated, and the clickable hyperlink is embedded in the meeting minutes document.

[0034] In one embodiment, the meeting knowledge graph is compared with the historical meeting knowledge graph. Before determining the conflicting content, the person responsible for the meeting is mapped to the corresponding employee ID in the employee data table in the enterprise database for entity alignment, and the meeting decision dependencies are associated with the financial budget table and project schedule. The current decision is compared with the constraints of the enterprise database to generate corresponding risk path prompts.

[0035] Figure 3 A flow chart of another method for enhancing conference memory for a conference tablet provided in an embodiment of the present application. Figure 3 As shown, during the meeting, touch handwriting, voice data and gesture operations are collected synchronously to generate a raw event stream with a timestamp; task tags (such as "★Urgent") in handwritten content are recognized in real time to trigger to-do reminders.

[0036] At the end of the meeting, a structured meeting minutes is automatically generated, the knowledge graph of the meeting is integrated with the enterprise database, and clickable hyperlinks are synchronized. Clicking on the task item jumps to the corresponding whiteboard screen and discussion recording, and the global decision network is updated. It should be noted that the meeting knowledge graph of the embodiment of the present application includes the meeting's topics, conclusions, and task dependencies, and the enterprise database includes ERP project progress, CRM customer feedback, and financial budget tables.

[0037] Scenario: New product launch decision Topic: "2025-Q3 product launch plan" → Conclusion: "Need to increase the number of testers, budget +20%".

[0038] Enterprise database status: HR table: The current number of people in the testing team is 5, and the maximum number of people is 10.

[0039] Financial statement: The remaining quarterly budget is 500,000.

[0040] Integration and update: Entity alignment: person in charge of the meeting "Li, the testing supervisor" ↔ "Wang, the HR library".

[0041] Relationship enhancement: Decision: Add testing → Dependency: Budget 200,000.

[0042] Conflict detection: If the financial table shows that the remaining budget is only 100,000 → generate a conflict node and trigger an early warning.

[0043] Global decision network changes: Added a new node [Product launch decision Q3] and associated historical node [2025-Q2 decision: postpone launch].

[0044] Conflict path prompt: "Budget gap requires financial approval or cutting other expenses."

[0045] In the subsequent retrospective stage, through voice sentiment analysis, that is, using the sentiment analysis model to identify angry / questioning tones, and through speech conflict detection, that is, detecting the frequency of "but" / "however" in the speech ≥ 5 times / minute → dispute + 0.2, the historical meeting heat map is displayed on the AR interface of the virtual information layer, that is, the controversial area is highlighted, and voice commands are supported to locate key fragments; when a new meeting mentions a historical topic, related content is automatically pushed to the tablet sidebar.

[0046] 103. Compare the conference knowledge graph with the historical conference knowledge graph, identify conflicting content, and overlay a virtual information layer on the physical interface of the conference tablet.

[0047] Specifically, in one embodiment of the present application, the incremental knowledge management module of the intelligent processing center calculates the similarity between the meeting content of the current meeting and the historical meeting, and when it is determined that the meeting topics, meeting decisions and task items of the current meeting are associated with the historical topics corresponding to the historical meetings, the associated content corresponding to the historical meetings is pushed to the sidebar of the conference tablet for reference by participants, so as to facilitate the sorting out of the relationship between the current meeting and the historical meetings.

[0048] This application also semantically compares the key entities of the current meeting decision with those of the historical meeting decision, and calculates the difference between the current meeting decision and the historical meeting decision. It should be noted that the difference in the embodiment of the present application is specifically reflected in the budget value, time node and the allocation of responsible persons. When the difference between the current meeting and the historical meeting exceeds the preset threshold, a conflict node is generated, and then based on the conflict node, the conflict relationship between the current meeting decision and the historical meeting decision is marked on the conference tablet, such as "This budget is inconsistent with the 2024-Q4 meeting resolution", and the specific conflict content between the current meeting and the historical meeting is displayed based on the virtual information layer for the participants to consider.

[0049] In one embodiment, the AR overlay unit of the augmented reality interaction module overlays a virtual information layer on the physical interface of the conference tablet through the built-in projection in the conference tablet or an external virtual AR device. The relevant content of the historical meeting is displayed on the virtual information layer and highlighted. The task status indication in the current meeting is obtained in real time, and the task status indication is visually displayed on the virtual information layer. It should be noted that the task status indication in the embodiment of the present application includes task completion, approval status and overdue mark, such as "Completed-Pending Approval-Overdue". The dynamic version controller in this application records the full version change history of the whiteboard content through the virtual information layer, and supports participants to trace back to any discussion node by sliding the timeline.

[0050] 104. Based on the conference knowledge graph and spatiotemporal time flow, query the query association information corresponding to the semantic query request to determine the semantic contradiction, and display the historical conference evidence chain of the semantic contradiction based on the virtual information layer.

[0051] Specifically, in one embodiment of the present application, the memory enhancement service module provides an intelligent retrieval interface, which is set on the conference tablet for receiving semantic query requests. After receiving the semantic query request, based on the conference knowledge graph and spatiotemporal event flow in the enterprise database, the associated information associated with the request in the historical meeting is queried. It should be noted that the request associated information in the embodiment of the present application includes associated whiteboard screens, voice clips and task status.

[0052] According to the associated whiteboard images, voice clips and task status displayed on the virtual information layer, the semantic contradiction between the discussion content of the current meeting and the historical decisions is determined, and the controversial clips with semantic contradictions are displayed as a heat map on the virtual information layer.

[0053] In one embodiment, the database content is composed as shown in the following table:

[0054] Supports natural language queries, such as "show all unclosed risk items", which will search for technical risks, compliance risks, schedule risks, and resource risks. Associate whiteboard images, voice clips, and task tracking status. The importance adopts a dynamic weight scoring model, namely: impact range coefficient (calculated based on the number of associated tasks and the number of departments involved) × 0.4 + urgency coefficient (based on the deadline) × 0.3 + historical recurrence probability (counting the number of recurrences of similar risks from the knowledge graph) × 0.3.

[0055] Query "Display high-risk unclosed-loop technical issues", the system responds: a. Semantic analysis: Filter conditions: type, technology; Status: unclosed loop.

[0056] b. Graph retrieval: Return nodes (insufficient data for AI model training), associated whiteboards (list of data requirements), and meeting clips (recordings of engineers’ discussions).

[0057] c. Status display: Marked in red, indicating that the last update by the responsible person was "Waiting for data procurement approval".

[0058] d. Task status conflict resolution: The system overrides the status to “at risk” and generates an early warning to notify the project manager.

[0059] In addition, when the decision conflict warning unit detects that the current discussion content conflicts with the existing decision, it will automatically pop up the historical meeting evidence chain. The cross-conference association engine automatically generates a meeting sequence report based on the similarity of the topics, thereby visually displaying the discussion evolution path of the topic.

[0060] In one embodiment, in a product development meeting, when a user writes "User Privacy Protection Plan" on the conference tablet, the system automatically overlays the privacy protection red line clauses determined in historical meetings, the summary of the legal department's latest compliance requirements document, and the list of unclosed tasks associated with the current topic calculated through a dynamic timeline on the AR window of the virtual information layer on the right.

[0061] The privacy protection red line clauses determined in historical meetings are extracted by the system through keyword matching and semantic analysis. The privacy protection red line clauses related to the "user privacy protection plan" are extracted from the historical meeting records and displayed in the AR window of the virtual information layer in the form of a list, which helps users quickly review the consensus and decisions reached in previous meetings and avoid repeated discussions.

[0062] The summary of the latest compliance requirements document of the legal department is integrated with the legal department document management system within the enterprise to obtain the latest compliance requirements document in real time, and extract key summary information through natural language processing technology, including the full name and abbreviation of the regulations, the effective time of the latest version of the terms, the scope of legal jurisdiction, the type of enterprises subject to constraints, the mandatory provisions at the technical implementation level, the penalty measures and the amount range. This application can help users understand the latest legal and compliance requirements that the current privacy protection plan needs to meet by displaying this summary information in a concise text form in the AR window of the virtual information layer.

[0063] The dynamic timeline is used to calculate the unclosed task list associated with the current topic. Specifically, when the task is started, a timeline is automatically generated. During the execution of the task, the actual progress is compared every day. Before the task is due, an early warning is sent to the person in charge 2 days in advance. The remaining working hours require 3 hours of overtime every day to complete it on time. The system identifies unfinished tasks related to the "User Privacy Protection Plan" and displays these tasks in the form of a list in the AR window of the virtual information layer. Each task item displays key information such as the task name, person in charge, and deadline to help users track the progress of the task and ensure that the meeting discussion can cover all unfinished task points.

[0064] In one embodiment, when the meeting discussion mentions "project delay risk", the system performs voice recognition to trigger keyword retrieval, displays a split-screen comparison chart of the differences between historical processing solutions and the current discussion content, and automatically generates a draft email of risk escalation suggestions.

[0065] The system uses voice recognition technology to monitor meeting discussions in real time. When the keyword "project delay risk" is detected, the search mechanism is automatically triggered. The system searches through multiple sources of data such as historical meeting records, project management documents, and risk databases to locate records of response measures for similar risks three months ago.

[0066] The system calculates the text similarity and performs semantic analysis on the historical processing solutions and the current discussion content to extract the differences between the two. Then, the system displays the differences in risk assessment, response measures, responsibility allocation, etc. between the historical solutions and the current discussion in a split screen in the form of a difference comparison chart, which intuitively shows the similarities and differences between the historical solutions and the current discussion, helping users quickly understand the advantages and disadvantages of different solutions.

[0067] The system automatically generates a draft email of risk upgrade suggestions based on the meeting discussion content and historical data, combined with the preset risk assessment knowledge base: historical case library, failure case library, measure efficacy library, industry standard scale, and company traffic light rules. The draft email contains a reference link to the meeting fragment, which allows the recipient to directly view the details of the relevant meeting discussion and improve the accuracy and efficiency of information transmission.

[0068] In one embodiment, the current risk score is detected to be 85 points, exceeding the company's 70-point red line. Comparing industry data, it is found that 100% of peers will escalate when encountering risks of this magnitude. Checking historical records, it is found that similar risks were not escalated half a year ago, resulting in project losses. Matching company regulations, "cross-departmental resource coordination must be approved by the director." The system automatically generates a suggestion, "According to Article 8 of the rules, it is recommended to immediately escalate to the project management office, and the procurement department and sales department need to coordinate to deal with it together."

[0069] The above is an embodiment of the method proposed in this application. Based on the same inventive concept, the embodiment of this application also provides a conference memory enhancement device for a conference tablet, the structure of which is as follows: Figure 2 shown.

[0070] Figure 2 The internal structure diagram of a conference memory enhancement device for a conference tablet provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the device includes: at least one processor; and, a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by at least one processor, and the instructions are executed by at least one processor to enable the at least one processor to: Based on the preset data collection technology, multimodal data is collected in real time, and the multimodal data is encoded into a spatiotemporal event stream according to the time sequence of the multimodal data; the multimodal data includes touch data, voice data and perception data; Recognize handwritten text on the conference tablet and extract key tags in the speech by combining it with a pre-trained natural language processing model to build a conference knowledge graph corresponding to the current meeting; Compare the conference knowledge graph with the historical conference knowledge graph to identify conflicting content and overlay a virtual information layer on the physical interface of the conference tablet; Based on the conference knowledge graph and spatiotemporal time flow, query association information corresponding to the semantic query request is queried to determine the semantic contradiction, and the historical conference evidence chain of the semantic contradiction is displayed based on the virtual information layer.

[0071] The present application also provides a non-volatile computer storage medium storing computer executable instructions. When the computer executable instructions are executed, they can: Based on the preset data collection technology, multimodal data is collected in real time, and the multimodal data is encoded into a spatiotemporal event stream according to the time sequence of the multimodal data; the multimodal data includes touch data, voice data and perception data; Recognize handwritten text on the conference tablet and extract key tags in the speech by combining it with a pre-trained natural language processing model to build a conference knowledge graph corresponding to the current meeting; Compare the conference knowledge graph with the historical conference knowledge graph to identify conflicting content and overlay a virtual information layer on the physical interface of the conference tablet; Based on the conference knowledge graph and spatiotemporal time flow, query association information corresponding to the semantic query request is queried to determine the semantic contradiction, and the historical conference evidence chain of the semantic contradiction is displayed based on the virtual information layer.

[0072] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A conference memory enhancement method for a conference tablet, characterized in that: The method comprises: Based on a preset data collection technology, multimodal data is collected in real time, and the multimodal data is encoded into a spatiotemporal event stream according to the time sequence of the multimodal data; the multimodal data includes touch data, voice data and perception data; Recognize handwritten text on the conference tablet and extract key tags in the speech by combining it with a pre-trained natural language processing model to build a conference knowledge graph corresponding to the current meeting; Comparing the conference knowledge graph with the historical conference knowledge graph, determining conflicting content, and overlaying a virtual information layer on the physical interface of the conference tablet; Based on the conference knowledge graph and the spatiotemporal time flow, query association information corresponding to the semantic query request is queried to determine the semantic contradiction, and the historical conference evidence chain of the semantic contradiction is displayed based on the virtual information layer.

2. A conference memory enhancement method for a conference tablet according to claim 1, characterized in that: Based on the preset data collection technology, multi-modal data is collected in real time, including: The writing track, note pressure and erasing operation on the conference tablet are collected in real time through the preset touch note tracking technology; the touch note tracking technology includes electromagnetic induction or capacitive touch technology; The direction of the sound source is detected through beamforming technology, and combined with the coordinate positioning of the infrared sensor, the identity of the speaker to be bound is determined, and the speaker's voice features are extracted; Comparing the voice feature with the pre-stored voiceprint template of the speaker identity to be bound, so as to complete the identity binding of the speaker when the similarity is greater than the confidence threshold, and associating and storing the bound voice segment and whiteboard operation record according to the timestamp; Through the camera and infrared sensor integrated in the conference tablet, the speaker and the speaker's corresponding gesture operations are identified, and the spatial distribution of each participant is determined.

3. A conference memory enhancement method for a conference tablet according to claim 1, characterized in that: Combined with the pre-trained natural language processing model, key tags in the speech are extracted to build the meeting knowledge graph corresponding to the current meeting, including: Using a pre-trained natural language processing model, the meeting topics and task trigger words in the speech are identified to extract the task items and the corresponding task responsible persons, and the task responsible persons are bound to the task items; Perform sentiment analysis on the speech, determine the controversial issues, meeting decisions and corresponding responsible persons in the speech, and mark the controversial issues as controversial; Construct a conference knowledge graph based on a graph neural network, and integrate the conference knowledge graph with the enterprise database; The meeting agenda, meeting decisions, responsible persons and related documents of the current meeting are embedded into corresponding nodes in the meeting knowledge graph, a dependency chain is generated, and each node is associated with the corresponding historical task node.

4. The conference memory enhancement method for a conference tablet according to claim 1, characterized in that: Compare the conference knowledge graph with the historical conference knowledge graph to determine the conflicting content, including: When the identified meeting topics, meeting decisions and task items of the current meeting are associated with the historical topics corresponding to the historical meetings, the corresponding associated content is pushed to the sidebar of the conference tablet; Perform semantic comparison between the key entities of the current meeting decision and the historical meeting decision, and calculate the difference between the current meeting decision and the historical meeting decision; the difference includes budget value, time node and responsible person allocation; When the difference exceeds a preset threshold, a conflict node is generated to mark the conflict relationship between the current meeting decision and the historical meeting decision on the conference tablet, and display the corresponding conflict content.

5. The conference memory enhancement method for a conference tablet according to claim 1, characterized in that: Based on the conference knowledge graph and the spatiotemporal time flow, query association information corresponding to the semantic query request is queried to determine the semantic contradiction, and the historical conference evidence chain of the semantic contradiction is displayed based on the virtual information layer, specifically including: Based on the intelligent retrieval interface on the conference tablet, a semantic query request is received, and based on the conference knowledge graph and spatiotemporal event flow in the enterprise database, the corresponding request association information is queried; the request association information includes the associated whiteboard screen, voice clip and task status; Determine the semantic contradiction between the discussion content of the current meeting and the historical decision according to the associated whiteboard screen, the voice clip and the task status, and display the disputed clips with semantic contradictions in a heat map on the virtual information layer; Based on the similarity of topics between the current meeting and historical meetings, a meeting sequence report is generated to visualize the knowledge evolution path.

6. A conference memory enhancement method for a conference tablet according to claim 1, characterized in that: Superimposing a virtual information layer on the physical interface of the conference tablet specifically includes: Through the built-in projection or external virtual device of the conference tablet, a virtual information layer is superimposed on the physical interface of the conference tablet, and the relevant content of the historical meeting is highlighted through the virtual information layer; Acquire the task status indication in the current meeting in real time, and visualize the task status indication in the virtual information layer; the task status indication includes task completion degree, approval status and overdue mark; The entire version change history of the whiteboard content is recorded on the virtual information layer, and the entire version change history can be slid back according to the time axis.

7. A conference memory enhancement method for a conference tablet according to claim 1, characterized in that: Before comparing the conference knowledge graph with the historical conference knowledge graph to determine conflicting content, the method further includes: Map the meeting responsible person to the corresponding employee ID in the employee data table in the enterprise database to perform entity alignment; The meeting decision dependencies are associated with the financial budget table and the project schedule, and the current decision is compared with the constraints of the enterprise database to generate corresponding risk path prompts.

8. The conference memory enhancement method for a conference tablet according to claim 1, characterized in that: After constructing the conference knowledge graph corresponding to the current conference, the method further includes: Analyze the responsible persons, deadlines and dependencies in the task items of the current meeting, and associate the task items with the corresponding whiteboard images and voice clips; The task ID of the project management in the associated enterprise database is used to generate a clickable hyperlink to jump to the task details, and the clickable hyperlink is embedded in the meeting minutes document.

9. A conference memory enhancement device for a conference tablet, characterized in that: The device comprises: at least one processor; and, a memory communicatively coupled to the at least one processor; The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute a conference memory enhancement method for a conference tablet as described in any one of claims 1-8.

10. A non-volatile computer storage medium storing computer executable instructions, characterized in that: When the computer executable instructions are executed, a conference memory enhancement method for a conference tablet as described in any one of claims 1 to 8 is implemented.

Images