Page turning control method, system and equipment for electronic whiteboard and storage medium

Abstract

The invention provides a page turning control method, system and device for an electronic whiteboard and a storage medium, and the method comprises the steps: obtaining multi-modal data in an explanation process, positioning a current explanation area on a current page according to the multi-modal data, and carrying out the focusing display of the current explanation area; calculating the explanation progress of the current page according to the current explanation area, and pre-loading the content of the next page in advance under the condition that the explanation progress reaches a preset threshold value; and when it is determined that explanation of the current page is completed based on the explanation progress, automatically skipping to the next page and calling the loaded content of the next page for display. Whether the preloading operation is triggered or not can be determined according to the explanation progress, content loading delay can be avoided through the preloading operation, page turning fluency is ensured, and waste of system resources is avoided.

Description

Technical Field

[0001] This invention relates to the field of intelligent control technology for electronic whiteboards, and in particular to a page-turning control method, system, device, and storage medium for electronic whiteboards. Background Technology

[0002] In traditional presentation scenarios, page-turning often causes noticeable interactive lag. The main reason for this lag is the delay in loading file content. When the speaker triggers a page turn, the system only begins loading high-definition charts, complex animations, or video materials for the next page. This loading delay prevents the next page's content from displaying in a timely manner. Moreover, traditional page-turning controls only start loading after a page-turning click is detected, lacking a mechanism to predict when page turns will occur. This creates an unavoidable waiting window, becoming a core pain point affecting the smoothness of the presentation. Summary of the Invention

[0003] This invention provides a page-turning control method, system, device, and storage medium for an electronic whiteboard to solve the problems existing in related technologies. The technical solution is as follows:

[0004] In a first aspect, embodiments of the present invention provide a page-turning control method for an electronic whiteboard, comprising:

[0005] Acquire multimodal data during the explanation process, locate the current explanation area on the current page based on the multimodal data, and focus on display the current explanation area;

[0006] The explanation progress of the current page is calculated based on the current explanation area, and the content of the next page is preloaded in advance when the explanation progress reaches a preset threshold.

[0007] When the explanation progress determines that the current page has been completed, the system will automatically redirect to the next page and display the already loaded content.

[0008] In one implementation, it further includes:

[0009] The preloaded content of the next page is stored in the local temporary file of the electronic whiteboard; the content of the next page is only retained in the local temporary file for a preset time.

[0010] Automatically clear all contents in local temporary files when the presentation ends.

[0011] In one implementation, it further includes:

[0012] Extract keywords from the preloaded next page content to determine the core keywords for the next page content;

[0013] Display the core keywords for the next page in a pop-up window of a specified size.

[0014] In one implementation, locating the current explanation area on the current page based on multimodal data includes:

[0015] Acquire audio data, extract keywords from the audio data, find the target page element that matches the keywords on the current page, determine the preliminary explanation area based on the target page element, and focus on display the preliminary explanation area;

[0016] The system acquires the pen's handwriting coordinates within a specified timeframe for focusing on the initial explanation area, and calibrates the initial explanation area based on these coordinates to redefine the current explanation area.

[0017] In one implementation, it further includes:

[0018] When preloading the content of the next page, determine whether there are related tags in the content of the next page;

[0019] If the next page contains related tags, the content of the specified page bound to the related tags will be preloaded.

[0020] In one implementation, it further includes:

[0021] Define the specified page associated with the next page content through custom settings;

[0022] Generate corresponding related tags based on the specified page, and mark the related tags on the next page content.

[0023] In one implementation, calculating the explanation progress of the current page based on the current explanation area includes:

[0024] Get the coordinates of the current explanation area, and calculate the vertical position of the center point of the current explanation area based on the coordinates;

[0025] Get the total height of the page, and calculate the current narration progress based on the vertical position of the center point of the current narration area and the total height of the page.

[0026] Secondly, embodiments of the present invention provide a page-turning control system for an electronic whiteboard, comprising:

[0027] The progress analysis module is used to acquire multimodal data during the explanation process, locate the current explanation area on the current page based on the multimodal data, and focus on display the current explanation area.

[0028] The preloading module is used to calculate the explanation progress of the current page based on the current explanation area, and preload the content of the next page in advance when the explanation progress reaches a preset threshold.

[0029] The page display module automatically redirects to the next page and displays the already loaded content when it determines that the current page has been explained based on the progress of the explanation.

[0030] Thirdly, embodiments of the present invention provide an electronic device comprising a memory and a processor. The memory and the processor communicate with each other via an internal connection path. The memory stores instructions, and the processor executes the instructions stored in the memory. When the processor executes the instructions stored in the memory, it causes the processor to perform the method described in any of the above embodiments.

[0031] Fourthly, embodiments of the present invention provide a computer-readable storage medium that stores a computer program, wherein when the computer program is run on a computer, the methods in any of the embodiments described above are executed.

[0032] The advantages or beneficial effects of the above technical solutions include at least the following:

[0033] This invention determines the current narration progress based on multimodal data, preloads the content for the next page according to the current progress, and automatically jumps to the next page and displays the preloaded content when the current page has been completed. This invention precisely triggers the preloading operation at the appropriate time, avoiding content loading delays, ensuring smooth page turning, and preventing waste of system resources.

[0034] The above overview is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features of the invention will become readily apparent from the accompanying drawings and the following detailed description. Attached Figure Description

[0035] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the various drawings denote the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings depict only some embodiments disclosed in the invention and should not be construed as limiting the scope of the invention.

[0036] Figure 1 This is a flowchart illustrating the page-turning control method for the electronic whiteboard of the present invention.

[0037] Figure 2 This is a structural block diagram of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0038] In the following description, only certain exemplary embodiments are briefly described. As those skilled in the art will recognize, the described embodiments can be modified in various ways without departing from the spirit or scope of the invention. Therefore, the drawings and description are considered to be exemplary in nature and not restrictive.

[0039] Example 1

[0040] In traditional presentation scenarios, page-turning often causes noticeable interactive lag, mainly due to three technical bottlenecks:

[0041] 1. Content loading delay: The system only begins loading high-definition charts, complex animations, or video footage for the next page when the speaker triggers a page turn. For large files (such as a 50MB 4K presentation), even with 5G / WiFi 6, a loading time of 500ms-2s is still required.

[0042] 2. Rendering performance bottleneck: After page turning, the device needs to re-parse the layout and execute scripts (such as dynamic chart initialization), causing a sudden surge in CPU / GPU load. Tests show that rendering complex PPT pages can consume 80% of the mobile device's GPU resources, causing the frame rate to plummet to below 20fps.

[0043] 3. Lack of predictive mechanism: Traditional solutions cannot accurately predict page-turning timing. 95% of presentation systems only start loading after detecting a page-turning click, creating an unavoidable waiting window. Microsoft research shows that a delay of over 700ms increases audience attention loss by 47%.

[0044] This sequential processing model of "click → load → render" has become a core pain point affecting the fluency of a presentation. Especially in cross-device screen sharing scenarios, multi-level transmission protocols (such as HDCP encryption and Miracast codec) further amplify latency, causing negative impacts such as interrupted presentation rhythm and reduced professionalism.

[0045] To address this issue, this embodiment provides a page-turning control method for an electronic whiteboard, which precisely triggers a pre-loading operation at the appropriate time, ensuring smooth page turning while avoiding resource waste. For example... Figure 1 As shown, the page-turning control method in this embodiment specifically includes:

[0046] Step S1: Obtain multimodal data during the explanation process, locate the current explanation area on the current page based on the multimodal data, and focus on display the current explanation area.

[0047] In this embodiment, the multimodal data includes audio data and the handwriting coordinates of the smart pen. The user can record speech through a microphone, and during the speech, the smart pen emits infrared light. The electronic whiteboard captures the infrared light to determine the coordinates of the infrared light falling on the electronic whiteboard screen, which are also called handwriting coordinates.

[0048] This embodiment uses a method to locate the currently explained area on the current page based on multimodal data, including:

[0049] Step S11: Obtain audio data, extract keywords from the audio data, find the target page element that matches the keywords on the current page, determine the preliminary explanation area based on the target page element, and focus on display the preliminary explanation area.

[0050] This embodiment converts audio data into text in real time and extracts keywords related to location and content from the text, such as location keywords like "top left corner," "right side," and "bottom," as in "..." Figure 1 Keywords related to page elements, such as "Conclusion Section" and "Sales Data Bar Chart".

[0051] When loading the current page, parse all locatable elements on the current page, including text paragraphs (position coordinates and content), charts (position coordinates and titles), tables (position coordinates and titles), images (position coordinates and alt text), etc.

[0052] Semantic similarity (such as BERT-based text similarity) is used to match keywords extracted from the text with the content of elements on the current page. Page elements with similarity scores higher than a threshold are identified as target page elements, and their position coordinates on the current page are recorded. For example, if the keyword is "sales data bar chart," and there is a bar chart on the current page titled "Q3 sales revenue," the similarity is calculated. If it exceeds the threshold, a match is made, and the bar chart titled "Q3 sales revenue" is identified as the target page element. The position coordinates of the target page element on the current page are recorded, thus determining the initial explanation area and focusing the display on that area.

[0053] It should be noted that the position coordinates of the target page element on the current page refer to the coordinates of the outer contour of the target page element on the current page; if the target page element is a bar chart, the outer contour range of the bar chart is determined as the initial explanation area; if the target page element is text, the paragraph containing the text is determined as the initial explanation area.

[0054] If the number of areas to be initially explained is unique, then the area to be initially explained can be directly determined as the current area to be explained.

[0055] Assuming there are multiple preliminary explanation areas, where the similarity between multiple page elements and keywords extracted from the text is greater than a threshold, each preliminary explanation area is highlighted on the current page. Subsequently, the user selects one of the multiple preliminary explanation areas using a smart pen to obtain the final current explanation area.

[0056] Step S12: Obtain the pen stroke coordinates within a specified time for focusing display in the initial explanation area, and calibrate the initial explanation area based on the pen stroke coordinates to redetermine the current explanation area.

[0057] In this embodiment, the user selects one of several preliminary explanation areas using a smart pen to determine the current explanation area. This selection must be made within a specified time after the area is focused. For example, within five seconds of selecting and focusing the preliminary explanation area, the user can use the smart pen to calibrate the explanation area. If more than five seconds have passed, assuming the preliminary explanation area has been focused for five minutes before the user uses the smart pen again, the smart pen will be unable to perform the explanation area calibration.

[0058] If the electronic whiteboard does not receive the infrared light signal from the smart pen within the specified time, and the number of preliminary explanation areas is not unique, then the preliminary explanation area at the bottom of the current page will be used as the current explanation area by default. This will be used to calculate the subsequent explanation progress and ensure that the content of the next page can be preloaded in advance.

[0059] Users can emit infrared light from a smart pen onto an electronic whiteboard. The electronic whiteboard captures the infrared light through infrared receivers installed at the four corners of its frame, and uses a triangulation algorithm to determine the landing point of the infrared light on the electronic whiteboard, thereby determining the coordinates of the smart pen's strokes.

[0060] When the handwriting coordinates fall within the range of any preliminary explanation area, it is equivalent to selecting that preliminary explanation area as the current explanation area. The focus display effect of the current explanation area is maintained, while the focus effect of other unselected preliminary explanation areas disappears.

[0061] Assuming the note coordinates do not fall within any of the initial explanation areas, the page element pointed to by the handwriting coordinates is redefined as the current explanation area, and the focus display effect of all initial explanation areas disappears.

[0062] In this embodiment, the user can select or redefine the lecturing area using a smart pen, making the current lecturing area more closely match the user's presentation.

[0063] It should be noted that the current area to be explained can also be selected or redefined through gesture recognition or eye tracking. The specific methods of gesture recognition and eye tracking will not be described in detail here.

[0064] Step S2: Calculate the explanation progress of the current page based on the current explanation area, and preload the content of the next page in advance when the explanation progress reaches the preset threshold.

[0065] After determining the current area to be explained, the explanation progress of the current page is calculated based on the current area. The specific method is as follows:

[0066] Obtain the coordinates of the current explanation area, and calculate the vertical position of the center point of the current explanation area based on the coordinates of the current explanation area; assuming that the current explanation area is a text paragraph, generate a square box outside the text paragraph, calculate the coordinates of the center point of the square box, and use the Y-axis coordinate of the center point coordinate to represent the vertical position of the center point of the current explanation area.

[0067] The total height of the current page is obtained, and the explanation progress of the current page is calculated based on the vertical position of the center point of the current explanation area and the total page height. In this embodiment, the bottom left corner of the current page is taken as the origin, and the Y-axis is positive upwards. At this time, the explanation progress = (1 - vertical coordinate of the center point / total page height) * 100%.

[0068] If the explanation progress is less than the preset threshold, then repeat steps S1 and S2 to continue to locate the current explanation area and calculate the explanation progress based on the multimodal data, until the explanation progress is greater than or equal to the preset threshold.

[0069] When the progress of the explanation is greater than or equal to the preset threshold, the content of the next page can be obtained in advance and preloaded.

[0070] In this embodiment, a local storage space is deployed on the electronic whiteboard, and the pre-loaded content of the next page is stored in a local temporary file within the electronic whiteboard's local storage space. The content of the next page stored in the local temporary file is only retained for a preset time. After the preset time has elapsed, the content is deleted, and all content in the local temporary file is automatically cleared when the presentation is completely finished, freeing up space in the local temporary file for the next presentation.

[0071] When the presentation progress reaches a threshold, the next page's content is preloaded and stored in local storage. At this point, it is determined whether there are any related tags in the next page's content. If related tags exist, the corresponding page is identified based on these tags, and its content is also preloaded.

[0072] Among them, the associated tags can be pre-defined. Users can pre-set a specified page associated with the next page content, generate corresponding associated tags based on the page number and page content of the specified page, and mark the associated tags on the next page content.

[0073] Further semantic analysis is performed on the preloaded next page content to determine the core keywords of the next page content. A pop-up window of a specified size is displayed in the blank space of the current page or in a specified position to display the core keywords of the next page, which can prompt the user about the content to be presented on the next page.

[0074] Step S3: When it is determined that the current page has been explained based on the progress of the explanation, automatically jump to the next page and display the loaded content of the next page.

[0075] During the user's presentation, the system continuously calculates the presentation progress. Once the content on the current page has been presented, the system automatically redirects to the next page and displays the pre-loaded content, reducing loading delays.

[0076] Example 2

[0077] This embodiment provides a page-turning control system for an electronic whiteboard. This system executes the page-turning control method for the electronic whiteboard as described in Embodiment 1. The system specifically includes:

[0078] The progress analysis module is used to acquire multimodal data during the explanation process, locate the current explanation area on the current page based on the multimodal data, and focus on display the current explanation area.

[0079] The preloading module is used to calculate the explanation progress of the current page based on the current explanation area, and preload the content of the next page in advance when the explanation progress reaches a preset threshold.

[0080] The page display module automatically redirects to the next page and displays the already loaded content when it determines that the current page has been explained based on the progress of the explanation.

[0081] This embodiment determines the current narration progress based on multimodal data, preloads the content for the next page according to the current narration progress, and automatically jumps to the next page and displays the preloaded content when it is determined that the current page has been narrated. This invention precisely triggers the preloading operation at the appropriate time, which can avoid content loading delays, ensuring smooth page turning and avoiding waste of system resources.

[0082] The functions of each module in this embodiment system can be found in the corresponding descriptions in the above methods, and will not be repeated here.

[0083] Example 3

[0084] This embodiment provides an electronic device. Figure 2 A structural block diagram of an electronic device according to an embodiment of the present invention is shown. Figure 2As shown, the electronic device includes a memory 100 and a processor 200. The memory 100 stores a computer program that can run on the processor 200. When the processor 200 executes the computer program, it implements the page-turning control method for the electronic whiteboard in the above embodiment. The number of memories 100 and processors 200 can be one or more.

[0085] The electronic device also includes:

[0086] The communication interface 300 is used to communicate with external devices and perform data exchange and transmission.

[0087] If the memory 100, processor 200, and communication interface 300 are implemented independently, they can be interconnected via a bus to communicate with each other. This bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. This bus can be divided into an address bus, a data bus, a control bus, etc.

[0088] Optionally, in a specific implementation, if the memory 100, processor 200, and communication interface 300 are integrated on a single chip, then the memory 100, processor 200, and communication interface 300 can communicate with each other through an internal interface.

[0089] This invention provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method provided in this invention.

[0090] This invention also provides a chip, which includes a processor for calling and executing instructions stored in a memory, causing a communication device on which the chip is installed to perform the method provided in this invention.

[0091] This invention also provides a chip, including: an input interface, an output interface, a processor, and a memory. The input interface, output interface, processor, and memory are connected through an internal connection path. The processor is used to execute code in the memory. When the code is executed, the processor is used to execute the method provided in this invention.

[0092] It should be understood that the aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. General-purpose processors can be microprocessors or any conventional processor. It is worth noting that the processor can be a processor supporting the Advanced Reduced Instruction Set Computing (RISC) machine (ARM) architecture.

[0093] Further, optionally, the aforementioned memory may include read-only memory and random access memory, and may also include non-volatile random access memory. The memory may be volatile or non-volatile, or may include both. Non-volatile memory may include read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory may include random access memory (RAM), which serves as an external cache. Many forms of RAM are available by way of example, but not limitation. Examples include static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0094] In the above embodiments, implementation can be achieved, in whole or in part, by software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the present invention is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another.

[0095] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of those different embodiments or examples.

[0096] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0097] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various variations or substitutions within the technical scope disclosed in the present invention, and these should all be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A page-turning control method for an electronic whiteboard, characterized in that, include: Acquire multimodal data during the explanation process, locate the current explanation area on the current page based on the multimodal data, and focus on display the current explanation area; The explanation progress of the current page is calculated based on the current explanation area, and the content of the next page is preloaded in advance when the explanation progress reaches a preset threshold. When the current page has been completed based on the explanation progress, the system will automatically redirect to the next page and display the already loaded content.

2. The page-turning control method for an electronic whiteboard according to claim 1, characterized in that, Also includes: The preloaded content of the next page is stored in the local temporary file of the electronic whiteboard; the content of the next page is only retained in the local temporary file for a preset time. Automatically clear all contents of the local temporary file when the presentation ends.

3. The page-turning control method for an electronic whiteboard according to claim 1, characterized in that, Also includes: Extract keywords from the preloaded next page content to determine the core keywords for the next page content; Display the core keywords for the next page in a pop-up window of a specified size.

4. The page-turning control method for an electronic whiteboard according to claim 1, characterized in that, The step of locating the current explanation area on the current page based on the multimodal data includes: Acquire audio data, extract keywords from the audio data, find target page elements that match the keywords on the current page, determine the preliminary explanation area based on the target page elements, and focus on display the preliminary explanation area; The pen's handwriting coordinates are acquired within a specified time period during which the initial explanation area is focused and displayed. The initial explanation area is then calibrated based on the handwriting coordinates to redetermine the current explanation area.

5. The page-turning control method for an electronic whiteboard according to claim 1, characterized in that, Also includes: When preloading the content of the next page, determine whether there are related tags in the content of the next page; If a related tag exists in the content of the next page, the content of the specified page bound to the related tag will be preloaded.

6. The page-turning control method for an electronic whiteboard according to claim 5, characterized in that, Also includes: Define the specified page associated with the next page content through custom settings; Generate corresponding related tags based on the specified page, and mark the related tags on the next page content.

7. The page-turning control method for an electronic whiteboard according to claim 1, characterized in that, The step of calculating the explanation progress of the current page based on the current explanation area includes: Obtain the coordinates of the current explanation area, and calculate the vertical position of the center point of the current explanation area based on the coordinates; Obtain the total height of the page, and calculate the current page's explanation progress based on the vertical position of the center point of the current explanation area and the total page height.

8. A page-turning control system for an electronic whiteboard, characterized in that, include: The progress analysis module is used to acquire multimodal data during the explanation process, locate the current explanation area on the current page based on the multimodal data, and focus on display the current explanation area. The preloading module is used to calculate the explanation progress of the current page based on the current explanation area, and preload the content of the next page in advance when the explanation progress reaches a preset threshold. The page display module automatically jumps to the next page and displays the already loaded content when it determines that the current page has been explained based on the explanation progress.

9. An electronic device, characterized in that, include: A processor and a memory, wherein the memory stores instructions that are loaded and executed by the processor to implement the page-turning control method for the electronic whiteboard as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the page-turning control method for the electronic whiteboard as described in any one of claims 1 to 7.

Images