Focus display method, system and equipment of electronic whiteboard and storage medium

By combining voice recognition and infrared pen, the intelligent automatic focus display of the electronic whiteboard is realized, which solves the problem of cumbersome manual operation in the existing technology and improves user experience and interactivity.

CN120610677APending Publication Date: 2025-09-09GUANGZHOU LANGO ELECTRONICS TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202510731962.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-06-03
Publication Date
2025-09-09

AI Technical Summary

Technical Problem

Existing electronic whiteboard content focus display relies on manual annotation by users, which is cumbersome and inefficient. It is difficult to meet the flexible usage needs in diverse teaching or meeting scenarios, and is highly dependent on manual operation, affecting interactivity and continuity.

Method used

Through voice recognition technology, keywords in real-time voice are acquired, semantic analysis is performed and matched with the electronic whiteboard display elements, content matching the keywords is automatically located and highlighted, and the focus object is adjusted with the infrared pen to achieve intelligent focus display without manual operation.

Benefits of technology

It simplifies the operating process, improves the interactivity and ease of use of the electronic whiteboard, enhances the user experience, and achieves more intelligent and efficient content-focused display.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120610677A_ABST
    Figure CN120610677A_ABST
Patent Text Reader

Abstract

The invention provides a focusing display method, system and device for an electronic whiteboard and a storage medium, and the method comprises the steps: obtaining real-time voice, and determining a first keyword in the real-time voice through semantic analysis; performing semantic matching on the first keyword and all display elements in the electronic whiteboard, and when the first keyword is in semantic matching with any display element, marking the matched display element as a first focusing object; positioning a position coordinate of the first focusing object in a bottom layer of the electronic whiteboard, mapping the position coordinate to a top layer of the electronic whiteboard, and determining a focusing area, directly facing the first focusing object, on the top layer; and performing focusing display processing on the focusing area in the top layer based on a preset rule to obtain a highlight identifier for highlighting the first focusing object. According to the invention, the operation difficulty can be simplified, the efficiency can be improved, and the interactivity and the use convenience of the electronic whiteboard can be greatly improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of electronic whiteboard display processing, and in particular to a focused display method, system, device and storage medium of an electronic whiteboard. Background Art

[0002] In existing electronic whiteboard applications, content focus display usually relies on users to manually mark specific areas to achieve highlighting or magnified display of the content in that area. This operation method requires users to interact in front of the electronic whiteboard in person, which limits their range of activities and makes it difficult to meet the flexible use needs in diverse teaching or conference scenarios. In addition, users are required to constantly manually mark and adjust according to the progress of the speech or explanation. The operation is cumbersome and inefficient, and it is easy to interrupt the rhythm of the explanation and affect the coherence and interactivity of the overall presentation. Therefore, the existing focus display method has problems such as strong dependence on manual operation, lack of intelligent interaction, and poor convenience of use. There is an urgent need for a more automated and intelligent content focus method to improve the user experience and practicality of electronic whiteboards in actual applications. Summary of the Invention

[0003] The embodiments of the present invention provide a focus display method, system, device, and storage medium for an electronic whiteboard to solve the problems existing in related technologies. The technical solutions are as follows:

[0004] In a first aspect, an embodiment of the present invention provides a focus display method for an electronic whiteboard, comprising:

[0005] Acquire real-time speech and determine the first keyword in the real-time speech through semantic analysis;

[0006] Performing semantic matching between the first keyword and all display elements in the electronic whiteboard, and when the first keyword matches any display element, marking the matched display element as a first focus object;

[0007] Locating the position coordinates of the first focused object in the bottom layer of the electronic whiteboard, mapping the position coordinates to the top layer of the electronic whiteboard, and determining a focus area on the top layer that is directly opposite to the first focused object;

[0008] Based on preset rules, a focus display process is performed on the focus area in the top layer to obtain a highlight mark for highlighting the first focus object.

[0009] In one embodiment, it further includes:

[0010] Differentiating the elements of the display page of the electronic whiteboard to obtain each display element on the electronic whiteboard, where the display element is an image, a text paragraph or an icon;

[0011] When the display element is an image, the content of the image is understood based on the pre-trained model to obtain semantic information corresponding to the image; the semantic information is used to perform semantic similarity matching with the first keyword.

[0012] In one embodiment, it further includes:

[0013] When there are multiple display elements on the display page of the electronic whiteboard that match the first keyword, determining a second keyword in the real-time speech through semantic analysis; wherein the keyword time interval between the second keyword and the first keyword remains within a set threshold;

[0014] The first keyword, the second keyword and each display element of the electronic whiteboard are matched for semantic similarity. When the semantics between the first keyword, the second keyword and one of the display elements match, the matched display element is marked as a first focus object.

[0015] In one embodiment, determining a focus area on the top layer directly facing the first focus object includes:

[0016] determining a boundary size of the first focused object according to the position coordinates;

[0017] Generate a coverage area facing the first focused object on the top layer according to the boundary size.

[0018] In one embodiment, performing focused display processing on the focused area of ​​the top layer based on a preset rule includes:

[0019] Generate a coverage border at the boundary position of the coverage area;

[0020] The border color of the covering border is highlighted to obtain a highlighted mark that completely surrounds the first focused object.

[0021] In one embodiment, it further includes:

[0022] When the infrared beam is received, the highlight mark corresponding to the first focused object in the top layer is removed, and the coordinate position where the infrared beam contacts the electronic white screen is determined;

[0023] determining the display element pointed by the infrared beam according to the coordinate position where the infrared beam contacts the electronic white screen, and taking the display element pointed by the infrared beam as the second focusing object;

[0024] Based on preset rules, the second focused object in the top layer is subjected to focus display processing to obtain a highlight mark for highlighting the second focused object.

[0025] In one embodiment, it further includes:

[0026] When the infrared beam is not received for a continuous preset time, the highlight mark of the second focused object is eliminated, and the real-time voice is continuously monitored to generate the highlight mark of the first focused object by analyzing the real-time voice.

[0027] In a second aspect, an embodiment of the present invention provides a focus display system for an electronic whiteboard, which executes the focus display method for an electronic whiteboard as described above; the system includes:

[0028] A speech analysis module is used to obtain real-time speech and determine the first keyword in the real-time speech through semantic analysis;

[0029] a semantic matching module, configured to perform semantic matching between the first keyword and all display elements in the electronic whiteboard, and when the first keyword matches any display element, mark the matched display element as a first focused object;

[0030] a layer mapping module, configured to locate the position coordinates of the first focused object in the bottom layer of the electronic whiteboard, map the position coordinates to the top layer of the electronic whiteboard, and determine a focus area on the top layer that is directly opposite to the first focused object;

[0031] The focus display module performs focus display processing on the focus area in the top layer based on preset rules to obtain a highlight mark for highlighting the first focus object.

[0032] In a third aspect, embodiments of the present invention provide an electronic device comprising: a memory and a processor. The memory and the processor communicate with each other via an internal connection path, the memory is configured to store instructions, and the processor is configured to execute the instructions stored in the memory. When the processor executes the instructions stored in the memory, the processor performs the method according to any of the aforementioned embodiments.

[0033] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the method in any one of the above-mentioned embodiments is executed.

[0034] The advantages or beneficial effects of the above technical solution include at least:

[0035] The present invention uses speech recognition technology to determine the content being described by the user, and accurately locates the focus object corresponding to the user's verbal description in the bottom layer of the electronic whiteboard, and automatically focuses on and displays the focus object on the top layer, simplifying the operation process, improving efficiency, and greatly enhancing the interactivity and ease of use of the electronic whiteboard.

[0036] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present invention will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the multiple drawings represent the same or similar components or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings only depict some embodiments disclosed herein and should not be construed as limiting the scope of the invention.

[0038] Figure 1 Schematic diagram of the flow of the focus display method of the electronic whiteboard of the present invention;

[0039] Figure 2 FIG. 1 is a structural block diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0040] Hereinafter, only certain exemplary embodiments are briefly described. As will be appreciated by those skilled in the art, the described embodiments may be modified in various ways without departing from the spirit or scope of the present invention. Therefore, the drawings and description are to be considered as illustrative in nature and not restrictive.

[0041] Example 1

[0042] This embodiment provides a focus display method for an electronic whiteboard. The automatic focus display function based on voice recognition solves the limitations and inconveniences of the traditional manual annotation display method, and provides users with a more intelligent and efficient solution.

[0043] like Figure 1 As shown, the focus display method of the electronic whiteboard specifically includes the following steps:

[0044] Step S1: Acquire real-time speech and determine the first keyword in the real-time speech through semantic analysis.

[0045] When the electronic whiteboard is displaying content, the user can speak about the content displayed on the electronic whiteboard through a microphone or other device. During this period, the microphone or other device will record the user's real-time voice and perform semantic analysis on the real-time voice.

[0046] In this embodiment, the collected real-time speech signal is converted into text information through speech recognition technology (such as ASR, Automatic Speech Recognition) to obtain original text content that can be used for semantic analysis and processing.

[0047] Clean and standardize the recognized text content, including removing invalid words or filler words (such as "um", "ah", etc.), word segmentation (splitting continuous sentences into meaningful word units), and词性标注 (identifying the词性 of nouns, verbs, adjectives, etc. to assist in subsequent semantic judgment), etc.

[0048] Based on word segmentation and词性标注, combined with natural language processing (NLP) technology, conduct semantic-level analysis, mainly including:

[0049] Dependency syntax analysis: Identify the grammatical relationships between words in a sentence and find key components such as the subject, predicate, and object.

[0050] Named entity recognition (NER): Identify entity words such as person names, place names, times, events, etc. with clear referential meanings.

[0051] Keyword extraction algorithm: Use algorithm models such as TF-IDF, TextRank, BERT, etc. to evaluate the importance of each word in the entire sentence.

[0052] Context analysis: Combine the current presentation scenario (such as teaching, meeting, demonstration, etc.) and historical conversation content to further optimize the keyword judgment logic.

[0053] After that, calculate the semantic weights of the extracted candidate keywords to obtain the corresponding weight values. The comprehensive consideration factors for weights include frequency of occurrence, syntactic position (such as whether it is the subject or object), whether it is a named entity, whether it is the core expression of an action or object, and whether it is relevant to the current displayed content, etc.

[0054] Sort the keywords in the text content according to the weight values and finally determine the first keyword.

[0055] Step S2: Perform semantic matching between the first keyword and all display elements on the electronic whiteboard. When the first keyword matches any display element, mark the matching display element as the first focus object.

[0056] The operating system or dedicated software of the electronic whiteboard usually maintains a content layer in the background. This content layer records all currently displayed information, including display elements such as text, images, charts, etc. and the positions of each display element on the display page. When the user performs addition, deletion, or modification operations, these changes are updated to the content layer in real time.

[0057] It should be noted that the term "词性标注" in Chinese is not accurately translated here as there is no exact English equivalent provided in the original text. It should be replaced with the correct English term if available.The content layer is read to distinguish the elements of the content displayed on the current display page of the electronic whiteboard. When the display element is text, it is segmented according to the text's topic transitions, logical step divisions or natural pause points, and a continuous text is divided into multiple text paragraphs, which are then focused and displayed in the form of text paragraphs.

[0058] When the display element is an image, the image's content is understood based on a pre-trained model to obtain the corresponding semantic information. Pre-training the model requires the collection of an image dataset containing millions or even billions of images, each with detailed label information. A convolutional neural network is selected to learn and train the image dataset. After training, the pre-trained model can identify objects (such as people, cars, and trees) in the image, as well as understand the relationships between these objects, the context of the scene, and the overall meaning conveyed by the image.

[0059] When the display elements are icons, computer vision and natural language processing techniques are used to understand the content of the chart and the meaning behind it. This analysis involves not only identifying the elements in the chart (such as titles, axis labels, data points, etc.), but also understanding the relationship between these elements and the information the chart is trying to convey.

[0060] This embodiment reads the display elements currently displayed on the electronic whiteboard and semantically matches the first keyword obtained by semantic analysis with all the display elements currently displayed. That is, the core vocabulary (i.e., the first keyword) extracted from the real-time voice is intelligently compared with the text, image, chart and other content elements currently displayed on the electronic whiteboard, so as to find the most relevant or most matching display element and mark it as the first focus object.

[0061] For example, if the first keyword is "glasses", the text paragraph containing the word "glasses" in the electronic whiteboard is determined as the first focus object. If an image of "glasses" is displayed on the electronic whiteboard, the image is used as the first focus object.

[0062] Furthermore, assuming that there are multiple display elements on the display page of the electronic whiteboard that match the first keyword, the second keyword is extracted from the real-time speech through semantic analysis. The extraction method of the second keyword can be the same as the extraction method of the first keyword. At the same time, the keyword positioning time when the first keyword appears in the real-time speech is recorded, the keyword positioning time when the second keyword appears in the real-time speech is determined, and the difference between the keyword positioning time of the first keyword and the keyword positioning time of the second keyword is calculated to obtain the keyword time interval. This embodiment needs to ensure that the keyword time interval remains within the set threshold (such as 1 to 2 seconds) to ensure the correlation between the first keyword and the second keyword, so that the two keywords belong to the same semantic unit or topic focus.

[0063] Afterwards, each display element in the electronic whiteboard is searched, and the first keyword, the second keyword and each display element of the electronic whiteboard are matched for semantic similarity; assuming that a display element is a text paragraph, and the text paragraph contains the first keyword and the second keyword, the text is updated to the first focus object; assuming that a display element is an image, and the object contained in the image, or the meaning expressed by the image matches the first keyword and the second keyword, the image is updated to the first focus object.

[0064] The purpose of determining the first focus object in this embodiment is to find the display element on the electronic whiteboard that has the highest degree of matching with the content expressed by the real-time voice, so as to facilitate subsequent focus display processing of the display element.

[0065] Step S3: Locate the position coordinates of the first focused object in the bottom layer of the electronic whiteboard, map the position coordinates to the top layer of the electronic whiteboard, and determine the focus area on the top layer facing the first focused object.

[0066] The boundary size of the first focused object is determined according to the position coordinates, and a coverage area corresponding to the boundary size is generated on the top layer of the electronic whiteboard, so that the coverage area on the top layer faces the first focused object on the bottom layer.

[0067] It should be noted that the transparency of the top layer is zero to avoid blocking the content displayed by the bottom layer. The transparency of the overlay area on the top layer is also zero to avoid blocking the first focused object.

[0068] When the first focused object is a text paragraph, the position coordinates of the text paragraph in the bottom layer are located, and a coverage area that matches the boundary size of the text paragraph is generated based on the position coordinates (the coverage area is presented as a horizontal box shape that matches the distribution of the text paragraph); when the first focused object is an image, the position coordinates of the image in the bottom layer are located, and a coverage area that matches the boundary size of the image is generated based on the position coordinates (the coverage area is presented as a vertical box shape that matches the image size).

[0069] Step S4: performing focus display processing on the focus area in the top layer based on preset rules to obtain a highlight mark for highlighting the first focus object.

[0070] In this embodiment, a cover border is generated at the boundary of the coverage area of ​​the top layer and the color of the cover border is highlighted to obtain a highlighted mark that completely surrounds the first focused object. The highlighting process can be to change the border color to a bright color, such as red or yellow, or to make the border flash at a certain frequency to attract the user's attention.

[0071] In addition, the overlay border can be enlarged according to a preset ratio, and the first focused object within the overlay border can be enlarged to make the first focused object more clearly visible; even a shadow can be added to the first focused object within the overlay border to make it look like it is floating above the page, increasing the three-dimensional and layered feeling.

[0072] Alternatively, the transparency of the area outside the coverage area in the top layer may be changed to blur the area outside the coverage area, while keeping the content within the coverage area clear, allowing the user to focus more.

[0073] It should be noted that the focus display processing method can be set in advance, and after setting, preset rules are formed, so that in the actual process, the corresponding focus display processing can be directly executed according to the preset rules to achieve the effect of highlighting the first focus object.

[0074] Furthermore, in addition to focusing on the relevant display content through voice recognition, the infrared light beam emitted by the infrared pen can also be used to adjust the focus object. Specifically:

[0075] The user uses an infrared pen to emit an infrared beam toward the electronic whiteboard. Multiple infrared receiving sensors distributed along the whiteboard's frame or surface distinguish between ambient light and the specific wavelength of infrared light emitted by the pen. When the infrared beam from the pen hits the electronic whiteboard, part of it directly reaches a nearby infrared receiving sensor or is reflected before reaching a sensor. The sensor then converts the received light signal into an electrical signal. By knowing the distances between the sensors and their respective distances from the infrared light point, the principles of trigonometric geometry can be used to precisely calculate the exact location on the electronic whiteboard where the infrared beam hits.

[0076] When the electronic whiteboard of this embodiment recognizes the infrared beam, it eliminates the highlight mark corresponding to the first focused object in the top layer and determines the coordinate position where the infrared beam contacts the electronic white screen through the sensor on the electronic whiteboard.

[0077] The display element pointed by the infrared beam is determined based on the coordinate position where the infrared beam contacts the electronic white screen. When the infrared beam happens to fall on any display element, for example, the infrared beam falls on an image or a text paragraph, the display element pointed by the infrared beam is used as the second focusing object. At this time, the second focusing object is used as the main focusing object.

[0078] Similarly, the focus area facing the second focus object on the top layer is determined based on the position coordinates of the second focus object in the bottom layer, and the focus area facing the second focus object in the top layer is focused and displayed based on preset rules to obtain a highlight mark for highlighting the second focus object.

[0079] When the infrared beam is extinguished and no infrared beam is received from the infrared pen within a continuous preset time, the highlight mark of the second focused object is eliminated, and the real-time voice is continuously monitored, and the content focus display is restored by analyzing the real-time voice to generate the highlight mark of the first focused object.

[0080] During the entire process of this embodiment, the user does not need to manually mark and adjust the highlighted content. The display elements on the electronic whiteboard are automatically focused and highlighted through voice or infrared pen, which can greatly improve the interactivity and ease of use of the electronic whiteboard.

[0081] Example 2

[0082] This embodiment provides a focus display system for an electronic whiteboard, which executes the focus display method for an electronic whiteboard as described in the first embodiment.

[0083] The focus display system of the electronic whiteboard specifically includes:

[0084] A speech analysis module is used to obtain real-time speech and determine the first keyword in the real-time speech through semantic analysis;

[0085] a semantic matching module, configured to perform semantic matching between the first keyword and all display elements in the electronic whiteboard, and when the first keyword matches any display element, mark the matched display element as a first focused object;

[0086] a layer mapping module, configured to locate the position coordinates of the first focused object in the bottom layer of the electronic whiteboard, map the position coordinates to the top layer of the electronic whiteboard, and determine a focus area on the top layer that is directly opposite to the first focused object;

[0087] The focus display module performs focus display processing on the focus area in the top layer based on preset rules to obtain a highlight mark for highlighting the first focus object.

[0088] It should be noted that the functions of each module in the system of this embodiment can be found in the corresponding description in the above method, and will not be repeated here.

[0089] Example 3

[0090] This embodiment provides an electronic device, Figure 2 FIG. 1 shows a structural block diagram of an electronic device according to an embodiment of the present invention. Figure 2 As shown, the electronic device includes a memory 100 and a processor 200. The memory 100 stores a computer program that can be executed on the processor 200. When the processor 200 executes the computer program, the focus display method of the electronic whiteboard described in the above embodiment is implemented. The number of the memory 100 and the processor 200 can be one or more.

[0091] The electronic device also includes:

[0092] The communication interface 300 is used to communicate with external devices and perform data exchange transmission.

[0093] If the memory 100, the processor 200, and the communication interface 300 are implemented independently, the memory 100, the processor 200, and the communication interface 300 can be connected to each other via a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc.

[0094] Optionally, in a specific implementation, if the memory 100, the processor 200 and the communication interface 300 are integrated on a chip, the memory 100, the processor 200 and the communication interface 300 can communicate with each other through an internal interface.

[0095] An embodiment of the present invention provides a computer-readable storage medium storing a computer program. When the program is executed by a processor, the method provided in the embodiment of the present invention is implemented.

[0096] An embodiment of the present invention further provides a chip, which includes a processor for calling and executing instructions stored in a memory, so that a communication device equipped with the chip executes the method provided by the embodiment of the present invention.

[0097] An embodiment of the present invention also provides a chip, comprising: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the method provided by the embodiment of the invention.

[0098] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor that supports the advanced reduced instruction set machine (ARM) architecture.

[0099] Furthermore, optionally, the above-mentioned memory may include read-only memory and random access memory, and may also include non-volatile random access memory. The memory may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Among them, the non-volatile memory may include read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) or flash memory. The volatile memory may include random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available. For example, static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct rambus RAM (DR RAM).

[0100] In the above embodiments, all or part of the embodiments may be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the present invention are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another.

[0101] In the description of this specification, reference to the terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art may combine and integrate different embodiments or examples described in this specification, as well as features of different embodiments or examples, unless otherwise inconsistent.

[0102] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of such features. In the description of the present invention, "plurality" means two or more, unless otherwise specifically defined.

[0103] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various modifications and substitutions within the technical scope disclosed in the present invention, and such modifications and substitutions are intended to be encompassed by the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be subject to the scope of protection of the claims.

Claims

1. A focusing display method for an electronic whiteboard, characterized in that: include: Acquire real-time speech, and determine a first keyword in the real-time speech through semantic analysis; Performing semantic matching between the first keyword and all display elements in the electronic whiteboard, and when the first keyword matches any of the display elements, marking the matched display element as a first focus object; Locating the position coordinates of the first focused object in the bottom layer of the electronic whiteboard, mapping the position coordinates to the top layer of the electronic whiteboard, and determining a focus area on the top layer that faces the first focused object; The focus area in the top layer is subjected to focus display processing based on a preset rule to obtain a highlight mark for highlighting the first focus object.

2. The focus display method of the electronic whiteboard according to claim 1, characterized in that: Also includes: Performing element differentiation on the display page of the electronic whiteboard to obtain each of the display elements on the electronic whiteboard, wherein the display elements are images, text paragraphs or charts; In the case where the display element is an image, the content of the image is understood based on a pre-trained model to obtain semantic information corresponding to the image; the semantic information is used to perform semantic similarity matching with the first keyword.

3. The focus display method of the electronic whiteboard according to claim 1, characterized in that: Also includes: When there are multiple display elements on the display page of the electronic whiteboard that match the first keyword, determining a second keyword in the real-time speech through semantic analysis; wherein the keyword time interval between the second keyword and the first keyword remains within a set threshold; The first keyword, the second keyword and each display element of the electronic whiteboard are matched for semantic similarity. When the semantics between the first keyword, the second keyword and one of the display elements match, the matched display element is marked as the first focus object.

4. The focus display method of the electronic whiteboard according to claim 1, characterized in that: Determining the focus area on the top layer facing the first focus object includes: determining a boundary size of the first focused object according to the position coordinates; A coverage area facing the first focused object is generated on the top layer according to the boundary size.

5. The focus display method of the electronic whiteboard according to claim 4, characterized in that: The focusing display processing of the focus area of ​​the top layer based on a preset rule includes: generating a coverage frame at a boundary position of the coverage area; The border color of the covering border is highlighted to obtain the highlight mark that completely surrounds the first focused object.

6. The focus display method of the electronic whiteboard according to claim 1, characterized in that: Also includes: When the infrared beam is received, the highlight mark corresponding to the first focused object in the top layer is removed, and the coordinate position where the infrared beam contacts the electronic white screen is determined; determining the display element pointed by the infrared beam according to the coordinate position where the infrared beam contacts the electronic white screen, and taking the display element pointed by the infrared beam as the second focusing object; Based on the preset rule, the second focused object in the top layer is subjected to focus display processing to obtain a highlight mark for highlighting the second focused object.

7. The focus display method of the electronic whiteboard according to claim 6, characterized in that: Also includes: When the infrared beam is not received for a continuous preset time, the highlight mark of the second focused object is eliminated, and the real-time voice is continuously monitored to determine whether it is received, and the highlight mark of the first focused object is generated by analyzing the real-time voice.

8. A focus display system for an electronic whiteboard, characterized in that: The system for performing the focus display method of the electronic whiteboard according to any one of claims 1 to 7 comprises: A speech analysis module, configured to obtain real-time speech and determine a first keyword in the real-time speech through semantic analysis; a semantic matching module, configured to perform semantic matching between the first keyword and all display elements in the electronic whiteboard, and when the first keyword matches any of the display elements, mark the matched display element as a first focused object; a layer mapping module, configured to locate the position coordinates of the first focused object in the bottom layer of the electronic whiteboard, map the position coordinates to the top layer of the electronic whiteboard, and determine a focus area on the top layer directly facing the first focused object; A focus display module performs focus display processing on the focus area in the top layer based on a preset rule to obtain a highlight mark for highlighting the first focus object.

9. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores instructions, and the instructions are loaded and executed by the processor to implement the focus display method of the electronic whiteboard according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the focus display method of the electronic whiteboard according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Projection control method and apparatus, projection device and storage medium

    CN108769638A

  • Display method and system, computer system, and computer-readable storage medium

    CN109343768A

  • Text display method and device and terminal equipment

    CN110232111A

  • Presentation file playing control method and device

    CN112114771A

  • Speech content prompting method and system

    CN112233669A