Intelligent whiteboard input method and intelligent whiteboard

Abstract

The invention provides an intelligent whiteboard input method and an intelligent whiteboard, and the method comprises the steps: switching to an input mode when an event triggering to enter the input mode is monitored; when an event of entering a handwriting mode is monitored in the input mode, switching to the handwriting mode and displaying a pre-initialized full-screen window on the top; when a writing event is monitored in the handwriting mode, the event is intercepted, a writing track is generated in the full-screen window in real time, and the handwriting mode is quitted when the condition of quitting the handwriting mode is met; after the handwriting mode is quitted, character recognition is conducted according to the writing track, an input control is filled in, the writing track is emptied, and the full-screen window is initialized. By means of the method, full-screen writing of the intelligent whiteboard is supported, continuous writing recognition is supported, a writing function provided by a third-party input method is not depended on any more, and the method is suitable for the intelligent whiteboard which is widely provided with an Android operating system.

Description

Technical Field

[0001] This application relates to the field of smart whiteboard interaction technology, and in particular to a smart whiteboard input method and a smart whiteboard. Background Technology

[0002] An intelligent interactive whiteboard is an electronic device that integrates a touch display screen, a computing unit, and a dedicated operating system, designed to enable efficient interaction between the user and the displayed content. With the development of science and technology, its application scenarios are becoming increasingly widespread, and users' demands for efficient text input are constantly increasing.

[0003] Currently, most mainstream smart interactive whiteboards run on the Android operating system, and their input method mainly relies on a virtual keyboard. Users need to select characters one by one from a candidate bar, resulting in low overall input efficiency. Existing technology includes some smart interactive whiteboards that are equipped with a stylus and support handwriting input via third-party input methods. This allows users to write or draw within a preset area using the stylus, and the third-party input method then collects the handwriting trajectory data and converts it into standard text for input. However, this method has significant limitations: firstly, the handwriting input area is usually restricted, allowing writing only within a specific area, making efficient handwriting input difficult; secondly, this handwriting input function is provided by a third-party input method and lacks native system support, resulting in unstable function coverage and poor system compatibility. Summary of the Invention

[0004] The embodiments of this application provide a smart whiteboard input method, a smart whiteboard, and a computer-readable storage medium, which can support full-screen writing on the smart whiteboard and support continuous writing recognition. It no longer relies on the writing function provided by third-party input methods and is compatible with a wide range of smart whiteboards equipped with the Android operating system.

[0005] In a first aspect, embodiments of this application propose a smart whiteboard input method, including: When an event triggering the entry into input mode is detected, switch to input mode; When the first input event to enter handwriting mode is detected in input mode, switch to handwriting mode and display the pre-initialized full-screen window on top; When a second input event for writing is detected in handwriting mode, the event is intercepted and the writing trajectory is generated in real time in the full-screen window. The handwriting mode is exited when the conditions for exiting handwriting mode are met. After exiting handwriting mode, the system performs character recognition based on the writing trajectory and fills the input control, clears the writing trajectory, and initializes the full-screen window.

[0006] In some possible embodiments, switching to input mode further includes displaying a virtual keyboard, wherein listening for a first input event to enter handwriting mode in input mode includes: In input mode, when an input event triggered by the stylus is detected, and the conditions of initial detection or failure to detect within a previously set time are met, and the virtual keyboard is currently displayed, it is determined that the first input event to enter handwriting mode has been detected in input mode.

[0007] In some possible embodiments, after displaying the pre-initialized full-screen window on top, the method further includes: Intercept the first input event and generate the corresponding writing trajectory in the full-screen window.

[0008] In some possible embodiments, when a second input event of writing is detected in handwriting mode, intercepting the event and generating a writing trajectory in real time in a full-screen window includes: In handwriting mode, when an input event triggered by the stylus is detected, and the time elapsed since the last detected first or second input event is less than a set time elapsed, it is determined that a second input event for writing has been detected. Intercept the second input event and generate the corresponding writing trajectory in the full-screen window.

[0009] In some possible embodiments, satisfying the conditions for exiting handwriting mode includes: If a second input event is detected in handwriting mode and no second input event is detected within a set time, the conditions for exiting handwriting mode are met.

[0010] In some possible embodiments, satisfying the conditions for exiting handwriting mode includes: If an input event triggered by the stylus is detected in handwriting mode, and the input event is an input event for a pre-defined close button, then the conditions for exiting handwriting mode are met.

[0011] In some possible embodiments, before listening for an event that triggers entry into input mode, the method further includes: Register an interception interface and listen for events through the interception interface, the events being input events triggered by a stylus or human body.

[0012] Secondly, embodiments of this application also propose a smart whiteboard, comprising: The input control module is used to switch to input mode when it detects an event that triggers the entry into input mode. The mode control module is used to switch to handwriting mode and display the pre-initialized full-screen window on top when the first input event of entering handwriting mode is detected in input mode. The writing module is used to intercept the second input event of writing in handwriting mode, generate the writing trajectory in real time in the full-screen window, and exit handwriting mode when the conditions for exiting handwriting mode are met. The recognition module is used to recognize characters based on the writing trajectory after exiting handwriting mode, fill them into the input control, clear the writing trajectory, and initialize the full-screen window.

[0013] Thirdly, embodiments of this application also propose an intelligent whiteboard, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform steps in an intelligent whiteboard input method as described in any of the first aspects above.

[0014] Fourthly, embodiments of this application also propose a computer-readable storage medium storing computer-executable instructions for performing steps in a smart whiteboard input method as described in any of the first aspects above.

[0015] The intelligent whiteboard input method, intelligent whiteboard, and computer-readable storage medium described in this application embodiment support full-screen writing on the intelligent whiteboard and continuous writing recognition, no longer relying on the writing function provided by third-party input methods, and are compatible with a wide range of intelligent whiteboards equipped with the Android operating system.

[0016] Other features and advantages of this application will be set forth in the following description and will be apparent in part from the description or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a flowchart illustrating a smart whiteboard input method according to an embodiment of this application; Figure 2 This is a schematic diagram illustrating the principle of an input framework under the standard Android operating system in an embodiment of this application. Figure 3 This is a schematic diagram of a page where a virtual keyboard has been displayed in an embodiment of this application; Figure 4 This is a flowchart illustrating an embodiment of the present application that detects a first input event that triggers handwriting mode. Figure 5 This is a flowchart illustrating how a first input event is intercepted in an embodiment of this application. Figure 6 This is a schematic diagram of a first input event in an embodiment of this application; Figure 7 This is a schematic diagram illustrating a real-time generation of writing trajectories in an embodiment of this application; Figure 8 This is a flowchart illustrating how a second input event is intercepted in an embodiment of this application. Figure 9 This is a flowchart illustrating an interception process for continuous writing in an embodiment of this application; Figure 10 This is a schematic diagram of a full-screen window in an embodiment of this application; Figure 11 This is a flowchart illustrating how recognized text is input into an input control in an embodiment of this application. Figure 12 This is a schematic diagram of a smart whiteboard device according to an embodiment of this application; Figure 13 This is a schematic diagram of the structure of a smart whiteboard according to an embodiment of this application. Detailed Implementation

[0019] To further illustrate the technical solutions provided in the embodiments of this application, a detailed description is provided below in conjunction with the accompanying drawings and specific implementation methods.

[0020] An intelligent interactive whiteboard is an electronic device that integrates a touch display screen, a computing unit, and a dedicated operating system, designed to enable efficient interaction between the user and the displayed content. With the development of science and technology, its application scenarios are becoming increasingly widespread, and users' demands for efficient text input are constantly increasing.

[0021] Currently, most mainstream smart interactive whiteboards run on the Android operating system, and their input method mainly relies on a virtual keyboard. Users need to select characters one by one from the candidate bar, resulting in low overall input efficiency. However, some existing smart interactive whiteboards support handwriting input by equipping a stylus and using a third-party input method. This allows users to write or draw within a preset area using the stylus, and the third-party input method then collects the handwriting trajectory data and converts it into standard text for input.

[0022] Among them, patent application CN117008736A discloses an input method and electronic device, proposing an input method that allows writing within a floating window. This method requires calculating the size and position of the floating window to display it. To avoid interfering with writing, the size and position of the floating window need to be adjusted using parameters such as the size, number, and direction of the input characters to meet the user's input needs. This technology can improve the input efficiency of users using electronic devices by loading a floating window near the user's pen stroke position, allowing continuous writing within the floating window near the current pen stroke position without interrupting the current writing process.

[0023] However, this method has obvious limitations: on the one hand, the handwriting input area is usually limited, and writing can only be done in a specific area, making it difficult to achieve efficient handwriting input; on the other hand, this type of handwriting input function is provided by third-party input methods and lacks native system support, thus resulting in problems such as unstable function coverage and poor system compatibility.

[0024] Therefore, considering the technical problems of limited handwriting input area and reliance on third-party input methods in the existing technology, which makes it difficult to achieve efficient handwriting input, this application proposes an intelligent whiteboard input method, such as... Figure 1 As shown, it includes: Step S101: When an event triggering the entry into input mode is detected, switch to input mode; Before listening to an event that triggers entry into input mode, an interception interface is registered with the event distribution center of the smart whiteboard, and the event is listened to through the interception interface, wherein the event is an input event triggered by a stylus or human body; Step S102: When the first input event of entering handwriting mode is detected in input mode, switch to handwriting mode and display the pre-initialized full-screen window on top; In some possible embodiments, the full-screen window can be transparent or semi-transparent, and the full-screen window is automatically initialized after the smart whiteboard is started to prepare for full-screen handwriting. Step S103: When a second input event for writing is detected in handwriting mode, the event is intercepted and a writing trajectory is generated in real time in the full-screen window. The handwriting mode is exited when the conditions for exiting handwriting mode are met. Step S104: After exiting the handwriting mode, perform character recognition based on the writing trajectory and fill in the input control, clear the writing trajectory, and initialize the full-screen window.

[0025] The method described in this application embodiment realizes full-screen writing functionality without relying on third-party input methods, supporting users to write multiple characters continuously within the entire screen area of ​​the smart whiteboard. Furthermore, the method is designed at the system level, perfectly adapting to all soft keyboard input methods that comply with the Android standard operating system, and fully compatible with display modes such as free window and split screen, providing users with a truly free, immersive, and barrier-free writing experience.

[0026] In the standard Android operating system, the scheduler is the core component of event handling. It is responsible for distributing events captured at the hardware level to the currently focused control, such as input events and control events. Specifically, the event is forwarded through the event distribution hub. After the scheduler determines the event type, it forwards the event to the target control in the view hierarchy through the event distribution hub to realize the consumption of the event.

[0027] In this embodiment of the application, based on the input framework principle under the above-mentioned Android standard operating system, such as Figure 2 As shown, when the scheduler in the smart whiteboard receives an event for the focused control on the current page, it sends the event to the event dispatch center, which then distributes it to the corresponding control. By registering an interception interface in the event dispatch center, the event can be intercepted when the corresponding conditions are met, preventing it from reaching the corresponding control and instead forwarding it to the designated control for consumption via the interception interface.

[0028] In some possible embodiments, such as Figure 3 As shown, based on the input framework principle of the Android standard operating system, switching to input mode also includes displaying a virtual keyboard. Specifically, when an event triggering entry into input mode is detected, the system switches to input mode, and the event dispatch center forwards the event to the method call center, so that the method call center calls the corresponding window display method to display the virtual keyboard. The event triggering entry into input mode is a predefined control event for input controls, such as clicking an input box, search box, or other input controls.

[0029] Similarly, in input mode, when an event triggering the exit from input mode is detected and the virtual keyboard is displayed, the corresponding window hiding method is called through the method call hub to hide the virtual keyboard and exit the input mode. The event triggering the exit from input mode is a predefined event that causes a change in the focus of the current page. For example, in input mode, the input control gains focus. When an event targeting the control control or other input controls is detected, it is determined that the focus of the current page has changed, thus triggering the exit from the current input mode.

[0030] As is well known, smart whiteboards support split-screen functionality, meaning multiple processes can run simultaneously. In traditional input modes, multiple input controls might trigger their corresponding input modes. However, in the standard Android operating system, if a control on a page loses focus, it will be unable to input characters or other content. For example, in split-screen or free window mode, multiple application windows might be displayed on one screen. When the input box in application A gains focus, the virtual keyboard appears, and input mode is entered. When writing in application B, the system will default to application B gaining focus, and application B will then handle the corresponding input events. In this scenario, application A loses focus and cannot write in full screen.

[0031] In this embodiment, to achieve full-screen writing functionality, handwriting events need to be intercepted under appropriate circumstances to prevent the input control from losing focus. Specifically, when the first input event of entering handwriting mode is detected in input mode, the system switches to handwriting mode and displays the pre-initialized full-screen window on top. The detection of the first input event of entering handwriting mode in input mode includes, for example: Figure 4 As shown, it includes: In input mode, when an input event triggered by the stylus is detected, and the conditions of initial detection or failure to detect within a previously set time are met, and the virtual keyboard is currently displayed, it is determined that the first input event to enter handwriting mode has been detected in input mode.

[0032] The input event consists of at least two sub-events. Specifically, the input event includes at least a touch start sub-event and a touch end sub-event. Between the two sub-events, there may also be one or more touch point movement sub-events. When the touch start sub-event triggered by the stylus is detected, it is determined that the input event has been detected.

[0033] In this embodiment, by displaying the pre-initialized full-screen window on top, when an input event is detected again, the corresponding control is the full-screen window, while the input control that triggered the forward input mode in the original page still gets focus. This avoids the problem of accidentally touching other areas and causing the input control on the current page to lose focus in the case of multiple processes, and provides the function of full-screen writing.

[0034] In some possible embodiments, when an input event is detected for the first time or after a previously set time period, i.e. in input mode, after the first writing or after completing a certain writing, an input event for the input control with the current focus is detected. At this time, based on the attribute parameters corresponding to the stored virtual keyboard, it is determined whether the virtual keyboard should be displayed.

[0035] In this embodiment of the application, when the smart whiteboard is started and initialized, attribute parameters are created to characterize the current virtual keyboard display state. When the input event is detected, the current virtual keyboard display state is determined by reading the attribute parameters, wherein: When the current virtual keyboard is confirmed to be displayed, the first input event to enter handwriting mode is detected in the input mode. When it is determined that the current virtual keyboard is not displayed, it is determined that the detected input event is another input event, which is then distributed by the event distribution center.

[0036] In this embodiment, the smart whiteboard supports simultaneous input from both a stylus and a finger. The stylus includes both a thick and a thin end, and is a general term for a smart pen, including but not limited to smart pens and capacitive styluses. Specifically, the type of input tool triggering the input event is determined based on the contact area between the input tool and the whiteboard. For example, a pre-defined contact area within a first range indicates a thin end of the stylus, within a second range indicates a thick end, and within a third range indicates a finger.

[0037] The contact area value is a relative value related to the device, typically based on pixels or a digitizer. Generally, the contact area value of the fine end of the stylus is less than 10, the contact area value of the thick end is between 18 and 20, and the contact area value of the finger is between 17 and 35. These contact area values ​​can be adjusted according to actual conditions. In this embodiment, there is no specific limitation on how to identify the type of input tool that triggers the input event. It can be set and adjusted according to actual conditions. Alternatively, other specialized SDKs (Software Development Kits) can be used to more accurately and simply determine the input tool. In this embodiment, the device is configured to support global writing with the fine end of the stylus, while supporting operation of the device with the thick end of the stylus or finger touch.

[0038] Regardless of which process's input control gains focus, triggers input mode, and displays the corresponding virtual keyboard, the interception interface will intercept the first input event before it reaches the virtual keyboard, and generate the corresponding writing trajectory in the full-screen window, such as... Figure 5 As shown. In this embodiment of the application, the interception refers to immediately consuming and processing the input event in a control of a specified full-screen window, without passing it up to the next layer.

[0039] To enable full-screen writing functionality, the full-screen window will only be displayed on top when switching to handwriting mode, and will act as an input control to handle intercepted input events.

[0040] In some possible embodiments, it can also be configured as a full-screen handwriting input button. When an input event is detected for this button, it actively enters handwriting mode and displays the initialized full-screen window. The conditions for switching to handwriting mode can be set according to actual needs; only one possible implementation is given in this application embodiment.

[0041] In some possible embodiments, such as Figure 6 As shown, the first input event includes at least a touch start sub-event and a touch end sub-event. Between the two sub-events, there may also be one or more touch point movement sub-events. When an input event is intercepted, all sub-events of that input event are forwarded to the full-screen window for processing in real-time according to their chronological order. Specifically, when the full-screen window receives the touch start sub-event, it records the current touch point's position in the full-screen window as the starting point for writing, and generates a writing trajectory in the full-screen window in real-time based on the next sub-event, until the touch end sub-event, at which point the generated writing trajectory is recorded, completing the writing task.

[0042] The touch start sub-event is a Down event; the touch point movement sub-event is a Move event; and the touch end sub-event is an Up / Cancel event. The above-mentioned sub-events with different roles for various events can be set according to the actual situation. In this application embodiment, a commonly used example is given, without specific limitation.

[0043] In some possible embodiments, the above-mentioned interception interface is also configured to intercept the Outside event when it is detected, and forward it to the corresponding control for handling the Outside event to implement the corresponding control logic, such as automatically closing the drop-down menu, hiding the pop-up layer, or canceling the focus state, which are the same as the existing interception methods and will not be described in detail here.

[0044] See Figure 7 This is a schematic diagram of an exemplary real-time generation of writing trajectory, wherein the first input event includes five sub-events: touching point A corresponding to the start sub-event, touching point B corresponding to the end sub-event, as shown above. Figure 7 As shown, writing trajectories are generated in real time in the full-screen window based on various sub-events.

[0045] In some possible embodiments, upon detecting the first output event, the system switches to handwriting mode and continues listening for events. Upon detecting a second input event involving writing in handwriting mode, the event is intercepted, and the writing trajectory is generated in real-time within the full-screen window. Specifically, such as... Figure 8 As shown, it includes the following steps: Step S801: In handwriting mode, when an input event triggered by the stylus is detected and the time elapsed since the last detected first or second input event is less than a set time elapsed, it is determined that a second input event for writing has been detected. In some possible embodiments, an input event that is detected within a set time after the first input event or the second input event is detected is determined to be the second input event for writing. If the second input event is detected in handwriting mode and no second input event is detected again after the set time exceeds the set time, then the condition for exiting handwriting mode is determined to be met. Step S802: Intercept the second input event and generate the corresponding writing trajectory in the full-screen window.

[0046] In some possible embodiments, the set duration is typically 800 milliseconds, such as... Figure 9 As shown, if no second input event is detected after 800 milliseconds, the condition for exiting handwriting mode is met and text recognition begins; if writing is done again within 800 milliseconds, it is determined to be the second input event for writing, thus achieving the function of continuous writing.

[0047] In this embodiment of the application, the specific process of intercepting the second input event and generating the corresponding writing trajectory in the full-screen window is the same as the process of intercepting the first input event and generating the corresponding writing trajectory in the full-screen window, and will not be repeated here.

[0048] In some possible embodiments, to let the user know that the current page is in handwriting mode, such as Figure 10 As shown, a text prompt or a close button is set in the full-screen window. The close button is used to exit the handwriting mode, and the text prompt and the close button indicate that the user is currently in handwriting mode. Specifically, if an input event triggered by the stylus is detected in handwriting mode, and the input event is an input event targeting the pre-defined close button, the condition for exiting handwriting mode is determined to be met.

[0049] In some possible embodiments, by setting the aforementioned full-screen handwriting input button and the aforementioned close button, the entry and exit of handwriting mode can be actively controlled.

[0050] In this embodiment of the application, when any of the above conditions for exiting handwriting mode are met, the handwriting mode is exited, and character recognition is performed based on the writing trajectory recorded in the full-screen window. Specifically, any existing character recognition technology can be used to recognize the writing trajectory, and no specific limitation is made in this embodiment of the application.

[0051] After recognizing the text, the writing trajectory is cleared and the full-screen window is initialized. The initialization of the full-screen window means that the full-screen window after the writing trajectory is cleared is placed in the background again and is not called up to the top layer for display.

[0052] In some possible embodiments, when the full-screen window is displayed on top, the accessibility service determines the current input control, including but not limited to input boxes or search boxes. Based on the above design, the accessibility service records the input controls that have gained focus on the original page and identifies focus changes on the page, such as... Figure 11 As shown, there are two possible ways to input the recognized text into the input control, wherein: If the writing process is continuous and the focus on the original page is not disturbed, after recognizing the text and initializing the full-screen window, the accessibility service will automatically return the focus to the input control that has gained focus on the original page. At this time, the recognized text can be directly input into the input control. If, during the writing process, the focus on the original page is interfered with for some other reason, and the accessibility service cannot recognize the focus on the page or the control that gains focus is a control control, then the clipboard is enabled to copy the recognized text to the clipboard. When the control that gains focus is recognized as an input control, the recognized text is pasted into the input control using the clipboard.

[0053] The method described in this application embodiment accurately distinguishes between input events and control events by recognizing touch tools, thereby realizing full-screen continuous writing functionality without relying on third-party input methods. It supports free writing in multi-window modes such as full screen, free window, and split screen, and automatically fills the recognized text into the input control, providing users with a truly free, immersive, and barrier-free writing experience.

[0054] Based on the same inventive concept, this application also proposes a smart whiteboard, such as... Figure 12 As shown, it includes: The input control module 1201 is used to switch to input mode when it detects an event that triggers the entry into input mode; The mode control module 1202 is used to switch to handwriting mode and display the pre-initialized full-screen window on top when the first input event of entering handwriting mode is detected in the input mode. The writing module 1203 is used to intercept the second input event of writing in handwriting mode and generate the writing trajectory in the full-screen window in real time when the conditions for exiting handwriting mode are met. The recognition module 1204 is used to recognize characters based on the writing trajectory and fill them into the input control after exiting the handwriting mode, as well as to clear the writing trajectory and initialize the full-screen window.

[0055] Based on the same inventive concept, this application proposes an intelligent whiteboard, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform an intelligent whiteboard input method as described in any of the first aspects of the above embodiments.

[0056] The following reference Figure 13 To describe a smart whiteboard 130 according to this embodiment of the present application. Figure 13 The device 130 shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.

[0057] like Figure 13 As shown, a smart whiteboard 130 is presented in the form of a general-purpose smart whiteboard. The components of a smart whiteboard 130 may include, but are not limited to: at least one processor 131, at least one memory 132, and a bus 133 connecting different system components (including memory 1302 and processor 1301).

[0058] Bus 133 represents one or more of several bus structures, including a memory bus or memory controller, peripheral bus, processor, or local bus using any of the various bus structures.

[0059] The memory 132 may include a readable medium in the form of volatile memory, such as random access memory (RAM) 1321 and / or cache memory 1322, and may further include read-only memory (ROM) 1323.

[0060] The memory 132 may also include a program / utility 1325 having a set (at least one) of program modules 1324, including but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of these examples may include an implementation of a network environment.

[0061] A smart whiteboard 130 can also communicate with one or more external devices 134 (e.g., keyboards, pointing devices, etc.), one or more devices that enable a user to interact with the smart whiteboard 130, and / or any device that enables the smart whiteboard 130 to communicate with one or more other smart whiteboards (e.g., routers, modems, etc.). This communication can be performed via input / output (I / O) interface 135. Furthermore, a smart whiteboard 130 can also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via network adapter 136. As shown, network adapter 136 communicates with other modules used for the smart whiteboard 130 via bus 133. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with a smart whiteboard 130, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0062] Based on the same inventive concept, embodiments of this application provide a computer-readable storage medium storing a computer program. The computer program includes program instructions, which, when executed by a computer, cause the computer to perform any of the smart whiteboard input methods described above. Since the principle by which the computer-readable storage medium solves the problem is similar to that of the smart whiteboard input method, the implementation of the computer-readable storage medium can be referred to the implementation of the method, and repeated details will not be elaborated further. The method described in this application embodiment achieves full-screen writing functionality without relying on third-party input methods, supporting users to continuously write multiple characters across the entire screen area of ​​the smart whiteboard. Furthermore, the method is designed at the system level, perfectly adapting to all soft keyboard input methods conforming to the Android standard operating system, and fully compatible with display modes such as free windows and split-screen, providing users with a truly free, immersive, and barrier-free writing experience.

[0063] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0064] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0065] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0066] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0067] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A smart whiteboard input method, characterized in that, include: When an event triggering the entry into input mode is detected, switch to input mode; When the first input event to enter handwriting mode is detected in input mode, switch to handwriting mode and display the pre-initialized full-screen window on top; When a second input event for writing is detected in handwriting mode, the event is intercepted and the writing trajectory is generated in real time in the full-screen window. The handwriting mode is exited when the conditions for exiting handwriting mode are met. After exiting handwriting mode, the system performs character recognition based on the writing trajectory and fills the input control, clears the writing trajectory, and initializes the full-screen window.

2. The method according to claim 1, characterized in that, Switching to input mode also includes displaying a virtual keyboard. The step of listening for the first input event to enter handwriting mode in input mode includes: In input mode, when an input event triggered by the stylus is detected, and the conditions of initial detection or failure to detect within a previously set time are met, and the virtual keyboard is currently displayed, it is determined that the first input event to enter handwriting mode has been detected in input mode.

3. The method according to claim 1, characterized in that, After displaying the pre-initialized full-screen window on top, the method further includes: Intercept the first input event and generate the corresponding writing trajectory in the full-screen window.

4. The method according to claim 1, characterized in that, When a second input event for writing is detected in handwriting mode, the event is intercepted and a writing trajectory is generated in real time in the full-screen window, including: In handwriting mode, when an input event triggered by the stylus is detected, and the time elapsed since the last detected first or second input event is less than a set time elapsed, it is determined that a second input event for writing has been detected. Intercept the second input event and generate the corresponding writing trajectory in the full-screen window.

5. The method according to claim 1, characterized in that, The conditions for exiting handwriting mode include: If a second input event is detected in handwriting mode and no second input event is detected within a set time, the conditions for exiting handwriting mode are met.

6. The method according to claim 1, characterized in that, The conditions for exiting handwriting mode include: If an input event triggered by the stylus is detected in handwriting mode, and the input event is an input event for a pre-defined close button, then the conditions for exiting handwriting mode are met.

7. The method according to claim 1, characterized in that, Before listening for an event that triggers entry into input mode, the method further includes: Register an interception interface and listen for events through the interception interface, the events being input events triggered by a stylus or human body.

8. A smart whiteboard, characterized in that, include: The input control module is used to switch to input mode when it detects an event that triggers the entry into input mode. The mode control module is used to switch to handwriting mode and display the pre-initialized full-screen window on top when the first input event of entering handwriting mode is detected in input mode. The writing module is used to intercept the second input event of writing in handwriting mode, generate the writing trajectory in real time in the full-screen window, and exit handwriting mode when the conditions for exiting handwriting mode are met. The recognition module is used to recognize characters based on the writing trajectory after exiting handwriting mode and fill them into the input control, as well as to clear the writing trajectory and initialize the full-screen window.

9. A smart whiteboard, characterized in that, include: At least one processor; The at least one processor is also connected in communication with a memory, wherein the memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the steps of a smart whiteboard input method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions for performing steps in a smart whiteboard input method as described in any one of claims 1 to 7.

Images