Electronic whiteboard-based circle selection processing method and device, equipment and storage medium
By capturing and identifying touch events on the electronic whiteboard, generating circle selection areas and calling operation menus, the inconvenience of circle selection and operation of electronic whiteboard large-screen all-in-one machine is solved, and operation accuracy and user experience are improved.
Patent Information
- Application Number
- CN202411200780.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-29
- Publication Date
- 2024-11-26
AI Technical Summary
The existing electronic whiteboard large-screen all-in-one machine has problems such as inconvenient operation and insufficient feedback in circle selection and operation functions, which is difficult to meet the diverse needs of users, especially when processing writing content and pictures, which lacks efficient and intuitive editing and operation methods. .
By capturing and identifying touch events on the surface of the electronic whiteboard, generating a circle selection area, and calling the corresponding operation menu according to the type of the identified object, providing relevant operation options, users can complete the operation through simple clicks, reducing the missed circle selection and cumbersome steps.
It improves the accuracy of circle selection and operation accuracy, provides an intuitive and convenient operation experience, meets a variety of usage scenarios, and reduces the risk of content modification or loss caused by misoperation.
Smart Images

Figure CN119025012A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of large-screen all-in-one electronic whiteboards, and in particular to a circle selection processing method, device, equipment and storage medium based on an electronic whiteboard. Background Art
[0002] The electronic whiteboard large screen all-in-one is an interactive device that integrates large screen display, touch function and computer system. It combines the functions of traditional whiteboard with modern display and touch technology. Through large screen display, touch operation and multimedia functions, it improves the efficiency of information display and communication, and provides users with a more efficient and convenient operation experience. It is often used in education, business and conferences.
[0003] The large-screen all-in-one electronic whiteboard has multi-touch and handwriting functions, but there may be errors in recognizing the trajectory and intention of the user's circle selection, especially when processing the user's handwriting and inserted pictures. It lacks convenient circle selection and operation functions and cannot meet the diverse needs of users. When using the electronic whiteboard, users often need to edit, search, delete and copy the written content and pictures. The existing technical solutions have not provided efficient and intuitive implementation methods. And when circling, the user may lack real-time feedback on the circling process and do not know whether the area he circled is correct. The existing large-screen all-in-one electronic whiteboard has disadvantages such as inconvenient operation and insufficient feedback in the circling and operation functions, which is not conducive to the user experience. Summary of the invention
[0004] The present invention aims to provide a circle selection processing method, device, equipment and storage medium based on an electronic whiteboard to solve the above-mentioned technical problems, optimize the circle selection function processing flow of the electronic whiteboard large-screen all-in-one machine, and improve the user operation experience.
[0005] In order to solve the above technical problems, the present invention provides a circle selection processing method based on an electronic whiteboard, comprising:
[0006] Capturing a touch event on the surface of the electronic whiteboard and identifying the touch event, and generating a circled area based on the identification result;
[0007] Performing object recognition on the circled area, obtaining the recognized object in the circled area, and calling a corresponding operation menu on the surface of the electronic whiteboard according to the type of the recognized object; wherein the operation menu includes a plurality of operation options;
[0008] The object processing is performed on the identified object in response to an operation instruction sent by the user on the operation menu.
[0009] In the above scheme, the user's touch event on the surface of the electronic whiteboard is captured, and the area selected by the user is generated by identifying the touch event. The user's selection action can be captured in real time, so that the user can immediately see the selected area, thereby reducing the probability of wrong selection. The capture and identification of touch events ensure the accuracy of the selected area, which helps to improve the accuracy of subsequent operations. The content in the selected area is identified, the object in the area is determined, and the corresponding operation menu is generated according to the type of the identified object. The operation options in the menu are related to the selected object, making the operation process more intuitive and convenient. The user can complete the operation by simply clicking without looking for other menus or toolbars. By calling different operation menus, the user can perform diversified operations on different types of content to meet a variety of usage scenarios. The instant display of the menu and the intuitive presentation of the operation options enable the user to better understand and use the functions of the electronic whiteboard. According to the instructions sent by the user in the operation menu, the identified objects in the selected area are processed accordingly, which can quickly respond to the user's operation instructions, process the objects in time, and avoid cumbersome operation steps. And the operation menu is directly related to the selected object, which can reduce the risk of content modification or loss due to misoperation.
[0010] In one implementation, capturing a touch event on the surface of the electronic whiteboard and identifying the touch event, and generating a circled area based on the identification result, specifically includes:
[0011] Based on the touch screen driver, the touch events on the surface of the electronic whiteboard are monitored in real time; wherein the touch events include touch start events, touch move events and touch end events;
[0012] Whenever a touch event is detected, the touch point position information is generated;
[0013] When the user stays on the surface of the electronic whiteboard for more than a first preset time, determining that the touch end event is detected and controlling the electronic whiteboard to enter a circle selection mode;
[0014] The circled area is generated on the surface of the electronic whiteboard based on the accumulated first contact information.
[0015] In one implementation, the step of capturing a touch event on the surface of the electronic whiteboard and identifying the touch event, and generating a circled area based on the identification result, further includes:
[0016] Capturing touch events on the surface of the electronic whiteboard based on a gesture recognition library to obtain gesture information;
[0017] The boundary of the circled area is calculated according to the gesture information and the boundary is generated on the surface of the electronic whiteboard to obtain the circled area.
[0018] In one implementation, obtaining the identified object in the circled area and calling a corresponding operation menu on the surface of the electronic whiteboard according to the type of the identified object specifically includes:
[0019] Acquire the identified object in the circled area; wherein the types of the identified object include: picture and text;
[0020] When the type of the identified object is a picture, a first floating menu is generated on the surface of the electronic whiteboard; wherein the operation options of the first floating menu include: picture search, picture deletion, picture copy and text selection;
[0021] When the type of the identified object is text, a second floating menu is generated on the surface of the electronic whiteboard; wherein the operation options of the second floating menu include: font conversion, text search, text deletion and text copy.
[0022] In one implementation, when the type of the recognized object is text, before generating the second floating menu on the surface of the electronic whiteboard, the method further includes:
[0023] Handwriting detection is performed on the text in the circled area. When the text is handwriting, the handwriting is converted into standard text based on OCR technology; wherein the standard text is editable text.
[0024] In one implementation, the performing object processing on the identified object in response to an operation instruction sent by the user on the operation menu specifically includes:
[0025] When the operation instruction is a picture search instruction, calling a first preset interface to perform a picture search and presenting the picture search results on the surface of the electronic whiteboard;
[0026] When the operation instruction is a picture deletion instruction, the picture in the circled area is deleted and the electronic whiteboard surface is re-rendered;
[0027] When the operation instruction is a picture copy instruction, the picture in the circled area is copied to a preset position;
[0028] When the operation instruction is to select text, the text contained in the picture in the circled area is extracted and copied to the preset position.
[0029] In one implementation, the performing object processing on the identified object in response to an operation instruction sent by the user on the operation menu further includes:
[0030] When the operation instruction is a font conversion instruction, the text in the circled area is converted into a preset font based on OCR technology and the preset font is re-rendered on the surface of the electronic whiteboard;
[0031] When the operation instruction is a text search instruction, calling a second preset interface to perform a text search and presenting the text search results on the surface of the electronic whiteboard;
[0032] When the operation instruction is a text deletion instruction, deleting the text in the circled area and re-rendering the electronic whiteboard surface;
[0033] When the operation instruction is a text copy instruction, the text in the circled area is copied to a preset position.
[0034] In a second aspect, the present application further provides a circle selection processing device based on an electronic whiteboard, comprising: a touch recognition module, a menu generation module and an instruction response module;
[0035] The touch recognition module is used to capture touch events on the surface of the electronic whiteboard and recognize the touch events, and generate a circled area based on the recognition result;
[0036] The menu generation module is used to perform object recognition on the circled area, obtain the recognized object in the circled area, and call a corresponding operation menu on the surface of the electronic whiteboard according to the type of the recognized object; wherein the operation menu includes a plurality of operation options;
[0037] The instruction response module is used to perform object processing on the identified object in response to an operation instruction sent by a user on the operation menu.
[0038] In the above scheme, the user's touch event on the surface of the electronic whiteboard is captured, and the area selected by the user is generated by identifying the touch event. The user's selection action can be captured in real time, so that the user can immediately see the selected area, thereby reducing the probability of wrong selection. The capture and identification of touch events ensure the accuracy of the selected area, which helps to improve the accuracy of subsequent operations. The content in the selected area is identified, the object in the area is determined, and the corresponding operation menu is generated according to the type of the identified object. The operation options in the menu are related to the selected object, making the operation process more intuitive and convenient. The user can complete the operation by simply clicking without looking for other menus or toolbars. By calling different operation menus, the user can perform diversified operations on different types of content to meet a variety of usage scenarios. The instant display of the menu and the intuitive presentation of the operation options enable the user to better understand and use the functions of the electronic whiteboard. According to the instructions sent by the user in the operation menu, the identified objects in the selected area are processed accordingly, which can quickly respond to the user's operation instructions, process the objects in time, and avoid cumbersome operation steps. And the operation menu is directly related to the selected object, which can reduce the risk of content modification or loss due to misoperation.
[0039] In one implementation, the touch recognition module is used to capture a touch event on the surface of the electronic whiteboard and recognize the touch event, and generate a circled area based on the recognition result, specifically including:
[0040] Based on the touch screen driver, the touch events on the surface of the electronic whiteboard are monitored in real time; wherein the touch events include touch start events, touch move events and touch end events;
[0041] Whenever a touch event is detected, the touch point position information is generated;
[0042] When the user stays on the surface of the electronic whiteboard for more than a first preset time, determining that the touch end event is detected and controlling the electronic whiteboard to enter a circle selection mode;
[0043] The circled area is generated on the surface of the electronic whiteboard based on the accumulated first contact information.
[0044] In one implementation, the touch recognition module is used to capture a touch event on the surface of the electronic whiteboard and recognize the touch event, and generate a circled area based on the recognition result, and further includes:
[0045] Capturing touch events on the surface of the electronic whiteboard based on a gesture recognition library to obtain gesture information;
[0046] The boundary of the circled area is calculated according to the gesture information and the boundary is generated on the surface of the electronic whiteboard to obtain the circled area.
[0047] In one implementation, obtaining the identified object in the circled area and calling a corresponding operation menu on the surface of the electronic whiteboard according to the type of the identified object specifically includes:
[0048] Acquire the identified object in the circled area; wherein the types of the identified object include: picture and text;
[0049] When the type of the identified object is a picture, a first floating menu is generated on the surface of the electronic whiteboard; wherein the operation options of the first floating menu include: picture search, picture deletion, picture copy and text selection;
[0050] When the type of the identified object is text, a second floating menu is generated on the surface of the electronic whiteboard; wherein the operation options of the second floating menu include: font conversion, text search, text deletion and text copy.
[0051] In one implementation, when the type of the recognized object is text, before generating the second floating menu on the surface of the electronic whiteboard, the method further includes:
[0052] Handwriting detection is performed on the text in the circled area. When the text is handwriting, the handwriting is converted into standard text based on OCR technology; wherein the standard text is editable text.
[0053] In one implementation, the instruction response module is used to perform object processing on the identified object in response to an operation instruction sent by the user on the operation menu, specifically including:
[0054] When the operation instruction is a picture search instruction, calling a first preset interface to perform a picture search and presenting the picture search results on the surface of the electronic whiteboard;
[0055] When the operation instruction is a picture deletion instruction, the picture in the circled area is deleted and the electronic whiteboard surface is re-rendered;
[0056] When the operation instruction is a picture copy instruction, the picture in the circled area is copied to a preset position;
[0057] When the operation instruction is to select text, the text contained in the picture in the circled area is extracted and copied to the preset position.
[0058] In one implementation, the instruction response module is used to perform object processing on the identified object in response to an operation instruction sent by a user on the operation menu, and further includes:
[0059] When the operation instruction is a font conversion instruction, the text in the circled area is converted into a preset font based on OCR technology and the preset font is re-rendered on the surface of the electronic whiteboard;
[0060] When the operation instruction is a text search instruction, calling a second preset interface to perform a text search and presenting the text search results on the surface of the electronic whiteboard;
[0061] When the operation instruction is a text deletion instruction, deleting the text in the circled area and re-rendering the electronic whiteboard surface;
[0062] When the operation instruction is a text copy instruction, the text in the circled area is copied to a preset position.
[0063] In a third aspect, the present application also provides a terminal device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, the electronic whiteboard-based circle selection processing method as described above is implemented.
[0064] In a fourth aspect, the present application further provides a computer-readable storage medium, the computer-readable storage medium including a stored computer program, wherein when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the electronic whiteboard-based circle selection processing method as described above. BRIEF DESCRIPTION OF THE DRAWINGS
[0065] Figure 1 A schematic flow chart of a circle selection processing method based on an electronic whiteboard provided in one embodiment of the present invention;
[0066] Figure 2 The schematic diagram of a circle selection processing device based on an electronic whiteboard provided in one embodiment of the present invention. DETAILED DESCRIPTION
[0067] The specific implementation of the present invention is further described in detail below in conjunction with the accompanying drawings and examples. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.
[0068] The terms "first" and "second" and the like in the specification, claims and drawings of this application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.
[0069] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0070] First, some terms in this application are explained to facilitate understanding by those skilled in the art.
[0071] (1) Circle selection: In electronic whiteboard or touch screen applications, "circle selection" means that the user draws a closed area on the screen with a finger or stylus to select or operate the content in the area.
[0072] Example 1
[0073] See also Figure 1 , Figure 1 The flowchart of a method for processing circle selection based on an electronic whiteboard provided in an embodiment of the present invention is shown in FIG. The method for processing circle selection based on an electronic whiteboard provided in an embodiment of the present invention comprises steps 101 to 103, and each step is specifically as follows:
[0074] Step 101: Capture a touch event on the surface of the electronic whiteboard and identify the touch event, and generate a circled area based on the identification result.
[0075] In one embodiment, the capturing of touch events on the surface of the electronic whiteboard and identifying the touch events, and generating a circled area based on the identification results, specifically include: monitoring the touch events on the surface of the electronic whiteboard in real time based on a touch screen driver; wherein the touch events include touch start events, touch move events, and touch end events; generating contact point position information each time a touch event is detected; when the user stays on the surface of the electronic whiteboard for more than a first preset time, determining that the touch end event is detected and controlling the electronic whiteboard to enter a circled mode; and generating the circled area based on the accumulated first contact point information.
[0076] Electronic whiteboards are usually equipped with touch screen technology, so their touch events can be captured and processed by touch screen drivers. These drivers are responsible for converting the original signals of the touch screen into events that can be understood by the operating system or application. In an embodiment of the present invention, touch events on the surface of the electronic whiteboard are monitored in real time based on the touch screen driver, including touch start events, touch move events, and touch end events. Different operating systems and whiteboard brands may use different touch screen drivers and APIs. Select a suitable touch screen driver according to the operating system of the electronic whiteboard device. Exemplarily, the touch screen driver of the Windows system usually uses WM_TOUCH messages to capture touch events; the Android system captures touch events through the MotionEvent class; the Linux system can process touch events through the evdev or libinput library. When the user touches the screen, the system generates a touch start event. This event usually includes information such as the location and ID of the touch point. When the user moves a finger or stylus on the screen, the system generates a touch move event. This event usually includes the location of the current touch point. When the user leaves the screen, the system generates a touch end event. This event usually includes the location and ID of the last touch point. For example, in an embodiment of the present invention, the user's finger or pen stops on the electronic whiteboard, and when it is detected that the user's finger or pen stops on the whiteboard surface for more than 2 seconds, the circle selection mode is entered. Using the captured touch point coordinates, a rectangular or other shaped circle selection area can be calculated, and the calculated circle selection area is drawn on the screen as visual feedback to the user.
[0077] In one embodiment, as an alternative to the embodiment of the present invention, touch events on the surface of the electronic whiteboard can also be captured through gesture recognition. The Android system can use classes such as GestureDetector and ScaleGestureDetector to detect gestures. The Windows system can use the Windows.UI.Input.GestureRecognizer class (in UWP applications) or other related libraries. Cross-platform libraries such as TensorFlow.js's gesture recognition model are suitable for web applications. The gesture recognition library can recognize common gestures (such as circling, clicking, sliding, etc.) and obtain the user's gesture information, that is, the coordinates of the touch points. According to the touch point coordinates obtained after a gesture, that is, the gesture information, the coordinates of the upper left corner and the lower right corner of the circled area are calculated and a rectangle or other shape is drawn on the electronic whiteboard to represent the circled area.
[0078] Step 102: performing object recognition on the circled area, obtaining the recognized object in the circled area, and calling a corresponding operation menu on the surface of the electronic whiteboard according to the type of the recognized object; wherein the operation menu includes a plurality of operation options.
[0079] In an embodiment of the present invention, the text and the picture in the circled area are distinguished by image processing technology. Commonly used technologies include color detection, shape detection, etc. Color detection is a technology that distinguishes handwriting from background images by identifying areas of different colors in an image, and is suitable for scenes with obvious color contrast. Exemplarily, the image is converted into different color spaces (such as HSV, Lab) to make it easier to separate the colors of interest. For example, converting the image from RGB to HSV can make color separation more intuitive; setting a color range to detect the color of the handwriting. For example, in the HSV space, the range of the H, S, and V channels can be set to filter specific colors; using color thresholds to generate a binary image, in which the handwriting area will be divided into white or black (or other colors), and the background area will be excluded. Shape detection technology is used to identify and extract areas with specific geometric shapes in an image. It is often used to detect the outline of handwriting. Exemplarily, the image is converted into a grayscale image and smoothed to reduce the impact of noise; an edge detection algorithm (such as Canny edge detection) is used to extract the edge of the handwriting; dilation and erosion operations are applied to enhance the shape characteristics of the handwriting; and a contour detection algorithm is used to identify and extract the contour of the handwriting.
[0080] In one embodiment, the step of obtaining the recognized object within the circled area and calling a corresponding operation menu on the surface of the electronic whiteboard according to the type of the recognized object specifically includes: obtaining the recognized object within the circled area; wherein the types of the recognized object include: picture and text; when the type of the recognized object is a picture, generating a first floating menu on the surface of the electronic whiteboard; wherein the operation options of the first floating menu include: picture search, picture deletion, picture copy and text selection; when the type of the recognized object is text, generating a second floating menu on the surface of the electronic whiteboard; wherein the operation options of the second floating menu include: font conversion, text search, text deletion and text copy.
[0081] In an embodiment of the present invention, a floating menu corresponding to different recognition objects is pre-generated in the control system of the electronic whiteboard, and is called according to the different recognition object types in the circled area, and different floating menus are generated on the surface of the electronic whiteboard. The floating menu allows the user to quickly perform related operations without leaving the current operation. The user does not need to manually search for functions in the menu or toolbar, which can significantly improve the operating efficiency and the smoothness of the workflow. The floating menu can dynamically adjust the displayed content according to the circled content or position, provide instant feedback, and help the user complete the operation more accurately. Furthermore, the operation options in the floating menus of different recognition objects are also different. Providing relevant operation options according to the content of the circled area can make operations more convenient and improve the user experience.
[0082] In one embodiment, when the type of the identified object is text, before generating the second floating menu on the surface of the electronic whiteboard, it also includes: performing handwriting detection on the text in the circled area, and when the text is handwriting, converting the handwriting into standard text based on OCR technology; wherein the standard text is editable text.
[0083] In an embodiment of the present invention, handwriting detection is performed by edge detection algorithm, contour analysis and extraction of handwriting features. An edge detection algorithm (such as Canny edge detection) is used to identify the handwriting edge in the image. The handwriting usually shows obvious features on the edge; contour analysis is to detect the contour in the image. The contour of the handwriting is usually continuous and regular; the handwriting features are extracted, such as the thickness and continuity of the line, and the handwriting usually shows consistent features. Preferably, in order to improve the accuracy of handwriting detection, the circled area can also be subjected to pre-processing operations such as image cropping, denoising, and binarization. When the circled area contains handwriting, the handwriting can be converted into standard text through an open source OCR library (such as Tesseract) or integrated third-party OCRAPI. For example, Tesseract can recognize text in multiple languages and supports handwritten text recognition; third-party OCR APIs such as Google Cloud Vision API, Microsoft Azure ComputerVision, etc., these services usually provide stronger handwriting recognition capabilities and higher accuracy. OCR technology converts handwriting into standard editable text. This step includes recognizing and classifying each character to generate corresponding text. The recognized text is returned to the user and displayed on the electronic whiteboard, where the user can further edit or use the text.
[0084] Step 103: performing object processing on the identified object in response to an operation instruction sent by the user on the operation menu.
[0085] In one embodiment, the object processing of the identified object is performed in response to the operation instruction sent by the user on the operation menu, specifically including: when the operation instruction is an image search instruction, calling a first preset interface to perform an image search and presenting the image search results on the surface of the electronic whiteboard; when the operation instruction is an image deletion instruction, deleting the image in the circled area and re-rendering the electronic whiteboard surface; when the operation instruction is an image copy instruction, copying the image in the circled area to a preset position; when the operation instruction is to select text, extracting the text contained in the image in the circled area and copying it to the preset position.
[0086] In an embodiment of the present invention, when the user clicks the "Image Search" option, the system will call the Google Image Search API to display relevant image search results; when the user clicks the "Image Delete" option, the circled image will be deleted and the whiteboard content will be re-rendered; when the user clicks the "Image Copy" option, the circled image content will be copied to the clipboard for pasting in other applications; when the user clicks "Select Text", if the image in the circled area contains text, the text content in the image will be detected through OCR technology. After the user clicks "Select Text", the text content is extracted and copied for pasting. As a preferred solution of an embodiment of the present invention, the system displays the search results in multiple windows on the right side of the screen for user viewing.
[0087] In one embodiment, the object processing of the identified object in response to the operation instruction sent by the user on the operation menu also includes: when the operation instruction is a font conversion instruction, converting the text in the circled area into a preset font based on OCR technology and re-rendering the preset font on the electronic whiteboard surface; when the operation instruction is a text search instruction, calling a second preset interface to perform text search and presenting the text search results on the electronic whiteboard surface; when the operation instruction is a text deletion instruction, deleting the text in the circled area and re-rendering the electronic whiteboard surface; when the operation instruction is a text copy instruction, copying the text in the circled area to a preset position.
[0088] In an embodiment of the present invention, when the user clicks the "font conversion" option, the OCR module pre-integrated in the system will be called to convert the handwriting into a standard font. The converted text replaces the handwriting and is re-rendered on the whiteboard. The specific implementation process of converting handwriting into a standard font through OCR technology has been described in detail in the previous article and will not be repeated here. When the user clicks the "text search" option, the browser or search engine API is called to search, and the search results are displayed in multiple windows on the right side of the screen; when the user clicks the "text delete" option, the text in the circled area will be deleted and the whiteboard content will be re-rendered; when the user clicks the "text copy" option, the text in the circled area will be copied to the clipboard for pasting in other applications.
[0089] In an embodiment of the present invention, a circle selection processing device based on an electronic whiteboard is also provided, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, the above-mentioned circle selection processing method based on the electronic whiteboard is implemented.
[0090] In an embodiment of the present invention, a computer-readable storage medium is further provided. The computer-readable storage medium includes a stored computer program. When the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the above-mentioned electronic whiteboard-based circle selection processing method.
[0091] Exemplarily, the computer program can be divided into one or more modules, one or more modules are stored in the memory and executed by the processor to complete the present invention. One or more modules can be a series of computer program instruction segments that can complete specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic whiteboard-based circle selection processing device.
[0092] The electronic whiteboard-based circle selection processing device may be a computing device such as a desktop computer, a notebook, a PDA, and a cloud server. The electronic whiteboard-based circle selection processing device may include, but is not limited to, a processor, a memory, and a display. Those skilled in the art may understand that the above components are merely examples of the electronic whiteboard-based circle selection processing device and do not constitute a limitation on the electronic whiteboard-based circle selection processing device. It may include more or fewer components than the components, or combine certain components, or different components. For example, the electronic whiteboard-based circle selection processing device may also include input and output devices, network access devices, buses, etc.
[0093] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the electronic whiteboard-based circle selection processing device, and uses various interfaces and lines to connect various parts of the entire electronic whiteboard-based circle selection processing device.
[0094] The memory can be used to store computer programs and / or modules. The processor realizes various functions of the electronic whiteboard-based circle selection processing device by running or executing the computer programs and / or modules stored in the memory and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, a text conversion function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, text message data, etc.), etc. In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0095] Among them, if the module based on the circle selection processing based on the electronic whiteboard is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. Computer-readable media may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc. Ordinary technicians in this field can understand and implement it without paying creative labor.
[0096] The embodiment of the present invention provides a circle selection processing method based on an electronic whiteboard, which captures the touch event of the user on the surface of the electronic whiteboard, generates the area selected by the user by identifying the touch event, can capture the user's circle selection action in real time, and enable the user to immediately see the circled area, thereby reducing the probability of wrong circle selection. The capture and identification of touch events ensure the accuracy of the circled area, which helps to improve the accuracy of subsequent operations. The content in the circled area is identified, the object in the area is determined, and a corresponding operation menu is generated according to the type of the identified object. The operation options in the menu are related to the circled object, making the operation process more intuitive and convenient. The user can complete the operation by simply clicking without looking for other menus or toolbars. By calling different operation menus, the user can perform diversified operations on different types of content to meet a variety of usage scenarios. The instant display of the menu and the intuitive presentation of the operation options enable the user to better understand and use the functions of the electronic whiteboard. According to the instructions sent by the user in the operation menu, the identified objects in the circled area are processed accordingly, and the user's operation instructions can be quickly responded to, and the objects are processed in time, avoiding cumbersome operation steps. Furthermore, the operation menu is directly related to the circled object, which can reduce the risk of content modification or loss due to misoperation.
[0097] Example 2
[0098] See also Figure 2 , Figure 2 The present invention provides a schematic diagram of a circle selection processing device based on an electronic whiteboard according to an embodiment of the present invention. The present invention provides a circle selection processing device based on an electronic whiteboard, including: a touch recognition module 201, a menu generation module 202 and an instruction response module 203;
[0099] The touch recognition module 201 is used to capture touch events on the surface of the electronic whiteboard and recognize the touch events, and generate a circled area based on the recognition result;
[0100] The menu generation module 202 is used to perform object recognition on the circled area, obtain the recognized object in the circled area, and call a corresponding operation menu on the surface of the electronic whiteboard according to the type of the recognized object; wherein the operation menu includes a plurality of operation options;
[0101] The instruction response module 203 is used to perform object processing on the identified object in response to an operation instruction sent by the user on the operation menu.
[0102] In one embodiment, the touch recognition module 201 is used to capture touch events on the surface of the electronic whiteboard and identify the touch events, and generate a circled area based on the identification results, specifically including: monitoring the touch events on the surface of the electronic whiteboard in real time based on a touch screen driver; wherein the touch events include touch start events, touch move events, and touch end events; each time a touch event is detected, contact point position information is generated; when the user stays on the surface of the electronic whiteboard for more than a first preset time, it is determined that the touch end event is detected and the electronic whiteboard is controlled to enter a circled mode; and the circled area is generated on the surface of the electronic whiteboard based on the accumulated first contact information.
[0103] In one embodiment, the touch recognition module 201 is used to capture touch events on the surface of the electronic whiteboard and identify the touch events, and generate a circled area based on the identification results. It also includes: capturing touch events on the surface of the electronic whiteboard based on a gesture recognition library to obtain gesture information; calculating the boundary of the circled area based on the gesture information and generating the boundary on the surface of the electronic whiteboard to obtain the circled area.
[0104] In one embodiment, the step of obtaining the recognized object within the circled area and calling a corresponding operation menu on the surface of the electronic whiteboard according to the type of the recognized object specifically includes: obtaining the recognized object within the circled area; wherein the types of the recognized object include: picture and text; when the type of the recognized object is a picture, generating a first floating menu on the surface of the electronic whiteboard; wherein the operation options of the first floating menu include: picture search, picture deletion, picture copy and text selection; when the type of the recognized object is text, generating a second floating menu on the surface of the electronic whiteboard; wherein the operation options of the second floating menu include: font conversion, text search, text deletion and text copy.
[0105] In one embodiment, when the type of the identified object is text, before generating the second floating menu on the surface of the electronic whiteboard, it also includes: performing handwriting detection on the text in the circled area, and when the text is handwriting, converting the handwriting into standard text based on OCR technology; wherein the standard text is editable text.
[0106] In one embodiment, the instruction response module 203 is used to perform object processing on the identified object in response to the operation instruction sent by the user on the operation menu, specifically including: when the operation instruction is an image search instruction, calling the first preset interface to perform image search and presenting the image search results on the electronic whiteboard surface; when the operation instruction is an image deletion instruction, deleting the image in the circled area and re-rendering the electronic whiteboard surface; when the operation instruction is an image copy instruction, copying the image in the circled area to a preset position; when the operation instruction is to select text, extracting the text contained in the image in the circled area and copying it to the preset position.
[0107] In one embodiment, the instruction response module 203 is used to perform object processing on the identified object in response to the operation instruction sent by the user on the operation menu, and also includes: when the operation instruction is a font conversion instruction, converting the text in the circled area into a preset font based on OCR technology and re-rendering the preset font on the electronic whiteboard surface; when the operation instruction is a text search instruction, calling a second preset interface to perform text search and presenting the text search results on the electronic whiteboard surface; when the operation instruction is a text deletion instruction, deleting the text in the circled area and re-rendering the electronic whiteboard surface; when the operation instruction is a text copy instruction, copying the text in the circled area to a preset position.
[0108] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0109] The embodiment of the present invention provides a circle selection processing device based on an electronic whiteboard, which captures the touch event of the user on the surface of the electronic whiteboard, generates the area selected by the user by identifying the touch event, can capture the user's circle selection action in real time, and enable the user to immediately see the circled area, thereby reducing the probability of wrong circle selection. The capture and identification of touch events ensure the accuracy of the circled area, which helps to improve the accuracy of subsequent operations. The content in the circled area is identified, the object in the area is determined, and a corresponding operation menu is generated according to the type of the identified object. The operation options in the menu are related to the circled object, making the operation process more intuitive and convenient. The user can complete the operation by simply clicking without looking for other menus or toolbars. By calling different operation menus, the user can perform diversified operations on different types of content to meet a variety of usage scenarios. The instant display of the menu and the intuitive presentation of the operation options enable the user to better understand and use the functions of the electronic whiteboard. According to the instructions sent by the user in the operation menu, the identified objects in the circled area are processed accordingly, and the user's operation instructions can be quickly responded to, and the objects are processed in time, avoiding cumbersome operation steps. Furthermore, the operation menu is directly related to the circled object, which can reduce the risk of content modification or loss due to misoperation.
[0110] The above are only preferred embodiments of the present invention. It should be pointed out that, for ordinary technicians in this technical field, several improvements and substitutions can be made without departing from the technical principles of the present invention. These improvements and substitutions should also be regarded as the scope of protection of the present invention.
Claims
1. A circle selection processing method based on electronic whiteboard, It is characterized in that include: Capturing a touch event on the surface of the electronic whiteboard and identifying the touch event, and generating a circled area based on the identification result; Performing object recognition on the circled area, obtaining the recognized object in the circled area, and calling a corresponding operation menu on the surface of the electronic whiteboard according to the type of the recognized object; wherein the operation menu includes a plurality of operation options; The object processing is performed on the identified object in response to an operation instruction sent by the user on the operation menu.
2. A circle selection processing method based on an electronic whiteboard as claimed in claim 1, It is characterized in that The capturing of the touch event on the surface of the electronic whiteboard and identifying the touch event, and generating the circled area based on the identification result, specifically includes: Based on the touch screen driver, the touch events on the surface of the electronic whiteboard are monitored in real time; wherein the touch events include touch start events, touch move events and touch end events; Whenever a touch event is detected, the touch point position information is generated; When the user stays on the surface of the electronic whiteboard for more than a first preset time, determining that the touch end event is detected and controlling the electronic whiteboard to enter a circle selection mode; The circled area is generated on the surface of the electronic whiteboard based on the accumulated first contact information.
3. A circle selection processing method based on an electronic whiteboard as claimed in claim 1, It is characterized in that The method of capturing a touch event on the surface of the electronic whiteboard and identifying the touch event, and generating a circled area based on the identification result, further includes: Capturing touch events on the surface of the electronic whiteboard based on a gesture recognition library to obtain gesture information; The boundary of the circled area is calculated according to the gesture information and the boundary is generated on the surface of the electronic whiteboard to obtain the circled area.
4. A circle selection processing method based on an electronic whiteboard as claimed in claim 1, It is characterized in that The obtaining of the identified object in the circled area and calling a corresponding operation menu on the surface of the electronic whiteboard according to the type of the identified object specifically includes: Acquire the identified object in the circled area; wherein the types of the identified object include: picture and text; When the type of the identified object is a picture, a first floating menu is generated on the surface of the electronic whiteboard; wherein the operation options of the first floating menu include: picture search, picture deletion, picture copy and text selection; When the type of the identified object is text, a second floating menu is generated on the surface of the electronic whiteboard; wherein the operation options of the second floating menu include: font conversion, text search, text deletion and text copy.
5. A circle selection processing method based on an electronic whiteboard as claimed in claim 4, It is characterized in that When the type of the identified object is text, before generating the second floating menu on the surface of the electronic whiteboard, the method further includes: Handwriting detection is performed on the text in the circled area. When the text is handwriting, the handwriting is converted into standard text based on OCR technology; wherein the standard text is editable text.
6. A circle selection processing method based on an electronic whiteboard as claimed in claim 4, It is characterized in that The performing object processing on the identified object in response to the operation instruction sent by the user on the operation menu specifically includes: When the operation instruction is a picture search instruction, calling a first preset interface to perform a picture search and presenting the picture search results on the surface of the electronic whiteboard; When the operation instruction is a picture deletion instruction, the picture in the circled area is deleted and the electronic whiteboard surface is re-rendered; When the operation instruction is a picture copy instruction, the picture in the circled area is copied to a preset position; When the operation instruction is to select text, the text contained in the picture in the circled area is extracted and copied to the preset position.
7. A circle selection processing method based on an electronic whiteboard as claimed in claim 4, It is characterized in that The performing object processing on the identified object in response to the operation instruction sent by the user on the operation menu further includes: When the operation instruction is a font conversion instruction, the text in the circled area is converted into a preset font based on OCR technology and the preset font is re-rendered on the surface of the electronic whiteboard; When the operation instruction is a text search instruction, calling a second preset interface to perform a text search and presenting the text search results on the surface of the electronic whiteboard; When the operation instruction is a text deletion instruction, deleting the text in the circled area and re-rendering the electronic whiteboard surface; When the operation instruction is a text copy instruction, the text in the circled area is copied to a preset position.
8. A circle selection processing device based on an electronic whiteboard, It is characterized in that include: Touch recognition module, menu generation module and command response module; The touch recognition module is used to capture touch events on the surface of the electronic whiteboard and recognize the touch events, and generate a circled area based on the recognition result; The menu generation module is used to perform object recognition on the circled area, obtain the recognized object in the circled area, and call a corresponding operation menu on the surface of the electronic whiteboard according to the type of the recognized object; wherein the operation menu includes a plurality of operation options; The instruction response module is used to perform object processing on the identified object in response to an operation instruction sent by a user on the operation menu.
9. A terminal device, It is characterized in that The invention comprises a processor, a memory and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, the electronic whiteboard-based circle selection processing method as claimed in any one of claims 1 to 7 is implemented.
10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the electronic whiteboard-based circle selection processing method as claimed in any one of claims 1 to 7.
Citation Information
Cited By
Circling processing method and apparatus based on electronic whiteboard, and device and storage medium
WO2026045017A1
