Display device, electronic whiteboard device and whiteboard erasing method
By building a transparent first layer on the electronic whiteboard and filling the erase area, the problem of lag and erase effect delay in the electronic whiteboard under complex line drawing is solved, and a fast and synchronous whiteboard erase effect is achieved.
Patent Information
- Application Number
- CN202010680573.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-15
- Publication Date
- 2025-05-02
- Estimated Expiration
- 2040-07-15
AI Technical Summary
When performing erasing on an electronic whiteboard, the whiteboard needs to instantly calculate the intersection of the line drawings in the erase area, resulting in a lot of time when the whiteboard is drawn in complex lines, and the calculation, rendering and layer merging of electronic whiteboards can take a lot of time, resulting in the problem of lag and the display of the erase effect lags behind the user's actions.
By building a transparent first layer, the erase path entered by the user is entered into the layer, and the erase area is determined based on the initial and final position of the board erase, the area is filled with an opaque background image, and the first layer is superimposed on other layers to display.
It realizes rapid erasing and drawing lines, reduces lags during the whiteboard erasing process, ensures that the erasing effect is synchronized with user actions, and simplifies whiteboard erasing calculations.
Smart Images

Figure CN114089852B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and in particular, to a display device, an electronic whiteboard apparatus, and a whiteboard erasing method. Background Art
[0002] With the support of the application, the electronic whiteboard can be written on the display device by touching the touch-screen integrated device with a pen, hand or other touch objects. Usually, the electronic whiteboard uses a superimposed double layer, including the line drawing layer displayed on the upper layer and the background layer displayed on the lower layer. Erasing the whiteboard means erasing the written content with a blackboard eraser, hand or other touch objects.
[0003] In some whiteboard erasing implementations, the canvas.drawbitmap component service of the Android system is usually used to calculate the area to be erased through a standard drawing mechanism, obtain the erasing trajectory and the intersection points with the lines in the erased area, so as to split the lines to be erased into multiple lines, and then achieve the erasing effect of the lines by adjusting the color and transparency properties of the line pixels.
[0004] However, when the user is erasing on the electronic whiteboard, the whiteboard needs to instantly calculate the intersection of the lines in the erased area. When the lines on the whiteboard are complex, the electronic whiteboard will take a lot of time to calculate, render, and merge layers. The erasing of the whiteboard may be stuck, and the display of the erasing effect may lag behind the user's erasing action. Summary of the invention
[0005] In order to solve the problem of whiteboard erasing jamming and the erasing effect being out of sync with user actions, the present application provides a display device, an electronic whiteboard apparatus, and a whiteboard erasing method.
[0006] The embodiment of the present application is implemented as follows:
[0007] A first aspect of an embodiment of the present application provides a display device, comprising: a display, configured to display a user interface and receive an erasing path; a first controller, configured to: enter the erasing path into a first layer, wherein the first layer is set to be transparent; determine an erasing area in the first layer based on an initial position and a final position of an eraser; fill the erasing area with an opaque background image; and superimpose the first layer on other layers and display it on the display.
[0008] The second aspect of the embodiment of the present application provides a whiteboard erasing method, which includes: entering the erasing path input by the user into a first layer, and setting the first layer to be transparent; determining an erasing area in the first layer based on the initial position and final position of the eraser; filling the erasing area with an opaque background image; and superimposing the first layer on other layers for display.
[0009] A third aspect of an embodiment of the present application provides an electronic whiteboard device, including a memory, a processor, and a computer program stored in the memory, wherein when the processor executes the computer program, the whiteboard erasing method provided in the second aspect of the invention of the present application is executed.
[0010] The beneficial effects of the present application are as follows: by constructing the first layer, a separate layer can be established for the erasing path; further, by filling the erasing area with a background image, the speed of erasing lines can be accelerated; further, by overlaying the first layer for display, the whiteboard erasing calculation can be simplified; further, by determining the initial position of the eraser, it is possible to avoid misoperation of the screen outside the whiteboard application window; further, by pausing the native system refresh mechanism during the erasing process, it is possible to avoid interference of the native system with the UI interface of the whiteboard erasing operation; further, by partially refreshing the erasing area, the erasing speed can be increased, the jamming during the whiteboard erasing process can be reduced, and the problem of the erasing effect being out of sync with the user's erasing action can be solved. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0012] Figure 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment;
[0013] Figure 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to an embodiment;
[0014] Figure 3 exemplarily shows a hardware configuration block diagram of the control device 100 according to the embodiment;
[0015] Figure 4 exemplarily shows a functional configuration diagram of a display device 200 according to an embodiment;
[0016] Figure 5a exemplarily shows a schematic diagram of software configuration in a display device 200 according to an embodiment;
[0017] Figure 5b exemplarily shows a schematic diagram of the configuration of an application in a display device 200 according to an embodiment;
[0018] Fig. 6AA schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application according to an embodiment of the present application is shown;
[0019] Figure 6B A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown;
[0020] Figure 6C A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown;
[0021] Fig.6D A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown;
[0022] Fig. 6E A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown;
[0023] Fig. 6F A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown;
[0024] Figure 6G A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown;
[0025] Figure 7 A logical schematic diagram of line drawing and erasing in a TV whiteboard application according to an embodiment of the present application is shown;
[0026] Figure 8 A schematic flow chart of a whiteboard erasing method according to an embodiment of the present application is shown. DETAILED DESCRIPTION
[0027] In order to make the purpose, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, not all of the embodiments.
[0028] Based on the exemplary embodiments shown in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application. In addition, although the disclosure in this application is introduced according to one or several exemplary examples, it should be understood that each aspect of these disclosures can also constitute a complete technical solution separately.
[0029] It should be understood that the terms "first", "second", "third", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, for example, they can be implemented according to an order other than those given in the diagrams or descriptions of the embodiments of this application.
[0030] In addition, the terms "including" and "having" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.
[0031] The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0032] References throughout this specification to "multiple embodiments", "some embodiments", "one embodiment" or "an embodiment", etc., mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in at least one embodiment. Therefore, phrases such as "in multiple embodiments", "in some embodiments", "in at least another embodiment" or "in an embodiment" that appear throughout this specification do not necessarily all refer to the same embodiment. In addition, in one or more embodiments, specific features, structures or characteristics may be combined in any suitable manner. Therefore, without limitation, specific features, structures or characteristics shown or described in conjunction with one embodiment may be combined in whole or in part with features, structures or characteristics of one or more other embodiments. Such modifications and variations are intended to be included within the scope of this application.
[0033] The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually wirelessly control the electronic device within a short range. It is generally connected to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, motion sensors, etc. For example: a handheld touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.
[0034] The term "gesture" used in this application refers to a user's behavior of expressing an intended idea, action, purpose, or result through a change in hand shape or hand movement.
[0035] Figure 1 FIG. 2 is a schematic diagram showing an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through the mobile terminal 300 and the control apparatus 100 .
[0036] The control device 100 can be a remote controller, including infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, to control the display device 200 wirelessly or by wire. The user can input user commands through buttons on the remote controller, voice input, control panel input, etc. to control the display device 200. For example, the user can input corresponding control commands through the volume plus and minus keys, channel control keys, up / down / left / right movement keys, voice input keys, menu keys, power on / off keys, etc. on the remote controller to realize the function of controlling the display device 200.
[0037] In some embodiments, a mobile terminal, a tablet computer, a computer, a laptop computer, and other smart devices may also be used to control the display device 200. For example, an application running on the smart device is used to control the display device 200. The application may be configured to provide the user with various controls in an intuitive user interface (UI) on a screen associated with the smart device.
[0038] For example, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. For example, it is possible to establish a control command protocol with the mobile terminal 300 and synchronize the remote control keyboard to the mobile terminal 300, and control the user interface on the mobile terminal 300 to achieve the function of controlling the display device 200. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve a synchronous display function.
[0039] like Figure 1 It is also shown that the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. For example, the display device 200 sends and receives information, interacts with an electronic program guide (EPG), receives software program updates, or accesses a remotely stored digital media library. The server 400 may be a group or multiple groups, and may be one or more types of servers. Other network service content such as video on demand and advertising services are provided through the server 400.
[0040] The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size, and resolution are not limited. It is understood by those skilled in the art that the display device 200 may be modified in performance and configuration as required.
[0041] In addition to providing a broadcast receiving television function, the display device 200 may also provide an intelligent network television function that provides a computer support function, such as network television, intelligent television, and Internet Protocol Television (IPTV).
[0042] Figure 2 FIG. 2 is a block diagram showing a hardware configuration of a display device 200 according to an exemplary embodiment. Figure 2 As shown in the figure, the display device 200 includes a controller 210, a tuner and demodulator 220, a communication interface 230, a detector 240, an input / output interface 250, a video processor 260-1, an audio processor 60-2, a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.
[0043] The display 280 is a component for receiving an image signal input from the video processor 260-1, and displaying video content and images as well as a menu control interface. The display 280 includes a display screen component for presenting a picture, and a drive component for driving the image display. The displayed video content may be from broadcast television content, or may be various broadcast signals received through a wired or wireless communication protocol. Alternatively, various image contents sent from a network server end may be displayed via a network communication protocol.
[0044] At the same time, the display 280 simultaneously displays a user manipulation UI interface generated in the display device 200 and used to control the display device 200 .
[0045] Furthermore, depending on the type of the display 280, a driving component for driving the display is also included. Alternatively, if the display 280 is a projection display, a projection device and a projection screen may also be included.
[0046] The communication interface 230 is a component used to communicate with external devices or external servers according to various communication protocol types. For example, the communication interface 230 can be a Wifi chip 231, a Bluetooth communication protocol chip 232, a wired Ethernet communication protocol chip 233, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown in the figure).
[0047] The display device 200 can establish control signal and data signal transmission and reception with an external control device or content providing device through the communication interface 230. Also, the infrared receiver is an interface device for receiving infrared control signals from the control device 100 (such as an infrared remote controller, etc.).
[0048] The detector 240 is used by the display device 200 to collect signals of the external environment or interact with the outside world. The detector 240 includes a light receiver 242, which is a sensor for collecting the intensity of ambient light, and can adaptively display parameter changes by collecting ambient light.
[0049] And includes an image collector 241, such as a camera, a camera, etc., which can be used to collect external environment scenes, as well as to collect user attributes or interactive gestures with the user. It can adaptively change display parameters and recognize user gestures to achieve the function of interacting with the user.
[0050] In some other exemplary embodiments, the detector 240 may also be a temperature sensor, and the display device 200 may adaptively adjust the display color temperature of the image by sensing the ambient temperature. For example, when the temperature is high, the display device 200 may be adjusted to display a cooler color temperature of the image, or when the temperature is low, the display device 200 may be adjusted to display a warmer color temperature of the image.
[0051] In some other exemplary embodiments, the detector 240 may also be a sound collector, such as a microphone, which can be used to receive the user's voice, including the voice signal of the user's control instructions for controlling the display device 200, or collect environmental sounds for identifying the type of environmental scene, and the display device 200 can adaptively adapt to the environmental noise.
[0052] The input / output interface 250 is used to transmit data between the display device 200 and other external devices under the control of the controller 210, such as receiving video signals and audio signals, or command data from external devices.
[0053] Among them, the input / output interface 250 may include, but is not limited to, the following: a high-definition multimedia interface HDMI interface 251, an analog or data high-definition component input interface 253, a composite video input interface 252, a USB input interface 254, an RGB port (not shown in the figure), and any one or more interfaces.
[0054] In some other exemplary embodiments, the input / output interface 250 may also form a composite input / output interface by using the above-mentioned multiple interfaces.
[0055] The tuner-demodulator 220 receives broadcast television signals by wired or wireless reception, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and demodulate the television audio and video signals and EPG data signals carried in the television channel frequency selected by the user from multiple wireless or wired broadcast television signals.
[0056] Tuner 220, based on user selection and controlled by controller 210, responds to the user-selected television signal frequency and the television signal carried by the frequency.
[0057] The tuner-demodulator 220 can receive signals in many ways, depending on the broadcasting format of the television signal, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting signals, and can receive signals in digital or analog modulation modes according to different modulation types. Depending on the type of television signal received, it can receive analog signals and digital signals.
[0058] In some other exemplary embodiments, the tuner-demodulator 220 may also be in an external device, such as an external set-top box, etc. In this way, the set-top box outputs the television audio and video signals after modulation and demodulation, and inputs the signals into the display device 200 through the input / output interface 250 .
[0059] The video processor 260-1 is used to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal to obtain a signal that can be directly displayed or played on the display device 200.
[0060] For example, the video processor 260 - 1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
[0061] The demultiplexing module is used to demultiplex the input audio and video data streams. For example, if MPEG-2 is input, the demultiplexing module demultiplexes the data streams into video signals and audio signals.
[0062] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
[0063] The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the scaled video image to generate an image signal for display.
[0064] The frame rate conversion module is used to convert the input video frame rate, such as converting the 60Hz frame rate to 120Hz frame rate or 240Hz frame rate. The usual format is implemented by interpolation.
[0065] The display formatting module is used to receive the frame rate converted video output signal and change the signal to conform to the display format signal, such as outputting RGB data signal.
[0066] The audio processor 260-2 is used to receive external audio signals, and perform decompression and decoding, as well as noise reduction, digital-to-analog conversion, and amplification processing according to the standard codec protocol of the input signal to obtain a sound signal that can be played in the speaker.
[0067] In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.
[0068] Furthermore, in some other exemplary embodiments, the video processor 260 - 1 and the audio processor 260 - 2 may be separate chips, or may be integrated with the controller 210 into one or more chips.
[0069] The audio output 272 receives the sound signal output by the audio processor 260-2 under the control of the controller 210, such as the speaker 272, and in addition to the speaker 272 carried by the display device 200 itself, can output to the external audio output terminal 274 of the generating device of the external device, such as an external audio interface or a headphone interface.
[0070] The power supply, under the control of the controller 210, uses the power input from the external power supply to provide power supply support for the display device 200. The power supply may include a built-in power supply circuit installed inside the display device 200, or may be an external power supply installed on the display device 200, providing a power supply interface for an external power supply in the display device 200.
[0071] The user input interface is used to receive a user input signal, and then send the received user input signal to the controller 210. The user input signal may be a remote control signal received by an infrared receiver, and various user control signals may be received by a network communication module.
[0072] For example, a user inputs a user command through the remote controller 100 or the mobile terminal 300 , and the user input interface responds to the user input through the controller 210 according to the user input.
[0073] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.
[0074] The controller 210 controls the operation of the display device 200 and responds to the user's operation through various software control programs stored in the memory 290 .
[0075] like Figure 2As shown, the controller 210 includes RAM 213 and ROM 214, as well as a graphics processor 216, a CPU processor 212, a communication interface 218, such as: a first interface 218-1 to an nth interface 218-n, and a communication bus. Among them, the RAM 213 and ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected through a bus.
[0076] ROM 213 is used to store various system startup instructions. When a power-on signal is received, the display device 200 starts to power on, and the CPU processor 212 runs the system startup instructions in the ROM, and copies the operating system stored in the memory 290 to the RAM 213, so that the operating system starts to run. After the operating system is started, the CPU processor 212 copies various application programs in the memory 290 to the RAM 213, and then starts to run various application programs.
[0077] The graphics processor 216 is used to generate various graphic objects, such as icons, operation menus, and user input command display graphics. It includes an operator, which performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes. It also includes a renderer, which generates various objects based on the operator, and displays the rendered results on the display 280.
[0078] The CPU processor 212 is used to execute the operating system and application instructions stored in the memory 290, and execute various applications, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents.
[0079] In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode and / or the operation of displaying the picture in the normal mode. The multiple or one sub-processors are used for an operation in the standby mode and the like.
[0080] The controller 210 may control the overall operation of the display device 100. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.
[0081] The object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object may include, for example, displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon. User commands for selecting UI objects may be commands inputted through various input devices (e.g., a mouse, keyboard, touchpad, etc.) connected to the display device 200 or voice commands corresponding to voices spoken by the user.
[0082] The memory 290 includes various software modules for driving the display device 200. For example, the various software modules stored in the memory 290 include a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
[0083] The basic module is a bottom-level software module used for signal communication between various hardware in the postpartum care display device 200 and for sending processing and control signals to the upper-level modules. The detection module is a management module used for collecting various information from various sensors or user input interfaces, and performing digital-to-analog conversion and analysis management.
[0084] For example, the speech recognition module includes a speech analysis module and a speech instruction database module. The display control module is a module used to control the display 280 to display image content, and can be used to play multimedia image content and UI interface information. The communication module is a module used to control and communicate data with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is a module used to provide various services and various applications.
[0085] At the same time, the memory 290 is also used to store received external data and user data, images of various items in various user interfaces, and visual effect images of focus objects, etc.
[0086] Figure 3 FIG. 1 is a block diagram showing a configuration of a control device 100 according to an exemplary embodiment. Figure 3 As shown, the control device 100 includes a controller 110 , a communication interface 130 , a user input / output interface 140 , a memory 190 , and a power supply 180 .
[0087] The control device 100 is configured to control the display device 200, and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200. For example, the user operates the channel increase and decrease keys on the control device 100, and the display device 200 responds to the channel increase and decrease operations.
[0088] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.
[0089] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other smart electronic device can play a similar function to the control device 100 after installing the application for controlling the display device 200. For example, the user can install the application to realize the function of the physical button of the control device 100 through various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other smart electronic device.
[0090] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.
[0091] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display device 200. For example, the received user input signal is sent to the display device 200. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip, a Bluetooth module, and an NFC module.
[0092] The user input / output interface 140 includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144. For example, the user can input user commands through voice, touch, gesture, pressing, and other actions. The input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding command signal, and sends it to the display device 200.
[0093] The output interface includes an interface for sending received user commands to the display device 200. In some embodiments, it can be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input command needs to be converted into an infrared control signal according to an infrared control protocol, and then sent to the display device 200 via an infrared sending module. For another example, in the case of a radio frequency signal interface, the user input command needs to be converted into a digital signal, and then modulated according to a radio frequency control signal modulation protocol, and then sent to the display device 200 by a radio frequency sending terminal.
[0094] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.
[0095] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller 110. The memory 190 can store various control signal instructions input by the user.
[0096] The power supply 180 is used to provide operating power support for various components of the control device 100 under the control of the controller 110. It can be a battery and related control circuits.
[0097] Figure 4 FIG. 2 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to an exemplary embodiment. Figure 4 As shown, the memory 290 is used to store operating systems, applications, content, and user data, etc., and drives the system operation of the display device 200 and responds to various user operations under the control of the controller 210. The memory 290 may include volatile and / or non-volatile memory.
[0098] The memory 290 is specifically used to store the operating program that drives the controller 210 in the display device 200, and to store various applications built into the display device 200, various applications downloaded by users from external devices, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and various internal data supporting the applications. The memory 290 is used to store system software such as the OS kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.
[0099] The memory 290 is specifically used to store drivers and related data such as the audio and video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, and the input / output interface of the detector 240.
[0100] In some embodiments, the memory 290 may store software and / or programs, and the software programs used to represent the operating system (OS) include, for example, a kernel, middleware, an application programming interface (API), and / or an application. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application), and the kernel may provide an interface to allow the middleware and API, or the application to access the controller to control or manage system resources.
[0101] For example, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, an optical receiving module 2909, a power control module 2910, an operating system 2911, and other applications 2912, a browser module, etc. The controller 210 executes various software programs in the memory 290 to perform functions such as: broadcast television signal reception and demodulation function, television channel selection control function, volume selection control function, image control function, display control function, audio control function, external command recognition function, communication control function, optical signal reception function, power control function, a software control platform supporting various functions, and other applications such as a browser function.
[0102] Figure 5a Schematically shows a configuration block diagram of a software system in a display device 200 according to an exemplary embodiment.
[0103] like Figure 5a As shown in , the operating system 2911 includes execution software for processing various basic system services and for implementing hardware-related tasks, and acts as a medium for data processing between application programs and hardware components. In some embodiments, part of the operating system kernel may include a series of software for managing display device hardware resources and providing services for other programs or software codes.
[0104] In some other embodiments, a portion of the operating system kernel may include one or more device drivers, which may be a set of software codes in the operating system that help operate or control devices or hardware associated with the display device. The driver may include code to operate video, audio, and / or other multimedia components. Examples include display, camera, Flash, WiFi, and audio drivers.
[0105] Among them, the accessibility module 2911-1 is used to modify or access the application to achieve the accessibility of the application and the operability of its displayed content.
[0106] The communication module 2911 - 2 is used to connect to other peripheral devices via relevant communication interfaces and communication networks.
[0107] The user interface module 2911 - 3 is used to provide objects for displaying the user interface so that each application can access it and realize user operability.
[0108] Control application 2911-4 is used for controllable process management, including runtime applications, etc.
[0109] The event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand, and in the application 2912 on the other hand, and is used to monitor various user input events, and implement one or more groups of predefined operation handlers according to the recognition results of various events or sub-events in response to various event references.
[0110] The event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.
[0111] The event identification module 2914-1 is used to define various types of events inputted by various user input interfaces, identify various events or sub-events, and transmit them to the processor for executing one or more corresponding processing procedures.
[0112] Among them, events or sub-events refer to inputs detected by one or more sensors in the display device 200, and inputs from external control devices (such as the control device 100, etc.). For example: various sub-events of voice input, gesture input of gesture recognition, and sub-events of remote control key command input of the control device, etc. For example, one or more sub-events in the remote control include multiple forms, including but not limited to one or a combination of pressing up / down / left / right / , confirming key, pressing and holding a key, etc. And operations of non-physical keys, such as moving, pressing, releasing, etc.
[0113] The interface layout manager 2913 directly or indirectly receives user input events or sub-events monitored by the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the positions of each control or sub-control in the interface, as well as the size or position and hierarchy of the container and other execution operations related to the interface layout.
[0114] like Figure 5b As shown in , the application layer 2912 includes various applications that can also be executed on the display device 200. The application may include but is not limited to one or more applications, such as: live TV application, video on demand application, media center application, application center, game application, etc.
[0115] The live TV application can provide live TV through different signal sources. For example, the live TV application can provide a TV signal using input from cable TV, wireless broadcast, satellite service, or other types of live TV services. And, the live TV application can display the video of the live TV signal on the display device 200.
[0116] Video on demand applications can provide videos from different storage sources. Unlike live TV applications, video on demand provides video display from some storage source. For example, video on demand can come from the server side of cloud storage, or from the local hard disk storage containing stored video programs.
[0117] Media center applications can provide various multimedia content playback applications. For example, a media center can be a service that users can access various images or audios through a media center application, which is different from live TV or video on demand.
[0118] The application center can provide and store various applications. The application can be a game, an application, or some other application related to a computer system or other device but can be run on a smart TV. The application center can obtain these applications from different sources, store them in a local storage, and then run them on the display device 200.
[0119] The embodiments of the present application can be applied to various types of display devices (including but not limited to smart TVs, tablet computers, etc.). The following will describe the technical solution in the UI interface related to line erasing in a TV whiteboard application.
[0120] Figure 6A-6G A schematic diagram of a UI interface for erasing a line in an electronic whiteboard application of a display device according to an embodiment of the present application is shown.
[0121] in, Fig. 6A A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application according to an embodiment of the present application is shown.
[0122] The display device provided in the present application includes a display, which is configured to display a user interface and receive an erase path. As shown in the figure, the main window in the display device UI is an electronic whiteboard UI, and track 601 is a line that the user has written into the electronic whiteboard. In some embodiments, the electronic whiteboard generally uses a superimposed double layer, that is, a line layer displayed on the upper layer and a background layer displayed on the lower layer. During the writing process, the writing area formed by the lines formed by the writing is displayed opaquely and displayed as the line color. After the line writing is completed and enters the writing queue, the lines entering the writing queue are calculated to update the line layer, thereby realizing the line writing function of the electronic whiteboard.
[0123] In some embodiments, taking the drawing line 601 as an example, for a touch screen terminal, it is usually displayed to the user through a canvas in the form of an application. The user can touch the canvas with a finger or move on the screen through a touch tool. The terminal receives and identifies the user's sliding trajectory, collects touch points, and connects to form a drawing line path (Path). At the same time, the touch data of the drawing line needs to be saved. In some embodiments, the first controller of the display device abstracts the drawing line into a command object, and its touch data, such as the touch point position coordinates of the drawing line, the thickness of the touch track, the color, etc., are all saved as touch data in the command object. Then the upper-level application calls the touch data through the command object, modifies and edits the touch data, and other operations. For example, when a drawing line in the canvas needs to be edited, the touch data needs to be modified through the command object.
[0124] In some embodiments, the electronic whiteboard UI also includes whiteboard operation controls for operating and configuring the electronic whiteboard. The whiteboard operation controls may include, for example, a brush control for input, an eraser control for erasing, a color palette control for selecting background color and brush color, etc.
[0125] In some embodiments, while the display device is applying an electronic whiteboard, the display device is also configured to display other interactive elements, which may include, for example, a TV home page control, a search control, a message button control, a mailbox control, a browser control, a favorites control, a signal bar control, a voice control, etc.
[0126] In order to improve the convenience and image of the TV UI, the display device provided in the embodiment of the present application includes a first controller, which controls the TV and its UI in response to the operation of the interactive element. For example, the user clicks the search control through a controller such as a remote control, and the search UI can be displayed on top of other UIs, that is, the UI of the application component that controls the interactive element mapping can be enlarged, or run and displayed in full screen.
[0127] In some embodiments, the interactive elements of the television may also be operated by sensors, which may be, but are not limited to, acoustic input sensors, pressure sensors, such as microphones, touch screens, which may detect voice commands including indications of the desired interactive elements, or touch instructions.
[0128] Figure 6B A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown.
[0129] The display device provided in the present application includes a display configured to receive an erasing path. The figure shows the motion trajectory of a user erasing a drawing line 601 using an eraser, wherein the eraser erases from an initial position 602 to a final position 603 in a vertical direction.
[0130] In some embodiments, when the user uses the eraser, the first controller enters the erasing path input by the user into the first layer, and sets the first layer to have a transparent attribute.
[0131] In addition to the line drawing layer displayed on the upper layer and the background layer displayed on the lower layer, the electronic whiteboard of the display device also includes a first layer for recording erase tracks. When the whiteboard application is started, the first controller initializes the first layer to the system's Native (local framework) layer to communicate through the Native layer and the upper whiteboard application code.
[0132] That is, it can be considered that in the embodiment of the present application, when inputting, the user enters the trajectory of the drawing into the drawing layer, and when erasing, the user enters the erasing path of the eraser into the first layer provided in the embodiment of the present application.
[0133] In some embodiments, the first controller of the display device acquires erasing key points according to the user's touch gestures on the display, connects the erasing key points to form an erasing path, saves the data of the erasing path and records the erasing path into a first layer. For example, the first layer can be implemented as a canvas bitmap.
[0134] It should be noted that the eraser of the electronic whiteboard can be set to a touch object or the user's palm, and its shape can be set to Figure 6B The rectangle shown can also be set to a circle, a triangle, or other shapes.
[0135] The first controller collects and obtains the key points of erasing by the user, and then smoothly connects the key points of erasing to form an erasing path. In some embodiments, the first controller can also fill in points between the key points of erasing. For example, when the erasing path is formed by the erasing points, it is determined whether to fill in points according to the minimum spacing Dmin of adjacent points, and the minimum spacing Dmin is the minimum radius of the rectangular blackboard eraser in the figure. When the distance between adjacent erasing points is greater than Dmin, fill in points for this adjacent point until the distance between two adjacent points is less than Dmin.
[0136] After the first layer records the erasing path input by the user, the first controller determines the erasing area in the first layer based on the initial position and the final position of the eraser.
[0137] In some embodiments, when the initial position of the eraser does not intersect with the final position, the first controller configures the erasing area as an eraser path area that does not include the final position.
[0138] like Figure 6B As shown, the blackboard eraser moves vertically downward from the initial position 602 to the final position 603 through the erasing path, and the first controller can calculate the erasing area as the initial position 602 and the area along the erasing path of the blackboard eraser according to the shape of the blackboard eraser and the erasing path, as shown in the figure. It should be noted that the erasing area in the present application does not include the final position 603 of the blackboard eraser. This setting allows the user to always be in a visual state of the erased content during the line erasing process, which can improve the accuracy of erasing the line.
[0139] Figure 6C A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown.
[0140] based on Figure 6B The figure shows the UI schematic diagram after the drawing line 601 is erased by the eraser. It can be found that the display effect of the erased area is the same as the background layer, and the erasure of the drawing line is achieved.
[0141] After determining the erased area in the first layer, the first controller fills the erased area with an opaque background image, and then overlays the first layer on other layers and displays it on the display, such as Figure 6C shown.
[0142] In some embodiments, when the electronic whiteboard is in the erased state, after the first controller obtains the erased area, it changes the pixel attributes included in the erased area in the first layer to opaque, and sets the erased area as the background image, that is, sets the pixels contained in the erased area to the color settings of the pixels in the background layer.
[0143] For example, the color of the line drawing 601 in the upper line drawing layer is black, and the parameter configuration is (0, 0, 0), and the color presented by the lower background layer is white, and the parameter configuration is (255, 255, 255). Since the attributes of the pixels contained in the line drawing 601 in the upper line drawing layer are opaque, the black line drawing 601 can be seen, and the attributes of the pixels in the remaining area of the line drawing layer are all transparent, so that the white background can be seen. The first controller sets the color of the erased area in the first layer to the color of the background layer (255, 255, 255), sets the attributes of the pixels to opaque, and sets the attributes of the pixels in other areas of the first layer to transparent by default.
[0144] Finally, the first controller overlays the erased area with the set first layer on other layers and displays it on the display. For example, the first layer can be specifically implemented as overlaying the upper end of the background layer and the line layer, thereby achieving the erasure of the electronic whiteboard line, as shown in the figure.
[0145] Since the first layer is on top of the other layers, the erasing area is configured as a background image, and the erasing effect of the erasing area of the drawing line 601 can be achieved by superimposing and synthesizing the images.
[0146] It can be understood that by recording the erasing path into a separate first layer, the erasing area can be quickly acquired, and there is no need to calculate the intersection of the erasing area and the existing drawing lines, nor is there a need to split the existing drawing lines. This avoids using the drawing mechanism to erase the whiteboard content, can increase the whiteboard erasing speed, reduce the amount of calculation on the display device, and achieve synchronization between whiteboard erasing and user erasing actions.
[0147] It should be noted that the final position 603 still retains the drawing lines in the drawing line layer, thus achieving accurate erasing of the electronic whiteboard.
[0148] In some embodiments, during the recording of the erasing path of the first layer, the first controller suspends the native system refresh mechanism of the display device and uses the Native layer refresh mechanism to partially refresh the erasing area.
[0149] After detecting that the electronic whiteboard is in the erased state, the first controller temporarily terminates the native system refresh mechanism of the display device set in the whiteboard application. The native system refresh mechanism is used to periodically refresh the screen of the electronic whiteboard. Through the refresh, the user interface on the screen of the electronic whiteboard sometimes pops up advertising pages or dialog boxes and other content for users to watch. For example, if the user inserts a USB into the electronic whiteboard, the native system refresh mechanism can detect the insertion of the USB, so that a dialog box for prompting the USB insertion is displayed on the screen of the electronic whiteboard, resulting in confusion in the user interface and affecting the user's operation and viewing of the electronic whiteboard.
[0150] During the process of continuously rendering and overlaying the first layer, the first controller uses a customized Native layer refresh mechanism to refresh the erased area of the first layer, and overlays it with other layers to achieve a whiteboard erasing effect.
[0151] In some embodiments, after detecting that the electronic whiteboard completes the erasing action, the first controller restarts the native system refresh mechanism of the display device to avoid affecting the look and feel of the user interface and other functions.
[0152] In some embodiments, when the initial position of the eraser intersects with the final position, the first controller configures the erasing area to be the initial position minus the intersecting area.
[0153] Fig.6D A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown.
[0154] In the figure, the moving trajectory of the eraser moves from the initial position 602 to the final position 603, and the initial position and the final position intersect. In the intersection area 604, it can be found that the end point of the drawing line 601 at the center is located in the intersection area 604. Based on the shape of the eraser and the erasing path of the eraser, the first controller sets the erasing area in the first layer as the area to be filled 605.
[0155] Then, the first controller fills the erased area, i.e., the area to be filled 605, with an opaque background image, i.e., sets the color of the pixels contained in the fill area 605 to the color of the background layer (255, 255, 255), sets the pixel attributes to opaque, and sets the pixel attributes in other areas of the first layer to transparent by default.
[0156] Finally, the first controller superimposes the first layer on other layers and displays them on the display, such as Fig. 6E shown.
[0157] Fig. 6E A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown.
[0158] based on Fig.6D The figure shows the UI schematic diagram after the drawing line 601 is erased by the eraser. It can be found that the display effect of the erased area is the same as the background layer, and the erasure of the drawing line is achieved.
[0159] After determining the erasing area in the first layer, the area to be filled 605, the first controller fills the filling area 605 with an opaque background image, and then overlays the first layer on other layers and displays it on the display. For example, the first layer can be specifically implemented as being overlaid on the upper end of the background layer and the line drawing layer, thereby achieving erasing of the electronic whiteboard line drawing, as shown in the figure.
[0160] In some embodiments, when the initial position of the eraser exceeds the area of the whiteboard application window, the first controller updates the initial position to the intersection area of the eraser and the whiteboard application window.
[0161] Fig. 6F A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown.
[0162] The electronic whiteboard UI is a small window on the screen. The initial position of the eraser is located at the border 606 of the electronic whiteboard UI. The first controller configures the initial position 602 of the eraser as the intersection area of the eraser and the electronic whiteboard application window, as shown in the figure.
[0163] The moving track of the eraser moves from the initial position 602 to the final position 603, and the initial position and the final position intersect, and their intersection area 604, based on the shape of the eraser and the erasing path of the eraser, the first controller sets the erasing area in the first layer as the area to be filled 605.
[0164] Then, the first controller fills the erased area, i.e., the area to be filled 605, with an opaque background image, i.e., sets the color of the pixels contained in the fill area 605 to the color of the background layer (255, 255, 255), sets the pixel attributes to opaque, and sets the pixel attributes in other areas of the first layer to transparent by default.
[0165] Finally, the first controller superimposes the first layer on other layers and displays them on the display, such as Figure 6G shown.
[0166] Figure 6G A schematic diagram of a UI interface for drawing and erasing lines in a TV whiteboard application in another embodiment of the present application is shown.
[0167] based on Fig. 6F The figure shows the UI schematic diagram after the drawing line 601 is erased by the eraser. It can be found that the display effect of the erased area is the same as the background layer, and the erasure of the drawing line is achieved.
[0168] After determining the erasing area in the first layer, the area to be filled 605, the first controller fills the filling area 605 with an opaque background image, and then overlays the first layer on other layers and displays it on the display. For example, the first layer can be specifically implemented as being overlaid on the upper end of the background layer and the line drawing layer, thereby achieving erasing of the electronic whiteboard line drawing, as shown in the figure.
[0169] Figure 7 A logical schematic diagram of line drawing and erasing in a TV whiteboard application in an embodiment of the present application is shown.
[0170] In step 701, the first layer is initialized and transferred to the Native layer.
[0171] In addition to the line drawing layer displayed on the upper layer and the background layer displayed on the lower layer, the electronic whiteboard of the display device also includes a first layer for recording erase tracks. For example, the first layer can be implemented as a canvas bitmap. When the whiteboard application is started, the first controller initializes the first layer to the Native layer of the system to communicate with the upper whiteboard application code through the Native layer.
[0172] In step 702, touch key points are collected according to the touch gesture
[0173] The first controller collects and obtains the user's input gesture on the display screen to obtain touch key points, that is, erasing key points. The erasing key points may include a starting point, an inflection point, an end point, etc.
[0174] In step S703 , the touch key points are connected to form a touch path, and the touch data is saved and recorded into the first layer canvas bitmap.
[0175] The first controller collects and obtains the key erasing points of the user, and then smoothly connects the key erasing points to form an erasing path. In some embodiments, the first controller can also fill in points between the key erasing points to obtain a more accurate erasing path.
[0176] In step S704, the native system refresh mechanism of the Android system of the display device is stopped.
[0177] After detecting that the electronic whiteboard is in the erased state, the first controller temporarily terminates the native system refresh mechanism of the display device set in the whiteboard application to prevent the native system refresh mechanism from periodically refreshing the screen of the electronic whiteboard to pop up advertising pages or dialog boxes, etc., affecting the viewing and operation of the erased whiteboard.
[0178] In step S705, the erased area of the first layer is refreshed using the custom Native layer.
[0179] In step 706, the first layer is superimposed on other layers.
[0180] While the first controller is continuously rendering and overlaying the first layer, the first controller uses a custom Native layer refresh mechanism to partially refresh the first layer, that is, the erased area in the canvas bitmap, and then overlays the refreshed first layer on top of other layers.
[0181] In step S707, the Panel screen is displayed.
[0182] The display device displays the first layer superimposed on the comprehensive layer composed of other layers on the display, so as to achieve the effect of erasing the whiteboard.
[0183] In step S707, after erasing is completed, the screen is refreshed using the Android native system refresh mechanism.
[0184] After the first controller detects that the electronic whiteboard completes the erasing action, the first controller restarts the native system refresh mechanism of the display device to restore the normal display of other functional applications of the display device UI.
[0185] In some embodiments, when the drawn line of the whiteboard is erased, the first controller of the display device will calculate the alpha value of the erased area of the first layer and configure its alpha value when the first layer is superimposed.
[0186] For example, when the first layer src is superimposed on the line drawing layer dst, the pixels of the final output comprehensive layer outcome image and its calculation formula can be expressed as follows:
[0187] outcome.alpha=src.alpha*src.alpha+dst.alpha*(1-src.alpha);
[0188] outcome.red=src.red*src.alpha+dst.red*(1-src.alpha);
[0189] outcome.blue=src.blue*src.alpha+dst.blue*(1-src.alpha);
[0190] outcome.green=src.green*src.alpha+dst.green*(1-src.alpha);
[0191] Among them, outcome.alpha represents the transparency of the comprehensive layer; src.alpha represents the transparency of the first layer; outcome.red / blue / green represent the color configuration parameters of the pixels of the comprehensive layer; src.red / blue / green represent the color configuration parameters of the pixels of the first layer; dst.red / blue / green represent the color configuration parameters of the pixels of the line drawing layer.
[0192] Based on the above description of the line-drawing and erasing UI interface in the TV whiteboard application in FIG6 and the operation of the display device, the present application also provides a whiteboard erasing method.
[0193] Figure 8 A schematic flow chart of a whiteboard erasing method according to an embodiment of the present application is shown.
[0194] In step 801, the erasing path input by the user is recorded into the first layer, and the first layer is set to be transparent;
[0195] In step 802, based on the initial position and final position of the eraser, an erasure area is determined in the first layer;
[0196] In step 803, the erased area is filled with an opaque background image;
[0197] In step 804, the first layer is superimposed on other layers for display.
[0198] The specific content of the whiteboard erasing method has been described above. Figure 6A-6G The relevant whiteboard erasing UI interface introduction and the specific operations involved in the display device are explained in detail and will not be repeated here.
[0199] The present application also provides an electronic whiteboard device, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the content of the whiteboard erasing method provided in the embodiment of the present application when executing the computer program.
[0200] The beneficial effects of the embodiments of the present application are that, by constructing the first layer, a separate layer can be established for the erasing path; further, by filling the erasing area with a background image, the speed of erasing lines can be accelerated; further, by superimposing the first layer on the display, the whiteboard erasing calculation can be simplified; further, by determining the initial position of the eraser, it is possible to avoid misoperation of the screen outside the whiteboard application window; further, by pausing the native system refresh mechanism during the erasing process, it is possible to avoid the native system from interfering with the UI interface of the whiteboard erasing operation; further, by partially refreshing the erasing area, the erasing speed can be increased, the jamming during the whiteboard erasing process can be reduced, and the problem of the erasing effect being out of sync with the user's erasing action can be solved.
[0201] In addition, it will be appreciated by those skilled in the art that various aspects of the present application may be illustrated and described by a number of patentable categories or situations, including any new and useful process, machine, product or combination of substances, or any new and useful improvements thereto. Accordingly, various aspects of the present application may be performed entirely by hardware, entirely by software (including firmware, resident software, microcode, etc.), or by a combination of hardware and software. The above hardware or software may all be referred to as "data blocks", "controllers", "engines", "units", "components" or "systems". In addition, various aspects of the present application may be represented as computer products located in one or more computer-readable media, which include computer-readable program codes.
[0202] A computer storage medium may include a propagated data signal containing computer program code, for example, in baseband or as part of a carrier wave. The propagated signal may be in a variety of forms, including electromagnetic, optical, etc., or a suitable combination. A computer storage medium may be any computer-readable medium other than a computer-readable storage medium, which can be connected to an instruction execution system, device or apparatus to communicate, propagate or transmit the program for use. The program code on the computer storage medium may be transmitted via any suitable medium, including radio, cable, fiber optic cable, RF, or similar media, or any combination of the above media.
[0203] The computer program coding required for the operation of each part of the application can be written in any one or more programming languages, including object-oriented programming languages such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB.NET, Python, etc., conventional procedural programming languages such as C language, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages such as Python, Ruby and Groovy, or other programming languages, etc. The program coding can be run completely on the user's computer, or run on the user's computer as an independent software package, or run partly on the user's computer and partly on the remote computer, or run completely on the remote computer or server. In the latter case, the remote computer can be connected to the user's computer through any network form, such as a local area network (LAN) or a wide area network (WAN), or connected to an external computer (e.g., via the Internet), or in a cloud computing environment, or used as a service such as software as a service (SaaS).
[0204] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this application, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this application. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this application. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.
[0205] Similarly, it should be noted that in order to simplify the description of the disclosure of this application and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this application, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the object of this application are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.
[0206] Each patent, patent application, patent application disclosure, and other materials, such as articles, books, instructions, publications, documents, etc., cited in this application are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the content of this application, documents that limit the broadest scope of the claims of this application (currently or later attached to this application) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the attached materials of this application are inconsistent or conflicting with the content described in this application, the descriptions, definitions, and / or use of terms in this application shall prevail.
Claims
1. A display device, characterized in that: include: a touch screen configured to display a user interface and receive an erase path; The first controller is configured as: Controlling the touch screen to display a user interface, the user interface comprising a first layer, the first layer being a transparent layer when no erasing path is entered; In response to an erasing operation input by a user, an erasing path is generated based on an initial position and a final position of the eraser, and the erasing path is recorded in a first layer, wherein the display level of the first layer is higher than that of the line drawing layer and the background layer; Based on the erasing path, determining an erasing area in the first layer; Setting the pixel attribute of the erased area to be opaque; Get the color of the background layer; The color of the pixels included in the erased area is set to the color of the background layer, and the pixel attributes of other areas in the first layer outside the erased area are set to be transparent; The touch screen is controlled to display a superimposed image of the first layer, the line drawing layer, and the background layer.
2. The display device according to claim 1, characterized in that: The first controller determines the erasing area in the first layer based on the initial position and the final position of the eraser in the erasing path, and is specifically configured as follows: The erasing area is configured as an eraser path area that does not include the final position; When the initial position and the final position of the eraser intersect, the erasing area is configured as the initial position minus the intersecting area.
3. The display device according to claim 1, characterized in that: The first controller is further configured to: When the whiteboard application is started, the first layer is initialized to the system's Native layer; During the recording of the erasing path, the first layer suspends the native system refresh mechanism of the display device and uses the Native layer refresh mechanism to partially refresh the erasing area; After detecting that the electronic whiteboard has completed the erasing action, the native system refresh mechanism of the display device is restarted.
4. The display device according to claim 1, characterized in that: Before the first controller executes recording the erasing path into the first layer, the first controller is further configured to: Acquire the erasing key points collected by the touch screen; Smoothly connecting the erasing key points to generate the erasing path; The erase path is saved.
5. The display device according to claim 4, characterized in that: The first controller executes smooth connection of the erasing key points to generate the erasing path, and is specifically configured as follows: Get the minimum distance between adjacent points, where the minimum distance is the minimum radius of the eraser control; Calculating the distance between adjacent erasure key points; If the distance between adjacent erasure key points is greater than the minimum distance, fill in points between adjacent erasure key points.
6. A whiteboard erasing method, characterized in that: The display device according to any one of claims 1 to 5, wherein the display device comprises a touch screen and a first controller, wherein the touch screen is configured to display a user interface, and the method for receiving an erasure path comprises: Controlling the touch screen to display a user interface, the user interface comprising a first layer, the first layer being a transparent layer when no erasing path is entered; In response to an erasing operation input by a user, an erasing path is generated based on an initial position and a final position of the eraser, and the erasing path input by the user is recorded in a first layer, wherein the display level of the first layer is higher than the line drawing layer and the background layer; Based on the erasing path, determining an erasing area in the first layer; Setting the pixel attribute of the erased area to be opaque; Get the color of the background layer; Setting the color of the pixels filled in the erased area to the color of the background layer, and setting the pixel attributes of other areas in the first layer outside the erased area to transparent; The touch screen is controlled to display a superimposed image of the first layer, the line drawing layer, and the background layer.
7. The whiteboard erasing method according to claim 6, characterized in that: Determining an erasure area in the first layer based on the erasure path includes: When the initial position and the final position of the eraser do not intersect, configuring the erasing area to be an eraser path area that does not include the final position; When the initial position and the final position of the eraser intersect, the erasing area is configured as the initial position minus the intersecting area.
8. The whiteboard erasing method according to claim 6, characterized in that: Also includes: When the whiteboard application is started, the first layer is initialized to the system's Native layer; During the recording of the erasing path, the first layer suspends the native system refresh mechanism of the display device and uses the Native layer refresh mechanism to partially refresh the erasing area; After detecting that the electronic whiteboard has completed the erasing action, the native system refresh mechanism of the display device is restarted.
9. The whiteboard erasing method according to claim 6, characterized in that: Before recording the erasing path into the first layer, the method further includes: obtaining erasing key points collected by the touch screen; Smoothly connecting the erasing key points to generate the erasing path; The erase path is saved.
10. The whiteboard erasing method according to claim 9, characterized in that: Smoothly connecting the erasing key points to generate the erasing path, comprising: Get the minimum distance between adjacent points, where the minimum distance is the minimum radius of the eraser control; Calculating the distance between adjacent erasure key points; If the distance between adjacent erasure key points is greater than the minimum distance, fill in points between adjacent erasure key points.
11. An electronic whiteboard device, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory, wherein the processor executes the whiteboard erasing method according to any one of claims 6 to 10 when executing the computer program.
Citation Information
Patent Citations
Method for erasing vector scripts
CN104992460A
Drawn line erasing method and drawn line erasing device
CN106910232A
Picture display method and device and readable storage medium
CN107544730A
Annotation display method and device therefor, and intelligent interactive tablet
CN108874292A
Method, apparatus, equipment and storage medium for wiping electronic whiteboard
CN109324724A