A display device and a display method

Abstract

The application shows a display device and a display method, which solve the problem that the boundary color is erased when the completed coloring is erased. The display device comprises a display configured to show a coloring interface, the coloring interface comprising a coloring picture and an erasing control, the coloring picture comprising a coloring area and a boundary surrounding the coloring area; a touch component forming a touch screen with the display to receive a user instruction; and a controller configured to: acquire a moving track formed by a user selecting a pixel point on the touch screen; confirm a target erasing area corresponding to the moving track; judge whether the position coordinates of each pixel point in the target erasing area are the position coordinates of the boundary; if the position coordinates of the pixel point are not the position coordinates of the boundary, delete the pixel point; and if the position coordinates of the pixel point are the position coordinates of the boundary, retain the boundary.

Description

[0001] This application claims priority to Chinese Patent Application No. 202110741457.8, filed on June 30, 2021, entitled “A Display Device and Display Method”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to display technology. More specifically, it relates to a display device and a display method. Background Technology

[0003] The operability of the user interface on a smart TV significantly impacts the user experience. With the increasing prevalence of smart TVs, more and more educational, entertainment, and children's learning applications can be used on television. A drawing board is crucial for both teaching and children's educational purposes. We provide users with different types of coloring pictures for coloring.

[0004] In existing technology, the coloring area and coloring boundary are stored in the same image during the coloring process. When the completed coloring is erased, the boundary is also erased at the same time. This destroys the boundary information of the coloring image, which may cause the coloring to go outside the area, affecting the coloring function and user experience. Summary of the Invention

[0005] This application provides a display device and display method through exemplary embodiments, solving the problem that boundary colors are simultaneously erased when erasing completed coloring. This application avoids damaging the boundary information of the colored image, thereby preventing coloring outside the designated coloring area and improving the user experience when operating the display device.

[0006] In a first aspect, this application provides a display device, comprising: a display configured to display a coloring interface, the coloring interface including a coloring image, coloring controls, and an erasing control, the coloring image including a coloring area and a boundary surrounding the coloring area; a touch component for receiving user touch input instructions, wherein the touch component and the display form a touch screen; and a controller configured to: acquire a movement trajectory formed by a pixel selected by the user on the touch screen; confirm a target erasing area corresponding to the movement trajectory; determine whether the position coordinates of each pixel in the target erasing area are the position coordinates of the boundary; if the position coordinates of the pixel are not the position coordinates of the boundary, delete the pixel; if the position coordinates of the pixel are the position coordinates of the boundary, retain the boundary.

[0007] In some embodiments of this application, the colored area includes an already colored area; the controller is further configured to: save the configuration information of the pixels on the already colored area and the configuration information of the boundary in the same file, so that the already colored area and the boundary are displayed in the same image; if the position coordinates of the pixel are not the position coordinates of the boundary, then delete the pixel; including: if the position coordinates of the pixel are not the position coordinates of the boundary, then delete the configuration information of the pixel in the same file.

[0008] In some embodiments of this application, if the position coordinates of a pixel are the position coordinates of a boundary, the boundary is preserved; including: if the position coordinates of a pixel are not the position coordinates of a boundary, the boundary configuration information is preserved in the same file.

[0009] In some embodiments of this application, confirming the target erasure area corresponding to the movement trajectory includes: confirming a first intersecting trajectory, the first intersecting trajectory being a set of pixels where the movement trajectory intersects with the painted area; and confirming the target erasure area based on the first intersecting trajectory.

[0010] In some embodiments of this application, the colored area also includes an uncolored area; confirming the target erasure area corresponding to the movement trajectory includes: confirming a second intersecting trajectory, the second intersecting trajectory being a set of pixels where the movement trajectory intersects with the uncolored area; and confirming the target erasure area based on the pixels on the movement trajectory other than the second intersecting trajectory.

[0011] In some embodiments of this application, the controller is further configured to: traverse and read the color of each pixel on the coloring image; if the color of a pixel is the color of the boundary, then save the position coordinates of the pixel as the position coordinates of the boundary to the memory.

[0012] In some embodiments of this application, the color of the boundary is a first color, and the color of the uncolored area is a second color, the first color and the second color are different; if the color of a pixel is the color of the boundary, the position coordinates of the pixel are saved as the position coordinates of the boundary to the memory; including: determining whether the color of the pixel is the first color; if the color of the pixel is the first color, the position coordinates of the pixel are saved as the position coordinates of the boundary to the memory.

[0013] In some embodiments of this application, the target erasure area includes a set of all pixels whose distance from the movement trajectory is less than or equal to a preset erasure width.

[0014] In some embodiments of this application, the step of obtaining the user's movement trajectory on the touch screen includes: reading the touch screen event type, which includes: finger drop event, finger movement event, and finger lift event; when it is a finger drop event, obtaining the pixel position passed by the finger movement to confirm the movement trajectory; when it is a finger movement event, obtaining the pixel position passed by the finger movement to confirm the movement trajectory; and when it is a finger lift event, ending the touch screen event reading operation.

[0015] Secondly, this application provides a display method, including: acquiring the movement trajectory formed by a user selecting a pixel on a touch screen; confirming the target erasure area corresponding to the movement trajectory; determining whether the position coordinates of each pixel in the target erasure area are the position coordinates of the boundary; if the position coordinates of the pixel are not the position coordinates of the boundary, deleting the pixel; if the position coordinates of the pixel are the position coordinates of the boundary, retaining the boundary.

[0016] As can be seen from the above technical solutions, this application provides a display device and display method that can scan the colored area, record and save boundary position information, convert different colors into pixels with different characteristics (referring to boundary and non-boundary), and save the set of boundary pixels as boundary positions. This is used to distinguish between the boundary and the colored area when erasing the color applied by the user, thus ensuring that only the user's color is erased during the coloring process, while the colored boundary is preserved. The closed area and boundary information of the colored image are not destroyed, ensuring that the coloring function remains usable. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 A schematic diagram illustrating an operational scenario between a display device and a control device according to some embodiments is shown;

[0019] Figure 2 A hardware configuration block diagram of a control device 100 according to some embodiments is shown;

[0020] Figure 3 A hardware configuration block diagram of a display device 200 according to some embodiments is shown;

[0021] Figure 4 A software configuration diagram of a display device 200 according to some embodiments is shown;

[0022] Figure 5This is a schematic diagram of a display device 200 according to some embodiments;

[0023] Figure 6a This is a schematic diagram of an electronic whiteboard interface according to some embodiments;

[0024] Figure 6b This is a schematic diagram illustrating the insertion of an image into another electronic whiteboard interface according to some embodiments;

[0025] Figure 6c This is a schematic diagram illustrating yet another electronic whiteboard interface according to some embodiments;

[0026] Figure 6d This is a schematic diagram illustrating yet another electronic whiteboard interface according to some embodiments;

[0027] Figure 7a A flowchart illustrating a display method according to some embodiments is shown;

[0028] Figure 7b A flowchart illustrating a display method according to some embodiments is shown;

[0029] Figure 8 A schematic diagram of a colored image displayed on a display device 200 according to some embodiments is shown;

[0030] Figure 9 A schematic diagram of the target landing point according to some embodiments is shown;

[0031] Figure 10 A schematic diagram of the erasure range with a preset erasure width r according to some embodiments is shown;

[0032] Figure 11 A schematic diagram showing a colored image according to some embodiments is provided;

[0033] Figure 12 A schematic diagram of the target landing point of the erasure trajectory according to some embodiments is shown;

[0034] Figure 13 A schematic diagram of a painted image after the color has been erased, according to some embodiments, is shown;

[0035] Figure 14 A flowchart illustrating a method for identifying boundary location information of a colored image according to some embodiments is shown. Detailed Implementation

[0036] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0037] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0038] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0039] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0040] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0041] Figure 1 This is a schematic diagram illustrating the operational scenario between the display device and the control device according to the embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control device 100.

[0042] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0043] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0044] In some embodiments, the smart device 300 and the display device may also be used for data communication.

[0045] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0046] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0047] In some embodiments, software steps executed by one execution entity can be migrated to another execution entity with which it communicates data, as needed. For example, software steps executed by a server can be migrated to a display device with which it communicates data, and vice versa.

[0048] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0049] In some embodiments, the communication interface 130 is used for external communication and includes at least one of a WIFI chip, a Bluetooth module, an NFC module, or an alternative module.

[0050] In some embodiments, the user input / output interface 140 includes at least one of a microphone, touchpad, sensor, button, or alternative module.

[0051] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown.

[0052] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0053] In some embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output.

[0054] In some embodiments, the display 260 includes a display screen component for presenting an image, a driving component for driving image display, a component for receiving image signals output from a controller, and a user control UI interface, etc.

[0055] In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

[0056] In some embodiments, the tuner 210 receives broadcast television signals via wired or wireless reception and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0057] In some embodiments, the communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0058] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0059] In some embodiments, the external device interface 240 may include, but is not limited to, one or more interfaces such as: High Definition Multimedia Interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0060] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0061] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations via various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0062] In some embodiments, the object can be any of the optional objects, such as a hyperlink, an icon, or other operable controls. Operations related to the selected object include: displaying links to hyperlinked pages, documents, images, etc., or performing operations corresponding to the program associated with the icon.

[0063] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.

[0064] A CPU (CPU) processor is used to execute operating system and application instructions stored in memory, as well as various interactive instructions received from external input, to execute various applications, data, and content, ultimately for the display and playback of various audio and video content. A CPU processor can include multiple processors, such as a main processor and one or more sub-processors.

[0065] In some embodiments, a graphics processor is used to generate at least one of various graphical objects, such as icons, operation menus, and user-input-based graphics. The graphics processor includes an arithmetic logic unit (ALU) that performs calculations based on various user-input interactive commands and displays various objects according to display attributes; it also includes a renderer that renders the various objects obtained from the ALU, the rendered objects being displayed on a monitor.

[0066] In some embodiments, a video processor is configured to receive an external video signal and perform at least one of the following video processing operations according to a standard encoding and decoding protocol of the input signal: decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc., to obtain a signal that can be directly displayed or played on a display device 200.

[0067] In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, and a display formatting module. The demultiplexing module demultiplexes the input audio and video data streams. The video decoding module processes the demultiplexed video signal, including decoding and scaling. The image compositing module, such as an image synthesizer, overlays and blends a GUI signal generated by a graphics generator based on user input or its own generation with the scaled video image to generate a displayable image signal. The frame rate conversion module converts the input video frame rate. The display formatting module modifies the received frame rate-converted video output signal to conform to a display format, such as outputting RGB data signals.

[0068] In some embodiments, an audio processor is configured to receive external audio signals, perform decompression and decoding according to a standard codec protocol of the input signal, and at least one of the following processes: noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in a speaker.

[0069] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0070] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user, enabling the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0071] In some embodiments, the user interface 280 is an interface that can be used to receive control input (e.g., physical buttons on the display device body, or others).

[0072] In some embodiments, the display device's system may include a kernel, a command interpreter (shell), a file system, and applications. The kernel, shell, and file system together form the basic operating system structure, allowing users to manage files, run programs, and use the system. Upon power-up, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, and runs and maintains virtual memory, the scheduler, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. Applications are compiled into machine code after startup, forming a process.

[0073] See Figure 4 In some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer.

[0074] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0075] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications in the application layer. Applications can access system resources and obtain system services during execution through the API interface.

[0076] like Figure 4As shown, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services for system services or applications; PackageManager, which retrieves various information related to application packages currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0077] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0078] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0079] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0080] Based on the aforementioned display device, rotation and / or height adjustment functions can be enabled by adding a driving component and an attitude detection component. Typically, the driving component includes a rotation component and / or a height adjustment component. The controller 250 can communicate with the rotation component and / or the height adjustment component, thereby controlling the rotation component to drive the display to rotate when rotation is required, and controlling the height adjustment component to drive the display to rise or fall when rise or fall is required.

[0081] In one possible implementation, the rotating component and / or lifting component are equipped with GPIO interfaces. The controller reads these GPIO interfaces to change their states. When the GPIO interface states change, the rotating component and / or lifting component drive the display to rotate and / or lift based on the changed GPIO interface states.

[0082] In a possible implementation, the lifting component and / or the lifting component includes an MCU chip with an integrated Bluetooth module, thereby enabling the lifting component and / or the lifting component to support Bluetooth functionality, such as Bluetooth Low Energy (BLE). Consequently, the controller 250 can communicate with the lifting component and / or the lifting component based on the Bluetooth protocol.

[0083] In some embodiments, the detection component includes a sensor for detecting the rotation state of the display and a sensor for detecting the lifting state of the display. During display rotation or lifting, the controller monitors the display's rotation or lifting state in real time based on data detected by the attitude detection component. For example, during display rotation control, information such as rotation angle and angular velocity is obtained by listening to sensor data. During display lifting control, information such as lifting distance and lifting speed is obtained by listening to sensor data.

[0084] In some embodiments, the detection component is included in the driving component. For example, a sensor for detecting the rotation state of the display is included in the rotation component, and together with the rotation component, constitutes the rotation component. A sensor for detecting the lifting state of the display is included in the lifting component, and together with the lifting component, constitutes the lifting component.

[0085] Figure 5 This is a schematic diagram of a display device 200 according to some embodiments, such as Figure 5 As shown, the display device includes a monitor 260 and a lifting drive device 511. The lifting drive device 511 is connected to a lifting guide rail 512, which is fixed to the bracket 512. A rotation drive device is located inside the lifting drive device, i.e., between the lifting drive device and the monitor. Figure 5 Not shown in the image.

[0086] In some embodiments, the display device 200 described above can be a touch display device, whose display is composed of a touch component and a screen. The touch display device supports touch interaction functions, allowing users to operate the host device simply by lightly touching the display with their fingers. This eliminates the need for keyboards, mice, and remote controls, making human-computer interaction more direct. On the touch display, users can input different control commands through touch operations. For example, users can input touch commands such as click, swipe, long press, and double-click; different touch commands can represent different control functions.

[0087] To achieve the different touch actions described above, the touch-sensitive component can generate different electrical signals when the user inputs different touch actions, and send the generated electrical signals to the controller 250. The controller 250 can extract features from the received electrical signals, and thus determine the control function to be executed by the user based on the extracted features. For example, when the user inputs a click touch action at any program icon location in the application interface, the touch component will sense the touch action and generate an electrical signal. After receiving the electrical signal, the controller 250 can first determine the duration of the level corresponding to the touch action in the electrical signal. If the duration is less than a preset time threshold, it can be identified that the user inputs a click touch command. The controller 250 then extracts the positional features of the generated electrical signal to determine the touch location. When the touch location is within the display range of the application icon, it is determined that the user inputs a click touch command at the application icon location. Accordingly, the click touch command is used to execute the function of running the corresponding application in the current scenario, so the controller 250 can start and run the corresponding application.

[0088] For example, when a user inputs a swipe gesture on the media asset display page, the touch component also sends the sensed electrical signal to the controller 250. The controller 250 first determines the duration of the signal corresponding to the touch gesture in the electrical signal. If the duration is greater than a preset time threshold, it then determines the positional change of the signal. Obviously, for interactive touch gestures, the position of the signal will change, thus confirming that the user has input a swipe touch command. The controller 250 then determines the swiping direction of the swipe touch command based on the change in the position of the signal, and controls the page to be turned on the media asset display page to display more media asset options. Furthermore, the controller 250 can also extract features such as the swiping speed and swiping distance of the swipe touch command, and control the page turning according to the extracted features to achieve a responsive effect.

[0089] Similarly, for touch commands such as double-tap and long-press, the controller 250 can extract different features and determine the type of touch command based on these features, then execute the corresponding control function according to preset interaction rules. In some embodiments, the touch component also supports multi-touch, allowing users to input touch actions on the touchscreen using multiple fingers, such as multi-finger taps, multi-finger long presses, and multi-finger swipes.

[0090] The aforementioned touch actions can also be combined with specific applications to achieve specific functions. For example, when a user opens a drawing application, the display 260 can present a drawing area. The user can draw specific touch action trajectories in the drawing area by sliding touch commands. The controller 250 then determines the touch action pattern based on the touch action detected by the touch component and controls the display 260 to display it in real time to meet the demonstration effect. For example, a basic function of touch screen display devices is for users to control the rotation of the displayed image by rotating their fingers on the screen. Currently, the interaction method involves rotating multiple fingers on the screen, and the image immediately rotates to a horizontal or vertical angle according to the direction of finger rotation, without any interactive process, resulting in a poor user experience.

[0091] In some embodiments, the display device 200 includes a display for displaying a coloring image.

[0092] In some embodiments, the control device 100 may be a stylus, allowing the user to input user commands by clicking on the touchscreen, such as a capacitive stylus, to fill or erase the color of an image on the display device 200. Alternatively, the control device 100 may be a mouse, where pressing and moving the mouse button fills or erases the color of an image on the display device 200.

[0093] In some embodiments, the control device 100 includes a control unit, which is used to receive the movement trajectory presented by the change of position over time caused by a human hand sliding on the display, and generate corresponding control commands according to the movement trajectory to complete the color filling or erasing of the image on the display device 200.

[0094] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) can also be used to control the display device 200. For example, an application running on the smart device can be used to control the display device 200 to complete the color filling of the image on the display device 200.

[0095] In some embodiments, the controller 250 controls the operation of the display device 200 and responds to user operations associated with the display 260 by running various software control programs (such as an operating system and / or various applications) stored in memory. For example, it controls the presentation of a user interface on the display, the user interface including several UI objects; in response to a received user command on a UI object on the user interface, the controller 250 can perform an operation related to the object selected by the user command.

[0096] The display device provided in this application has a drawing board function. This drawing board function is implemented based on a drawing board function-related application installed on the display device. For ease of explanation, the drawing board function-related application is referred to as a "drawing board application." For example, the drawing board application can provide images in JPG, PNG, or SVG formats, allowing users to color over the images and erase colored areas.

[0097] In some embodiments, some or all of the steps involved in the embodiments of this application are implemented within the operating system and in the application. In some embodiments, the application used to implement some or all of the steps of the embodiments of this application is the aforementioned "paintboard application", which is stored in the memory. The controller 250 controls the operation of the display device 200 and responds to user operations related to the application by running the application in the operating system.

[0098] After the display device launches the drawing board application, the electronic drawing board interface appears on the screen. The electronic drawing board interface displays user interface objects, information, and / or areas for input content corresponding to one or more functions of the drawing board application. The aforementioned user interface objects refer to the objects that constitute the electronic drawing board interface, and may include, but are not limited to, text, images, icons, soft keys (or "virtual buttons"), drop-down menus, radio buttons, checkboxes, selectable lists, etc. The displayed user interface objects may include non-interactive objects used to convey information or constitute the appearance of the user interface, interactive objects that can be interacted with by the user, or a combination of non-interactive and interactive objects. The user interacts with the user interface object by touching the touchscreen at the location corresponding to the interactive object they wish to interact with. The display device detects the contact and responds to the detected contact by performing an operation corresponding to the interaction with the interactive object.

[0099] Figure 6a Schematic diagrams of electronic whiteboards in some embodiments are shown. For example... Figure 6aAs shown, the electronic drawing board includes a menu bar, a drawing area, and control bars. The menu area provides user navigation, specifically including "Start," "Insert," "Design," "View," "Process," and "Tools" controls. Users can trigger different interactive controls to achieve various image processing-related functions. The drawing area is for inputting content. The control area can centrally display controls corresponding to one or more functions of the image processing application, such as pen controls, eraser controls, and color controls. Users can use these controls to perform corresponding operations and set parameters for each control, such as setting the color and line style of the pen control. When a pen control is selected, its corresponding toolbar is displayed, where users can select the pen color and thickness. The toolbar also displays a color swatch control and a color picker control. When the electronic drawing board interface is displayed, the user picks up a brush by clicking the brush control. After picking up the brush, the user can select an existing brush color option from the corresponding toolbar, or click the color swatch control to trigger the display of the color swatch for selecting a brush color, or click the color picker control to trigger the process of picking a color from the drawing area. The brush color selected by the user on the color swatch, or the color picked up from the drawing area, will be configured as the input color of the brush control. While the brush control is picked up, the user can input content based on contact with the drawing area; the input content is the user's contact trajectory on the drawing area. When the user selects the eraser control, the input content is also the user's contact trajectory on the drawing area.

[0100] Figure 6b This is a schematic diagram illustrating the insertion of images into another electronic whiteboard interface according to some embodiments. For example... Figure 6b As shown, the user can trigger the "Insert" control on the display to input a user command that indicates the drop-down menu corresponding to the "Insert" control. The controller can respond to this user command and display the following on the display: Figure 6b The user interface shown displays a drop-down menu corresponding to the "Insert" control. This drop-down menu contains multiple items, specifically "Insert Picture," "Insert Text Box," and "Insert Object." Users can insert pictures into the application by selecting "Insert Picture." Specifically, when a user operates the control device and inputs a user command to select an item, the controller responds to the user command and displays the following on the screen: Figure 6b The user interface shown displays options for inserting images. Then, when the user operates the control device and inputs a user command to select an image, the controller can respond to the user command and display the image in the drawing area. For example, when the user selects... Figure 6b After the first image is inserted, it will be displayed in the drawing area.

[0101] In some embodiments, the image displayed in the drawing area of ​​the electronic drawing board can be in RGB format, or it can be in JPG, PNG or SVG format.

[0102] In some embodiments, after an image is inserted, the user can color it.

[0103] Figure 6c This is a schematic diagram illustrating yet another electronic whiteboard interface according to some embodiments. For example... Figure 6c As shown, the coloring image includes preset patterns for coloring (patterns include clouds, dinosaurs, and grass, etc.). Each pattern consists of at least one line and at least one closed region enclosed by a continuous line. The at least one line serves as the boundary of the closed region and is displayed differently from the color within the closed region, allowing users to clearly identify the boundary and the closed region. Users can color within the closed region. Closed regions can be set adjacently or non-adjacently. When a user colors an image, they are coloring the closed regions within the image. Typically, the color of the closed region is a solid background color, such as white; the coloring boundary is the boundary line of the closed region, which surrounds the closed region. Typically, the color of the coloring boundary is a solid boundary color, such as black. To color, the user can click the color control, select the desired color, then click the brush control, select the area to color, and complete the coloring operation. To erase, the user selects the erase control, selects the area to erase, and completes the erasure operation.

[0104] In some embodiments, during the coloring process of a coloring image, the portion of a closed region that has already been colored is called a colored region. The configuration information of the pixels in the colored region and the configuration information of the boundary are stored in the same file so that the colored region and the boundary are displayed in the same image. The configuration information includes color and position. Thus, when the area to be erased includes the boundary or a portion of the boundary, since the boundary is also in the same file being erased, the boundary included in the "selected area to erase" will also be erased. The boundary is the limit for coloring in the coloring image. Deleting the boundary destroys the boundary information of the coloring region enclosed by that boundary. When the aforementioned coloring region is selected again for coloring, the color will extend beyond the coloring region, such as... Figure 6d .

[0105] The display device provided in this application is described below with reference to the accompanying drawings. The display device includes a monitor for displaying a coloring interface; the controller of the display device can be configured to execute the following display method. Figure 7a A flowchart illustrating a display method according to some embodiments is shown. Figure 7aAs shown, the display method includes: obtaining the movement trajectory formed by the user selecting a pixel on the touch screen; confirming the target erasure area corresponding to the movement trajectory; determining whether the position coordinates of each pixel in the target erasure area are the position coordinates of the boundary; if the position coordinates of the pixel are not the position coordinates of the boundary, then delete the pixel; if the position coordinates of the pixel are the position coordinates of the boundary, then retain the boundary.

[0106] In one implementation, obtaining the movement trajectory formed by the user selecting pixels on the touchscreen includes: responding to the user's instruction on the touchscreen to erase the color of the colored area, for example, the user selects the erase control on the electronic drawing board. At this time, all pixels in the colored area are in a state of being selected. The user moves the selected pixels on the touchscreen, and the aforementioned set of selected pixels is the movement trajectory.

[0107] In one implementation, the user can also select the erase control on the electronic whiteboard through a specific action. This application does not limit the method of selecting the erase control.

[0108] Figure 7b A flowchart illustrating a display method according to some embodiments is shown. Figure 7b As shown, in a specific implementation, the display methods include:

[0109] S1, obtain the pixel position information of the target landing point on the coloring image.

[0110] like Figure 8 As shown, the coloring image includes pre-set patterns for coloring (patterns include clouds, dinosaurs, and grass, etc.). Each pattern comprises at least one line and at least one closed area enclosed by the line. For example, it includes line 41 and a closed area 61 enclosed by line 41, line 42 and a closed area 62 enclosed by line 41, and a closed area 63 enclosed by line 43. The pattern formed by the continuous closed areas 61 and 62 enclosed by lines 41 and 42 is a cloud. Users can color within the closed areas. Other lines and the colored areas enclosed by lines that make up the pattern are the same as described above and will not be repeated.

[0111] Understandably, users can fill or erase colors in areas 61, 62, and 63 by coloring images on the electronic drawing board. Furthermore, color filling or erasing can only be performed within closed areas.

[0112] The target landing point refers to the movement trajectory resulting from the sliding of a hand, control device, and / or intelligent device on the colored image on the display device 200, causing the position to change over time. The sliding of the control device and / or intelligent device on the colored image on the display device 200 is pre-associated with corresponding control commands, which is not limited in this application.

[0113] This application provides a method for obtaining pixel position information of a target landing point of a finger on a coloring image. In a specific implementation, taking a finger as an example, when the finger falls and moves on the coloring image, the method for obtaining pixel position information of the target landing point of the finger on the coloring image includes: reading the touch screen event type, which includes: finger fall event, finger move event, and finger lift event; when it is a finger fall event, obtaining the pixel position passed by the finger movement; when it is a finger move event, obtaining the pixel position passed by the finger movement; when it is a finger lift event, ending the operation.

[0114] In a specific implementation method Figure 9 A schematic diagram of the target landing point according to some embodiments is shown. For example... Figure 9 As shown, when a human hand, control device, and / or smart device slides from point A to point B on the colored image on display device 200, a trajectory "line segment AB" is formed. The pixels of the target landing point mentioned in S1 refer to the pixels corresponding to all points on the trajectory "line segment AB," and the position information of all pixels, i.e., coordinates (x, y, y). i y i The set of () is the pixel position information of the target landing point on the coloring image that we need to obtain in this step.

[0115] In a specific implementation, the target landing point determines the erasure location, and the erasure range can be determined by a preset erasure width r. That is, if the preset erasure width r is specified, then the distance from the target landing point (x...) will be determined by the erase width r. i y i All pixels whose distance from the target point is less than or equal to r are erased. At this time, the target pixel also includes pixels in set S, which is the set of all pixels whose distance from the target point is less than or equal to the preset erasure width r.

[0116] Figure 10 A schematic diagram of the erasure range with a preset erasure width r according to some embodiments is shown. For example... Figure 10 As shown, when the target landing point is the trajectory "line segment AB", the erasing range is a strip-shaped area with a width of 2r formed by "all circles with each point of "line segment AB" as the center and the erasing width r as the radius", namely, regions 621 and 631 in the figure. In other words, when the preset erasing width is r, it is necessary to obtain not only the position information of the pixel points of the target landing point, i.e., the coordinates (x, y, r) i y i The set of pixels, and at the same time, the position information of all pixels whose distance from the target landing point is less than or equal to r, i.e., coordinates (x, y, r). i y i A set of ).

[0117] S2, if the pixel is at a boundary location, then the pixel is retained; the aforementioned color should be the initial color of the boundary. In this way, after multiple coloring and erasing operations, the color of the boundary can be kept consistent, thereby ensuring that the boundary of the coloring area is not destroyed and ensuring the normal use of the drawing board function.

[0118] Figure 11 A schematic diagram illustrating the coloring of a colored image according to some embodiments is shown. For example... Figure 11 As shown, see also Figure 8 Areas 61, 62, and 63 have been colored (the color is black).

[0119] Figure 12 A schematic diagram of the target landing point of the erasure trajectory according to some embodiments is shown. For example... Figure 12 As shown, the erasure trajectory is trajectory “line segment AB”, which passes through colored area 62 and colored area 63.

[0120] In a specific implementation, when the preset erase width is r, the erase trajectory is the trajectory "line segment AB", and the erase range is the strip-shaped area with a width of 2r formed by "all circles formed with each point of "line segment AB" as the center and the erase width r as the radius", which intersects with the colored areas 62 and 63. It can be understood that the colors of pixels at other locations are preserved.

[0121] In a specific implementation, the boundary location refers to the boundary, i.e., as shown in the example below. Figure 8 The continuous lines 41, 42, and 43, and other lines that enclose the colored area, are shown. Figure 13 A schematic diagram of a painted image after the color has been erased, according to some embodiments, is shown. For example... Figure 13 As shown, when the erasure trajectory is trajectory "line segment AB", the intersection areas of the aforementioned strip area with closed areas 61 and 62 are erased, namely erasure area 621 and erasure area 631. The intersection of line 42 with the strip area, i.e., line segment 421 and line segment 422, are preserved; the intersection of line 43 with the strip area, i.e., line segment 431 and line segment 432, are preserved. Here, the boundary position refers to lines 42 and 43, and other lines that enclose the colored area. Preserving the pixels means preserving line segments 421, 422, 431, and 432.

[0122] This application provides a method for preserving line segments 421, 422, 431, and 432. In a specific implementation, based on a preset erasure width r, all pixels (x, y, r) whose distance from the target landing point is less than or equal to r are obtained. i y iLet S be the set of pixels. Iterate through each pixel (x) in set S. i y i ), determine pixel (x) i y i If it is a boundary, then preserve the boundary.

[0123] S3, if the pixel is not at the boundary position, then delete the pixel;

[0124] In a specific implementation, such as Figure 13 As shown, when the erasure trajectory is trajectory "line segment AB", the aforementioned strip area and the areas intersecting with the colored areas 61 and 62 are erased, namely erasure area 621 and erasure area 631.

[0125] It is understandable that the boundary location information, i.e., the pixel (x) i y i The position coordinates can be pre-stored in the control device so that when there is an erase command, the boundary position information can be directly retrieved as the boundary position.

[0126] In some embodiments of this application, the colored area includes an already colored area; the controller is further configured to: save the configuration information of the pixels on the already colored area and the configuration information of the boundary in the same file, so that the already colored area and the boundary are displayed in the same image; if the position coordinates of the pixel are not the position coordinates of the boundary, then delete the pixel; including: if the position coordinates of the pixel are not the position coordinates of the boundary, then delete the configuration information of the pixel in the same file.

[0127] In some embodiments of this application, if the position coordinates of a pixel are the position coordinates of a boundary, the boundary is preserved; including: if the pixel is not a boundary position, the boundary configuration information is preserved in the same file.

[0128] In some embodiments of this application, confirming the target erasure area corresponding to the movement trajectory includes: confirming a first intersecting trajectory, the first intersecting trajectory being a set of pixels where the movement trajectory intersects with the painted area; and confirming the target erasure area based on the first intersecting trajectory.

[0129] In some embodiments of this application, the colored area also includes an uncolored area; confirming the target erasure area corresponding to the movement trajectory includes: confirming a second intersecting trajectory, the second intersecting trajectory being a set of pixels where the movement trajectory intersects with the uncolored area; and confirming the target erasure area based on the pixels on the movement trajectory other than the second intersecting trajectory.

[0130] The following section, with reference to the accompanying drawings, explains the method for identifying and saving the boundary configuration information of the colored image.

[0131] In some embodiments, the initial color of the boundary position is different from the color of the area on the coloring image other than the boundary position; in the step of obtaining the initial color of the boundary position, the initial color of the boundary is the boundary color; in the step of obtaining the target pixel on the coloring image, the controller is further configured to: save the coloring image; set the boundary color of the coloring image; starting from the first pixel of the coloring image, traverse and read the color of each pixel of the coloring image; if the color of the pixel is the boundary color, then save the position coordinates of the pixel as the position coordinates of the boundary to the memory.

[0132] In some embodiments, the boundary color is a first color, and the color of the uncolored area is a second color, the first color and the second color are different; if the color of a pixel is the boundary color, the position coordinates of the pixel are saved to the memory as the position coordinates of the boundary; including: determining whether the color of a pixel is the first color; if the color of a pixel is the first color, the position coordinates of the pixel are saved to the memory as the position coordinates of the boundary.

[0133] like Figure 8 As shown, the coloring image includes preset patterns that can be colored. These patterns are defined by continuous lines that enclose multiple colorable areas. The continuous lines serve as the boundaries of these colorable areas (for ease of description, "boundaries" will be used below instead of "continuous lines enclosing multiple colorable areas"). To help users distinguish between the boundaries and the colorable areas, the color of the boundary lines is clearly different from the initial color of the colorable areas. For example, Figure 8 The borders of the colored image shown are outlined in black, and the initial color of the colored area is white.

[0134] The method for identifying the boundary position information of a colored image provided in this application utilizes the characteristic that the boundary color is significantly different from the initial set color of the colored area. By distinguishing colors, the boundary and the colored area are differentiated, and the set of position information of the boundary pixels is then saved as the boundary position. Figure 14 A flowchart illustrating a method for recognizing boundary location information of a colored image according to some embodiments is shown. Figure 14 As shown,

[0135] S001, determine pixel point (x) i y i Is the color of the boundary color?

[0136] In some embodiments, starting from the first pixel (x0, y0) of the colored image, each pixel (x0, y0) of the colored image is traversed. i y i The color of the pixel (x) is used to determine the value of that pixel. i y iIs the color of the boundary color?

[0137] In some embodiments, when determining pixel point (x) i y i Before determining the color, a color image can be loaded into memory, saved in bitmap format, and its boundary color set to enable the judgment step. It is understood that the boundary color can be a single color or multiple colors; this application does not limit this.

[0138] S002, if pixel (x) i y i ) is the boundary color, which will be the color of this pixel (x). i y i )save.

[0139] In some embodiments, if a certain pixel (x) i y i ) is the boundary color, which will be the color of this pixel (x). i y i The pixels (x, y) are stored in set A. Iterate through each pixel (x, y) of the colored image. i y i After coloring, all elements in set A are used as boundary positions.

[0140] It is understandable that if pixel (x) i y i If the color is not the boundary color, then the pixel (x) is considered to be... i y i () refers to the colored area, or the blank area outside the colored pattern on the colored image. The colored area and the blank area can be the same color or different color, but they should both be significantly different from the boundary color.

[0141] The method described in the above embodiments distinguishes pixels by color, transforming different colors into pixels with different characteristics (referring to boundary and non-boundary). By storing the set of boundary pixels as boundary positions, when determining whether a target pixel is a boundary position, the controller, in response to the control command to erase the color, is further configured to: traverse all pixels on the colored image to determine whether the color of the pixel is a boundary color; if the color of the pixel is a boundary color, then the pixel is determined to be the target pixel.

[0142] In some situations, before selecting the area to be erased, the coloring image has already colored a portion of the area. The coloring image includes both colored and uncolored areas. The area to be erased may pass through both colored and uncolored areas. The uncolored areas should not have their color erased.

[0143] To achieve more efficient erasure, the display method provided in this application further includes: the colored area being a closed area; in the step of erasing the color of the target pixel, the controller is further configured to: identify a first intersecting pixel, the first intersecting pixel being a pixel where the target landing point intersects with the boundary of the colored area; based on the first intersecting pixel, identify pixels on the target landing point that overlap with the colored area, and use them as target pixels; the colored area also includes an uncolored area; the uncolored area is a closed area; the controller is further configured to: identify a second intersecting pixel, the second intersecting pixel being a pixel where the target landing point intersects with the boundary of the uncolored area; based on the second intersecting pixel, delete pixels on the target landing point that overlap with the uncolored area, so that the remaining pixels on the target landing point are used as target pixels.

[0144] The method provided in this application can scan the colored area, record and save boundary position information, and convert different colors into pixels with different characteristics (referring to boundaries and non-boundaries). By saving the set of boundary pixels as boundary positions, it can distinguish between boundaries and colored areas when erasing the color applied by the user. This ensures that during the coloring process, only the user's color is erased, while the colored boundaries are preserved. The closed areas and boundary information of the colored image are not destroyed, ensuring that the coloring function remains usable.

[0145] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0146] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

[0147] The above embodiments of this application do not constitute a limitation on the scope of protection of this application.

Claims

1. A display device, characterized in that, include: A display is configured to show a coloring interface, the coloring interface including a coloring image, coloring controls and an eraser control, the coloring image including a coloring area and a boundary surrounding the coloring area; A touch component for receiving instructions from user touch input, wherein the touch component and the display form a touch screen; The controller is configured to: Acquire the movement trajectory of the pixel selected by the user on the touch screen; Confirm the target erasure area corresponding to the movement trajectory; Determine whether the position coordinates of each pixel in the target erasure area are the position coordinates of the boundary; If the position coordinates of the pixel are not the position coordinates of the boundary, then delete the pixel; If the position coordinates of the pixel are the position coordinates of the boundary, then the boundary is retained.

2. The display device according to claim 1, characterized in that, The colored area includes the already colored area; The controller is further configured to: The configuration information of the pixels in the colored area and the configuration information of the boundary are saved in the same file so that the colored area and the boundary are displayed in the same image. The step of deleting the pixel if its position coordinates are not the position coordinates of the boundary includes: If the position coordinates of the pixel are not the position coordinates of the boundary, then the configuration information of the pixel is deleted from the same file.

3. The display device according to claim 2, characterized in that, The step of preserving the boundary if the position coordinates of the pixel are the position coordinates of the boundary includes: If the position coordinates of the pixel are the position coordinates of the boundary, then the configuration information of the boundary is retained in the same file.

4. The display device according to claim 3, characterized in that, The confirmation of the target erasure area corresponding to the movement trajectory includes: Confirm the first intersecting trajectory, which is the set of pixels where the moving trajectory intersects with the colored area; The target erasure area is identified based on the first intersecting trajectory.

5. The display device according to claim 3, characterized in that, The colored area also includes an uncolored area; confirming the target erasure area corresponding to the movement trajectory includes: Confirm the second intersecting trajectory, which is the set of pixels where the moving trajectory intersects with the unpainted area; The target erasure area is identified based on the pixels on the movement trajectory other than the second intersecting trajectory.

6. The display device according to claim 1, characterized in that, The controller is also configured to: Iterate through and read the color of each pixel in the colored image; If the color of the pixel is the same as the color of the boundary, then the position coordinates of the pixel are saved to the memory as the position coordinates of the boundary.

7. The display device according to claim 6, characterized in that, The color of the boundary is a first color, and the color of the unpainted area is a second color, wherein the first color and the second color are different; If the color of the pixel is the same as the color of the boundary, then the position coordinates of the pixel are saved to the memory as the position coordinates of the boundary; including: Determine whether the color of the pixel is the first color; If the color of the pixel is the first color, then the position coordinates of the pixel are saved to the memory as the position coordinates of the boundary.

8. The display device according to claim 1, characterized in that, The target erasure area includes the set of all pixels whose distance from the movement trajectory is less than or equal to the preset erasure width.

9. The display device according to any one of claims 1-8, characterized in that, The step of acquiring the user's movement trajectory on the touchscreen includes: Read the touch screen event type, which includes: finger drop event, finger movement event, and finger lift event; When the event is "finger falls", the positions of the pixels the finger moves through are obtained and confirmed as the movement trajectory. When it is a finger movement event, the position of the pixel points through which the finger moves is confirmed as the movement trajectory; When the finger is lifted, the touch screen event reading operation ends.

10. A display method, characterized in that, include: A coloring interface is displayed, which includes a coloring image, coloring controls, and an eraser control. The coloring image includes a coloring area and the boundary surrounding the coloring area. Acquire the movement trajectory of the pixel selected by the user on the touchscreen; Confirm the target erasure area corresponding to the movement trajectory; Determine whether the position coordinates of each pixel in the target erasure area are the position coordinates of the boundary; If the position coordinates of a pixel are not the position coordinates of the boundary, then delete the pixel. If the position coordinates of a pixel are the same as the position coordinates of the boundary, then the boundary is retained.

Images