Touch track display method and electronic equipment
By storing historical track images in electronic devices and generating target track images, the problem of hand delay for electronic devices with weak processor performance when processing touch tracks is solved, and timely touch response and improved user experience are achieved.
Patent Information
- Application Number
- CN202411405983.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-09
- Publication Date
- 2025-03-07
AI Technical Summary
Electronic devices with weak processor performance are prone to delays in handling touch tracks, resulting in untimely responses.
By storing the historical track image in the electronic device and collecting touch data within the first preset time, generating a target track image, and then displaying and updating the historical track image, to improve rendering and display speed.
It effectively avoids the follow-up delay of touch tracks during rendering and display, provides timely touch response, and improves user experience.
Smart Images

Figure CN119576199A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of terminal devices, and in particular to a touch track display method and electronic device. Background Art
[0002] With the continuous development of electronic devices, the functions of electronic devices such as smart watches and smart bracelets are becoming increasingly rich, covering areas such as sports monitoring, health monitoring, communication interaction, near-field communication, entertainment life, etc.
[0003] When using an electronic device, a user can perform touch operations on the touch screen of the electronic device to form a corresponding touch track in the electronic device. In some scenarios, some electronic devices with weaker processor performance can also realize the function of forming corresponding touch tracks based on touch operations, such as smart watches. However, there are certain limitations in the hardware of such electronic devices with weaker processor performance, and their processing capabilities are limited. If the touch track is processed on such electronic devices, problems such as hand tracking delay and untimely response will occur. Summary of the invention
[0004] The present application provides a method for displaying a touch track and an electronic device, which can effectively avoid hand tracking delays in the touch track rendering and display process while maintaining the original hardware performance of the electronic device, thereby providing users with timely touch response.
[0005] In a first aspect, a method for displaying a touch trajectory is provided, which is applied to an electronic device, wherein a processor in the electronic device includes a microcontroller unit, and the display of the touch trajectory includes: the electronic device acquires first touch data through a touch screen within a first preset time period; when a historical trajectory image is stored in the electronic device, the electronic device generates a target trajectory image based on the first touch data and the historical trajectory image, and displays the target trajectory image, and then updates the historical trajectory image based on the target trajectory image, wherein the historical trajectory image stored in the electronic device is drawn by the touch data collected before the first preset time period.
[0006] Through the display method of the touch track provided by the embodiment of the present application, when the electronic device maintains the original hardware performance or the performance change is not big, there is a hand-following delay in the rendering and display process of the electronic device for the user's touch track, which causes the electronic device to not provide the handwriting input function or the user experience of the touch track not responding in time. In order to provide a touch input function with timely touch response, the electronic device of the present application collects the first touch data within the first preset time, and when the electronic device stores the historical track image drawn by the touch data collected before the first preset time, the target track image is generated through the first touch data and the historical track image, and the target track image is displayed, and the historical track image is updated based on the target track image; in this way, in the process of continuous rendering and display of the touch track, it is only necessary to further render the first touch data on the basis of the historical track image stored before the first preset time, so as to improve the speed of rendering the target track image, and then speed up the process of displaying the target track image, so that the user can feel the timely touch response of the hand, and improve the user experience.
[0007] In some possible implementations, the electronic device may be a smart watch, a smart bracelet, or other electronic devices that support handwriting input.
[0008] In some possible implementations, the electronic device acquires the first touch data through the touch screen within the first preset time period, including intermediate touch data, wherein the intermediate touch data may refer to touch data immediately following the initial touch data, or may refer to touch data acquired successively within a period of time after the initial touch data.
[0009] The initial touch data is the touch data collected for the first time based on a first preset time length during the handwriting input process of each character, word, number, punctuation, etc., and the initial touch data at least includes a handwriting starting point.
[0010] For the intermediate touch data, the electronic device at this time stores a historical trajectory image, and then the target trajectory image can be generated through the intermediate touch data and the corresponding historical trajectory image.
[0011] In some possible implementations, the first touch data may further include initial touch data. For the initial touch data, the electronic device may store a blank historical track image, or may not store a blank historical track image.
[0012] When a historical trajectory image of a blank image is stored in the electronic device, a target trajectory image can be generated through the initial touch data and the corresponding historical trajectory image. When no historical trajectory image is stored in the electronic device, a corresponding target trajectory image, i.e., an initial trajectory image, can be generated through the initial touch data.
[0013] When there is no historical trajectory image in the electronic device, a blank historical trajectory image may be created, and then a target trajectory image is generated through the initial touch data and the corresponding historical trajectory image.
[0014] In some possible implementations, the first touch data includes a coordinate information, and generating a target trajectory image based on the first touch data and the historical trajectory image includes: when the first touch data includes a coordinate information, connecting the historical trajectory image with a coordinate information in the first touch data to obtain the target trajectory image.
[0015] In some possible implementations, when the first touch data includes multiple coordinate information, generating a target trajectory image based on the first touch data and the historical trajectory image includes: sequentially connecting the historical trajectory image with each coordinate information in the first touch data to obtain the target trajectory image.
[0016] In some possible implementations, when the first touch data includes multiple coordinate information, generating a target trajectory image based on the first touch data and the historical trajectory image includes: the electronic device generates a sub-trajectory image based on the multiple coordinate information in the first touch data; and merging the historical trajectory image and the sub-trajectory image to obtain the target trajectory image.
[0017] It should be understood that the number of coordinate points in the touch data collected each time may be one or more. When the user uses one finger to perform handwriting input, if the first preset time length corresponding to collecting the touch data includes one collection cycle, usually one touch point will be collected, that is, the coordinate point corresponding to one touch point; if the first preset time length corresponding to collecting the touch data includes multiple collection cycles, multiple continuously changing touch points are collected in a short time, that is, multiple coordinate points are collected.
[0018] It should also be understood that collecting multiple touch points in one collection process can reduce the number of data processing times and improve data processing efficiency.
[0019] It should be understood that if the first touch data includes multiple coordinate information, these coordinate information can be rendered into a sub-trajectory image first, and then the sub-trajectory image and the historical trajectory image are merged into a target trajectory image. This step-by-step data processing method improves the display efficiency of touch data.
[0020] In some possible implementations, the method further includes: when a first event occurs during the user touch input process, clearing the stored first touch data and historical track image, the first event being used to indicate the end of the touch track input.
[0021] It should be understood that the first event includes an interruption event, which is used to indicate that the touch track completes a complete input. During the handwriting input process, by monitoring the interruption event, it can be determined that the user has completed the input of a text, word, number or punctuation mark.
[0022] The first event also includes a pause event, which is used to indicate that the user pauses during the handwriting input process. For example, when the user makes an error in handwriting input and pauses for a long time, during the handwriting input process, the user input can be determined to be finished by monitoring the pause event.
[0023] It should also be understood that if the first event does not occur during the user's touch input process, it means that the user has not completed an input and it is necessary to continue to respond to the user's input.
[0024] During the handwriting input process, by monitoring the first event, it can be determined whether the user has completed an input. If the first event occurs, it indicates that the input has been completed. If no interruption event occurs, it indicates that the input is still continuing. By monitoring the first event, the electronic device's determination of the handwriting input process can be improved, thereby improving the accuracy of handwriting input recognition.
[0025] In some possible implementations, the electronic device further includes a memory, and the memory is used to store the historical track image. In some possible implementations, the first touch data and the historical track image are stored in different storage areas to facilitate direct acquisition of the corresponding data; the memory includes a first storage area and a second storage area, and the first touch data can be stored in the first storage area, and the historical track image can be stored in the second storage area.
[0026] The first storage area and the second storage area are two storage areas in the memory.
[0027] After acquiring the first touch data, the electronic device will also perform a series of data processing. At this time, the first touch data needs to be stored first, and the historical trajectory image needs to be updated through the target trajectory image. That is to say, the stored backup trajectory graphics need to be updated according to the target trajectory image corresponding to each acquisition, so that in the subsequent data processing process, the historical trajectory image can be directly called for data merging.
[0028] In some possible implementations, the historical trajectory image is updated based on the target trajectory image. It should be understood that as the touch data is continuously collected, the correspondingly generated target trajectory image is also continuously updated. Therefore, the historical trajectory image can be updated by the target trajectory image, so as to facilitate the subsequent direct call of the updated historical trajectory image.
[0029] In some possible implementations, the historical trajectory image includes one or more trajectory images, and the method further includes: when the historical trajectory image includes one trajectory image, replacing the historical trajectory image based on the currently determined target trajectory image. When the historical trajectory image includes N trajectory images, storing the currently determined target trajectory image, and deleting the earliest stored trajectory image among the N trajectory images.
[0030] If the historical trajectory image has only one trajectory image, the storage space occupied by the historical trajectory image can be reduced, that is, the amount of data storage can be reduced, and in the process of calling the historical trajectory image for subsequent processing, there is no need for indexing, which speeds up data processing and improves the efficiency of touch trajectory display; if the historical trajectory image has multiple trajectory images, such as two trajectory images or three trajectory images, by storing multiple trajectory images, the availability of the historical trajectory image is ensured, and the fault tolerance of the touch trajectory displayed by the smartphone is improved. At the same time, in abnormal situations, timely processing can be improved to improve the stability of the smartphone.
[0031] In some possible implementations, the historical trajectory image is determined by any of the following methods: when the electronic device displays the target trajectory image, a screenshot of the display interface of the electronic device is taken to obtain the historical trajectory image; when the target trajectory image is displayed in the touch area, the historical trajectory image is determined based on the image of the touch area, wherein the touch area is a partial area or the entire area in the touch input interface.
[0032] The above-mentioned historical trajectory image determination process can provide a method for the smart watch to quickly determine the historical trajectory image, which can improve the hardware processing speed in the smart watch.
[0033] In some possible implementations, the hardware in the electronic device includes a microcontroller unit and a graphics processor, and the method includes: the microcontroller unit obtains first touch data, converts the first touch data into a trajectory drawing instruction, and sends it to the graphics processor; the graphics processor renders a first trajectory image corresponding to the first touch data based on the trajectory drawing instruction; the microcontroller unit obtains a historical trajectory image from a memory, and after receiving the first trajectory image sent by the image processor, merges the first trajectory image and the historical trajectory image to obtain a target trajectory image; the microcontroller unit controls the display and storage of the target trajectory image.
[0034] The microcontroller unit is used to collect initial touch data or intermediate touch data received on the touch panel, and convert the initial touch data or intermediate touch data into an instruction to instruct a graphics processor to draw a trajectory image. When receiving the trajectory image after the graphics processor has finished drawing, if there is an alternative trajectory image in the memory, the alternative trajectory image is merged with the trajectory image drawn by the graphics processor into a target trajectory image, and the target trajectory image is displayed on the display panel and stored in the memory to realize the display of the touch trajectory. In this way, during the process of continuous rendering and display of the touch trajectory, it is only necessary to merge the trajectory image corresponding to each newly added touch data into the historical trajectory image, thereby improving the speed of generating the target trajectory image, and then speeding up the process of displaying the target trajectory image, so that the user can feel the timely touch response of the hand during the handwriting input process, thereby improving the user experience.
[0035] In some possible implementations, the electronic device includes a smart watch or a smart bracelet.
[0036] In a second aspect, a touch track display device is provided, comprising a unit for executing any one of the methods in the first aspect. The device may correspond to executing the method described in the first aspect above. For the relevant description of the units in the device, please refer to the description of the first aspect above, and for the sake of brevity, it will not be repeated here.
[0037] The method described in the first aspect above can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions. For example, the device may include a touch acquisition unit, a processing unit, and a display unit.
[0038] In a third aspect, the present application provides a computer-readable storage medium storing a computer program. When the computer program is executed by a touch track display device, the touch track display device performs any one of the touch track display methods in the first aspect.
[0039] In a fourth aspect, a computer program product is provided, the computer program product comprising: a computer program, when the computer program is executed by a touch track display device, the touch track display device executes any one of the touch track display methods in the first aspect.
[0040] It can be understood that the beneficial effects of the second to fourth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] Figure 1 A schematic diagram showing a chat interface of a smart watch entering a chat APP;
[0042] Figure 2 A schematic diagram showing a handwriting track rendering display in an input interface of a smart watch is shown;
[0043] Figure 3 A schematic diagram showing an example of touch track rendering display;
[0044] Figure 4 A hardware structure diagram of an electronic device provided in an embodiment of the present application is shown;
[0045] Figure 5 A schematic diagram of the software architecture of an electronic device according to an embodiment of the present application is shown;
[0046] Figure 6 A schematic diagram showing an application scenario to which the embodiments of the present application are applicable;
[0047] Figure 7 A schematic diagram showing a flow chart of a method for displaying a touch track provided in an embodiment of the present application is shown;
[0048] Figure 8 A schematic diagram of a touch input interface in an application provided in an embodiment of the present application is shown;
[0049] Fig. 9 A schematic diagram showing a target trajectory image in a touch trajectory display method provided in an embodiment of the present application is shown;
[0050] Fig.10 A schematic diagram showing a target track image determined in another touch track display method provided in an embodiment of the present application is shown;
[0051] Fig.11 A schematic diagram showing a target track image determined in another touch track display method provided in an embodiment of the present application is shown;
[0052] Fig.12 A schematic diagram showing a pop-up window appearing in another touch track display method provided in an embodiment of the present application is shown;
[0053] Fig.13 A schematic diagram showing a flow chart of another method for displaying a touch track provided in an embodiment of the present application is shown;
[0054] Fig.14 A schematic diagram of an electronic device provided by an embodiment of the present application is shown;
[0055] Fig.15 A schematic diagram showing a flow chart of another method for displaying a touch track provided in an embodiment of the present application is shown;
[0056] Fig.16 A schematic diagram showing a flow chart of another method for displaying a touch track provided in an embodiment of the present application is shown;
[0057] Fig.17 A schematic diagram showing a touch track display device provided in an embodiment of the present application is shown;
[0058] Fig.18 A schematic structural diagram of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION
[0059] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0060] In the following, the terms "first", "second", and "third" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", and "third" may explicitly or implicitly include one or more of the features.
[0061] For ease of understanding, some concepts involved in the embodiments of the present application are introduced and explained below:
[0062] 1. Follow-up delay
[0063] The tracking delay can also be expressed with "response delay" to express a similar meaning. It is usually used to describe the large time difference between the operation of a user touching the touch screen of an electronic device to form a trajectory (such as touching with a stylus, handwriting, etc.) and the electronic device displaying the corresponding trajectory on the touch screen. There is a situation where the electronic device's response cannot keep up with the hand's action, making the user feel that the operation is not smooth enough, affecting the user experience.
[0064] 2. LiteOS
[0065] LiteOS is a lightweight operating system that is simple, efficient, and scalable.
[0066] Electronic devices such as smart watches and smart bracelets are usually small in size, which determines that their internal hardware selection and system performance are subject to certain restrictions. For example, the main control chip is the MCU chip, and the software architecture is LiteOS. Among them, the MCU chip has the advantages of low power consumption and miniaturization, which is very suitable for the requirements of electronic devices for battery life and size, but its performance is relatively limited, which makes electronic devices prone to slow computing speed and untimely response when processing complex tasks.
[0067] Currently, electronic devices usually provide pre-selected options for users to choose from limited options to achieve corresponding functions such as message reply and text input.
[0068] For example, when the smart watch is running a chat application (Application, App), after entering the chat App, you can see a list of contacts, click on one of the contacts A, and enter the chat interface with the contact A. Figure 1 A schematic diagram showing a smart watch entering a chat interface in a chat APP; Figure 1 As shown in (a) in FIG. 1 , in the chat interface, historical messages are displayed, and there is a voice input box 101 and an expression input box 102 at the bottom of the chat interface, such as Figure 1 As shown in (b) in FIG. 1 , the user can click the voice input box 101 to reply to the voice message; Figure 1 As shown in (c) in FIG. 1 , the user can also click the expression input box 102 to display the expression list, and the user can select a suitable expression according to his or her needs to realize the expression message reply; Figure 1 As shown in (d) in the figure, the user can also slide down in the chat interface to display multiple preset quick replies below the voice input box 101 and the expression input box 102, such as "OK", "Okay", "Busy now, contact later", "Yes", "Great!", etc. The user can choose a suitable quick reply according to his or her needs to reply to the text message.
[0069] It should be understood that when a user replies to a message through a chat app in a smart watch, he or she can usually only choose one of the above three forms to reply. If none of the above three forms or contents meet the user's needs, the user will not be able to reply to the message in time; that is, during use, the user cannot freely enter a reply message, which limits the user's flexibility.
[0070] In some related technologies, when the hardware in a smart watch remains unchanged or is slightly modified, in order to meet the user's need for handwriting input, the electronic device can provide the user with recognition and display functions of handwriting and other methods, so as to realize free input in the smart watch and provide the user with more customizable and flexible functions.
[0071] Exemplarily, a touch signal input by the user through handwriting or the like is collected, and the trajectory corresponding to the touch signal is rendered and displayed to achieve free input by the user on the smart watch. Figure 2 FIG. shows a schematic diagram of rendering and displaying a handwriting trajectory in an input interface of a smart watch. In the input interface, the user writes the character "person" by handwriting. Since the main control chip of the smart watch has a low main frequency, it takes a certain amount of time from receiving a touch signal in the form of handwriting or the like to rendering and displaying the corresponding trajectory, resulting in a follow-up delay in the user's touch trajectory during the rendering and display process. As shown in Figure 2 (a) in FIG., when the user just writes the character "person" by handwriting, the response of the smart watch is timely; as shown in Figure 2 (b) in FIG., Figure 2 (c) in FIG., Figure 2 (d) in FIG., as the user writes more content by handwriting, the response delay of the smart watch becomes larger and larger. Furthermore, it makes the user feel that the operation of the smart watch is not smooth, affecting the user experience.
[0072] For the display method of the touch trajectory provided in the above related technology, during the user's handwriting process, when the finger slides on the screen of the smart watch, the smart watch will continuously and real-time collect the coordinate points of the finger touching the screen at a preset collection frequency; and during the screen display process, each time the screen is refreshed at a preset screen refresh frequency, a rendering action of a line will be executed from the touch start point to the currently received touch end point to form the displayed touch trajectory.
[0073] It should be understood that both the touch start point and the touch end point are coordinate points.
[0074] Figure 3 FIG. shows a schematic diagram of an example of rendering and displaying a touch trajectory. Exemplarily, as shown in Figure 3 (a) in FIG., the currently displayed touch trajectory H is formed by performing a single rendering from the touch start point h1 to the current touch end point h8; at the moment corresponding to the next screen refresh, the displayed touch trajectory H', as shown in Figure 3 (b) in FIG., this touch trajectory H' is formed by performing a single rendering from the touch start point h1 to the current touch end point h 11 after performing a single rendering.
[0075] Analyzing the above display method of the touch trajectory, it can be seen that each time the screen is refreshed, a rendering process is performed from the touch start point to the touch end point. As the number of collected coordinate points increases, the rendering time from the touch start point to the currently received touch end point also becomes longer. Once the rendering time exceeds the time for the finger to continue sliding on the screen, the touch response as shown in Figure 2 (c) in FIG. and Figure 2 (d) in FIG. will be untimely, that is, there will be a follow-up delay.
[0076] In view of this, an embodiment of the present application provides a method for displaying a touch trajectory and an electronic device, wherein the method is applied to an electronic device, a processor in the electronic device includes a microcontroller unit, and during a handwriting input process of text, words, numbers, punctuation marks, etc., the electronic device collects touch data (initial touch data and intermediate touch data) within a first preset time period, and when the electronic device has a historical trajectory image drawn by the touch data collected before the first preset time period, a target trajectory image is generated through the touch data and the historical trajectory image, and the target trajectory image is displayed and stored; in this way, during the process of continuous rendering and display of the touch trajectory, it is only necessary to further render each newly added touch data on the basis of the historical trajectory image, thereby improving the speed of rendering the target trajectory image, and then speeding up the process of displaying the target trajectory image, so that the user can feel the timely touch response of the hand during the handwriting input process, thereby improving the user experience.
[0077] The electronic device to which the touch track display method provided in the embodiment of the present application is applied is described below in conjunction with the accompanying drawings. The electronic device may be a smart watch, a smart bracelet, or other electronic device that supports handwriting input. The embodiment of the present application does not impose any restrictions on the specific type of the electronic device.
[0078] Figure 4 FIG. 1 shows a hardware structure diagram of an electronic device provided in an embodiment of the present application, such as Figure 4 As shown, the electronic device 100 may include a processor 110, a memory 120, a charging management module 140, a power management module 141, a battery 142, an antenna 1, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a touch screen 130, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a touch sensor 180K, etc.
[0079] It should be noted that Figure 4 The structure shown does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include Figure 4 More or fewer components than those shown, or the electronic device 100 may include Figure 4 Combinations of some of the components shown, or the electronic device 100 may include Figure 4 Subassemblies of some of the components shown. Figure 4 The components shown may be implemented in hardware, software, or a combination of software and hardware.
[0080] The processor 110 is the control center of the electronic device 100. It uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing software programs and / or modules stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 may include one or more processing units. For example, the processing unit in the processor 110 may include a graphics processing unit (GPU), and may also include some or all of the following processing units: an application processor (AP), an image signal processor (ISP), a controller, a digital signal processor (DSP), and a neural-network processing unit (NPU). Among them, different processing units can be independent devices or integrated devices.
[0081] The processor 110 in the electronic device 100 may also include a microcontroller unit (MCU), also known as a single chip microcomputer (Single Chip Microcomputer) or a single chip microcomputer. The MCU appropriately reduces the frequency and specifications of the central processing unit (CPU) and integrates functional modules such as memory and input / output interface.
[0082] The touch screen 130 can be used to display information input by the user or information provided to the user, as well as various menus, images, etc. of the electronic device 100, and can also accept user input. The touch screen 130 is also called a touch screen; the touch screen 130 may include a touch panel 131 and a display panel 132, wherein the display panel 132, also called a display screen, may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a micro OLED (Micro OLED) or a quantum dot light emitting diode (QLED).
[0083] The touch panel 131 can collect the user's contact or non-contact operation on or near it (such as the user's operation on or near the touch panel 131 using any suitable object or accessory such as a finger, stylus, etc., and can also include somatosensory operation; the operation includes single-point control operation, multi-point control operation and other operation types), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 131 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device is used to detect the user's touch orientation, posture, direction, speed and trajectory of handwriting sliding, etc., and detect the signal brought by the touch operation, and transmit the signal to the touch controller; the touch controller receives the touch information from the touch detection device, and converts it into information that the processor can process, and then sends it to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 131 can be implemented in various types such as resistive, capacitive, infrared and surface acoustic wave, and any technology developed in the future can also be used to implement the touch panel 131. Furthermore, the touch panel 131 may cover the display panel 132, and the user may perform operations on or near the touch panel 131 covered on the display panel 132 according to the content displayed on the display panel 132 (the displayed content includes but is not limited to: icons, voice input boxes, motion selection boxes, etc.). After the touch panel 131 detects the operation on or near it, it transmits it to the processor 110 to determine the user input, and then the processor 110 provides corresponding visual output on the display panel 132 according to the user input.
[0084] Understandably, Figure 4 In the embodiment, the touch panel 131 and the display panel 132 are two independent components to realize the input and output functions of the electronic device 100, but in some embodiments, the touch panel 131 and the display panel 132 can be integrated to realize the input and output functions of the electronic device 100.
[0085] The display panel 132 may provide reminder information of the wearing mode, wearing status, etc., and history information of the detected heart rate in visual (numbers, tables, graphs) or audible (synthesized speech or tone) form under the program control of the processor 110. As a non-limiting example, the trajectory of the user's handwriting input may be displayed.
[0086] The electronic device 100 can implement display functions through a GPU, a display panel 132, and an application processor. The GPU is a microprocessor for image processing, which connects the display panel 132 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0087] The memory 120 can be used to store software programs, and the processor 110 executes various functions of the electronic device 100 by running the software programs stored in the memory 120. The memory 120 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as chat, etc.), etc.; the data storage area may store data maintained according to the use of the electronic device 100 (such as audio data, motion data, etc.), etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0088] The electronic device 100 can implement audio functions, such as music playing and recording, through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, and the application processor.
[0089] The audio module 170 is used to convert digital audio information into analog audio signal output, and can also be used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 or some functional modules of the audio module 170 can be arranged in the processor 110.
[0090] The speaker 170A, also called a horn, is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music, play voice messages or make hands-free calls through the speaker 170A.
[0091] The receiver 170B, also called an earpiece, is used to convert an audio electrical signal into a sound signal. When a user uses the electronic device 100 to answer a call or voice message, the user can listen to the voice by placing the receiver 170B close to the ear.
[0092] Microphone 170C, also known as a microphone or a microphone, is used to convert sound signals into electrical signals. When a user makes a call or sends a voice message, the sound signal can be input into microphone 170C by speaking close to microphone 170C. Electronic device 100 can be provided with at least one microphone 170C. In other embodiments, electronic device 100 can be provided with two microphones 170C to achieve noise reduction function. In other embodiments, electronic device 100 can also be provided with three, four or more microphones 170C to achieve functions such as identifying the source of sound and directional recording. Processor 110 can process the electrical signal output by microphone 170C. For example, audio module 170 and wireless communication module 160 can be coupled through PCM interface. After microphone 170C converts ambient sound into an electrical signal (such as PCM signal), the electrical signal is transmitted to processor 110 through PCM interface; volume analysis and frequency analysis are performed on the electrical signal from processor 110 to determine the volume and frequency of ambient sound.
[0093] The electronic device 100 can monitor the user's physiological indicators, motion status, environmental information, etc. through various sensors in the sensor module 180 to provide the user with motion assistance and a convenient interactive experience.
[0094] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the touch screen 130. There are many types of pressure sensors 180A, for example, they can be resistive pressure sensors, inductive pressure sensors or capacitive pressure sensors. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When the force acts on the pressure sensor 180A, the capacitance between the electrodes changes, and the electronic device 100 determines the intensity of the pressure according to the change in capacitance. When the touch operation acts on the touch screen 130, the electronic device 100 detects the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when the touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, the instruction to view the short message is executed; when the touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.
[0095] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x-axis, the y-axis, and the z-axis) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used in scenes such as navigation and somatosensory games.
[0096] The touch sensor 180K may be provided in the touch screen 130 to detect a touch operation applied thereto or in the vicinity thereof and to determine the position of each touch point during the touch process. In other words, the touch sensor 180K is a touch detection device. The touch sensor 180K may transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation may be provided through the display panel 132.
[0097] The key 190 includes a function key, which can be a mechanical key or a touch key, and can realize multiple functions, such as turning on and off, waking up the screen, entering a specific menu, scrolling and selecting options, etc. The electronic device 100 can receive a key input signal and realize a function related to the case input signal.
[0098] Motor 191 can generate vibration. Motor 191 can be used for incoming call reminders and can also be used for touch feedback. Motor 191 can generate different vibration feedback effects for touch operations acting on different applications. Motor 191 can also generate different vibration feedback effects for touch operations acting on different areas of the touch screen 130. Different application scenarios (for example, time reminders, receiving messages, alarm clocks, and games) can correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0099] The indicator 192 may be an indicator light, which may be used to indicate the charging status and the change in the amount of electricity, and may also be used to indicate messages, missed calls, and notifications.
[0100] The electronic device 100 may also include an eSIM card (Embedded-SIM). After activating the eSIM function, the electronic device 100 can independently make calls, send and receive text messages, and use the mobile data network; that is, even if the electronic device 100 is not connected to a terminal device (for example, a mobile phone, tablet, laptop computer, etc.), you can still make and receive calls, receive text message verification codes, and use various applications that require the Internet, such as chatting, online music, weather queries, map navigation, etc., through the smart watch.
[0101] It should be understood that the electronic device 100 is also a terminal device.
[0102] In some embodiments, the electronic device 100 can establish a communication connection with a terminal device (e.g., a mobile phone, a tablet, a laptop, etc.). For example, the terminal device can establish a communication connection with the electronic device 100 by means of Bluetooth sharing or logging into an account. After the communication connection is successfully established between the electronic device 100 and the terminal device, data interaction and data synchronization can be achieved between the electronic device 100 and the terminal device, thereby achieving interaction of applications between the electronic device 100 and the terminal device. For example, the WeChat application in the terminal device and the WeChat application in the wearable electronic device 100 can synchronously display real-time chat information.
[0103] Understandably, Figure 4 The connection relationship between the modules shown is only a schematic illustration and does not constitute a limitation on the connection relationship between the modules of the electronic device 100. Optionally, the modules of the electronic device 100 may also adopt a combination of multiple connection modes in the above embodiments.
[0104] An operating system runs on the electronic device 100, and application programs can be installed on the operating system. The operating system in the electronic device 100 may include a real-time operating system (RTOS), LiteOS, and the like.
[0105] The software architecture of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes LiteOS of a layered architecture as an example to exemplify the software architecture of the electronic device 100.
[0106] It should be noted that although the embodiments of the present application are described using LiteOS as an example, its basic principles are also applicable to electronic devices 100 with other operating systems.
[0107] Figure 5 A schematic diagram of the software architecture of an electronic device according to an embodiment of the present application is shown. Figure 5 As shown, the software system of the electronic device 100 can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, LiteOS is divided into three layers, from the upper layer to the lower layer, namely the application layer (application), the application framework layer (application framework) and the operating system kernel layer (operating system kernel).
[0108] The application layer may include a series of applications, such as a chat application, a fitness application, a map application, a music application, etc. The chat application may be used to receive touch data.
[0109] In the embodiment of the present application, the application layer may further include a user interface (UI) module and a display module.
[0110] The UI module provides a user-visible interface for the application. The application displays various information to the user through the UI module, receives user input operation events, integrates the UI tasks corresponding to the operation events into the UI module, and calls and manages them through a unified interface.
[0111] The display module is responsible for presenting the information of the application to the user in a visual manner. It can convert data, images, text and other contents into pixels on the screen, so that the user can intuitively understand the running status and results of the application. For example, as the user continues to input touch data, it is rendered into a corresponding trajectory image and displayed in time on the touch screen 130, so that the user can intuitively understand the trajectory corresponding to the touch input.
[0112] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0113] The data interaction between the application layer and the application framework layer is carried out through the UI engine, which obtains data from the application layer and converts it into a format suitable for display on the user interface, for example, converting digital data into text, charts or graphics. In other words, the UI engine receives user operation events from the touch screen 130, such as clicking a button, sliding the screen, touching the track, etc., and then passes these events to the application framework layer for processing to realize the operation of data and the advancement of business processes.
[0114] That is to say, in the embodiment of the present application, the improvement is mainly to the UI engine, and the method of processing the trajectory image by the UI engine module is improved, from the real-time rendering of the trajectory image based on all coordinate points before the improvement to the method of adding new touch data based on the historical trajectory image.
[0115] The operating system kernel layer is used to allocate and manage all hardware and software resources in the operating system. The operating system kernel layer is a software component that belongs to the foundation and core part of the operating system.
[0116] The operating system kernel layer is a layer between the hardware and software in the electronic device 100 , and the operating system kernel layer includes at least a touch driver, a display driver, a graphics processing driver, an audio driver, and a sensor driver.
[0117] It should be noted that when the operating system is different, the corresponding operating system kernel layer is also different. For example, when the operating system is a Linux operating system or an Android operating system, the operating system kernel layer is a Linux kernel layer; when the operating system is a LiteOS operating system, the operating system kernel layer is a LiteOS kernel layer.
[0118] It should be noted that the electronic device mentioned in the embodiments of the present application may include more or fewer modules in the above-mentioned electronic device.
[0119] The following will be combined with the accompanying drawings to illustrate the embodiments of the present application through the following multiple exemplary embodiments. The methods in the following embodiments can be implemented in an electronic device with the above hardware structure and software architecture. The hardware structure diagram of the electronic device can be as follows: Figure 4 As shown, the software architecture diagram of the electronic device can be as follows Figure 5 As shown, the embodiments of the present application are not limited to this. For the sake of convenience of explanation, the embodiments of the present application all take the electronic device as a smart watch as an example.
[0120] Figure 6 A schematic diagram showing an application scenario applicable to the embodiment of the present application is shown. Figure 6 The application scenarios used in the embodiments of the present application are described. Figure 6 As shown in (a) in FIG. 1 , when using a smart watch, a user can enter a corresponding application through each application icon presented on the application list interface; taking the message app as an example, Figure 6 As shown in (b) in FIG. 1 , the user clicks the application icon of the message to enter the message App; enters the first display interface of the message App, which may be a contact list interface, and the user clicks contact B in the contact list interface, such as Figure 6 As shown in (c) in FIG. 1 , the chat interface with the contact B can be entered, such as Figure 6 The chat interface displays historical chat information, and there is a message input box 103 at the bottom. The message input box 103 can display "input information" to facilitate the user to intuitively understand the intention of the message input box 103. After the user clicks the message input box 103, the touch input interface can be entered, as shown in FIG. Figure 6 As shown in (e) in .
[0121] It should be understood that the touch input interface may also include a voice input box and / or an expression input box.
[0122] In the touch input interface, the preset area 105 can be used as the touch area, or the entire touch input interface can be used as the touch area. In the touch area, the user inputs a touch track, such as a handwriting track, according to the needs. As the user continues to input the touch track, the touch track input by the user is displayed in a highlighted line in the touch area; after the user completes the input, the text, punctuation and other information corresponding to the touch track are identified, and then the corresponding text, punctuation and other information are displayed on the electronic device until the user completes the handwriting input of the message.
[0123] It should be understood that during the use of the smart watch, you can also enter the touch input interface through the destination search box in the map app, enter the touch input interface through the message reply box in the WeChat app, enter the touch interface through the song search box in the music app, etc. It should also be understood that the embodiments of the present application do not limit the visual design, information presentation, etc. of the touch input interface in each application.
[0124] In some embodiments, the user can also enter the second display interface by clicking the message application, wherein the second display interface can be as follows: Figure 6 As shown in (f) in FIG. 1 , a new message box 104 may also be provided in the contact list interface in the message App, and the user may also click the new message box 104 to enter the Figure 6 The touch input interface shown in (e) should be understood from Figure 6 The display interface shown in (f) to Figure 6 There may be one or more intermediate interfaces between the display interfaces shown in (e), which is not limited in the embodiments of the present application.
[0125] Combine the following Figures 7 to 16 The touch track display method provided in the embodiment of the present application is described in detail.
[0126] It should be noted that the executor of the touch trajectory display method provided in the embodiment of the present application can be the above-mentioned electronic device (such as a smart watch or smart bracelet, etc.), or it can be a functional module or functional entity in the electronic device that can implement the method, and the solution can be implemented through hardware and / or software, as well as a combination of methods. The specific method can be determined according to actual usage requirements, and the embodiment of the present application does not limit this.
[0127] Figure 7 A schematic flow chart of a method for displaying a touch track provided by an embodiment of the present application is shown. The method is applied to an electronic device. A processor in the electronic device includes a microcontroller unit. After entering a touch input interface corresponding to an application program, when a touch input is performed, Figure 7 As shown, during the process of user handwriting input, the touch track display method provided in the embodiment of the present application includes the following steps:
[0128] S201: Acquire initial touch data.
[0129] Among them, touch data is data generated by the user sliding and clicking on the touch screen 130 through handwriting methods such as fingers and touch pens; the touch data at least includes coordinate information at the time of touch, and the user's sliding trajectory on the display screen can be generated based on the coordinate information in the touch data.
[0130] It should be understood that the coordinate information can be used to describe the position of the touch point, and the coordinate information can be a specific point, that is, a coordinate point, or can be used to identify an area or position range. For ease of expression, the embodiments of the present application are described by taking the coordinate point as an example.
[0131] In some embodiments, the touch data may also include pressure information, time information, touch type information, etc. The pressure information may reflect the degree of force applied by the user during handwriting, which may affect the thickness of the handwriting, etc. The time information may be used to record the specific time of handwriting input, and may be used to analyze the user's writing behavior, etc.
[0132] In the process of acquiring touch data, a series of touch data can be acquired by collecting the corresponding first preset time length.
[0133] It should be understood that in the process of handwriting input of each character, word, number, punctuation, etc., based on the preset collection frequency of the touch screen, the touch data collected for the first time is the initial touch data. It should be understood that the initial touch data at least includes the coordinate point of the handwriting starting point.
[0134] The number of coordinate points in the touch data collected each time may be one or more. When the user uses one finger to perform handwriting input, if the first preset time length corresponding to collecting the touch data includes one collection cycle, usually one touch point is collected, that is, the coordinate point corresponding to one touch point; if the first preset time length corresponding to collecting the touch data includes multiple collection cycles, multiple continuously changing touch points are collected in a short time, that is, multiple coordinate points are collected.
[0135] It should be understood that the initial touch data includes one or more coordinate points.
[0136] For example, the preset acquisition frequency is 60 Hz (Hertz), the first preset time length may be 1 / 60 s (second), and the corresponding initial touch data includes one coordinate point; the first preset time length may also be 0.05 s (second), and the corresponding initial touch data includes three coordinate points.
[0137] During the process of handwriting input by the user, the sliding speed varies. By including multiple collection cycles in the first preset time length, multiple touch points can be collected in one collection process, thereby reducing the number of data processing times and improving data processing efficiency.
[0138] It should be understood that when the duration of each acquisition is the first preset duration and the first preset duration includes multiple acquisition cycles, the number of coordinate information in the touch data acquired correspondingly may be different. For example, in two adjacent acquisition cycles, there may be one or two acquisition cycles in which no coordinate information is obtained.
[0139] S202: Generate an initial trajectory image based on the initial touch data, and display the initial trajectory image.
[0140] When the initial touch data is a coordinate point, the image of the corresponding rendered touch track is a point; when the initial touch data includes multiple coordinate points, the image of the corresponding rendered touch track is a line.
[0141] It should be understood that if the initial touch data is a point, a point can be displayed at the coordinates of the point as an initial trajectory image; if the initial touch data is a line, the line can be displayed as the initial trajectory image.
[0142] For example, the message content that the user intends to input is "I have received your email." When the user inputs the word "Receive" through the touch screen, when the initial touch data contains a coordinate point, the initial trajectory image corresponding to the initial touch data is as follows: Figure 8 As shown in (a) in the figure, for ease of viewing, Figure 8 (a) in FIG. 1 is a magnified display of the initial trajectory image; when the initial touch data includes multiple coordinate points, the initial trajectory image corresponding to the initial touch data is as follows: Figure 8 As shown in (b) in .
[0143] It should be understood that the touch input interface also displays an input information box 106, such as Figure 8 As shown in (a) in FIG. 1 , the input message box 106 displays the input message content “already” and a cursor.
[0144] S203: Store the initial trajectory image to obtain a historical trajectory image.
[0145] The initial trajectory image is stored in the smart watch. For example, the initial trajectory image can be stored in a memory in the MCU in the smart watch, or in a memory in the smart watch, so that the historical trajectory image can be called in the subsequent process of continuing to render the trajectory image.
[0146] It should be understood that if the memory capacity in the MCU is small or the processing efficiency is low, the memory in the smart watch should be used as much as possible.
[0147] It should be understood that the process of displaying the initial trajectory image and storing the initial trajectory image may be performed simultaneously or in a certain order, which is not limited in the embodiment of the present application.
[0148] In some embodiments, in the process of implementing the above-mentioned display of the initial trajectory image, in order to simplify the logical implementation of the solution of the present application, it is also possible to increase the process of generating the initial trajectory image in step 202, and determine the updated initial trajectory image based on the initial trajectory image and the stored trajectory image, wherein the stored trajectory image is obtained from the corresponding storage area in the smart watch, and the storage area is used to store the historical trajectory images corresponding to each first preset time length.
[0149] It should be understood that, for the initial touch data, the trajectory image stored in the corresponding storage area is a blank image, or in other words, there is no historical trajectory image stored in the corresponding storage area.
[0150] When a historical trajectory image of a blank image is stored in the electronic device, a target trajectory image can be generated through the initial touch data and the corresponding historical trajectory image. When no historical trajectory image is stored in the electronic device, a corresponding target trajectory image, i.e., an initial trajectory image, can be generated through the initial touch data.
[0151] When there is no stored historical trajectory image in the electronic device, a blank historical trajectory image may be created, and then a target trajectory image is generated through the initial touch data and the corresponding historical trajectory image.
[0152] Through the above process, there is no need to process the initial touch data collected for the first time separately. In other words, in the process of handwriting input of each character, word, number, punctuation, etc., there is no need to distinguish whether it is the first collection or the Nth collection (N is greater than 1), and the logic corresponding to each collection is the same.
[0153] The user's handwriting input is a continuous process. Therefore, while the user continues to input handwriting, the method further includes:
[0154] S204: Acquire intermediate touch data.
[0155] It should be understood that after the initial touch data, the processing logic of each newly added intermediate touch data is the same. Therefore, the intermediate touch data can refer to the touch data immediately following the initial touch data, or can refer to the touch data acquired successively within a period of time after the initial touch data.
[0156] Furthermore, the intermediate touch data is also data collected by the smart watch within a first preset time period, wherein the first preset time period may include the time required for one collection cycle, or may include the time required for multiple collection cycles.
[0157] It should also be understood that the process of the user's handwritten input is a non-uniform input process. That is to say, the number of touch points in the touch data collected for each first preset duration is different. That is, the number of touch points in the intermediate touch data may be the same as or different from the number of touch points in the initial touch data; the number of touch points in each intermediate touch data may also be the same or different.
[0158] S205. Generate a target trajectory image based on the intermediate touch data and the historical trajectory image, and display and store the target trajectory image.
[0159] It should be understood that the historical trajectory image is a stored historical trajectory image. If the intermediate touch data refers to the touch data immediately following the initial touch data, the historical trajectory image is the initial trajectory image; if the intermediate touch data refers to the touch data successively obtained within a period of time after the initial touch data, the historical trajectory image is the trajectory image corresponding to the storage after the previous acquisition.
[0160] After obtaining the intermediate touch data, continue to render the intermediate touch data on the basis of the historical trajectory image to form a target trajectory image; the historical trajectory image can be connected to the touch points in the intermediate touch data, or the historical trajectory image can be successively connected to each touch point in the intermediate touch data to form a target trajectory image.
[0161] It should be understood that the trajectory image in the embodiments of the present application is formed by connecting the touch points in the successively collected touch data with straight lines.
[0162] That is to say, when the intermediate touch data includes one touch point or when the intermediate touch data includes one coordinate point, connect the historical trajectory image to the touch point in the intermediate touch data to form a target trajectory image; for example, when the user inputs the character "person" through the touch screen, Fig. 9 Figure (a) therein is the historical trajectory image, Fig. 9 Figure (b) therein is the intermediate touch data. At this time, the intermediate touch data is one touch point, that is, touch point X. Furthermore, based on Fig. 9 the historical trajectory image in Figure (a) therein and Fig. 9 the intermediate touch data in Figure (b) therein, generate Fig. 9 the target trajectory image in Figure (c) therein.
[0163] And when the intermediate touch data includes multiple touch points or when the intermediate touch data includes multiple coordinate points, connect the historical trajectory image to the touch points in the intermediate touch data to form a target trajectory image; for example, when the user inputs the character "person" through the touch screen, Fig.10 Figure (a) therein is the historical trajectory image, Fig.10In Figure (b), the intermediate touch data is shown. At this time, the intermediate touch data includes multiple touch points, namely touch point X, touch point Y, and touch point Z. Furthermore, based on Fig.10 the historical trajectory image in Figure (a) in Fig.10 and the intermediate touch data in Figure (b) in Fig.10 a target trajectory image in Figure (c) in
[0164] is generated. In some embodiments, when the intermediate touch data includes multiple touch points, to improve the display efficiency of the touch trajectory, sub-trajectory images can be first rendered based on the multiple touch points in the intermediate touch data, and then the backup trajectory highlight and the sub-trajectory images are merged to obtain the target trajectory image.
[0165] Exemplarily, when the user inputs the character "person" through the touch screen, Fig.11 Figure (a) is the historical trajectory image, Fig.11 Figure (b) is the sub-trajectory image, which is rendered from the multiple touch points in the intermediate touch data. Furthermore, Fig.11 the historical trajectory image in Figure (a) and Fig.11 the sub-trajectory image in Figure (b) are merged to obtain Fig.11 the target trajectory image in Figure (c).
[0166] It should be understood that by storing the historical trajectory image, only the image needs to be saved or copied. Compared with the large number of coordinate point rendering operations in the related art, during the rendering process of each trajectory image, the process of drawing the trajectory image is shortened, the display of the trajectory image is accelerated, and the followability during the handwriting input process is improved.
[0167] S206. Update the historical trajectory image based on the target trajectory image.
[0168] For the stored target trajectory image and the initial trajectory image, they can be stored in the same storage area. In this storage area, the historical trajectory image can include one or more trajectory images.
[0169] If there is only one trajectory image in the historical trajectory image, the storage space occupied by the historical trajectory image can be reduced, and during the process of calling the historical trajectory image for subsequent processing, no indexing is required, which speeds up the data processing speed and improves the display efficiency of the touch trajectory. If the historical trajectory image has multiple trajectory images, such as two or three trajectory images, by storing multiple trajectory images, the availability of the historical trajectory image is ensured, the fault tolerance of the touch trajectory display on the smart phone is improved, and at the same time, in case of an abnormality, the stability of the smart phone can be improved by timely processing.
[0170] It should be understood that the historical trajectory image only includes one trajectory image, that is, in the process of storing the above trajectory images, the newly added target trajectory image to be stored will replace the stored initial trajectory image, or the newly added target trajectory image to be stored will replace the stored target trajectory image corresponding to the last display.
[0171] It should also be understood that the historical trajectory image includes multiple trajectory images, namely, the current trajectory image and / or the trajectory image before the current moment. If the storage space can be set to store two trajectory images, the two most recent trajectory images are stored.
[0172] It should be understood that if the historical trajectory image includes multiple trajectory images, different trajectory images may be stored in different storage areas.
[0173] It should also be understood that the initial touch data or the intermediate touch data may be stored in a storage area different from the historical trajectory image, for example, the initial touch data or the intermediate touch data may be stored in a first storage area in the memory, and the historical trajectory image may be stored in a second storage area in the memory. In the process of merging the initial touch data or the intermediate touch data with the historical trajectory image, the corresponding data may be directly retrieved from different storage areas at the same time, thereby facilitating the processing of these data and improving the efficiency of data processing.
[0174] In some embodiments, during the handwriting input process, a message pop-up window of other apps may appear. The pop-up window will automatically disappear after a second preset time period without user interaction. For example, during the handwriting input process of a user using a text messaging app, the WeChat app receives a new message. The smartwatch will prompt the user of the new message in the form of a pop-up window. Fig.12 As shown in (a); the pop-up window will interrupt the user's ongoing handwriting input, and the touch data and historical trajectory images of the handwriting input before the pop-up window appears are stored in the memory. Therefore, after the pop-up window message display reaches the second preset time length and disappears, as shown in Fig.12 As shown in (b) in the figure, the input interface still displays the content just input by the user, does not interrupt the content being input by handwriting, and can maintain the target trajectory image that has been displayed, thereby improving the user experience.
[0175] It should be understood that when the second preset time length is less than the third preset time length described below, the backup data corresponding to the touch data and the historical trajectory image can be retained; when the second preset time length is greater than or equal to the third preset time length, the backup data corresponding to the touch data and the historical trajectory image can be deleted.
[0176] For another example, when the user is inputting handwriting, a pop-up window may appear. In this case, the second preset time duration of the pop-up window is generally greater than the third preset time duration. At this time, the touch data and the backup data corresponding to the historical trajectory image are displayed.
[0177] It should be understood that the pop-up window in the above example can also be displayed to the user in the form of an interface display, and the embodiments of the present application are not limited to this.
[0178] The historical trajectory image in the embodiment of the present application can be determined by taking a screenshot when the trajectory image is displayed on the smart watch; it can also be determined by the image corresponding to the touch area that displays the touch trajectory during the process of displaying the target trajectory image in the touch area after the trajectory image is generated. At this time, the trajectory image can be the image corresponding to the preset area, or it can be the image corresponding to the touch input interface.
[0179] It should be understood that the above-mentioned historical trajectory image determination process can provide a method for the smart watch to quickly determine the historical trajectory image, and can improve the hardware processing speed in the smart watch, thereby obtaining the technical effect of improving the internal performance of the system in accordance with the laws of nature.
[0180] As mentioned above, when using a smart watch, the user has the need for handwriting. The smart watches in the related art have limited hardware performance and do not support timely touch response of the touch trajectory. Therefore, the smart watches in the related art do not support touch input, or there is a hand tracking delay in the touch input process. For example, when using a smart watch to collect the coordinate points of the user's touch input, the more coordinate points are input, the longer the corresponding rendering process takes, which results in the inability to meet the user's handwriting experience needs.
[0181] It should be understood that the electronic device in the embodiments of the present application is different from terminal devices with high hardware processing performance such as smartphones. Because smartphones have strong processor processing performance, they generally integrate writing trajectory prediction algorithms, etc. to achieve hand-tracking of handwriting; therefore, the touch trajectory display method in terminal devices such as smartphones is not applicable to the electronic device in the embodiments of the present application.
[0182] The display method of the touch track provided in the embodiment of the present application is applied to an electronic device, wherein a processor in the electronic device includes a microcontroller unit. During the handwriting input process of text, words, numbers, punctuation marks, etc., the electronic device collects touch data (initial touch data and intermediate touch data) within a first preset time period, and when the electronic device has a historical track image drawn by the touch data collected before the first preset time period, a target track image is generated through the touch data and the historical track image, and the target track image is displayed and stored; in this way, during the continuous rendering and display of the touch track, it is only necessary to further render each newly added touch data on the basis of the historical track image, thereby improving the rendering speed of the target track image, and further speeding up the process of displaying the target track image, so that the user can feel the timely touch response of the hand during the handwriting input process, thereby improving the user experience.
[0183] It should be understood that in the touch trajectory display method provided in the embodiment of the present application, the storage of multiple and increasing coordinate points in the related technology is replaced by the storage of a historical trajectory image, thereby reducing the amount of data storage; and generating a target trajectory image based on the touch data and the historical trajectory image. Compared with the related technology, each display requires a rendering to be performed from the touch starting point to the touch end point received at that time, thereby reducing the data processing process, etc., while the electronic device maintains the original hardware performance or the performance does not change much, a technical effect of improving the internal performance of the system that conforms to the laws of nature is obtained, so that the user can feel the timely response of the touch during the handwriting input process, thereby improving the user's usage experience.
[0184] In the process of handwriting input of characters, words, numbers and punctuation marks, in order to improve the accuracy of the electronic device's recognition of handwriting input, the monitoring of the first event in the handwriting input process is also added. Fig.13 A schematic diagram showing a flow chart of another method for displaying a touch track provided in an embodiment of the present application is shown. Fig.13 As shown, the following steps are included:
[0185] S211: Acquire first touch data.
[0186] It should be understood that the first touch data may be initial touch data or intermediate touch data.
[0187] When the first touch data is initial touch data, S212 , an initial track image is generated based on the initial touch data, and the initial track image is displayed.
[0188] S213: Store the initial trajectory image to obtain a historical trajectory image.
[0189] And when the first touch data is the intermediate touch data, S214 , generating a target trajectory image based on the intermediate touch data and the historical trajectory data, and displaying and storing the target trajectory image.
[0190] S215: Update the historical estimation image based on the target trajectory image.
[0191] During the handwriting input process, S216 , monitoring whether a first event exists.
[0192] When it is detected that no first event occurs during the handwriting input process, step 211 is continued to be executed to obtain first touch data.
[0193] When the first event is detected during the handwriting input process, S217 is executed to clear the stored touch data and historical track images.
[0194] In some embodiments, when clearing the stored intermediate touch data and historical track images, multiple candidate characters corresponding to the target track image are also displayed, or the closest identified candidate character is directly displayed in the input information box.
[0195] It should be understood that the first event includes an interruption event and a pause event. Among them, the interruption event is used to indicate that the touch track completes a complete input, that is, the user completes a complete input during the handwriting input process. The pause event is used to indicate that the user pauses during the handwriting input process, for example, when the user makes an error in the handwriting input and pauses for a long time.
[0196] It should be understood that during the handwriting input process, by monitoring the first event, it can be determined whether the user has completed an input. If the first event occurs, it indicates that the input has been completed. If the pause event does not occur, it indicates that the input is still continuing. By introducing the first event and monitoring it, the electronic device's judgment of the handwriting input process can be improved, thereby improving the accuracy of handwriting input recognition.
[0197] If the first event is detected, it means that the user has completed an input, and the electronic device needs to display the corresponding recognized candidate words and clear the corresponding storage space. If the first event is not detected, it means that the user has not completed an input, and it is necessary to continue to respond to the user's input.
[0198] That is, if an interruption event is detected, it means that the user has completed an input, and the electronic device needs to display the corresponding recognized candidate words and clear the corresponding storage space. If no interruption event is detected, it means that the user has not completed an input, and it is necessary to continue to respond to the user's input.
[0199] That is to say, if a pause event is detected, it means that the user has completed one input. Then, the electronic device needs to display the corresponding recognized candidate characters and clear the corresponding storage space. If no pause event is detected, it means that the user has not completed one input and needs to continue to respond to the user's input.
[0200] Among them, the smartwatch will recognize the target trajectory touch image as one or more corresponding candidate characters. When the user's hand raises and times out after entering one character, the already entered touch trajectory will be recognized as one or more candidate characters, and these candidate characters will be displayed.
[0201] At this time, the user can click to select the correct candidate character. At this time, the correct candidate character will be added to the already entered information box. After the user has completed all the input of the information content, Figure 6 For example, the user can click the "Complete" button in the touch input interface to realize the jump of the electronic device from the touch input interface back to the chat interface, and the message input box 103 in the chat interface will display the information content that the user has just entered. The user clicks the "Send" button to complete the sending of the handwritten information.
[0202] In some embodiments, the interruption event can be determined by the smartwatch detecting whether the touch screen interruption duration is greater than a third preset duration. The interruption event can be determined by analyzing the touch data, or by analyzing the coordinate information, pressure information, and time information in the touch data.
[0203] It should be understood that during the process of text input, there will be short pauses, such as the pauses between strokes in Chinese characters and between letters in English words. For example, there is a pause between the first stroke (a left-falling stroke) and the second stroke (a right-falling stroke) in the Chinese character "人"; there is a pause between the first stroke (a vertical hook) and the second stroke (a vertical stroke), and a pause between the second stroke (a vertical stroke) and the third stroke (a left-falling stroke) in the Chinese character "收", etc.; there is a pause between the first letter "a" and the second letter "n", and a pause between the second letter "n" and the third letter "d" in the word "and", and there are even pauses within the letters, etc. The duration of these pauses is generally less than the third preset duration. Therefore, the third preset duration can be used to monitor whether an interruption event occurs.
[0204] During the process of handwriting input, if the smartwatch detects that the touch screen interruption duration is greater than the third preset duration, it is determined that an interruption event is detected; if the smartwatch detects that the touch screen interruption duration is less than or equal to the third preset duration, it is determined that no interruption event is detected.
[0205] For example, the third preset duration is 2 seconds. If the smartwatch detects that the touch screen interruption duration is 3 seconds, exceeding the third preset duration, it is determined that an interruption event is detected.
[0206] In some embodiments, if coordinate information cannot be obtained within the touch screen interruption duration, it can be determined as an interruption event; or if coordinate information and pressure information cannot be obtained within the touch screen interruption duration, it can be determined as an interruption event; wherein, the touch screen interruption duration is determined by the time information in the touch data obtained last time and the system time.
[0207] In some embodiments, the pause event can be determined by the smart watch detecting whether the touch screen pause time is greater than a fourth preset time. The pause event can be determined by analyzing the touch data, or by analyzing the coordinate information, pressure information and time information in the touch data.
[0208] For example, the fourth preset time length is 1.8 seconds. If the smart watch detects that the touch screen pause time length is 2 seconds, which exceeds the fourth preset time length, it is determined that a pause event is detected.
[0209] In some embodiments, the fourth preset duration may be equal to the third preset duration.
[0210] The display method of the touch track proposed in the embodiment of the present application is applied to an electronic device whose hardware does not support timely touch response of the touch track. In the process of handwriting input of text, words, numbers and punctuation marks, the electronic device collects touch data (initial touch data and intermediate touch data) within a first preset time period, and when the electronic device has a historical track image drawn by the touch data collected before the first preset time period, a target track image is generated through the touch data and the historical track image, and the target track image is displayed and stored. In the process of handwriting input, whether a first event exists is monitored, and whether an input of a text, word, number or punctuation mark is completed or whether there is an input pause is determined based on the judgment of the first event. If an input is completed, the corresponding storage unit is cleared; in this way, in the process of continuous rendering and display of the touch track, it is only necessary to further render each newly added touch data on the basis of the historical track image, and by monitoring the first event, it is determined whether the user input is completed. In the process of improving the speed of rendering the target track image and accelerating the display of the target track image, the accuracy of the electronic device in recognizing the handwriting input is improved, so that the user can feel the timely touch response of the hand during the handwriting input, and the user experience is improved.
[0211] In one possible case, the electronic device may include a processor, a memory and a touch screen, wherein the memory may be a memory in the processor or an independent memory in the electronic device, wherein the processor includes an MCU and a GPU, and the touch screen includes a touch panel and a display panel.
[0212] Fig.14 A schematic diagram of an electronic device provided by an embodiment of the present application is shown. Fig.14As shown, the electronic device includes a touch screen composed of an MCU, a GPU, a RAM memory, a touch panel and a display panel, wherein there is data interaction between the MCU and the touch panel, the display panel and the GPU, that is, the MCU receives touch data formed on the touch panel, and the MCU displays the generated trajectory image on the display panel, and the MCU can also convert the received touch data into corresponding trajectory drawing instructions and send them to the GPU, so that the GPU generates a trajectory image corresponding to the trajectory drawing instructions and sends it to the MCU; and the RAM memory is used to store touch data and historical trajectory images.
[0213] In some embodiments, the display panel may also be referred to as a display screen, such as an LCD, and the touch panel may be referred to as a touch screen.
[0214] Among them, the MCU is used to collect the touch data received on the touch panel, and convert the touch data into instructions to instruct the GPU to draw a trajectory image, and after receiving the trajectory image after drawing, the trajectory image is displayed on the display panel and stored in the memory to realize the display of the touch trajectory. Fig.15 The illustrated embodiment is described in detail.
[0215] Fig.15 A schematic diagram showing a flow chart of another method for displaying a touch track provided in an embodiment of the present application is shown. Fig.15 As shown, the method comprises the following steps:
[0216] S301: The touch panel starts receiving handwriting input from a user.
[0217] It should be understood that the user's handwriting input here refers to the content that has just been input during the handwriting input process of each character, word, number, punctuation mark, etc.
[0218] S302 : The touch panel uploads the received initial touch data to the MCU.
[0219] That is to say, in the process of handwriting input of each character, word, number, punctuation, etc., based on the preset collection frequency of the touch screen, the touch data collected for the first time is the initial touch data, and the initial touch data at least includes the coordinate point of the handwriting starting point.
[0220] S303 : The MCU generates a first trajectory drawing instruction based on the initial touch data, and sends the first trajectory drawing instruction to the GPU.
[0221] S304 . The GPU renders an initial trajectory image corresponding to the initial touch data based on the received first trajectory drawing instruction, and notifies the MCU that the initial trajectory image has been drawn.
[0222] It should be understood that in the process of realizing the above-mentioned display of the initial trajectory image, in order to simplify the logical implementation of the solution of the present application, in the process of rendering the initial trajectory image in step 304, it is also possible to increase the determination of the updated initial trajectory image based on the initial trajectory image and the stored trajectory image, wherein the stored trajectory image is obtained from the corresponding storage area in the smart watch, and the storage area is used to store the historical trajectory images corresponding to each first preset time. It should be understood that for the initial touch data, the trajectory image stored in the corresponding storage area is an empty image, or there is no stored trajectory image in the corresponding storage area.
[0223] S305 , the MCU notifies the memory to back up the initial trajectory image, and sends the initial trajectory image to the display panel for display.
[0224] S306: The touch panel continues to receive the user's handwriting input.
[0225] It should be understood that the handwriting input of the user at this time is a continuous process with the handwriting input in step 301 .
[0226] S307 : The touch panel uploads the received intermediate touch data to the MCU.
[0227] The intermediate touch data may refer to the touch data immediately following the initial touch data, or may refer to the touch data acquired successively within a period of time after the initial touch data.
[0228] S308 . The MCU generates a second trajectory drawing instruction based on the intermediate touch data, and sends the second trajectory drawing instruction to the GPU.
[0229] S309 . The GPU renders a sub-track image corresponding to the intermediate touch data based on the received second track drawing instruction, and notifies the MCU that the sub-track image has been drawn.
[0230] S310. MCU obtains the historical trajectory image from the memory.
[0231] S311. The MCU combines the historical trajectory image and the sub-trajectory image to obtain a target trajectory image.
[0232] It should be understood that in the process of handwriting input, the embodiment of the present application can only perform incremental rendering on the newly added touch data, and then merge it with the historical trajectory image. Since trajectory image merging saves time compared to line drawing operations, it achieves the purpose of saving GPU load and improving the overall performance of the electronic device.
[0233] In some embodiments, the implementation process of the above S308 to S311 may also be: the MCU obtains the historical trajectory image from the memory; the MCU generates a third trajectory drawing instruction based on the intermediate touch data and the historical trajectory image, and sends the third trajectory drawing instruction to the GPU; the GPU renders the corresponding target trajectory image based on the received third trajectory drawing instruction, and notifies the MCU that the target trajectory image has been drawn;
[0234] S312: The MCU notifies the memory to back up the target trajectory image, and sends the target trajectory image to the display panel for display.
[0235] In the method for displaying a touch trajectory provided in an embodiment of the present application, the MCU is used to collect initial touch data or intermediate touch data received on the touch panel, and convert the initial touch data or the intermediate touch data into an instruction instructing the GPU to draw a trajectory image. After receiving the trajectory image drawn by the GPU, if there is an alternative trajectory image in the memory, the alternative trajectory image is merged with the trajectory image drawn by the GPU into a target trajectory image, and the target trajectory image is displayed on the display panel and stored in the memory to realize the display of the touch trajectory. In this way, during the process of continuous rendering and display of the touch trajectory, it is only necessary to merge the trajectory image corresponding to each newly added touch data into the historical trajectory image, thereby improving the speed of generating the target trajectory image, and then speeding up the process of displaying the target trajectory image, so that the user can feel the timely touch response of the hand during the handwriting input process, thereby improving the user experience.
[0236] Fig.16 A schematic diagram showing a flow chart of another method for displaying a touch track provided in an embodiment of the present application is shown. Fig.16 As shown, in the implementation process of the above S301 to S312, the method includes the following steps:
[0237] S313. The MCU continuously monitors whether an interrupt event occurs during the user's handwriting input process.
[0238] S314: If an interruption event occurs, the corresponding recognized candidate characters are displayed and the storage space corresponding to the current handwriting input in the memory is cleared.
[0239] S315: If no interruption event occurs, the touch panel continues to receive the user's handwriting input.
[0240] In some embodiments, during the implementation of S301 to S312, that is, during the handwriting input process, the method includes the following steps:
[0241] S323. The MCU monitors the duration of screen touch interruption during the user's handwriting input process.
[0242] It is understandable that whether an interruption event occurs is determined by monitoring whether the touch screen interruption during the handwriting input process exceeds the third preset time length.
[0243] S324: If the duration of the screen touch interruption is longer than the third preset duration, the corresponding recognized candidate characters are displayed and the storage space corresponding to the current handwriting input in the memory is cleared.
[0244] It should be understood that when the user clicks the touch screen again and starts handwriting input again, the execution is restarted. Fig.16 The process in , starts the sampling of touch data and drawing of trajectory images again.
[0245] S325: If the touch screen interruption duration is less than or equal to the third preset duration, the touch panel continues to receive the user's handwriting input.
[0246] In the method for displaying a touch track provided in an embodiment of the present application, the MCU is used to collect initial touch data or intermediate touch data received on the touch panel, and convert the initial touch data or the intermediate touch data into an instruction to instruct the GPU to draw a track image. After receiving the track image drawn by the GPU, if there is an alternative track image in the memory, the alternative track image is merged with the track image drawn by the GPU into a target track image, and the target track image is displayed on the display panel and stored in the memory, so as to realize the display of the touch track, and continuously monitor whether an interrupt event occurs during the handwriting input process, and determine whether a text, word, etc. input is completed through the interrupt event. In this way, during the process of continuous rendering and display of the touch track, it is only necessary to merge the track image corresponding to each newly added touch data into the historical track image, so as to improve the target track image generation speed, thereby speeding up the process of displaying the target track image and improving the accuracy of input detection; so that the user can feel the timely touch response of the hand during the handwriting input process, and improve the user experience.
[0247] It should be noted that in the embodiments of the present application, "greater than" can be replaced by "greater than or equal to", "less than or equal to" can be replaced by "less than", or "greater than or equal to" can be replaced by "greater than", and "less than" can be replaced by "less than or equal to".
[0248] It should be understood that the size of the sequence number of each process in the above embodiment does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention. The various embodiments described herein can be independent schemes, or they can be combined according to internal logic, and these schemes all fall within the scope of protection of this application.
[0249] It should also be understood that, although the various steps in the flow chart in the above-described embodiment are shown in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have strict order restrictions, and these steps can be performed in other orders. Moreover, at least a portion of the steps in the flow chart may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.
[0250] The above mainly describes the solution provided by the embodiment of the present application from the perspective of method steps. It can be understood that in order to achieve the above functions, the electronic device implementing the method includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should be aware that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in hardware or in a way that computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of protection of the present application.
[0251] The embodiment of the present application can divide the functional modules of the electronic device according to the above method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other feasible division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.
[0252] Fig.17 A schematic diagram of a display device for a touch track provided in an embodiment of the present application is shown. The device 400 can be used to perform the actions performed by the electronic device in the above method embodiment. The hardware in the electronic device does not support timely touch response of the touch track. The device 400 includes a touch acquisition unit 410, a processing unit 420, and a display unit 430.
[0253] The touch acquisition unit 410 is used to acquire initial touch data or intermediate touch data.
[0254] The processing unit 420 is used to generate an initial trajectory image based on the initial touch data, generate a target trajectory image based on the intermediate touch data and the historical trajectory image, and store the initial trajectory image and the target trajectory image.
[0255] The display unit 430 is used to display the initial trajectory image and the target trajectory image.
[0256] The processing unit 420 is further configured to monitor a first event in the handwriting input process, and clear the stored initial trajectory image and / or target trajectory image, and initial touch data and / or intermediate touch data after the first event occurs.
[0257] The touch track display device provided in the embodiment of the present application is used to execute the touch track display method of the above embodiment, and the technical principle and technical effect are similar, which will not be repeated here.
[0258] It should be noted that the above-mentioned display device 400 for displaying the touch track of the application is embodied in the form of a functional unit. The term "unit" here can be implemented in the form of software and / or hardware, and is not specifically limited to this.
[0259] Fig.18 The schematic structural diagram of the electronic device provided in the embodiment of the present application is shown. The electronic device is used to execute the corresponding steps and / or processes in any of the above method embodiments.
[0260] The electronic device 500 includes a processor 510, a touch screen 520, and a memory 530. The processor 510, the touch screen 520, and the memory 530 communicate with each other through an internal connection path, and the processor 510 can implement various possible implementations in the electronic device 500, and merge the historical track image with the touch data. The memory 530 is used to back up and store the track image and the touch data, and control the instructions executed by the processor 510.
[0261] Optionally, the memory 530 may include a read-only memory and a random access memory, and provide instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory. For example, the memory may also store information about the device type. The processor 510 may be used to execute instructions stored in the memory, and when the processor 510 executes instructions stored in the memory, the processor 510 is used to execute the various steps and / or processes of the method embodiment corresponding to the above-mentioned electronic device.
[0262] It should be understood that the electronic device may refer to a wearable device, and the wearable device includes a smart watch, a smart bracelet, or other wearable devices with a handwriting input function.
[0263] The electronic device 500 is used to execute the corresponding processes and steps in any of the above methods. The specific description is referred to the above description and will not be repeated here.
[0264] It should be understood that in the embodiments of the present application, the processor of the above-mentioned device may be a microcontroller unit (MCU), and the processor may also be other general-purpose processors, digital signal processors (DSPs), field programmable gate arrays (FPGAs), etc.
[0265] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software units in a processor for execution. The software unit can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor executes the instructions in the memory, and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.
[0266] The embodiment of the present application provides a computer program product, when the computer program product is run on an electronic device, the electronic device executes the technical solution in the above embodiment. Its implementation principle and technical effect are similar to those of the above method-related embodiments, and will not be repeated here.
[0267] The embodiment of the present application provides a readable storage medium, which contains instructions. When the instructions are executed in an electronic device, the electronic device executes the technical solution of the above embodiment. The implementation principle and technical effect are similar and will not be repeated here.
[0268] Among them, the electronic device, computer-readable storage medium, and computer program product provided in this embodiment are all used to execute the corresponding touch trajectory display method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
[0269] It should be understood that the "embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the various embodiments in the entire specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.
[0270] It should also be understood that in the present application, "under the circumstances of...", "if" and "if" all refer to the electronic device making corresponding processing under certain objective circumstances, and do not limit the time, nor do they require the electronic device to make a judgment when implementing it, nor do they mean the existence of other limitations.
[0271] Elements expressed in the singular herein are intended to mean "one or more" rather than "one and only one" unless otherwise specified. In this application, "at least one" is intended to mean "one or more" and "more than one" is intended to mean "two or more" unless otherwise specified.
[0272] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that there may be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. A can be singular or plural, and B can be singular or plural.
[0273] In this document, the term "at least one of..." or "at least one of..." means all or any combination of the listed items. For example, "at least one of A, B, and C" may mean: A exists alone, B exists alone, C exists alone, A and B exist at the same time, B and C exist at the same time, and A, B, and C exist at the same time, where A may be singular or plural, B may be singular or plural, and C may be singular or plural.
[0274] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0275] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0276] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0277] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims. In short, the above is only a preferred embodiment of the technical solution of the present application, and is not used to limit the protection scope of the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.
Claims
1. A method for displaying a touch track, characterized in that: Applied to an electronic device, the processor in the electronic device includes a micro control unit, and the method includes: Acquire first touch data, where the first touch data is data collected by the electronic device within a first preset time period; In the case where a historical trajectory image is stored in the electronic device, generating a target trajectory image based on the first touch data and the historical trajectory image, wherein the historical trajectory image is drawn based on the touch data collected before the first preset time period; The target trajectory image is displayed and stored.
2. The method for displaying a touch track according to claim 1, characterized in that: The electronic device further comprises a memory, and the memory is used to store the historical trajectory image.
3. The method for displaying a touch track according to claim 1 or 2, characterized in that: The first touch data includes coordinate information, and the generating the target trajectory image based on the first touch data and the historical trajectory image includes: The historical track image is connected with a piece of coordinate information in the first touch data to obtain the target track image.
4. The method for displaying a touch track according to claim 1 or 2, characterized in that: The first touch data includes a plurality of coordinate information, and the generating a target trajectory image based on the first touch data and the historical trajectory image includes: The historical trajectory image is sequentially connected with each of the coordinate information in the first touch data to obtain the target trajectory image.
5. The method for displaying a touch track according to claim 1 or 2, characterized in that: When the first touch data includes a plurality of coordinate information, generating a target trajectory image based on the first touch data and the historical trajectory image includes: generating a sub-track image based on a plurality of coordinate information in the first touch data; The historical trajectory image and the sub-trajectory image are combined to obtain the target trajectory image.
6. The method for displaying a touch track according to any one of claims 1 to 5, characterized in that: The method further comprises: When a first event occurs during a user touch input, the first touch data and the historical track image that have been stored are cleared, wherein the first event is used to indicate that the touch track input ends.
7. The method for displaying a touch track according to any one of claims 1 to 6, characterized in that: The method further comprises: Based on the target trajectory image, the historical trajectory image is updated.
8. The method for displaying a touch track according to claim 2, characterized in that: The memory includes a first storage area and a second storage area, and the method further includes: storing the first touch data in a first storage area; The historical trajectory image is stored in a second storage area.
9. The method for displaying a touch track according to any one of claims 1 to 8, characterized in that: The historical track image includes one or more track images, and the method further includes: When the historical trajectory image includes one trajectory image, replacing the historical trajectory image based on the currently determined target trajectory image; When the historical trajectory image includes N trajectory images, the currently determined target trajectory image is stored, and the earliest stored trajectory image among the N trajectory images is deleted.
10. The method for displaying a touch track according to any one of claims 1 to 9, characterized in that: The historical trajectory image is determined by any of the following methods: When the electronic device displays the target trajectory image, taking a screenshot of the display interface of the electronic device to obtain the historical trajectory image; In the process of displaying the target trajectory image in the touch area, the historical trajectory image is determined based on the touch area, wherein the touch area is a partial area or the entire area in the display interface of the electronic device.
11. The method for displaying a touch track according to any one of claims 2 to 10, characterized in that: The processor in the electronic device further includes a graphics processor, and the method includes: The micro control unit acquires the first touch data, converts the first touch data into a trajectory drawing instruction, and sends the instruction to the graphics processor; The graphics processor renders a first trajectory image corresponding to the first touch data based on the trajectory drawing instruction; The microcontroller unit obtains the historical trajectory image from the memory, and after receiving the first trajectory image sent by the image processor, merges the first trajectory image with the historical trajectory image to obtain the target trajectory image; The micro control unit controls the display and storage of the target trajectory image.
12. The method for displaying a touch track according to any one of claims 1 to 11, characterized in that: The electronic device includes a smart watch or a smart bracelet.
13. A touch track display device, characterized in that: The touch track display device comprises a processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the touch track display device executes any one of claims 1 to 12.
14. An electronic device, characterized in that: The electronic device comprises a processor, wherein the processor is coupled to a memory and reads instructions in the memory, and enables the electronic device to execute the touch track display method according to any one of claims 1 to 12 according to the instructions.
15. A computer program product, characterized in that The computer program product comprises a computer program which, when executed, causes the method according to any one of claims 1 to 12 to be performed.
Citation Information
Patent Citations
Handwriting track drawing method and device
CN109558059A
Information display method, reader and computer storage medium
CN110703978A
Writing track rendering method and device, writing screen equipment and storage medium
CN114442845A
Display method and device of graffiti track, computer equipment and storage medium
CN118502637A