A control method of an electronic device and an electronic device

By acquiring touch signals in the display driver circuit of electronic devices and negotiating synchronization parameters with the stylus, the problem of stylus disconnection caused by screen refresh rate switching is solved, improving input stability and user experience.

CN117093087BActive Publication Date: 2025-12-30HUAWEI TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210518501.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-13
Publication Date
2025-12-30
Estimated Expiration
2042-05-13

AI Technical Summary

Technical Problem

When the screen refresh rate of an electronic device changes, stylus input is prone to disconnection, resulting in a degraded user experience.

Method used

By acquiring a touch signal once every S rows of pixels after scanning the display driver circuit of the electronic device, and taking the N consecutively acquired signals as a group, an uplink synchronization signal is transmitted in the Kth acquisition time slot of each group to align with the stylus and negotiate downlink parameters to ensure synchronized signal transmission.

Benefits of technology

It effectively reduces the probability of stylus disconnection when inputting on electronic devices, thus improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117093087B_ABST
    Figure CN117093087B_ABST
Patent Text Reader

Abstract

A control method of an electronic device, which can be applied to an electronic device with a touch screen, the electronic device being provided with a display driving circuit and a touch sensor matched with the touch screen, the method comprising: the display driving circuit performing pixel scanning; the touch sensor collecting a touch signal each time the display driving circuit scans S rows of pixels, S >= 1; wherein N times of continuously collected touch signals are taken as a group, and an uplink synchronization signal is transmitted to the outside in the time slot of the Kth time of collecting the touch signal in each group, 1 <= K <= N, the uplink synchronization signal being used for time alignment with an external device. In this way, no matter how the frame rate of the touch screen of the electronic device changes, the time of collecting the touch signal of the electronic device is fixed each time, so as not to affect the collection of the downlink signal of the handwriting pen, reduce the probability of handwriting pen disconnection, and improve the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the technical field of terminals, and in particular to a control method for an electronic device and an electronic device. Background Art

[0002] With the development of electronic devices, electronic devices such as tablet computers or large-sized drawing tablets have experienced explosive growth, and the application software configured on electronic devices increasingly requires higher-precision touch, especially for drawing software and the like. Currently, a stylus is generally used as one of the input devices of an electronic device, and the character input function of the electronic device can be easily realized through the stylus. During the use of the electronic device, the screen refresh frame rate of the electronic device can be dynamically switched according to the change of the displayed scene. After the screen refresh frame rate of the electronic device is switched, for example, after the screen refresh frame rate is switched from 120Hz to 90Hz, the phenomenon of disconnection often occurs when using the stylus to input on the electronic device. Summary of the Invention

[0003] This application provides a control method for an electronic device, a control method for a stylus, a control method applied to a system including an electronic device and a stylus, an electronic device, a stylus, a computer storage medium, and a computer program product, which can reduce the probability of disconnection when the stylus inputs on the electronic device and improve the user experience.

[0004] In a first aspect, this application provides a control method for an electronic device, which can be applied to an electronic device with a touch screen. A display driving circuit and a touch sensor are configured in the electronic device to be matched with the touch screen. The display driving circuit performs pixel scanning; the touch sensor collects a touch signal every time after the display driving circuit scans S rows of pixels, where S≥1; wherein, N consecutive collected touch signals are used as a group, and an uplink synchronization signal is transmitted to the outside during the time slot of collecting the touch signal for the Kth time in each group, where 1≤K≤N, and the uplink synchronization signal is used for time alignment with an external device. Exemplarily, the external device may refer to a device other than the electronic device. Exemplarily, the display driving circuit may scan pixels row by row.

[0005] In this way, regardless of how the frame rate of the touch screen of the electronic device changes, the time for the electronic device to collect the touch signal each time is fixed, so it will not affect the collection of the downlink signal emitted by the stylus, thereby reducing the probability of stylus disconnection and improving the user experience.

[0006] According to the first aspect, S = H / N, where H is the number of rows of pixels that the display driving circuit needs to scan when the touch screen displays one frame of image at the standard frame rate. This makes it possible to support the switching of each frame rate that can be divisible by (F*N).

[0007] According to the first aspect, or any implementation of the first aspect above, the time slot for the Kth touch signal acquisition in each group is smaller than the time slot for each touch signal acquisition in each group except for the Kth touch signal acquisition. Since the time required to transmit the uplink synchronization signal is relatively small, while the time required to acquire the touch signal is relatively long, the time slot occupied by transmitting the uplink synchronization signal can be reduced to avoid wasting time.

[0008] According to the first aspect, or any implementation of the first aspect above, the method further includes: determining the total number of rows of pixels scanned by the display driving circuit between the first frame synchronization signal and the second frame synchronization signal, wherein the second frame synchronization signal is adjacent to the first frame synchronization signal and is the next frame synchronization signal after the first frame synchronization signal; when the total number of rows is less than the target number of rows, recounting the number of rows of pixels scanned by the display driving circuit, wherein the target number of rows is the number of rows of pixels that the display driving circuit needs to scan to display one frame of image at the target frame rate, and the target frame rate is the current display frame rate of the touch screen. This allows for the calibration of the line synchronization signal (i.e., the HSYNC signal) through the frame synchronization signal (i.e., the VSYNC signal).

[0009] According to the first aspect, or any implementation of the first aspect above, the method further includes: determining the establishment of a connection with the stylus; when the display driving circuit scans (K*S) rows of pixels for the first time after acquiring the frame synchronization signal, it transmits an uplink synchronization signal to the outside, the uplink synchronization signal being used for time alignment with the stylus. This ensures that timing alignment with the stylus is achieved immediately, preventing disconnections during stylus input.

[0010] According to the first aspect, or any implementation of the first aspect above, the method further includes: a touch sensor acquiring a downlink signal emitted by a stylus; and a touch screen displaying a touch position corresponding to the acquired downlink signal.

[0011] According to the first aspect, or any implementation of the first aspect above, the method further includes: when a connection is first established with the stylus, sending downlink parameters to the stylus; wherein the downlink parameters include: the offset of the first downlink signal from the starting position of the frame synchronization signal, the time interval between adjacent downlink signals, and the time required for each downlink signal. This allows for timing alignment of the downlink signals transmitted by the stylus through the downlink parameters.

[0012] According to the first aspect, or any implementation of the first aspect above, the time required for each downlink signal is greater than the time slot for each touch signal acquisition. This reduces the probability that the electronic device cannot accurately acquire the stylus's downlink signal due to the loss of the horizontal synchronization signal.

[0013] Secondly, this application provides a control method for a stylus, which can be applied to a stylus paired with an electronic device. The electronic device is equipped with a touch screen, a display driving circuit paired with the touch screen, and a touch sensor. The method includes: determining to establish a connection with the electronic device; acquiring an uplink synchronization signal emitted by the electronic device, wherein the touch sensor acquires a touch signal once after the display driving circuit scans S rows of pixels, S≥1, and the electronic device groups the N consecutively acquired touch signals as a group, and transmits an uplink synchronization signal to the outside during the time slot of the Kth acquired touch signal in each group, 1≤K≤N, the uplink synchronization signal being used for time alignment with an external device; and transmitting a downlink signal to the electronic device based on downlink parameters negotiated during the initial connection with the electronic device, wherein the downlink parameters include: the offset of the first downlink signal from the starting position of the frame synchronization signal in the electronic device, the time interval between adjacent downlink signals, and the time required for each downlink signal.

[0014] According to the second aspect, the time required for each downlink signal is greater than the time slot for each touch signal acquisition.

[0015] Thirdly, this application provides a control method applied to a system including an electronic device and a stylus. The electronic device is equipped with a touch screen, a display driving circuit and a touch sensor associated with the touch screen. The method includes: establishing a connection between the electronic device and the stylus; the electronic device performing pixel scanning through the display driving circuit; the electronic device acquiring a touch signal after the display driving circuit scans S rows of pixels each time, where S≥1, and the electronic device groups the N consecutively acquired touch signals as a group, and transmits an uplink synchronization signal to the outside during the time slot of the Kth acquisition of the touch signal in each group, where 1≤K≤N; the stylus acquiring the uplink synchronization signal; the stylus, in response to the acquired uplink synchronization signal, transmitting a downlink signal to the electronic device based on downlink parameters negotiated during the initial connection with the electronic device, wherein the downlink parameters include: the offset of the first downlink signal from the starting position of the frame synchronization signal in the electronic device, the time interval between adjacent downlink signals, and the time required for each downlink signal; and the electronic device acquiring the downlink signal transmitted by the stylus through the touch sensor.

[0016] According to the third aspect, S = H / N, where H is the number of rows of pixels that the display driving circuit needs to scan when the touch screen displays one frame of image at the standard frame rate.

[0017] According to the third aspect, or any implementation of the third aspect above, the time slot for the Kth touch signal acquisition in each group is smaller than the time slot for each touch signal acquisition in each group except for the Kth touch signal acquisition.

[0018] According to the third aspect, or any of the above implementations of the third aspect, the time required for each downlink signal is greater than the time slot for each acquisition of a touch signal.

[0019] Fourthly, this application provides an electronic device, including: a touch screen; a display driving circuit and a touch sensor associated with the touch screen; at least one memory for storing a program; and at least one processor for executing the program stored in the memory. When the program stored in the memory is executed, the processor is used to execute the method provided in the first aspect.

[0020] Fifthly, this application provides a stylus, comprising: a communication module for communicating with an electronic device; at least one memory for storing a program; and at least one processor for executing the program stored in the memory, wherein when the program stored in the memory is executed, the processor is configured to execute the method provided in the second aspect.

[0021] In a sixth aspect, this application provides a computer-readable storage medium storing a computer program that, when run on an electronic device, causes the electronic device to perform the method provided in the first aspect, or, when run on a stylus, causes the stylus to perform the method provided in the second aspect.

[0022] In a seventh aspect, this application provides a computer program product that, when run on an electronic device, causes the electronic device to perform the method provided in the first aspect, or, when run on a stylus, causes the stylus to perform the method provided in the second aspect.

[0023] It is understood that the beneficial effects of the second to seventh aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0024] Figure 1 This is a schematic diagram illustrating an application scenario provided by an embodiment of this application;

[0025] Figure 2 This is a schematic diagram of the structure of an electronic device provided in one embodiment of this application;

[0026] Figure 3 This is a schematic diagram illustrating the process of a display driving circuit that is compatible with a touch screen in an electronic device scanning row pixels, according to an embodiment of this application.

[0027] Figure 4 This is a timing diagram of a display driving circuit that scans row pixels in an electronic device that is compatible with a touch screen, according to an embodiment of this application.

[0028] Figure 5 This is a schematic diagram of an electronic device acquiring touch signals and a stylus transmitting downlink signals when displaying an image at a frame rate F, according to an embodiment of this application.

[0029] Figure 6 This is a schematic diagram of an electronic device acquiring touch signals and a stylus transmitting downlink signals when displaying an image at a frame rate of 2F, according to an embodiment of this application.

[0030] Figure 7 This is a schematic diagram of an electronic device acquiring touch signals and a stylus transmitting downlink signals when switching frame rates while displaying an image, according to an embodiment of this application.

[0031] Figure 8 This is a schematic diagram of an embodiment of the present application, in which the coding time slot of a stylus is larger than the touch acquisition time slot of an electronic device;

[0032] Figure 9 This is a schematic diagram of the hardware structure of a stylus provided in an embodiment of this application;

[0033] Figure 10 This is a flowchart illustrating a control method for an electronic device according to an embodiment of this application. Detailed Implementation

[0034] In this article, the term "and / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. The symbol " / " in this article indicates that the related objects are in an "or" relationship; for example, A / B means A or B.

[0035] The terms "first" and "second," etc., used in the specification and claims herein are used to distinguish different objects, not to describe a specific order of objects. For example, "first response message" and "second response message," etc., are used to distinguish different response messages, not to describe a specific order of response messages.

[0036] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0037] In the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more, for example, multiple processing units means two or more processing units, multiple elements means two or more elements, etc.

[0038] For example, Figure 1 An application scenario is illustrated in some embodiments of this application. For example... Figure 1 As shown, a user can use a stylus 200 to input data on an electronic device 100. The electronic device 100 may be, but is not limited to, a mobile phone, tablet computer, or other electronic device with a touchscreen; the stylus 200 may be, but is not limited to, an active capacitive stylus.

[0039] exist Figure 1 In this context, when the screen of electronic device 100 switches frame rates, the electronic device typically does so via CMD commands, and the timing of these CMD commands is strictly limited. If the CMD command is delayed or sent incorrectly, the touchscreen on electronic device 100 may have difficulty acquiring the downlink signal from stylus 200, causing the stylus 200 to display discontinuous lines during input. For example, when drawing a line on the touchscreen using the stylus 200, the line displayed on the touchscreen will be a discontinuous line. Furthermore, since existing protocols allocate sampling time slots for the touchscreen on electronic device 100 based on vertical synchronization (VSync) mechanism, it is difficult to align the sampling time of the touchscreen on electronic device 100 with the continuous downlink signal transmission time of stylus 200 when there is no multiple relationship between the frame rate before and after the switch (e.g., switching from 120Hz to 90Hz). As a result, the touchscreen on electronic device 100 has difficulty acquiring the downlink signal from stylus 200, causing the stylus 200 to experience disconnection during input.

[0040] To avoid the situations described above, the embodiments of the present application provide a control method for an electronic device. In this method, after the electronic device 100 establishes a connection with the stylus 200, the electronic device 100 can collect a touch signal every time the display driver circuit in it that is matched with the touch screen scans S rows of pixels, and takes collecting N touch signals as a cycle for cycling until the electronic device 100 disconnects from the stylus 200. Among them, when the electronic device 100 collects the touch signal for the Kth time in each cycle, it can transmit an uplink signal outward, where 1 ≤ K ≤ N. After the stylus 200 establishes a connection with the electronic device 100, when it first obtains the uplink signal, it can transmit a downlink signal according to the downlink parameters negotiated when the two establish a connection (such as when first establishing a connection, etc.). This makes it so that regardless of how the frame rate of the touch screen of the electronic device 100 changes, the time when the electronic device 100 collects the touch signal each time is fixed, so it will not affect its collection of the downlink signal of the stylus 200, that is, the situation of the stylus 200 losing connection will not occur.

[0041] Exemplarily, Figure 2 shows a hardware structure of the electronic device 100. As Figure 2 shown, the electronic device 100 may include: a processor 110, a memory 120, a communication module 130, and a touch screen 140. It can be understood that the structure Figure 2 schematically shown does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0042] The processor 110 is the computing and control core of the electronic device 100. The processor 110 may include one or more processing units. For example, the processor 110 may include one or more of the following: application processor (AP), modem, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. For example, after the electronic device 100 establishes a connection with the stylus 200, the processor 110 may control the touchscreen 140 to transmit uplink synchronization signals to the outside world, and control the touchscreen 140 to collect touch signals, etc.

[0043] The memory 140 may store a program that can be executed by the processor 110, enabling the processor 110 to perform at least some or all of the steps in the methods provided in the embodiments of this application. The memory 140 may also store data. The processor 110 may read the data stored in the memory 140. The memory 140 and the processor 110 may be configured separately. Alternatively, the memory 140 may be integrated into the processor 110.

[0044] Communication module 130 may include a wireless communication module. Communication module 130 can be applied to electronic device 100 using wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. For example, communication module 130 can be used to establish a connection between electronic device 100 and stylus 200. For example, communication module 130 can be a Bluetooth module.

[0045] The touchscreen 140 can be used to display images, videos, etc. The touchscreen 140 may include a display panel. The display panel may, but is not limited to, a liquid crystal display (LCD). The touchscreen 140 may employ in-cell touch technology, i.e., a touch sensor is embedded within the display screen. The touch sensor can be used to collect touch signals on the touchscreen 140. For example, in addition to displaying graphics and videos, the touchscreen 140 can also be used to transmit uplink synchronization signals to the outside and acquire downlink signals transmitted by the stylus 200 after the electronic device 100 establishes a connection with the stylus 200.

[0046] In some embodiments, when displaying an image, the touchscreen 140 displays a single frame. When displaying video, the touchscreen 140 displays the frames that make up the video sequentially in chronological order. Each frame can be divided into several basic viewpoints (pixels), and each pixel has independent color information. When displaying a single frame, the processor 110 can control the display driving circuit associated with the touchscreen 140 to scan the pixels of that frame line by line to form a complete image; the continuous scanning of the image utilizes the persistence of vision to "display" dynamic images. For example, the display driving circuit may, but is not limited to, scan line by line from top to bottom during operation. For example, the display driving circuit may, but is not limited to, be integrated into the touchscreen 140.

[0047] To facilitate understanding, the following example illustrates the process of displaying one frame of an image on the touchscreen 140. For example... Figure 3 As shown, when a frame of image needs to be displayed, the processor 110 can trigger the generation of a vertical synchronization (VSYNC) signal, also known as a frame synchronization signal, so that the display driver circuit can know that a new frame needs to be displayed. After the VSYNC signal is issued, a retrace time needs to be reserved for the display driver circuit. The interval from the start of the VSYNC signal to the start of the first line scan is called the vertical back porch (VBP), and the interval from the end of the last line scan to the start of the next VSYNC signal is called the vertical front porch (VFP).

[0048] When the display driver circuit scans each line, the processor 110 can trigger the generation of a horizontal synchronization (HSYNC) signal so that the display driver circuit can know that it needs to start scanning a new line of pixels. Each line of information begins with an HSYNC signal. After the HSYNC signal is issued, a retrace time needs to be reserved for the display driver circuit. The interval from the start of the HSYNC signal to the start of data enable is called the horizontal back porch (HBP), and the interval from the end of data enable to the start of the next HSYNC signal is called the horizontal front porch (HFP). The interval from the start to the end of data enable can be understood as... Figure 3 The interval shown in the medium gray area.

[0049] Continue reading Figure 3 The display driver circuit can scan from left to right while scanning a row of pixels. When the display driver circuit finishes scanning a row of pixels and receives a new HSYNC signal, it can jump from the rightmost to the leftmost position of the currently scanned row, move down one row, and begin scanning the next row of pixels. When the display driver circuit receives a new VSYNC signal, it can... Figure 3 Jump from the bottom to the top and to the left vertex position to begin scanning a new type of image.

[0050] For example, Figure 4 A timing diagram of signals for scanning pixels in a display driver circuit is shown. For example... Figure 4 As shown, each frame of the image corresponds to one VSYNC signal and multiple HSYNC signals. Each HSYNC signal requires scanning one row of pixels. The time occupied by HBP and HFP between two HSYNC signals is the duration of the video data enable signal (VDEN).

[0051] In this embodiment, during the display of one frame of image on the touchscreen 140, the processor 110 can control the touch sensor in the touchscreen to collect a touch signal once after the display driving circuit scans S rows of pixels, and cycle through N touch signal collections as one period until the electronic device 100 is disconnected from the stylus 200. The duration of each touch signal collection can be preset. For example, the duration t of each touch signal collection can be greater than 100 microseconds (μs) and less than 300 μs.

[0052] Furthermore, in this embodiment, a standard frame rate can be predefined, and based on this standard frame rate, the number of times the display driving circuit needs to collect touch signals when the touch screen 140 displays one frame of image at this standard frame rate is defined. Wherein, if the display driving circuit needs to scan H rows of pixels when the touch screen 140 displays one frame of image at a standard frame rate, and the defined number of times touch signals need to be collected is N, then S = H / N in the aforementioned interval of S rows of pixels. This enables multi-frame rate switching at integer frame rates of (F*N), where F is the standard frame rate. Since the number of rows that can be added or removed each time is S rows, multi-frame rate switching can be supported at a maximum frame rate of (F*N). For example, when F = 60Hz, if N = 4, it can support switching between multiple frequencies such as 240Hz, 120Hz, 80Hz, 60Hz, and 48Hz, that is, it can support switching between various frame rates divisible by (60*4 = 240). It is understandable that the time required to display a standard frame rate is T = 1 / F, the equivalent time to display one line is th = T / H, and the equivalent time tx corresponding to displaying S lines is S*th = S*T / H = T / N. Therefore, tx = 1 / F / N = 1 / (F*N), so the highest supported frame rate is Fx = F*N, which means that it can support multi-frame rate switching at the maximum frame rate of (F*N).

[0053] In some embodiments, when the touchscreen 140 displays an image at a standard frame rate, the time slot for the Kth acquisition of a touch signal after the VSYNC signal corresponding to a frame of image can be defined as the time slot for the touchscreen 140 to transmit an uplink synchronization signal to the outside. The uplink signal can be used, but is not limited to, for time alignment with the stylus 200. After the stylus 200 establishes a connection with the electronic device 100, when the stylus 200 first acquires the uplink signal, it can transmit a downlink signal according to the downlink parameters negotiated with the electronic device 100. This achieves timing alignment between the sampling time on the electronic device 100 and the continuous transmission time of the downlink signal by the stylus 200, reducing the probability of line drops during input and improving the user experience. In some embodiments, the downlink parameters can be some parameters necessary for the stylus 200 to transmit the downlink signal. The downlink signal can be a signal transmitted by the stylus 200 to the electronic device 100 after receiving the uplink signal. This signal can be used to determine the touch position, tilt angle, etc. of the stylus 200. In some embodiments, the signal transmitted outward by the electronic device 100 can be called the uplink signal, and the signal transmitted outward by the stylus 200 can be called the downlink signal.

[0054] In some embodiments, the downlink parameters may include the offset of the first downlink signal from the starting position of the VSYNC signal, the time interval between adjacent downlink signals, and the time required for each downlink signal. Additionally, the downlink parameters may also include the number of downlink signals required for the touchscreen 140 to display one frame of image at a standard frame rate. The number of downlink signals required for the touchscreen 140 to display one frame of image at a standard frame rate may be (N-1) as described above.

[0055] For example, such as Figure 5 As shown in the figure, 'a' represents the offset of the first downlink signal from the starting position of the VSYNC signal, 'b' represents the time interval between adjacent downlink signals, and 'c' represents the time required for each downlink signal. Figure 5 In this context, the uplink signal time slot refers to the time when electronic device 100 transmits the uplink signal, the display time slot refers to the time when electronic device 100 displays the image, the touch acquisition time slot refers to the time when electronic device 100 acquires the touch signal, and the stylus coding time slot refers to the time when stylus 200 transmits the downlink signal. Additionally, in... Figure 5 In the illustrated embodiment, the touchscreen 140 of the electronic device 100 displays images at a standard frame rate F. The electronic device 100 needs to collect touch signals eight times. During the first collection of touch signals, the electronic device 100 transmits an uplink signal. In subsequent collections, it can collect downlink signals emitted by the stylus 200 or touchscreen signals triggered by a user's finger or other touch object. Figure 5 In this process, the stylus 200 needs to transmit seven downlink signals. In some embodiments, the electronic device 100 can determine whether the touch signal is triggered by the stylus 200 or by a user's finger or other touch object based on the frequency, amplitude, etc. of the acquired touch signal. In some embodiments, the frequency of the touch signal generated by the stylus 200 is generally 120Hz to 360Hz, and the frequency of the touch signal generated by a finger touch is generally 60Hz to 120Hz. Therefore, the electronic device 100 can determine whether the touch signal is triggered by the stylus 200 or by a user's finger based on the frequency of the acquired touch signal.

[0056] Continue reading Figure 5 After the stylus 200 establishes a connection with the electronic device 100, when the stylus 200 first receives the uplink signal emitted by the electronic device 100, it can start transmitting a downlink signal after a duration of a, and the duration of transmitting the downlink signal is c. It will transmit the downlink signal once every b duration until the connection between the two is broken.

[0057] It is understandable that when the electronic device 100 displays an image at a standard frame rate, the electronic device 100 and the stylus 200 can communicate at a... Figure 5 It works as described in the document. When the electronic device 100 displays an image at a multiple of the standard frame rate instead of the standard frame rate, when the electronic device 100 establishes a connection with the stylus 200, the electronic device 100 can first follow the... Figure 5 It operates in the manner described above. Simultaneously, the electronic device 100 can count the number of touch signal acquisitions. When the number of touch signal acquisitions counted by the electronic device 100 reaches the aforementioned N times, the electronic device 100 can re-count the number of touch signal acquisitions and transmit an uplink signal during the time slot of the Kth touch signal acquisition (where K=1), repeating this cycle until the connection between the two is lost. The stylus 200 can then continue operating as described above. Figure 5 The work described in [the document / article].

[0058] For example, if electronic device 100 displays an image at twice the standard frame rate F, and the number of touch signal acquisitions is set to N = 8 at the standard frame rate F, where electronic device 100 transmits an uplink signal to the outside during the Kth touch signal acquisition (where K = 1), then electronic device 100 needs to acquire a total of (2N) touch signals to display one frame of image. Figure 6 As shown, after the electronic device 100 and the stylus 200 establish a connection, when the electronic device 100 first displays a frame of image, after generating a vsync signal, it can collect touch signals every S lines as described above. Specifically, the electronic device 100 can transmit an uplink signal when it needs to collect a touch signal for the Kth time (where K=1). Simultaneously, the electronic device 100 can count the number of touch signal collections. When the electronic device 100 has counted 8 times, it can reset the count (i.e., reset the count to zero) and transmit the uplink signal again when it needs to collect a touch signal for the Kth time, continuing to count the number of touch signal collections, and so on, until the connection between the two devices is broken. The stylus 200 can then continue to... Figure 5 The work described in [the document / article].

[0059] Furthermore, when the frame rate changes during the display of an image, the electronic device 100 can still operate as described above. Figure 6 It works in the manner described in [the document / document].

[0060] For example, if electronic device 100 initially displays an image at a standard frame rate F, and the number of touch signal acquisitions is set to N = 8 at the standard frame rate F, then after a period of time, electronic device 100 starts displaying the image at half the standard frame rate F, and after another period of time, starts displaying the image at twice the standard frame rate F. Figure 7As shown, after the electronic device 100 and the stylus 200 establish a connection, the electronic device 100 displays the image at a standard frame rate F. When the electronic device 100 first starts displaying a frame, after generating a vsync signal, it can collect touch signals every S lines as described above. Specifically, the electronic device 100 can send an uplink signal to the outside when it needs to collect a touch signal for the Kth time (where K=1). Simultaneously, the electronic device 100 can count the number of times it collects touch signals. When the electronic device 100 has counted 8 times, it can re-count the number of touch signal collections (i.e., reset the count to zero), and again send an uplink signal to the outside when it needs to collect a touch signal for the Kth time, continuing to count the number of touch signal collections, and so on, until the connection between the two is broken. The stylus 200 can then continue to... Figure 5 The work described in [the document / article].

[0061] Continue reading Figure 7 When electronic device 100 switches the frame rate from F to F / 2, the number of touch signal acquisitions counted by electronic device 100 is exactly 8. Therefore, the number of touch signal acquisitions can be recounted at this time, and an uplink signal is transmitted externally at the time of the Kth touch signal acquisition. When electronic device 100 displays an image at a frame rate of F / 2, when it displays the second frame of the image, the number of touch signal acquisitions counted is 4, which is less than 8. Therefore, it can continue to acquire touch signals every S lines, and will not transmit an uplink signal until the count reaches 8.

[0062] When the electronic device 100 switches the frame rate from F / 2 to 2F, the number of times the electronic device 100 collects touch signals is exactly 8. Therefore, at this time, the number of times the touch signals are collected can be counted again, and an uplink signal is sent to the outside at the time of the Kth time the touch signal is collected. This cycle continues until the connection between the electronic device 100 and the stylus 200 is broken.

[0063] From the above Figure 5 , 6 As described in section 7, regardless of the frame rate of the touchscreen of electronic device 100, electronic device 100 can always acquire the downlink signal from stylus 200 each time a touch signal is acquired, meaning that there will be no disconnection of stylus 200. It should be understood that... Figure 5 , 6 Both 7 and 7 are described with K=1. For cases where K takes other values, please refer to the description with K=1. They will not be repeated here.

[0064] In some embodiments, the time for the electronic device 100 to transmit the uplink signal is generally short, while the time for acquiring the touch signal is generally relatively long. Therefore, to avoid wasting time, the time slot occupied by transmitting the uplink signal for acquiring the touch signal can be reduced. That is, the time slot for acquiring the touch signal for generating the uplink signal can be designed to be shorter than the time slot for acquiring the touch signal at other times.

[0065] In some embodiments, the electronic device 100 can also count the total number of rows of pixels scanned by the display driving circuit corresponding to the touch screen 140 between two vsync signals. When the electronic device 100 triggers the generation of a new vsync signal, if the total number of rows it counts does not reach the number of rows required to display one frame of image at the current frame rate, the electronic device 100 can determine that there is an hsync signal loss. At this time, it can recount the number of rows of pixels scanned by the display driving circuit. This is to calibrate the hsync signal through the vsync signal.

[0066] Furthermore, when the hsync signal is lost, the number of rows containing pixels scanned by the display driving circuit, as counted by the electronic device 100, will be inaccurate. This will lead to a discrepancy between the timing of the electronic device 100's acquisition of the touch signal and the timing of the stylus 200's downlink signal. To reduce this, in this embodiment, the timing of the stylus 200's downlink signal transmission can be extended, making its downlink signal duration longer than the timing of the electronic device 100's acquisition of the touch signal. Thus, when the discrepancy between the timing of the electronic device 100's acquisition of the touch signal and the timing of the stylus 200's downlink signal is within a certain range, the electronic device 100 can still acquire the downlink signal from the stylus 200. For example, as... Figure 8 As shown, the downlink signal emitted by the stylus 200 is longer than the time for the electronic device 100 to acquire the touch signal. When the time offset of the electronic device 100 in acquiring the touch signal is less than r, the electronic device 100 can acquire the downlink signal of the stylus 200 completely.

[0067] For example, Figure 5 The diagram illustrates one hardware structure of the stylus 200. For example... Figure 5 As shown, the stylus 200 may include: a communication module 210, a signal transmitting / receiving unit 220, and a processor 230.

[0068] The communication module 210 may include a wireless communication module, which can be used to establish a connection between the stylus 200 and the electronic device 100. For example, the communication module 210 may be a Bluetooth module.

[0069] The signal transmitting / receiving unit 220 can be used to obtain the uplink synchronization signal transmitted by the electronic device 100, and after obtaining the uplink synchronization signal, transmit a downlink signal based on pre-set downlink parameters.

[0070] The processor 230 can negotiate the downlink parameters of the stylus 200 with the electronic device 100 through the communication module 210, and control the signal transmitting / receiving unit 220 to transmit a downlink signal based on the downlink parameters.

[0071] It can be understood that the structure schematically shown in this application Figure 3 does not constitute a specific limitation on the stylus 200. In some other embodiments of this application, the stylus 200 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware.

[0072] Next, based on the content described above, a control method for an electronic device provided in an embodiment of this application will be introduced. It can be understood that this method is proposed based on the content described above, and some or all of the content in this method can refer to the description in the above text.

[0073] Please refer to Figure 10 , Figure 10 which is a flowchart of a control method for an electronic device provided in an embodiment of this application. This method can be applied to an electronic device with a touch screen, and a display driving circuit and a touch sensor supporting the touch screen can be configured in the electronic device. Exemplarily, the electronic device can be the electronic device 100 described above. As Figure 10 shown, the control method of the electronic device can include the following steps:

[0074] S1001. The display driving circuit performs pixel scanning.

[0075] In this embodiment, the display driving circuit on the electronic device can perform pixel scanning row by row.

[0076] S1002. The touch sensor collects a touch signal every time after the display driving circuit scans S rows of pixels, where S≥1; among them, the continuously collected N touch signals are used as a group, and an uplink synchronization signal is transmitted to the outside within the time slot of the Kth collection of the touch signal in each group, 1≤K≤N, and the uplink synchronization signal is used for time alignment with an external device.

[0077] In this embodiment, during pixel scanning by the display driving circuit, the touch sensor can be controlled to collect a touch signal once after the display driving circuit scans S rows of pixels, where S≥1. The N consecutively collected touch signals can be grouped together, and within the time slot of the Kth touch signal collection in each group, an uplink synchronization signal is transmitted externally, where 1≤K≤N. The uplink synchronization signal is used for time alignment with an external device (such as a stylus). In other words, the touch sensor can collect a touch signal once after the display driving circuit scans S rows of pixels, and this cycle repeats with N touch signal collections as one period. Furthermore, the electronic device can transmit an uplink synchronization signal externally within the time slot of the Kth touch signal collection in each period.

[0078] In this way, regardless of how the frame rate of the electronic device's touchscreen changes, the time for the electronic device to collect touch signals each time is fixed. Therefore, it will not affect its collection of downlink signals emitted by the stylus, thereby reducing the probability of stylus disconnection and improving the user experience.

[0079] In some embodiments, after the electronic device establishes a connection with the stylus, when the display driving circuit on the electronic device receives the frame synchronization signal and performs its first scan of (K*S) rows of pixels, the electronic device can transmit an uplink synchronization signal to the outside. The uplink synchronization signal is used for time alignment with the stylus. That is, the uplink synchronization signal is transmitted to the outside during the time slot of the first transmission of the uplink synchronization signal.

[0080] Next, after receiving the uplink synchronization signal transmitted by the electronic device, the stylus can transmit downlink signals to the electronic device based on the downlink parameters negotiated during the initial connection. These downlink parameters include: the offset of the first downlink signal from the start position of the frame synchronization signal in the electronic device, the time interval between adjacent downlink signals, and the time required for each downlink signal. As one possible implementation, the downlink parameters can be sent from the electronic device to the stylus.

[0081] Then, the electronic device can acquire the downlink signal emitted by the stylus through its touch sensor, and display the touch position corresponding to the acquired downlink signal through its touch screen. Multiple touch positions connected in chronological order can form a touch trajectory.

[0082] It is understood that the processor in the embodiments of this application can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. A general-purpose processor can be a microprocessor or any conventional processor.

[0083] The method steps in the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, portable hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can reside in an ASIC.

[0084] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0085] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application.

Claims

1. A control method of an electronic device, characterized by, The method is applied to an electronic device with a touch screen, and the electronic device is configured with a display driving circuit and a touch sensor matched with the touch screen, and the method comprises the following steps: The display driving circuit performs pixel scanning; The touch sensor collects a touch signal each time after the display driving circuit scans S rows of pixels, and S≥1; Wherein, N consecutive touch signals are taken as a group, and an uplink synchronization signal is transmitted to the outside in the time slot of the Kth touch signal collection in each group, 1≤K≤N, and the uplink synchronization signal is used for time alignment with the external device.

2. The method of claim 1, wherein, S=H / N, H is the number of rows of pixels scanned by the display driving circuit when the touch screen displays one frame of image at a standard frame rate.

3. The method according to claim 1 or 2, characterized in that, The time slot of the Kth touch signal collection in each group is less than the time slot of each touch signal collection in each group except the Kth touch signal collection.

4. The method according to claim 1 or 2, characterized in that, The method further comprises the following steps: Determine the total number of rows of pixels scanned by the display driving circuit between the first frame synchronization signal and the second frame synchronization signal, the second frame synchronization signal is adjacent to the first frame synchronization signal, and is the next frame synchronization signal of the first frame synchronization signal; When the total number of rows is less than the target number of rows, re-count the number of rows of pixels scanned by the display driving circuit, wherein the target number of rows is the number of rows of pixels scanned by the display driving circuit when displaying one frame of image at a target frame rate, and the target frame rate is the current display frame rate of the touch screen.

5. The method of claim 1, wherein, The method further comprises the following steps: Determine to establish a connection with a stylus; When the display driving circuit scans (K*S) rows of pixels for the first time after obtaining a frame synchronization signal, transmit the uplink synchronization signal to the outside, and the uplink synchronization signal is used for time alignment with the stylus.

6. The method of claim 5, wherein, The method further comprises the following steps: The touch sensor obtains a downlink signal transmitted by the stylus; The touch screen displays the touch position corresponding to the obtained downlink signal.

7. The method according to claim 5 or 6, characterized in that, The method further comprises the following steps: When the connection with the stylus is established for the first time, send a downlink parameter to the stylus; Wherein, the downlink parameter comprises: the offset of the first downlink signal from the starting position of the frame synchronization signal, the time interval between adjacent downlink signals, and the time required for each downlink signal.

8. The method of claim 7, wherein, The time required for each downlink signal is greater than the time slot of each touch signal collection.

9. A control method of a stylus, characterized by, The method is applied to a stylus matched with an electronic device, and the electronic device is configured with a touch screen, a display driving circuit matched with the touch screen, and a touch sensor, and the method comprises the following steps: Determine to establish a connection with the electronic device; Obtain the uplink synchronization signal transmitted by the electronic device, wherein the touch sensor collects a touch signal each time after the display driving circuit scans S rows of pixels, S≥1, and the electronic device takes N consecutive touch signals as a group, and transmits the uplink synchronization signal to the outside in the time slot of the Kth touch signal collection in each group, 1≤K≤N, and the uplink synchronization signal is used for time alignment with the external device. transmit a downlink signal to the electronic device based on downlink parameters negotiated when the electronic device is first connected, wherein the downlink parameters include an offset of a first downlink signal from a start position of a frame synchronization signal in the electronic device, a time interval between adjacent downlink signals, and a time required for each downlink signal.

10. The method of claim 9, wherein, The time required for each downlink signal is greater than a time slot for collecting a touch signal each time.

11. A control method characterized by, The method is applied to a system comprising an electronic device and a stylus, the electronic device being configured with a touch screen, a display driving circuit and a touch sensor matched with the touch screen, and the method comprising: The electronic device establishes a connection with the stylus; The electronic device performs pixel scanning through the display driving circuit; The electronic device collects a touch signal through the touch sensor after each S rows of pixels scanned by the display driving circuit, S≥1, and takes N consecutive touch signals as a group, and transmits an uplink synchronization signal to the outside in a time slot for collecting a touch signal in each group, 1≤K≤N; The stylus acquires the uplink synchronization signal; The stylus transmits a downlink signal to the electronic device based on downlink parameters negotiated when the electronic device is first connected in response to the acquired uplink synchronization signal, wherein the downlink parameters include an offset of a first downlink signal from a start position of a frame synchronization signal in the electronic device, a time interval between adjacent downlink signals, and a time required for each downlink signal. The electronic device acquires the downlink signal transmitted by the stylus through the touch sensor.

12. The method of claim 11, wherein, S=H / N, H is the number of rows of pixels scanned by the display driving circuit when the touch screen displays one frame of image at a standard frame rate.

13. The method according to claim 11 or 12, characterized in that, The time slot for collecting a touch signal in each group is less than the time slot for collecting a touch signal in each group except the Kth time.

14. The method of any of claims 11 or 12, wherein, The time required for each downlink signal is greater than the time slot for collecting a touch signal each time.

15. An electronic device, comprising: It comprises: a touch screen; a display driving circuit and a touch sensor matched with the touch screen; at least one memory for storing a program; at least one processor for executing the program stored in the memory, when the program stored in the memory is executed, the processor is used to execute the method as claimed in any one of claims 1-8.

16. A stylus, characterized by It comprises: a communication module for communicating with an electronic device; at least one memory for storing a program; at least one processor for executing the program stored in the memory, when the program stored in the memory is executed, the processor is used to execute the method as claimed in claim 9 or 10.

17. A computer readable storage medium, the computer readable storage medium storing a computer program, when the computer program is run on an electronic device, the electronic device executes the method as claimed in any one of claims 1-8, or when the computer program is run on a stylus, the stylus executes the method as claimed in claim 9 or 10.

18. A computer program product, characterised in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the method of any of claims 1-8, or when the computer program product is run on a stylus, it causes the stylus to perform the method of claim 9 or 10.

Citation Information

Patent Citations

  • Display Apparatus

    US20190179475A1