Interactive system

Abstract

The present application provides an interactive system, which is applied in the technical field of electronics. The system comprises: an electronic device and an input apparatus; the electronic device has a capacitive touch-sensitive surface; the input apparatus comprises at least one outer surface; the outer surface is provided with a plurality of conductive members; and the conductive members can be capacitively coupled to the capacitive touch-sensitive surface. When the outer surface triggers a first touch operation on the capacitive touch-sensitive surface, the electronic device determines, from among a plurality of capacitors of the capacitive touch-sensitive surface, a target capacitor that is capacitively coupled to a target conductive member, determines, on the basis of the target capacitor, encoding information corresponding to the target conductive member, and outputs, on the basis of the encoding information, feedback information corresponding to the first touch operation. The touch response system provided in the embodiments of the present application enables the electronic device to respond to a touch object, thereby expanding application scenarios of the electronic device, meeting user requirements in some specific scenarios.

Description

An interactive system

[0001] This application claims priority to Chinese Patent Application No. 202510471647.0, filed on April 15, 2025, entitled "An Interactive System", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of electronic technology, and more specifically, to an interactive system. Background Technology

[0003] When an electronic device integrates a capacitive touch-sensitive surface, the device can not only display various data through the capacitive touch-sensitive surface, but also receive and respond to various operations through the capacitive touch-sensitive surface to realize command input, making it convenient for users to control the electronic device.

[0004] Currently, the touch operation response process involves the electronic device first determining touch parameters such as the touch position and number of touch points on the touchscreen, and then responding to the touch operation based on these parameters. The problem with this method is that it can only respond to touch operations, not to the object being touched. Summary of the Invention

[0005] This application provides an interactive system that enables electronic devices to respond to input devices, thereby expanding the application scenarios of electronic devices.

[0006] This application provides an interactive system, the system comprising:

[0007] Electronic devices with capacitively sensitive touch surfaces;

[0008] An input device includes at least one outer surface, the outer surface being provided with a plurality of conductive elements, the conductive elements being capable of capacitively coupling with the capacitive touch-sensitive surface;

[0009] The electronic device is configured to, when the outer surface triggers a first touch operation on the capacitive touch-sensitive surface, determine a target capacitor that is capacitively coupled to a target conductive element from among a plurality of capacitors on the capacitive touch-sensitive surface, determine the encoding information corresponding to the target conductive element based on the target capacitor, and output feedback information corresponding to the first touch operation based on the encoding information. The target conductive element includes a grounded conductive element among the plurality of conductive elements disposed on the outer surface.

[0010] The interactive system provided in this application allows the input device to perform a touch operation on a capacitive touch-sensitive surface. The electronic device can obtain the encoding information of the input device from the target capacitor that is capacitively coupled to the conductive components on the input device in the capacitive touch-sensitive surface. Based on the encoding information, the electronic device responds to the touch operation performed by the input device, thereby enabling the electronic device to respond to the touched object. This expands the application scenarios of the electronic device and meets the needs of users in some specific scenarios. Attached Figure Description

[0011] Figure 1 is a partial schematic diagram of the composition of a capacitive screen provided in an embodiment of this application;

[0012] Figure 2 is a schematic diagram of a capacitor electrode array provided in an embodiment of this application;

[0013] Figure 3 is a schematic diagram of the internal composition of an electronic device provided in an embodiment of this application;

[0014] Figure 4 is an exemplary schematic diagram of an interactive system provided in an embodiment of this application;

[0015] Figure 5 is a schematic diagram of the structure of an input device provided in an embodiment of this application;

[0016] Figure 6 is a schematic diagram of another input device provided in an embodiment of this application;

[0017] Figure 7 is a cross-sectional view along line AA in the input device of Figure 5;

[0018] Figure 8 is a schematic diagram of the structure of a sub-shell of an insulating shell;

[0019] Figure 9 is a schematic diagram of the conductive component in Figure 7;

[0020] Figure 10 is a schematic diagram of the structure of a sub-shell of another type of insulating shell;

[0021] Figure 11 is a schematic diagram of the conductive component in Figure 10;

[0022] Figure 12 is a schematic diagram of another input device provided in an embodiment of this application;

[0023] Figure 13 is a partial structural schematic diagram of the mounting frame in the input device of Figure 11;

[0024] Figure 14 is a schematic diagram of an input device provided in an embodiment of this application;

[0025] Figure 15 is a schematic diagram of a circuit structure for the input device in Figure 14;

[0026] Figure 16 is a schematic diagram of another circuit structure of the input device in Figure 14;

[0027] Figure 17 is a schematic diagram of another circuit structure of the input device in Figure 14;

[0028] Figure 18 is a schematic diagram of a conductive component of the input device in Figure 14 being installed on the wall of an insulating housing.

[0029] Figure 19 is a schematic diagram of another conductive component of the input device in Figure 14 being installed on the wall of the insulating housing.

[0030] Figure 20 is a schematic diagram of another type of conductive component of the input device in Figure 14 being installed on the wall of an insulating housing.

[0031] Figure 21 is a schematic diagram of another type of conductive component of the input device in Figure 14 being installed on the wall of the insulating housing.

[0032] Figure 22 is an exemplary encoding diagram of an input device provided in an embodiment of this application;

[0033] Figure 23 is a schematic diagram of the response flow of a touch operation provided in an embodiment of this application;

[0034] Figure 24 is a schematic diagram of a local capacitance image when a touch operation is performed through the input device shown in Figure 22;

[0035] Figure 25 shows a schematic diagram of the construction of a coordinate system provided in an embodiment of this application;

[0036] Figure 26 shows a schematic flowchart of a data configuration method provided in an embodiment of this application;

[0037] Figure 27 illustrates an exemplary scenario diagram regarding the functional configuration of the input device;

[0038] Figure 28 shows a schematic flowchart of an interaction method provided in an embodiment of this application;

[0039] Figure 29 illustrates a scenario of interaction between the input device and the electronic device provided in an embodiment of this application;

[0040] Figure 30 shows a schematic flowchart of an interaction method provided in an embodiment of this application;

[0041] Figure 31 shows a schematic diagram of a scenario where a ruler element is inserted via an input device;

[0042] Figure 32 shows a schematic diagram of a scenario where the position of an element is adjusted via an input device;

[0043] Figure 33 shows a schematic diagram of a scenario where the pose of an element is adjusted via an input device;

[0044] Figure 34 illustrates a scenario where element properties are adjusted via an input device;

[0045] Figure 35 shows a schematic flowchart of an interaction method provided in an embodiment of this application;

[0046] Figure 36 illustrates an exemplary scenario of outputting the first response result of the first touch operation;

[0047] Figure 37 illustrates an exemplary scenario where a second response result of the first touch operation is output.

[0048] Figure 38 illustrates an exemplary scenario of outputting a third response result of the first touch operation;

[0049] Figure 39 illustrates an exemplary scenario of outputting the fourth response result of the first touch operation;

[0050] Figure 40 illustrates an exemplary scenario of outputting the fifth response result of the first touch operation;

[0051] Figure 41 illustrates an exemplary scenario of outputting the sixth response result of the first touch operation;

[0052] Figure 42 illustrates an exemplary scenario of outputting the ninth response result of the first touch operation;

[0053] Figure 43 illustrates an exemplary scenario of outputting the tenth response result of the first touch operation;

[0054] Figure 44 illustrates an exemplary scenario where the eleventh response result of the first touch operation is output.

[0055] Figure 45 illustrates an exemplary scenario where the twelfth response result of the first touch operation is output.

[0056] Figure 46 illustrates an exemplary scenario of outputting the thirteenth response result of the first touch operation;

[0057] Figure 47 illustrates an exemplary scenario where the fourteenth response result of the first touch operation is output.

[0058] Figure 48 illustrates an exemplary scenario where the fifteenth response result of the first touch operation is output.

[0059] Figure 49 shows a schematic flowchart of an interaction method provided in an embodiment of this application;

[0060] Figure 50 illustrates a scenario of logging into an application using an input device;

[0061] Figure 51 illustrates an exemplary scenario of resource transfer using an input device;

[0062] Figure 52 illustrates another exemplary scenario of resource transfer using an input device;

[0063] Figure 53 illustrates another exemplary scenario of resource transfer using an input device;

[0064] Figure 54 shows a schematic flowchart of an interaction method provided in an embodiment of this application;

[0065] Figure 55 illustrates a scenario where the target object is determined based on the target function.

[0066] Figure 56 shows a schematic diagram of a scenario where the smart interactive flat panel performs the erasure function;

[0067] Figure 57 illustrates a scenario where an electronic device performs a selection function;

[0068] Figure 58 illustrates a scenario where a user adjusts the target content;

[0069] Figure 59 shows a schematic diagram of a scenario where a smart interactive whiteboard performs a screenshot function;

[0070] Figure 60 illustrates a scenario where a user edits a screenshot of content;

[0071] Figure 61 shows a schematic diagram of a scenario where an electronic device performs the interface content magnification function;

[0072] Figure 62 shows a schematic diagram of a scenario where an electronic device performs a timing function;

[0073] Figure 63 illustrates a scenario where a user sets the countdown duration.

[0074] Figure 64 illustrates a scenario where a user configures the applications to be launched for the input device;

[0075] Figure 65 shows a schematic flowchart of another interaction method provided in an embodiment of this application. The best embodiment of the present invention

[0076] The technical solutions in this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0077] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0078] Currently, some electronic devices integrate capacitive touch-sensitive surfaces, allowing users to perform touch operations. These surfaces sense and respond to user touch inputs. The capacitive touch-sensitive surface integrates a capacitive electrode array, which can be either self-capacitive or mutual-capacitive. In the self-capacitive type, each electrode forms a capacitance with ground; in the mutual-capacitive type, capacitance is formed at the intersection of two sets of electrodes.

[0079] For example, the capacitive touch-sensitive surface can be a capacitive screen with an integrated transparent array of capacitive electrodes (also called an electrode pattern). Referring to Figure 1, which is a partial schematic diagram of a capacitive screen according to an embodiment of this application, the capacitive screen includes a cover plate 11, a capacitive conductive film 12, and a display module 13 (including a display panel) arranged sequentially. The cover plate 11 and the capacitive conductive film 12 are connected by a transparent optical adhesive (OCA) 14, and the display module 13 is also connected to the capacitive conductive film 12 by the transparent optical adhesive 14.

[0080] The cover plate 11 can be made of transparent glass or acrylic and other materials. The capacitive conductive film 12 can be a double-layer capacitive conductive film, including a substrate 121 and electrode layers 122 and 123 located on both sides of the substrate. The substrate 121 can be made of polyethylene terephthalate (PET).

[0081] Referring to Figure 2, which is a schematic diagram of a capacitor electrode array provided in an embodiment of this application, the capacitor electrode array 20 shown in Figure 2 is a mutual capacitance capacitor electrode array, including X-axis capacitor electrodes arranged along the lateral direction of the capacitive screen (denoted by symbols T1, T2, and T3 in Figure 2) and Y-axis capacitor electrodes arranged along the longitudinal direction of the capacitive screen (denoted by symbols R1, R2, and R3 in Figure 2). Referring to Figure 1, the substrate 121 is located between the display module 13 and the cover plate 11. The electrode layer 122 composed of X-axis capacitor electrodes is located on the side of the substrate 121 facing away from the cover plate 11, and the electrode layer 123 composed of Y-axis capacitor electrodes is located on the side of the substrate 121 facing away from the display module 13.

[0082] The intersection of each X-axis and Y-axis capacitive electrode forms a capacitor, generally called a capacitor node. Taking an 86-inch capacitive touchscreen as an example, the number of X-axis capacitive electrodes is typically 160, and the number of Y-axis electrodes is typically 284. The pitch of each capacitor node is 6.7mm. Each capacitor node corresponds to a coordinate on the capacitive touchscreen.

[0083] For example, the capacitive touch-sensitive surface further includes a driving circuit, a sensing circuit, and a signal processing chip; the driving circuit is used to drive the capacitive electrode array; the sensing circuit is used to sense signal changes in the capacitive electrode array and send the sensed signal to the signal processing chip; the signal processing chip is used to process the signal sensed by the sensing circuit and send the processing result to the microcontroller unit; the microcontroller unit is used to obtain a capacitance image based on the processing result.

[0084] Referring to Figure 3, which is a schematic diagram of the internal composition of an electronic device provided in an embodiment of this application, the electronic device includes a capacitive touch-sensitive surface and a system-on-chip (SOC), also known as a host. The capacitive touch-sensitive surface (e.g., a capacitive screen) also includes a microcontroller unit (MCU), a driving circuit, a sensing circuit, and a signal processing chip. Referring to Figure 2, the driving circuit is connected to the X-axis capacitive electrode and can apply an excitation signal to it. The sensing circuit is connected to the Y-axis capacitive electrode and can detect signal changes (i.e., capacitance changes) at each capacitive node through the Y-axis capacitive electrode. The signal processing chip is connected to both the sensing circuit and the MCU, and can amplify, filter, and digitize the signal detected by the sensing circuit to obtain a processing result, which is then sent to the MCU. The MCU can process the processing result sent by the signal processing chip to obtain a capacitance image.

[0085] A capacitance image is an image constructed based on the capacitance change of each capacitor in a capacitance electrode array. A capacitance image is typically a grayscale image, where each pixel corresponds to a capacitor in the array, and the pixel value (grayscale value) corresponds to the magnitude of the capacitance change. Furthermore, since each capacitor corresponds to a coordinate on the capacitive touch surface, the position of each pixel in the capacitance image is the same as the position of the corresponding capacitor on the capacitive touch surface.

[0086] When an input device (such as a finger) touches a capacitive touchscreen and a touch operation is performed, the capacitance at the touch location changes. The MCU can determine the number and corresponding coordinates of these capacitors based on the capacitance image, and thus determine touch parameters such as the user's touch position and number of touch points on the capacitive touch-sensitive surface. The MCU can then send these touch parameters to the SOC, which can convert them into corresponding instructions and execute them.

[0087] The above description of the working principle of capacitive touch surface is based on mutual capacitive electrode as an example. It should be understood that the capacitor electrode array in capacitive touch surface can also be a self-capacitive electrode array. When it is a self-capacitive electrode array, it can also achieve similar functions. This embodiment will not elaborate on this.

[0088] As shown in Figure 1, when the capacitive touch-sensitive surface is a capacitive screen, the capacitive electrode array can be an on-cell capacitive electrode array located between the cover plate 11 and the display panel of the display module 13. Alternatively, the capacitive electrode array can be an in-cell capacitive electrode array integrated within the display module 13. Each capacitive electrode in the array can be a rhomboid electrode as shown in Figure 1, or a Manhattan-shaped electrode; this embodiment does not impose any limitations on this.

[0089] Electronic devices can include mobile phones, tablets, laptops, desktop computers, smartwatches, smart home devices (such as smart speakers, smart light bulbs, and smart door locks), and also include, but are not limited to, automotive electronic devices (such as in-vehicle capacitive touchscreens), educational electronic devices (such as electronic dictionaries, learning machines, and smart blackboards), and medical electronic devices. Capacitive touchscreens can be LCD screens, OLED screens, LED screens, MicroLED screens, and electronic paper, etc., all of which integrate capacitive electrode arrays.

[0090] It should be noted that, in addition to integrating capacitive touch-sensitive surfaces, electronic devices may also integrate signal output modules. These signal output modules can include optical signal output modules such as indicator lights, light strips, light rings, and light groups; audio output modules such as speakers and buzzers; and vibration signal output modules such as linear motors and piezoelectric elements. It should be understood that the types of signal output modules may include, but are not limited to, the examples mentioned above.

[0091] Referring to Figure 4, which is an exemplary schematic diagram of an interactive system provided in an embodiment of this application, the system includes an electronic device 41 and an input device 42. The electronic device 41 integrates a capacitive touch-sensitive surface 411, which can receive touch operations, including but not limited to single click, double click, press, slide, and rotation. The input device 42 has at least one outer surface, on which multiple conductive elements 421 can be disposed. The multiple conductive elements 421 can encode the input device 42, and each conductive element 421 can be capacitively coupled to a capacitor in the capacitive touch-sensitive surface. The encoded information can serve as a device identifier for the input device.

[0092] When a touch operation (hereinafter referred to as the first touch operation) is performed on the capacitive touch-sensitive surface via the input device 42, the electronic device 41 determines a target capacitor capacitively coupled to each conductive element 421 from a plurality of capacitors on the capacitive touch-sensitive surface, thereby determining a plurality of target capacitors, and then determines the encoding information of the input device 42 based on the plurality of target capacitors, and responds to the touch operation based on the encoding information.

[0093] Optionally, the input device further includes an insulating housing, with the outer surface located on the insulating housing. The shell wall of the insulating housing has multiple through holes, and the number of multiple conductive elements is less than or equal to the number of through holes. Each conductive element is at least partially disposed in one through hole. Referring to Figure 5, which is an exemplary schematic diagram of an input device provided in an embodiment of this application, the input device 100 includes an insulating housing 1, which is a hexahedron with six outer surfaces. At least one outer surface (i.e., the shell wall) has multiple through holes 12. On each outer surface, the number of conductive elements 2 is less than or equal to the number of through holes 12. Each conductive element 2 is at least partially disposed in one through hole 12. The multiple conductive elements 2 are electrically connected to each other and can capacitively couple with a capacitor on a capacitive touch-sensitive surface. The multiple conductive elements 2 are arranged on the outer surface according to a preset arrangement. The input device 100 can take many forms, such as a Rubik's Cube, a stamp, an educational toy (e.g., a set square), a toy (e.g., a doll, a model), or an ornament (e.g., a pendant).

[0094] The insulating housing 1 is a shell structure with excellent electrical insulation properties, used to isolate live conductors. The insulating housing 1 is typically made of plastic, ceramic, or composite materials. Designers can choose suitable insulating materials to manufacture the insulating housing 1 based on factors such as cost, weight, mechanical strength, and durability; this application embodiment does not impose specific limitations in this regard. The insulating housing 1 can provide a mounting base for multiple conductive components 2. The shape of the insulating housing 1 can vary depending on the product form of the input device 100.

[0095] The insulating shell 1 can be a regular hexahedron as shown in Figure 5, or it can be a regular or irregular object with at least one outer surface, such as a tetrahedron, triangular prism, cylinder, or frustum. The shell wall of the insulating shell 1 has multiple through holes 12, the size and structure of which are adapted to the size and structure of the conductive component 2, allowing the designer to flexibly set them according to actual needs.

[0096] Conductive component 2 is a structural component capable of conducting electric current. Conductive component 2 is made of materials with good conductivity, such as metals or conductive composite materials. For example, conductive component 2 can be made of copper (metal), conductive rubber (composite material), conductive plastic (composite material), carbon fiber (carbon-based material), or cadmium-copper alloy (alloy material). The shape of conductive component 2 can be columnar, stepped, etc.

[0097] On each outer surface, the number of conductive elements 2 is less than or equal to the number of through holes 12, and each conductive element 2 is at least partially disposed in one through hole 12. The number of conductive elements 2 can also be equal to the number of through holes 12. In this case, multiple through holes 12 are arranged according to a preset arrangement, with one conductive element 2 disposed in each through hole 12. Alternatively, the number of conductive elements 2 can be less than the number of through holes 12. In this case, some through holes 12 are provided with conductive elements 2, while others are not. When some through holes 12 are arranged according to a preset arrangement, the other through holes 12 can be arranged in any manner. Thus, by placing the conductive elements 2 on the insulating housing 1 through the through holes 12, a tight connection between the conductive elements 2 and the insulating housing 1 can be ensured, improving the overall structural stability of the input device 100. Furthermore, by using through holes 12 to install the conductive elements 2, complex bonding and snap-fit ​​processes can be avoided, simplifying the assembly steps of the conductive elements 2, reducing assembly difficulty, improving assembly efficiency, and thereby reducing production costs.

[0098] Multiple conductive elements 2 are electrically connected to each other, and all conductive elements 2 have the same potential. In use, the user holds the input device 100, so that the conductive elements 2 on the input device 100 act on the capacitive touch-sensitive surface, that is, facing the capacitive touch-sensitive surface. When multiple conductive elements 2 approach or contact the capacitive touch-sensitive surface, for example, when the distance between the conductive element 2 and the capacitive touch-sensitive surface is less than or equal to 3 mm and greater than or equal to 0 mm, capacitive coupling can occur with the capacitor on the capacitive touch-sensitive surface.

[0099] Optionally, the multiple through holes are arranged in an array, and the multiple through holes are arranged at least partially according to a preset arrangement.

[0100] As shown in Figure 5, multiple through holes on each outer surface of the insulating housing 1 are arranged in an array. When conductive elements are provided in some of the through holes on the outer surface, multiple conductive elements can be arranged on the outer surface in a preset arrangement. Alternatively, the multiple through holes are at least partially arranged in a preset arrangement so that multiple conductive elements on the outer surface are arranged on the outer surface in a preset arrangement.

[0101] Optionally, the outer surface is provided with a skin layer, and multiple conductive components are arranged on the outer surface in a first preset arrangement, and the skin layer is provided with a mark corresponding to the first preset arrangement; and / or, the outer surface is provided with a mark corresponding to the first preset arrangement.

[0102] As shown in Figure 5, on each outer surface of the input device 100, multiple conductive elements are arranged in a preset arrangement (i.e., the first preset arrangement).

[0103] Referring to Figure 6, in some embodiments, the outer surface of the insulating shell 1 is provided with a skin layer, which covers multiple through holes 12. The skin layer has markings 16 corresponding to a preset arrangement of multiple conductive elements 2. The skin layer can partially or completely cover the insulating shell 1. The skin layer can be made of insulating materials such as rubber, plastic, or textiles. Designers can flexibly choose suitable materials as the skin layer according to actual needs; this application does not impose specific limitations on this. The skin layer covers the through holes, which serves two purposes: firstly, it prevents dust, insects, and other foreign objects from entering the insulating shell through the through holes 12; secondly, it protects the conductive elements from excessive wear. Furthermore, markings 16 can be provided on the surface of the skin layer. These markings can be text, symbols, images, etc. As shown in Figure 6, markings 16 can be symbols such as "×" or "-". Thus, users can quickly and conveniently select the conductive element 2 that needs to be capacitively coupled to the capacitively sensitive surface by observing the markings 16.

[0104] In other embodiments, the outer surface may not have a skin layer, and the markings corresponding to the first preset arrangement can be directly placed on the outer surface. For example, marking 16 can be a sticker pasted on the outer surface or a mark sprayed on the outer surface. Marking 16 can be text, symbols, images, etc. In this way, users can quickly and conveniently select the conductive component 2 that needs to be capacitively coupled with the capacitive touch-sensitive surface by observing marking 16.

[0105] Optionally, the outer surface of the insulating housing is provided with a skin layer, which covers multiple through holes and has markings corresponding to a preset arrangement of multiple conductive components.

[0106] Referring to Figure 6, when a skin layer is provided on the outer surface of the insulating housing 1, the skin layer covers multiple through holes, which can protect the conductive components inside the through holes. At the same time, the skin layer is provided with markings 16 corresponding to the preset arrangement of multiple conductive components on the outer surface. In this way, the user can quickly and conveniently select the conductive component 2 that needs to be capacitively coupled to the capacitive touch-sensitive surface by observing the markings 16.

[0107] Optionally, the end face of the first end of the conductive element is located inside the through hole, or the end face of the first end of the conductive element protrudes from the outer surface of the insulating housing.

[0108] As shown in Figure 7, the insulating housing 1 has a receiving cavity 11 communicating with the through hole 12. The conductive element 2 is disposed in the through hole 12 and located outside the receiving cavity 11. The first end of the conductive element 2 is farther away from the receiving cavity 11 than the second end of the conductive element 2. For the conductive element 2 disposed on the lower part of the insulating housing 1 in Figure 7, as shown in Figures 8 and 9, the first end of the conductive element 2 is the lower end of the conductive element 2, and the second end of the conductive element 2 is the upper end of the conductive element 2. The lower end of the conductive element 2 is farther away from the receiving cavity 11 than the upper end of the conductive element 2.

[0109] Referring to Figures 8 and 9, the end face of the first end of the conductive element 2, which is disposed in the through hole 12 and located outside the receiving cavity 11, is located inside the through hole 12, for example, it can be flush with the outer surface of the insulating housing 1. This makes the input device 100 look neater and more aesthetically pleasing, thereby enhancing the overall feel and sophistication of the input device 100, and improving the visual effect and user experience. Furthermore, referring to Figures 10 and 11, the end face of the first end of the conductive element 2 can also protrude from the outer surface of the insulating housing 1. The designer can determine the protrusion height of the first end face of the conductive element 2 based on factors such as the structural strength, wear rate, and processing accuracy of the conductive element 2; this embodiment does not specifically limit this. Thus, when the input device 100 is used on the capacitive touch-sensitive surface, the end face of the first end of the conductive element 2 can be closer to or in closer contact with the capacitive touch-sensitive surface, thereby improving the reliability of capacitive coupling between the conductive element 2 and the capacitive touch-sensitive surface, and ensuring the accuracy of the electronic device in recognizing the arrangement of multiple conductive elements 2.

[0110] It should be noted that regardless of whether the end face of the first end of the conductive element 2 is located inside the through hole 2 or protrudes from the outer surface of the insulating housing 1, the user will come into contact with part of the conductive element 2 when holding the input device 100. Since multiple conductive elements 2 are electrically connected, all of the conductive elements 2 can be grounded through the human body, and thus, when multiple conductive elements 2 on the input device 100 act on the capacitive touch-sensitive surface, they can be capacitively coupled to the capacitive touch-sensitive surface. It should be noted that grounding means that the conductive element is in a conductive state. It should be noted that the through hole 12 can be a straight hole or other structures such as a stepped hole. Referring to Figures 8 to 11, in some embodiments, the through hole 12 may include an extension section 121 and a fixed section 122. The fixed section 122 is connected to the extension section 121; the fixed section 122 is further away from the outer surface of the insulating housing 1 than the extension section 121; the inner diameter of the fixed section 122 is larger than the inner diameter of the extension section 121. Correspondingly, the conductive element 2 may include a fixing part 21 and a detection part 22. The fixing part 21 is adapted to the inner diameter of the fixing section 122 and is disposed in the fixing section 122. The detection part 22 is connected to the fixing part 21 and is disposed in the extension section 121.

[0111] The fixing part 21 and the detection part 22 of the conductive element 2 can be an integral structure or separate structures. When the fixing part 21 and the detection part 22 are separate structures, they can be connected by a plug-in method. The structural dimensions of the detection part 22 are smaller than those of the fixing part 21. For example, the detection part 22 can be a metal pin, and the fixing part 21 can be a DuPont plug.

[0112] This application uses a detector 22 with a smaller structural size, which can reduce the material of the detector 22 and thus reduce production costs. Furthermore, by connecting the larger fixing part 21 to the fixing section 122, the smaller detector 22 connected to the fixing part 21 can be firmly installed in the extension section 121, thus achieving a firm connection of the conductive element 2.

[0113] Referring to Figures 8 and 9, in some embodiments, the outer surface of the insulating housing 1 is provided with a limiting groove 13, which is provided corresponding to and communicates with the through hole 12; the detection part 22 is inserted and connected to the fixing part 21, and a limiting part 23 is provided at the end of the detection part 22 away from the fixing part 21. The size of the limiting part 23 is larger than the aperture of the extension section 121 and smaller than or equal to the inner diameter of the limiting groove 13.

[0114] The shape of the limiting part 23 matches the shape of the limiting groove 13. For example, the limiting groove 13 can be a circular groove or a square groove, and the limiting part 23 can be a disc shape or a square shape accordingly. The limiting part 23 can be integrally formed with the detection part 22, or it can be fixedly connected to the detection part 22 by welding, bonding or other methods. The bottom wall of the limiting groove 13 communicates with the extension section 121. The end of the detection part 22 near the fixing part 21 passes through the bottom wall of the limiting groove 13 and the extension section 121 and extends into the fixing section 122, where it can be connected to the fixing part 21 inside the fixing section 122.

[0115] In this embodiment, a limiting part 23 is provided at the end of the detection part 22 away from the fixing part 21. During the process of connecting the detection part 22 and the fixing part 21, the limiting part 23 can abut against the bottom wall of the limiting groove 13 to limit the detection part 22, thereby preventing the detection part 22 from being inserted too far into the fixing part 21. This ensures that when the input device 100 acts on the capacitive touch surface, the conductive element 2 and the capacitive touch surface form a reliable capacitive coupling, thereby improving the working reliability of the input device 100.

[0116] Referring to Figure 7, in some embodiments, the second ends of multiple conductive elements 2 are electrically connected via multiple wires 24 disposed within the receiving cavity 11. Each conductive element 2 has its second end connected to one wire 24, and the ends of the multiple wires 24 are interconnected. The specifications, length, and other parameters of the conductive elements 2 can be flexibly selected according to actual needs, and this application embodiment does not impose specific limitations.

[0117] In this embodiment, multiple conductive elements 2 are electrically connected to each other via wires 24, ensuring that the potentials of the multiple conductive elements 2 are the same. This guarantees that when applied to a capacitive touch surface, all multiple conductive elements 2 can capacitively couple with the capacitive touch surface. Optionally, the input device further includes a mounting frame, which is fixedly disposed within the receiving cavity, and the multiple conductive elements are disposed within the mounting frame.

[0118] Referring to Figures 12 and 13, in some embodiments, the input device 100 may further include a mounting frame 3, which is fixedly disposed in the receiving cavity 11; the conductive element 2 is disposed on the mounting frame 3. The mounting frame 3 can be an integral frame or an assembled frame. The integral frame can be integrally formed by casting, stamping, or other methods, while the assembled frame can be obtained by assembling structural components such as beams and columns. By using the mounting frame 3 as the mounting base for the conductive element 2, stable support can be provided for the conductive element 2.

[0119] The mounting frame 3 has various structural forms. Referring to Figure 13, in some embodiments, the mounting frame 3 may include a bracket 31, which includes multiple branches 312. The multiple branches 312 are interconnected, and each branch 312 is tree-shaped and is provided with a conductive element 2.

[0120] The number of branches 312 can be two, three, four, etc. Multiple branches 312 can be integrally formed by injection molding, stamping, or other methods, or assembled from separate structures. The side of each branch 312 away from the connector 32 has a mounting surface. The conductive component 2 is detachably mounted on the mounting surface by screwing, or it can be fixed to the mounting surface by welding, bonding, or other methods. The mounting surface is adapted to the surface shape of the insulating housing 1; for example, when the surface of the insulating housing 1 is a plane or an inclined plane, the mounting surface can also be a plane or an inclined plane.

[0121] In this embodiment, the branch-like structure 312 resembles a tree branch, and the conductive element 2 can be disposed at the branch points and ends of the branch 312. This facilitates the spatial arrangement of the conductive element 2 and reduces the space occupied and weight of the branch 312, contributing to the lightweight design of the input device 100. The support 31 formed by the interconnection of multiple branches 312 can support multiple conductive elements 2. As shown in Figure 13, four conductive elements 2 can be disposed on each branch 312, and four branches 312 can accommodate 16 conductive elements 2. Furthermore, for conductive elements 2 connected to the branch 312 in a detachable manner, when a conductive element 2 on a branch 312 is damaged, only the damaged conductive element 2 can be replaced, effectively reducing the maintenance and replacement costs of the input device 100.

[0122] Please continue to refer to Figure 13. In some embodiments, the number of brackets 31 can be multiple; the mounting frame 3 may also include connectors 32, and multiple brackets 31 are connected by connectors 32.

[0123] The connector 32 can be a connecting shaft, connecting beam, or other structural component. The number of supports 31 can vary depending on the structural shape of the insulating shell 1. For example, if the insulating shell 1 has a tetrahedral or hexahedral structure, the number of supports 31 can be four or six, respectively, with each support 31 corresponding to one side of the insulating shell 1. Every two supports 31 can be connected by a connector 32, and the connectors 32 are then connected to each other by welding, bonding, or other methods.

[0124] The embodiments of this application employ multiple brackets 31, and connect the multiple brackets 31 into a whole through connectors 32. This not only improves the structural strength of the mounting frame 3, but also enables the arrangement of a larger number of conductive parts 2, effectively improving the expandability of the mounting frame 3, and thus increasing the amount of information carried on the input device 100.

[0125] Please refer to Figure 13. In some embodiments, the connector 32 can be a connecting shaft, with multiple branches 312 evenly distributed around the axis of the connecting shaft. For example, as shown in Figure 13, the number of branches 312 in the left and right side brackets 31 is four, and these four branches 312 can be symmetrically arranged about the axis of the connector 32. This not only allows for a more even distribution of stress in the mounting frame 3, reducing local stress concentration and thus improving the stability and strength of the structure, but also allows for a more even distribution of load to other brackets 31 when the conductive element 2 on one bracket 31 of the mounting frame 3 is subjected to the action of a capacitive touch-sensitive surface, reducing deformation or damage to the mounting frame 3 caused by unbalanced forces.

[0126] In addition to being electrically connected via the wires 24 described above, the multiple conductive components 2 can also be electrically connected via supporting structural components. In some embodiments, the mounting frame 3 can be a conductor; the multiple conductive components 2 can also be electrically connected to each other via the mounting frame 3.

[0127] The mounting frame 3 can be made of materials with good conductivity, such as metals or conductive composite materials. For example, the mounting frame 3 can be made of copper (metal), aluminum (metal), conductive rubber (composite material), conductive plastic (composite material), carbon fiber (carbon-based material), or cadmium-copper alloy (alloy material). It is understood that if the material of the mounting frame 3 is the same as that of the conductive component 2, for example, if both the mounting frame 3 and the conductive component 2 are made of aluminum, then the mounting frame 3 and the conductive component 2 can be integrally formed using methods such as casting.

[0128] In this embodiment, the mounting frame 3 is made of a conductor. By connecting the mounting frame 3 to the conductive component 2, the electrical connection between multiple conductive components 2 can be achieved conveniently and reliably. This not only eliminates the need for multiple wires and avoids problems such as increased resistance and maintenance difficulties caused by wire tangling, but also reduces the risk of the wires detaching from the conductive component 2 due to insufficient connection strength, thereby further improving the reliability of the electrical connection between multiple conductive components 2.

[0129] Optionally, the number of through holes is greater than the number of conductive elements, and at least two adjacent through holes are connected; at least one conductive element is movably connected to the mounting frame and is movable among the connected through holes.

[0130] To further meet customer needs for adjusting input information and to enable autonomous adjustment of the arrangement of multiple conductive components 2, this application optimizes the structure of the insulating housing 1, conductive components 2, and mounting frame 3. For each outer surface, the number of through holes 12 is greater than the number of conductive components 2, and at least two adjacent through holes 12 are connected; at least one conductive component 2 is movably connected to the mounting frame 3 and can move between the connected through holes 12.

[0131] The conductive component 2 can be movably connected to the mounting frame 3 using a sliding connection or other means, allowing the conductive component 2 to move relative to the mounting frame 3. The number of through holes 12 is greater than the number of conductive components 2, and at least two adjacent through holes 12 are connected, providing a movement channel for the conductive component 2.

[0132] For example, the insulating housing 1 has 16 through holes 12 arranged in four rows and four columns. Four through holes 12 in one column are connected to form a strip-shaped channel. Only one conductive element 2 is disposed in each of the four through holes 12. This conductive element 2 can move along the channel to any one of the four through holes 12. It is understood that when the user moves the conductive element 2 to different positions within the four through holes 12, the arrangement of multiple conductive elements 2 can be changed, forming four different arrangements. The user can select the desired arrangement from the four different arrangements as needed.

[0133] In this embodiment of the application, by moving the conductive element 2 among the multiple interconnected through holes 12, the arrangement of the multiple conductive elements 2 can be changed, allowing the user to independently select the desired arrangement of the multiple conductive elements 2, thereby further improving the user experience.

[0134] In some embodiments, at least one conductive element 2 is movably connected to the mounting frame 3 in a manner that allows it to move relative to the mounting frame 3, and the conductive element 2 can be moved away from or close to the outer surface of the insulating housing 1.

[0135] There are various ways to implement the movable connection between the conductive element 2 and the mounting frame 3. For example, a ratchet structure similar to a press-type ballpoint pen can be used. This application will not describe this in detail.

[0136] It should be noted that when multiple conductive elements 2 face the capacitive touch-sensitive surface, the conductive element 2 can only capacitively couple with the capacitive touch-sensitive surface when it is in contact with or close enough to it. Therefore, by movably connecting the conductive element 2 relative to the mounting frame 3, the conductive element 2 can extend outward from the input device 100 to approach the insulating housing 1, or retract inward from the input device 100 to move away from the insulating housing 1. In this way, the user can increase or decrease the number of conductive elements 2 that are effectively capacitively coupled with the capacitive touch-sensitive surface, thereby changing the arrangement of the conductive elements 2.

[0137] This embodiment of the application allows the user to control the number of conductive elements 2 that are effectively capacitively coupled to the capacitive touch-sensitive surface by making the conductive element 2 retractably connected to the mounting frame 3. This enables the user to independently select the arrangement of the multiple conductive elements 2 as needed, further improving the user experience.

[0138] Referring to Figure 13, in some embodiments, the input device 100 may further include a metal ball 4, which is disposed in the receiving cavity 11 and electrically connected to the conductive element 2. The metal ball 4 may be made of steel, copper, or the like. The diameter of the metal ball 4 can be flexibly set according to the size of the receiving cavity 11. The metal ball 4 may be a solid sphere or a hollow sphere. The metal ball 4 can be fixedly connected to the cavity wall of the receiving cavity 11 via a connector 32. For an input device 100 equipped with a mounting frame 3, as shown in Figure 13, the metal ball 4 can also be fixedly connected to the connector 32 of the mounting frame 3 via screwing, welding, or other methods.

[0139] In this embodiment, the metal ball 4 is electrically connected to the conductive element 2, which can serve a similar purpose to grounding the human body when it comes into contact with the conductive element 2, further ensuring that the conductive element 2 is capacitively coupled to the capacitive touch surface when it acts on the capacitive touch surface.

[0140] In some embodiments, the metal sphere 4 is disposed at the geometric center of the insulating housing 1. It is understood that the geometric center of the insulating housing 1 is the central location of the insulating housing 1 in space. The specific location of the insulating housing 1 depends on its geometry, and this application does not impose any specific limitations on it.

[0141] In this embodiment, placing the metal ball 4 at the geometric center of the insulating housing 1 can make the weight distribution of the input device 100 more uniform, thereby improving the user's grip on the input device 100 and ensuring that the user can remain comfortable even when using the input device 100 for a long time, further improving the user experience.

[0142] It should be noted that, in addition to being disposed on the insulating housing 1 through the through hole 12 mentioned above, the conductive component 2 can also be disposed on the insulating housing 1 in other ways.

[0143] In some embodiments, the arrangement of the plurality of conductive elements 2 on at least two outer surfaces is different.

[0144] When multiple conductive elements 2 are provided on multiple outer surfaces, the arrangement of the conductive elements 2 on two or more outer surfaces can be set differently. For example, for an insulating shell 1 with a hexahedral structure, the arrangement of the conductive elements 2 on adjacent outer surfaces can be set differently, while the arrangement of the conductive elements 2 on opposite outer surfaces can be set the same. In this case, the insulating shell 1 has multiple conductive elements 2 arranged in three different ways. As another example, for an insulating shell 1 with a tetrahedral structure, the arrangement of the conductive elements 2 on each of the four outer surfaces can be set differently, in which case the insulating shell 1 has multiple conductive elements 2 arranged in four different ways.

[0145] In this embodiment of the application, by arranging the multiple conductive elements 2 on at least two outer surfaces in different ways, multiple conductive elements 2 with different arrangements can be provided to the user to meet the user's various needs.

[0146] Referring to Figures 7 and 8, in some embodiments, the insulating housing 1 includes a plurality of sub-housings 14, the edges of which have bevels 141; wherein, the bevels 141 of two adjacent sub-housings 14 are connected by splicing.

[0147] The number of sub-shells 14 can be determined based on the number of outer surfaces of the insulating shell 1. For example, when the insulating shell 1 is hexahedral, six sub-shells 14 can be used, and each sub-shell 14 has a bevel 141 on all four sides. The inclination angle of the bevel 141 can be flexibly set according to actual needs, and this application does not impose a specific limitation on it.

[0148] In this embodiment, by setting a bevel 141 on the edge of the sub-shell 14 and splicing multiple sub-shells 14 into the whole insulating shell 1, the assembly of the insulating shell 1 can be realized conveniently and quickly, effectively improving the production efficiency of the input device 100.

[0149] Optionally, the insulating housing has edges with conductors provided on the edges, the conductors being electrically connected to a plurality of conductive elements.

[0150] Referring to Figures 6 and 12, the contact points of two adjacent outer surfaces on the insulating housing 1 form an edge, and the edge is provided with a conductor 15, which is electrically connected to each conductive element. When the user holds the insulating housing 1, if the user's finger comes into contact with the conductor 15, the conductor 15 can short-circuit the conductive element 2 with the user's finger. At this time, the conductive element 2 is grounded through the user's body, and can then be capacitively coupled with the capacitor in the capacitive touch-sensitive surface.

[0151] When the insulating housing 1 has a skin layer covering the conductor 15, and the user's fingers are separated from the conductor 15 by the skin layer when the user holds the insulating housing 1, the conductive element 2 is approximately grounded through the user's fingers. This also allows the conductive element 2 to capacitively couple with the capacitor in the capacitive touch-sensitive surface. It should be noted that grounding or approximately grounding are both conductive states, and the approximately grounding state after the skin layer is applied can be equated with grounding.

[0152] Optionally, the input device has a grip portion, which is provided with a conductor that is electrically connected to a plurality of conductive elements.

[0153] Referring to Figures 14 and 15, the input device 100 includes an insulating housing 1, conductive elements 2, a grip portion 3, and a control module 5. Multiple conductive elements 2 are spaced apart on the outer surface of the insulating housing 1. The grip portion 3 is disposed on the insulating housing 1, allowing the user to hold the input device 100. A conductor 31 is provided on the grip portion 3, and the conductor 31 is electrically connected to multiple conductive elements 2 via multiple electronic switches 4 (or the entire grip portion 3 can be made of conductive material, with the conductor 31 integrally formed with the grip portion 31). The control module 5 is electrically connected to the multiple electronic switches 4, and the control module 5 is used to control at least one electronic switch 4 to be turned on, so that at least one conductive element 2 is electrically connected to the grip portion 3. The input device 100 can take many forms, such as a Rubik's Cube or a stamp.

[0154] Optionally, a skin layer may be provided on the outer surface of the insulating shell 1. The skin layer may partially or completely cover the insulating shell 1.

[0155] The conductor is a structural component used to achieve an electrical connection between the conductive component and the ground. The conductor is made of a metal material with good conductivity, such as copper rods, copper alloys, stainless steel, or new composite materials such as carbon fiber.

[0156] As shown in Figure 14, the grip part 3 is disposed on the insulating housing 1. When the user takes the input device through the grip part 3, the conductor 31 can contact the user's hand to ground through the human body.

[0157] Conductor 31 is connected to multiple conductive elements 2 via multiple electrically controlled switches 4. Each conductive element 2 is connected to one end of one of the multiple electrically controlled switches 4, and one end of each electrically controlled switch 4 is connected to conductor 31. When an electrically controlled switch 4 is closed, the conductive element 2 is connected to conductor 31, allowing grounding through the human body. The electrically controlled switch 4 is a device that uses electrical signals to control the on / off state of a circuit. Various types of electrically controlled switches 4 can be used, including semiconductor switches and relays. A relay is an electrically controlled switch 4 based on electromagnetic induction, which uses the magnetic field generated by an electromagnetic coil to drive the mechanical contacts to close or open. Semiconductor switches include bipolar junction transistors (BJTs), metal-oxide-semiconductor field-effect transistors (MOSFETs), and insulated-gate bipolar transistors (IGBTs). BJTs control the on / off state of the collector and emitter by controlling the base current. MOSFETs control the conduction state between the drain and source through the gate voltage. In this design, NMOS turns on when the gate voltage is above the threshold, while PMOS turns on when the gate voltage is below the threshold. IGBT combines the features of MOSFET and BJT, controlling the switching between the collector and emitter via the base current.

[0158] The control module 5 is electrically connected to multiple electronic switches 4 and is used to control at least one electronic switch 4 to be turned on, so that at least one conductive element 2 can be electrically connected to the conductor 31; wherein the conductive element 2 electrically connected to the conductor 31 can be capacitively coupled to the capacitive touch-sensitive surface.

[0159] For example, for four conductive elements 2 arranged in a row, the four conductive elements 2 are connected to the conductor 31 in sequence through four electronically controlled switches 4.

[0160] When control module 5 controls the first and fourth electronic switches 4 to close, and the second and third electronic switches 4 to open, the first and fourth conductive elements 2 are electrically connected to conductor 31, enabling capacitive coupling with the capacitive touch-sensitive surface. If the electronic device identifies the conductive element 2 that is capacitively coupled to the capacitive touch-sensitive surface and records it as 1, and records the other conductive elements 2 as 0, then the arrangement is 1001.

[0161] When control module 5 controls the first, second, and third electronic switches 4 to close and the fourth electronic switch 4 to open, the first, second, and third conductive elements 2 are electrically connected to conductor 31, enabling capacitive coupling with the capacitive touch-sensitive surface. If the electronic device identifies the conductive element 2 that is capacitively coupled to the capacitive touch-sensitive surface and records it as 1, and records the other conductive elements 2 as 0, then the arrangement is 1110. It can be seen that control module 5 can quickly adjust the number and position of the conductive elements 2 electrically connected to conductor 31.

[0162] The solution provided in this application involves multiple electrically controlled switches 4 connected to multiple conductive elements 2 and conductors 31 on an insulating housing 1. A control module 5 is electrically connected to the multiple electrically controlled switches 4. By controlling the on / off state of the multiple electrically controlled switches 4 through the control module 5, the multiple conductive elements 2 electrically connected to the conductors 31 can be arranged in a preset pattern. In use, simply applying the multiple conductive elements 2 to the capacitive touch-sensitive surface—that is, facing the capacitive touch-sensitive surface and being close to or in contact with it—for example, when the distance between the conductive elements 2 and the capacitive touch-sensitive surface is less than or equal to 3mm and greater than or equal to 0mm, capacitive coupling can be achieved between the multiple conductive elements 2 electrically connected to the conductors 31 and the capacitive touch-sensitive surface. This enables the electronic device to recognize the arrangement of the multiple conductive elements 2 electrically connected to the conductors 31, thereby quickly acquiring information. Therefore, the solution of this application can shorten the time for complex information input and effectively improve the user experience.

[0163] Furthermore, this application can also adjust the arrangement of the conductive parts 2 electrically connected to the conductor 31 by controlling the corresponding conductive parts 2 to the conductor 31 according to the user's requirements for the number and arrangement of the conductive parts 2 electrically connected to the conductor 31, thereby further improving the user experience.

[0164] Referring to Figure 14, considering that the conductive element 2 electrically connected to the conductor 31 needs to contact or be close to the capacitive touch-sensitive surface to achieve capacitive coupling with the capacitive touch-sensitive surface, in some embodiments, multiple conductive elements 2 are disposed on the first outer surface of the insulating housing 1; the gripping part 3 is disposed on the second outer surface of the insulating housing 1, wherein the second outer surface is disposed opposite to the first outer surface. Thus, when the conductive element 2 electrically connected to the conductor 31 contacts or is close to the capacitive touch-sensitive surface, interference between the conductor 31 and the capacitive touch-sensitive surface can be prevented, thereby avoiding affecting the user's operation input device 100.

[0165] Referring to Figure 16, in some embodiments, the control module 5 includes a controller 51 and multiple latches 52. Each latch 52 is electrically connected to the controller 51, and each latch 52 is electrically connected to a corresponding electronic switch 4. The latches 52 can maintain the on / off state of the electronic switch 4 before the controller 51 was powered off, even when the controller 51 is powered off. The controller 51 can acquire control commands and send control signals to the latches 52 based on these commands. The latches 52 then generate switching signals to control the electronic switches 4 based on these control signals. When the control signal is valid, the latches 52 latch the control signal to their output and maintain this state until the next control signal arrives. Therefore, after the controller 51 controls the on / off state of the electronic switch 4, the controller 51 can enter a low-power mode and no longer send control signals to the latches 52. In this mode, the latches 52 can keep the electronic switch 4 either on or off.

[0166] For example, as shown in Figure 16, the electronic switch 4 uses NMOS transistors. The controller 51 sends a control command to the latch 52 to control the conduction of the first, second, and last NMOS transistors from left to right. Based on this control signal, the latch 52 generates a high-level signal to control the conduction of the first, second, and last NMOS transistors. When the first, second, and last NMOS transistors are turned on, the first conductive element 2, the second conductive element 2, and the last conductive element 2 are electrically connected to the conductor 31. After the controller 51 controls the conduction of the first, second, and last NMOS transistors, the controller 51 can enter a low-power mode and no longer send control signals to the latch 52. At this time, the latch 52 can maintain the high-level signal controlling the conduction of the first, second, and last NMOS transistors.

[0167] It should be noted that even if the controller 51 loses power due to a malfunction or other reasons, the latch 52 will continue to maintain the on / off state of each electronic switch 4. When the power supply to the controller 51 is restored, the controller 51 will read the state information stored in the latch 52 to ensure that the conductive parts 2 on the input device 100 can be seamlessly restored to the working state before the controller 51 lost power.

[0168] The solution provided in this application embodiment can not only effectively improve the working reliability and robustness of the input device 100 and ensure stable operation when the power is exhausted, but also reduce the working time of the controller 51, thereby effectively extending the battery life of the input device 100.

[0169] Referring to Figure 17, in some embodiments, the input device 100 may further include a storage module 6, which is electrically connected to the control module 5 and is used to provide control commands to the control module 5. The storage module 6 may be a USB flash drive, SD card, portable hard drive, Flash memory, etc. The storage module 6 may pre-store the coding pattern, arrangement rules, or other information of the conductive element 2, which can be sent to the control module 5 via control commands, enabling the control module 5 to control the on / off state of the electronic switch 4 based on this information.

[0170] This embodiment of the application, by setting up a storage module 6, allows users to conveniently control the on / off state of the conductive element 2 and the conductor 31, realize complex arrangement of the conductive element 2 electrically connected to the conductor 31 and quickly adjust the arrangement, further improving the user experience.

[0171] Referring to Figure 17, in some embodiments, the input device 100 may further include a communication module 7, which is electrically connected to the control module 5 and the storage module 6, for communicating with external electronic devices to obtain control commands and provide control commands to the control module 5 and / or the storage module 6.

[0172] The communication module 7 can be a wired communication module or can transmit data via radio waves. Wireless communication modules may include cellular communication modules (such as 2G / 3G / 4G / 5G modules), Wi-Fi modules, Bluetooth modules, ZigBee modules, etc. The communication module 7 can easily obtain control commands by communicating with other external electronic devices or cloud platforms. These control commands can be directly sent to the control module 5 to control the electric switch 4, or they can be stored in the storage module 6 and then sent to the control module 5 according to user needs.

[0173] By setting up a communication module 7 in this embodiment, the controller 51 can interact with other external electronic devices or cloud platforms, further facilitating the user's control over the on / off state of the conductive component 2 and the conductor 31.

[0174] Furthermore, referring to Figures 15 to 17, the input device 100 also includes a power supply module VCC, which may include a battery. The battery capacity can be determined based on factors such as the size of the input device 100 and its standby time. For smaller input devices 100, the battery can be a micro battery such as a button cell (e.g., CR2032). Many types and specifications of micro batteries are available, and designers can choose flexibly according to actual needs; this application does not impose specific limitations on this. Additionally, the input device 100 may also include a solar panel, which can utilize natural light to charge the battery, further extending battery life.

[0175] To ensure battery safety during charging, prevent overcharging and over-discharging, and optimize energy acquisition and storage efficiency, the input device 100 may also include a charging management integrated circuit, which is electrically connected to the solar panel and the battery, for managing the electrical energy acquired by the battery from the solar panel and charging the battery.

[0176] The following section, in conjunction with Figures 18 to 21, details the specific connection method between the insulating shell 1 and the conductive component 2.

[0177] In some embodiments, the insulating housing 1 has a receiving cavity, in which the control module 5 and the electric control switch 4 are disposed; the shell wall of the insulating housing 1 has a plurality of through holes, each through hole corresponding to a conductive element 2, and the conductive element 2 is at least partially disposed in the through hole. The conductive element 2 can be electrically connected to the electric control switch 4 via a wire 24.

[0178] In this embodiment, the conductive element 2 is disposed on the insulating housing 1 through a through hole, which ensures a tight connection between the conductive element 2 and the insulating housing 1, improving the overall structural stability of the input device 100. Furthermore, by using a through hole to install the conductive element 2, complex bonding and snap-fit ​​processes are avoided, simplifying the assembly steps of the conductive element 2, reducing assembly difficulty, improving assembly efficiency, and ultimately reducing production costs.

[0179] In some embodiments, the first end of the conductive element 2 is further away from the receiving cavity than the second end of the conductive element 2. For the conductive elements 2 provided on the insulating housing 1 in some of Figures 18 to 21, the first end of the conductive element 2 is the lower end of the conductive element 2, and the second end of the conductive element 2 is the upper end of the conductive element 2, with the lower end of the conductive element 2 being further away from the receiving cavity than the upper end of the conductive element 2. Referring to Figure 18, the end face of the first end of the conductive element 2 can be flush with the outer surface of the insulating housing 1. This makes the input device 100 appear neater and more aesthetically pleasing, thereby enhancing the overall sense of refinement and improving the visual effect and user experience of the input device 100.

[0180] Furthermore, referring to Figure 19, the end face of the first end of the conductive element 2 can also protrude from the outer surface of the insulating housing 1. The designer can determine the protrusion height of the first end face of the conductive element 2 based on factors such as the structural strength, wear rate, and processing precision of the conductive element 2; this embodiment does not impose a specific limitation on this. Thus, when the input device 100 acts on the capacitive touch-sensitive surface, the end face of the first end of the conductive element 2 can be closer to or in closer contact with the capacitive touch-sensitive surface, thereby improving the reliability of the capacitive coupling between the conductive element 2 and the capacitive touch-sensitive surface and ensuring the accuracy of the electronic device in recognizing the arrangement of multiple conductive elements 2.

[0181] Referring to Figure 21, in some embodiments, the conductive element 2 can be directly disposed on the outer surface of the insulating housing 1. Exemplarily, the conductive element 2, the control module 5, and the electronic switch 4 are located on the outside of the insulating housing 1 and connected to the outer surface of the insulating housing 1. The conductive element 2, the control module 5, and the electronic switch 4 can be directly disposed on the surface of the insulating housing 1 using methods such as bonding, welding, or snap-fitting.

[0182] In this embodiment, the conductive element 2 is directly provided on the outer surface of the insulating shell 1, which can eliminate the step of machining the through hole 12 on the insulating shell 1, and has the advantages of simple processing and low cost.

[0183] In other embodiments, the conductive element 2 may also be entirely disposed inside the insulating housing 1. For example, referring to FIG20, the insulating housing 1 has a receiving cavity (not shown in the figure); the conductive element 2 is at least partially disposed in the receiving cavity, and the distance d1 between the conductive element 2 and the outer surface of the insulating housing 1 is greater than or equal to 0.1 mm and less than or equal to 2 mm. For example, d1 can be 0.1 mm, 0.2 mm, 0.5 mm, 0.6 mm, 0.8 mm, 1 mm, 1.2 mm, 1.4 mm, 1.6 mm, 1.8 mm, 2 mm, etc.

[0184] The distance between the conductive element 2 and the outer surface of the insulating housing 1 can be directly controlled by adjusting the thickness of the insulating housing 1, or, as shown in Figure 20, indirectly controlled by adjusting the depth of a blind hole provided in the inner wall of the insulating housing 1. For the insulating housing 1 with a blind hole, the thickness can be relatively large, for example, 30–65 mm. For instance, the thickness of the insulating housing 1 can be directly set to 0.15 mm, or a blind hole can be provided in the inner wall of a thicker insulating housing 1, making the distance between the bottom wall of the blind hole and the outer surface of the insulating housing 1 0.15 mm. In this case, the distance between the conductive element 2 and the outer surface of the insulating housing 1 is very small. When the user holds the input device 100 and applies it to the capacitive touch surface, even if there is an insulating housing 1 between the conductive element 2 and the capacitive touch surface, it will not affect the capacitive coupling between the conductive element 2 and the capacitive touch surface.

[0185] Referring to Figure 22, which is an exemplary encoding schematic diagram of an input device provided in an embodiment of this application. As shown in Figure 5, an arrangement area 311 is provided on the outer surface of the input device. The arrangement area 311 is provided with N first conductive elements 331 (N is an integer greater than 2, for example, 3) and M second conductive elements 332 (M is an integer greater than or equal to 0). The N first conductive elements and M second conductive elements are arranged on the outer surface in a first preset arrangement. The N first conductive elements 331 form a preset non-rotationally symmetric pattern, used to identify the input device as a recognizable input device. The M second conductive elements 332 are used to encode the input device.

[0186] As shown in Figure 22, N is 3. The non-rotationally symmetric figure formed by the three first conductive elements 331 is an "L" shape. A rectangular coordinate system is constructed based on the three first conductive elements, and multiple coding regions are divided within the rectangular coordinate system. M second conductive elements 332 are set within each coding region. Specifically, the origin of the coordinate system is taken as the center point of one of the first conductive elements, and the two directions pointing from the center point of the first conductive element to the center points of the other two first conductive elements are taken as the horizontal and vertical axes of the rectangular coordinate system. Multiple adjacent coding regions are divided within the coordinate system.

[0187] In practical applications, the shape and size of each conductive element (including the first and second conductive elements) can be designed so that the size of the touch point formed by each conductive element on the capacitive touch-sensitive surface is less than or equal to K. Based on the size of the touch point, the arrangement area 311 is divided into 15 square areas of the same size as shown in Figure 22, with the side length of each square area being H, where H is greater than or equal to K. The relative distance between the center points of two adjacent areas is H. The number at the top left corner of each area in Figure 4 is the area number. Areas 1, 4, and 13 are reference areas, which are used to set the first conductive elements so that the three first conductive elements form a non-rotationally symmetric "L" shape.

[0188] When setting conductive components in each region, the center point of the conductive component coincides with the center point of the region. The center point of the first conductive component in region 1 can be set as the origin of the rectangular coordinate system. The direction from the center point of region 1 to the center point of the first conductive component in region 4 is the positive direction (or negative direction) of the X-axis (i.e., the horizontal axis) in the rectangular coordinate system. The direction from the center point of region 1 to the center point of the first conductive component in region 13 is the negative direction (or positive direction) of the Y-axis (i.e., the vertical axis) in the rectangular coordinate system. In Figure 22, the symbol X2 represents the X-axis in the constructed rectangular coordinate system, and the symbol Y2 represents the Y-axis in the constructed rectangular coordinate system.

[0189] Among them, regions 2 and 3, regions 5-12, and regions 14 and 15 are encoding regions. Each encoding region corresponds to a symbol in the encoding of the input device. The number in the lower right corner of each encoding region is the region number of the encoding region, which also represents the bit index of the corresponding encoding region. The bit index is the position of the symbol corresponding to the encoding region in the encoding. When region 311 is arranged to abut against the capacitive touch-sensitive surface, both the first conductive element 331 and the second conductive element 332 can contact the capacitive touch-sensitive surface and capacitively couple with the capacitor on the capacitive touch-sensitive surface. To avoid confusion, the capacitor capacitively coupled with the first conductive element 331 is referred to as the first target capacitor, and the capacitor capacitively coupled with the second conductive element 332 is referred to as the second target capacitor. The first target capacitor and the second target capacitor are collectively referred to as the target capacitor.

[0190] As shown in Figure 22, when a touch operation is performed via the input device, each area in the arrangement area 311 is opposite to an area in the capacitive touch-sensitive surface. The area in the capacitive touch-sensitive surface corresponding to the reference area (hereinafter referred to as the positioning area) has a first target capacitor capacitively coupled to the first conductive element, and the center point of the first target capacitor is located at the center point of the positioning area. When a second conductive element is provided in the encoding area, the area in the capacitive touch-sensitive surface corresponding to the encoding area (hereinafter referred to as the decoding area) has a second target capacitor capacitively coupled to the second conductive element, and the center point of the second target capacitor is located at the center of the decoding area. When no second conductive element is provided in the encoding area, there is no second target capacitor capacitively coupled to the second conductive element in the decoding area corresponding to the encoding area.

[0191] Based on the above examples, the coordinates of the encoded region in this rectangular coordinate system can be represented by the coordinates of the center point of the encoded region in the rectangular coordinate system. The coordinates of the encoded region in this rectangular coordinate system can be called the preset coordinates. Since the relative positional relationship between the encoded region and the reference region is fixed and known, the relative positional relationship between each decoded region and the positioning region is also fixed and known.

[0192] Furthermore, the relative distance between any two first target capacitors matches a preset distance, and the included angle between any two sides matches a preset angle. One endpoint of each side is the center point of a first target capacitor, and the other endpoint is the center point of another first target capacitor. As shown in Figure 22, since the distance between the center point of region 1 and the center point of region 4 is fixed, the distance between the first target capacitor corresponding to the first conductive element in region 1 and the first target capacitor corresponding to the first conductive element in region 4 is a preset distance 3H. Moreover, the included angle between one side formed by the first target capacitor corresponding to the first conductive element in region 1 and the first target capacitor corresponding to the first conductive element in region 4 as two endpoints, and another side formed by the first target capacitor corresponding to the first conductive element in region 1 and the first target capacitor corresponding to the first conductive element in region 13 as two endpoints, is equal to a preset angle of 90 degrees.

[0193] For example, the encoding of the input device can be a binary number. When the encoding region has a second conductive element, the corresponding code element of the encoding region is 1; when the encoding region does not have a second conductive element, the corresponding code element of the encoding region is 0. The decoding region corresponds one-to-one with the encoding region. Therefore, for each encoding region, when a second target capacitor formed by the second conductive element exists in the decoding region, the corresponding code element of the decoding region is 1; when a second target capacitor formed by the second conductive element does not exist in the decoding region, the corresponding code element of the decoding region is 0. Furthermore, since the relative positional relationship between the decoding region and the first target capacitor is the same as the relative positional relationship between the corresponding encoding region and the first conductive element, the decoding region and the corresponding encoding region correspond to the same bit index.

[0194] As shown in Figure 22, the arrangement area 311 has a total of 12 coding areas. Therefore, the code of the input device is a 12-bit binary number. Coding area 1 has no second conductive element, so the first bit of the binary number is 0. Coding area 2 has a second conductive element, so the second bit of the binary number is 1, and so on. Therefore, the code of the input device shown in Figure 22 is "010111101010". It can be understood that when no second conductive element is set in any coding area, the code of the input device is "000000000000", and when a second conductive element is set in all coding areas, the code of the input device is "111111111111".

[0195] Each input device has one or more outer surfaces, and each outer surface can be provided with an arrangement area 311. A set of conductive elements on each arrangement area 311 can encode the input device to form a 12-bit binary number (i.e., an encoding). For each symbol in the binary number, the corresponding encoding area is determined from the 12 encoding areas according to the bit index of the symbol in the binary number. When the symbol is 1, a second conductive element is provided in the corresponding encoding area; when the symbol is 0, no second conductive element is provided in the corresponding encoding area.

[0196] Of course, the encoding of the input device can also be a non-binary number; for example, the encoding of the input device can be a decimal number. In this case, the second conductive element can be designed so that it can cause different levels of capacitance change on the capacitive touch surface. For example, if the second conductive element can cause three levels of capacitance change, then when the second conductive element is not set in the encoding area, the corresponding code element of the encoding area is 0; when the second conductive element is set in the encoding area, and the capacitance change caused by the second conductive element is the first level out of three, the corresponding code element of the encoding area is 1; when the second conductive element is set in the encoding area, and the capacitance change caused by the second conductive element is the second level out of three, the corresponding code element of the encoding area is 2; when the second conductive element is set in the encoding area, and the capacitance change caused by the second conductive element is the third level out of three, the corresponding code element of the encoding area is 3. Thus, each code element can be one of 0, 1, 2, and 3.

[0197] As shown in Figure 22, the arrangement area 311 has a total of 12 coding areas. Therefore, when the code is a decimal number, there is no second conductive element in coding area 1, so the first digit of the decimal number is 0. There is a second conductive element in coding area 2. If the capacitance change caused by the second conductive element is at the second level, then the second digit of the decimal number is 2. And so on, the corresponding second conductive element can be set in the corresponding coding area according to the code element in the input device's code.

[0198] As shown in Figure 22, the non-rotationally symmetric shape formed by multiple first conductive elements 331 is "L"-shaped, and the relative distance between any two first conductive elements 331 is a preset distance (hereinafter referred to as the preset distance). Based on this, when a touch operation is performed through the input device, multiple target capacitors exist on the capacitive touch-sensitive surface, and each target capacitor is capacitively coupled to one of the conductive elements. Among the multiple target capacitors, each first target capacitor is located within the positioning area corresponding to the reference area. The electronic device can identify each first target capacitor from the multiple target capacitors based on the relative positional relationship between the various target capacitors.

[0199] Simultaneously, each second target capacitor is located within the corresponding decoding area of ​​the encoding area. The electronic device can determine the bit index corresponding to the decoding area based on the relative positional relationship between the decoding area and multiple first target capacitors (i.e., positioning areas), and determine whether there is a second target capacitor within the decoding area. When there is a second target capacitor, the corresponding code is determined based on the pixel value of the second target capacitor. When there is no second target capacitor (i.e., no second conductive element is provided), the code can be determined as the default code 0. In this way, each code in the encoding can be determined. The encoding of the input device can be obtained by combining all the code and the bit index corresponding to each decoding area.

[0200] In practical applications, by properly setting the size of each conductive component, the target capacitances generated by each conductive component on the capacitive touch surface can be prevented from interfering with each other, and each target capacitance can be clearly identified and distinguished by electronic devices.

[0201] When the input device is the one shown in Figures 14-16, its outer surface is provided with multiple conductive elements, including N third conductive elements and M fourth conductive elements. The third conductive elements function similarly to the first conductive elements and are always grounded. The fourth conductive elements function similarly to the second conductive elements and are grounded through an electronically controlled switch among all the conductive elements on the outer surface except for the third conductive elements. The arrangement of the N third conductive elements and the M fourth conductive elements on the outer surface is a second preset arrangement.

[0202] Optionally, to improve the accuracy during the decoding process, when using the encoding method shown in Figure 22, one or more error correction codes can be set in the encoding of the input device. The error correction code can be a Reed-Solomon error correction code, Hamming code, turbine code, polar code, etc. For example, for the encoding method shown in Figure 22, the 10th and 12th bits in the encoding can be set as error correction codes.

[0203] It should be understood that the above are merely illustrative examples, and the encoding methods for input devices may include, but are not limited to, the examples described above. In practical applications, the input device can be encoded using any encoding method through conductive components on the input device, as long as the encoding is feasible and can be recognized by the capacitive touch-sensitive surface.

[0204] Referring to Figure 23, which is a schematic diagram of a touch operation response flow provided in an embodiment of this application, the method is executed by the electronic device in the above example and includes the following steps:

[0205] S110. When the outer surface triggers the first touch operation on the capacitive touch-sensitive surface, determine the target capacitor that is capacitively coupled to the target conductive component from among the multiple capacitors on the capacitive touch-sensitive surface.

[0206] The target conductive element includes a grounded conductive element among multiple conductive elements disposed on the outer surface. As shown in Figure 5, multiple conductive elements are fixedly disposed on the outer surface. When a first touch operation is performed through the outer surface of the input device shown in Figure 5, all multiple conductive elements on the outer surface are grounded. The target conductive element includes all conductive elements on the outer surface. As shown in Figure 14, the control module can control some or all of the conductive elements on the outer surface to be grounded. When a first touch operation is performed through the outer surface of the input device shown in Figure 14, the target conductive element includes the grounded conductive element among the multiple conductive elements disposed on the outer surface.

[0207] Furthermore, in conjunction with Figure 22, in order to accurately determine the encoding information of the input device, regardless of which input device is used to perform the touch operation as shown in Figure 5 or Figure 14, the first conductive element and the third conductive element used for positioning are grounded, that is, the target conductive element includes the first conductive element or the third conductive element.

[0208] Furthermore, when a first touch operation is performed via the outer surface of the input device shown in FIG. 5, the target capacitor includes a first target capacitor capacitively coupled to a first conductive element, and a second target capacitor capacitively coupled to a second conductive element on the outer surface (the second conductive element is always grounded). Based on this, when a first touch operation is performed via the outer surface of the input device shown in FIG. 14, the target capacitor includes a first target capacitor capacitively coupled to a third conductive element, and a second target capacitor capacitively coupled to a fourth conductive element on the outer surface (the fourth conductive element is grounded via an electronically controlled switch). S120: Determine the encoding information corresponding to the target conductive element based on the target capacitor.

[0209] Optionally, S120 may include:

[0210] N first target capacitors and M second target capacitors are determined from multiple target capacitors. A target coordinate system is constructed based on the N first target capacitors. Based on the target coordinate system, the M second target capacitors are decoded to obtain the encoded information.

[0211] In this configuration, N first target capacitors correspond one-to-one with N first target conductive elements, and M second target capacitors correspond one-to-one with M second target conductive elements. When a first target conductive element includes a first conductive element, a second target conductive element includes a second conductive element; when a second target conductive element includes a third conductive element, a second target conductive element includes a fourth conductive element that is grounded. For example, during operation, the electronic device can periodically scan the capacitor electrode array on the capacitive touch-sensitive surface. During each scan, the capacitance change of each capacitor in the capacitor electrode array can be acquired, and a capacitance image can be drawn based on the capacitance change of each capacitor. After acquiring each capacitance image, it can be determined whether multiple touch points exist in the capacitance image, with each touch point corresponding to a target capacitor. If it is determined that multiple touch points exist in the capacitance image, it can be determined that multiple target capacitors exist on the capacitive touch-sensitive surface.

[0212] Referring to Figure 24, which is a schematic diagram of a partial capacitance image when a touch operation is performed using the input device shown in Figure 22. In this capacitance image 70, the pixel value of each pixel represents the capacitance change of the corresponding capacitor. A larger pixel value indicates a larger capacitance change, and a higher pixel value also indicates higher pixel brightness. Referring to Figure 22, when a touch operation is performed through the outer surface shown in Figure 22, each conductive element within the arrangement area 311 contacts the capacitive touch-sensitive surface. Each conductive element is a target conductive element, and each conductive element can capacitively couple with the capacitor (i.e., the target capacitor) at the contact location, causing a change in the capacitance change of the target capacitor. Each first conductive element 331 (or third conductive element) can form a first touch point 71 in the capacitance image 70, and each second conductive element 332 (or fourth conductive element) can form a second touch point 72 in the capacitance image 70. The first touch point 71 corresponds to the first target capacitor on the capacitive touch-sensitive surface, and the second touch point 72 corresponds to the second target capacitor on the capacitive touch-sensitive surface.

[0213] When the capacitance image includes multiple touch points as shown in Figure 24, since the multiple touch points shown in Figure 24 correspond one-to-one with the multiple conductive elements shown in Figure 22, the encoding information of the input device formed by the encoding of the multiple conductive elements (i.e., target conductive elements) shown in Figure 22 can be determined through the multiple touch points in Figure 24.

[0214] The touch point, also known as the touch area, is typically composed of one or more pixels with a value greater than a preset threshold. A pixel value greater than the preset threshold indicates that the capacitance change of the corresponding pixel has changed significantly due to the presence of conductive components. Generally, the pixel located at the center of the touch area (hereinafter referred to as the center pixel) has the largest pixel value. The coordinates of the center pixel are usually the coordinates of the touch point on the capacitive touch-sensitive surface, and the capacitance corresponding to the center pixel is the target capacitance. It should be understood that when the electronic device periodically scans the capacitive electrode array on the capacitive touch-sensitive surface to acquire a capacitance image, the touch point shown in Figure 24 will generally not exist in the capacitance image acquired by the electronic device when no touch operation is performed through the input device shown in Figure 22.

[0215] As described above, when encoding the input device, the size of each conductive element can be reasonably set so that the size of the touch point formed by each conductive element in the capacitance image is less than or equal to K, for example, 3 pixels. After acquiring the capacitance image, the electronic device can find each pixel in the capacitance image whose pixel value is greater than a preset threshold. For each pixel whose pixel value is greater than the preset threshold, the pixel values ​​of other pixels within a square area with a side length of 3 pixels (the size of both the first touch point and the second touch point is less than or equal to 3 pixels) centered on that pixel are determined. If the pixel values ​​of other pixels are all greater than the preset threshold and less than the pixel value of that pixel, then the square area is determined to be either the first touch point or the second touch point.

[0216] Next, for each pixel within the square region, the product of the pixel value and its X-axis coordinate in the original coordinate system of the capacitive image is calculated, yielding a first product result. The product of the pixel value and its Y-axis coordinate in the original coordinate system of the capacitive image is then calculated, yielding a second product result. For all pixels within the square region, all first product results are summed to obtain a first summation result, and the pixel values ​​of all pixels within the square region are summed to obtain a second summation result. Dividing the first summation result by the second summation result yields the X-axis coordinate of the center of the square region. Similarly, summing all second product results yields a third summation result, and dividing the third summation result by the second summation result yields the Y-axis coordinate of the center of the square region. This provides the center coordinates of the square region, which are the center coordinates of the touch point in the original coordinate system of the capacitive image. Therefore, all touch points in the capacitive image and the center coordinates of each touch point can be determined.

[0217] As described above, if the capacitance image is determined to include multiple touch points, then it can be determined that the capacitive touch-sensitive surface contains multiple target capacitors. In the case where the capacitance image includes multiple touch points, it can be determined whether there are N first touch points among the multiple touch points. If it is determined that there are N first touch points, then it can be determined that the capacitive touch-sensitive surface contains N first target capacitors, and the conductive component that capacitively couples with the first target capacitors is the first target conductive component.

[0218] If there are N first touch points, a target coordinate system can be constructed based on these N first touch points (i.e., the first target capacitors). Conversely, if there are no N first touch points, the input device is determined to be a normal input device, and touch operations are processed according to the conventional procedure.

[0219] Optionally, the step of constructing a target coordinate system based on N first touch points may include: determining a first target touch point, a second target touch point, and a third target touch point from the N first touch points; the relative distance between each pair of the first target touch point, the second target touch point, and the third target touch point is a preset distance; and constructing the target coordinate system by taking the first target touch point as the origin of the rectangular coordinate system, taking the direction from the first target touch point to the second target touch point as the X-axis direction of the rectangular coordinate system, and taking the direction from the first target touch point to the third target touch point as the Y-axis direction of the rectangular coordinate system.

[0220] As shown in Figure 22, during the setting of the encoding area, a Cartesian coordinate system is constructed based on three first conductive elements. The center point of the first conductive element in region 1 is the origin. The direction from the center point of the first conductive element in region 1 to the center point of the first conductive element in region 4 is the positive direction of the X-axis in the coordinate system, and the direction from the center point of the first conductive element in region 1 to the center point of the first conductive element in region 13 is the negative direction of the Y-axis in the coordinate system. Furthermore, based on the relative distances between the regions, it can be determined that the relative distance between the first touch point corresponding to region 1 and the first touch point corresponding to region 4 is approximately equal to or close to a preset distance 3H; the relative distance between the first touch point corresponding to region 1 and the first touch point corresponding to region 13 is approximately equal to or close to a preset distance H; and the distance between the first touch point corresponding to region 4 and the first touch point corresponding to region 13 is approximately equal to or close to a preset distance H. Here, the touch point corresponding to a region refers to the touch point formed by the conductive elements within that region, and the relative distance between two touch points is specified as the distance between the center coordinates of the two touch points.

[0221] After determining that multiple touch points exist in the capacitive image using the above method, the relative distance between each pair of touch points is calculated. If the relative distance between two touch points is H, then these two touch points are identified as the two first touch points corresponding to regions 4 and 13, respectively. If the relative distance between a certain touch point and both of these first touch points is a preset distance of 3H, then this touch point can be identified as the first touch point corresponding to region 1, and this first touch point is the first target touch point.

[0222] Referring to Figure 25, Figure 25 shows a schematic diagram of the construction of a coordinate system provided in an embodiment of this application. In the capacitance image 80 shown in Figure 25, each dashed box represents a decoding region. The number in the lower right corner of the decoding region is the region number of the decoding region, which is consistent with the bit index corresponding to the decoding region. Touch point 801 is the first touch point corresponding to the first conductive element in region 1, touch point 802 is the first touch point corresponding to the first conductive element in region 4, and touch point 803 is the first touch point corresponding to the first conductive element in region 13.

[0223] After determining that touch point 801 is the first touch point (i.e., the first target touch point) corresponding to region 1 using the above method, the center point of touch point 801 can be used as the origin of the target coordinate system. For touch points 802 and 803, a first vector 804 pointing from the center of touch point 801 to the center of touch point 802 is determined, as well as a second vector 805 pointing from the center of touch point 801 to the center of touch point 803. If the cross product between the first vector 804 and the second vector 805 is negative, then the first vector 804 is located on the X2 axis of the target coordinate system, and the second vector 805 is located on the Y2 axis of the coordinate system. Therefore, touch point 802 can be determined as the first touch point (i.e., the second target touch point) corresponding to region 4, and touch point 803 as the first touch point (i.e., the third target touch point) corresponding to region 13.

[0224] Next, the direction from the center point of touch point 801 to the center point of touch point 802 can be determined as the positive direction of the X2 axis in the target coordinate system, and the direction from the center point of touch point 801 to the center point of touch point 803 can be determined as the negative direction of the Y2 axis in the coordinate system. This allows the construction of a target coordinate system composed of the X2 and Y2 axes. Simultaneously, the angle β between the X1 and X2 axes in the original coordinate system of the capacitance image can be calculated and determined.

[0225] It can be understood that after determining the first vector 804 and the second vector 805, if the cross product between the first vector 804 and the second vector 805 is determined to be positive, then the first vector 804 can be determined to be located on the Y2 axis of the coordinate system, and the second vector 805 can be determined to be located on the X2 axis of the coordinate system. Therefore, touch point 802 can be determined to be the first touch point (i.e., the third target touch point) corresponding to region 13, and touch point 803 can be determined to be the first touch point (i.e., the second target touch point) corresponding to region 4. Subsequently, the direction from the center point of touch point 801 to the center point of touch point 803 can be determined to be the X2 axis direction of the coordinate system, and the direction from the center point of touch point 801 to the center point of touch point 802 can be determined to be the Y2 axis direction of the coordinate system.

[0226] In this embodiment, after the target coordinate system is constructed, the second touch point (i.e. the second target capacitor) in the capacitance image can be decoded based on the target coordinate system to obtain the encoding information of the input device.

[0227] Optionally, in the process of decoding M second target capacitors to obtain encoded information based on the target coordinate system, for each second target capacitor, the code element in the encoded information corresponding to the second target capacitor can be determined according to the capacitance change of the second target capacitor, and the encoded information can be determined based on the bit index and code element corresponding to the M second target capacitors respectively.

[0228] For example, the second target capacitor corresponds to the second touch point in the capacitance image, and the capacitance change of the second target capacitor corresponds to the pixel value of the second touch point. During the decoding process based on the second target capacitor, M second touch points can be determined from the other touch points included in the capacitance image besides the first touch point; M is an integer greater than or equal to 0, and the M second touch points are located within the target area in the target coordinate system; for each second touch point, the bit index corresponding to the second touch point (i.e., the second target capacitor) is determined based on the coordinates of the second touch point in the target coordinate system; for each second touch point, the code element in the encoding information corresponding to the second touch point (i.e., the second target capacitor) is determined based on the pixel value of the second touch point; wherein, the pixel value of the second touch point is the pixel value of the second touch point in the capacitance image of the capacitive touch-sensitive surface; the encoding information is determined based on the bit index and code element corresponding to each of the M second touch points.

[0229] In one implementation, after constructing the target coordinate system, the presence of a second touch point can be determined from other touch points besides the first touch point. As shown in Figure 22, the X-axis coordinate of the center point of each second conductive element is not less than the X-axis coordinate of the center point of the first conductive element in region 1 (0) and not greater than the X-axis coordinate of the center point of the first conductive element in region 4 (3H). The Y-axis coordinate of the center point of each second conductive element is not greater than the Y-axis coordinate of the center point of the first conductive element in region 1 (0) and not less than the Y-axis coordinate of the center point of the first conductive element in region 13 (-3H). That is, all second conductive elements are located within a rectangular area of ​​the coordinate system, with the coordinates of the upper left corner of the rectangular area being (0, 0) and the coordinates of the lower right corner being (3H, -3H).

[0230] Correspondingly, as shown in Figure 25, in the target coordinate system, the X-axis coordinate of the center point of each second touch point is not less than the X-axis coordinate of touch point 801 (which is 0) and not greater than the X-axis coordinate of touch point 802 (3H). The Y-axis coordinate of each second touch point is not greater than the Y-axis coordinate of touch point 801 (which is 0) and not less than the Y-axis coordinate of touch point 803 (which is -3H). That is, all second touch points are located within a rectangular target area in the target coordinate system. The coordinates of the upper left corner of this target area are (0, 0) and the coordinates of the lower right corner are (3H, -3H).

[0231] After constructing the target coordinate system, when determining that the capacitance image also includes other touch points, if the other touch points are located within the target area, that is, the X-axis coordinate of the touch point is greater than or equal to 0 and less than or equal to 3H, and the Y-axis coordinate is less than or equal to 0 and greater than or equal to -3H, then the touch point is determined to be the second touch point. Otherwise, the touch point is determined not to be the second touch point.

[0232] When the capacitive image includes a second touch point, the coordinates of the second touch point in the target coordinate system are determined. If the coordinates are one of the preset coordinates, or the distance between the coordinates and a preset coordinate is less than or equal to 3 pixels, then the bit index corresponding to the second touch point is determined to be the bit index corresponding to the decoding area corresponding to the preset coordinates.

[0233] When the input device uses binary data, the code corresponding to each second touch point can be directly determined to be 1. When the input device uses decimal data, multiple pixel value ranges can be set, each corresponding to a different level of capacitance change, with each range containing a code element. For each second touch point, the target pixel value range containing the center pixel of the second touch point can be determined, and the code element corresponding to the target pixel range is used as the code element for the second touch point.

[0234] For example, when a touch operation is performed using the input device shown in Figure 22, there will be 7 second touch points in the target area. The bit index corresponding to each second touch point can be determined as a symbol. At the same time, the symbol corresponding to other bit indices in the encoded information can be determined as the default symbol 0. All symbols can be combined based on the bit index corresponding to each symbol, and thus the encoded information can be determined as 010111101010.

[0235] It should be noted that after constructing the coordinate system, if it is determined that there are no other touch points in the capacitance image, it can be determined that each symbol in the encoded information is a default symbol.

[0236] In this embodiment of the application, after constructing the target coordinate system, the second touch point is determined, and the encoding information is determined according to the bit index and code element corresponding to the second touch point. Only the second touch point can be processed, which can reduce the amount of data processing and improve the efficiency of determining the encoding information.

[0237] Optionally, in the process of determining the second touch point, for each other touch point, if the coordinates of the other touch point in the target coordinate system correspond to one of the preset coordinates, then the other touch point is determined as the second touch point.

[0238] Referring to Figure 22, after constructing the target coordinate system, for each other touch point present in the capacitance image, the coordinates of the other touch points in the target coordinate system can be determined. If the coordinates of another touch point in the target coordinate system overlap with a preset coordinate or the distance between the other touch point and the preset coordinate is less than or equal to a preset distance threshold (i.e., close to overlap), then the other touch point can be determined as the second touch point. Conversely, if an other touch point does not overlap with any preset coordinate and the distance between the other touch point and each preset coordinate is greater than the preset distance threshold, then the other touch point is determined not to be the second touch point.

[0239] Optionally, in the process of decoding M second target capacitors to obtain encoded information based on the target coordinate system, multiple decoding regions can be determined from the target coordinate system based on multiple preset coordinates; the multiple decoding regions correspond one-to-one with multiple bits of code in the encoded information; for each decoding region, the code corresponding to the decoding region is determined according to the pixel value of the pixel in the decoding region; the pixel in the decoding region is the pixel in the capacitance image of the decoding region on the capacitive touch-sensitive surface; the encoded information is obtained by combining the code corresponding to the multiple decoding regions respectively.

[0240] As shown in Figure 22, multiple preset coordinates represent the coordinates of the center points of multiple encoding regions in the coordinate system. These preset coordinates correspond one-to-one with the multiple encoding regions and are consistent with the bit index of each encoding region. Similarly, the multiple encoding regions correspond one-to-one with the multiple decoding regions; therefore, the multiple preset coordinates correspond one-to-one with the multiple decoding regions, and the multiple preset coordinates correspond one-to-one with the multiple bit indices.

[0241] For example, taking the decoding area 1 shown in Figure 25 as an example, after the target coordinate system is constructed, the preset coordinates of the pre-stored encoding area 1 can be obtained. These preset coordinates correspond to the decoding area 1 and are associated with the bit index of the decoding area 1. Based on these preset coordinates, the position of the center point of the corresponding decoding area 1 is determined from the target coordinate system. Then, a square area with a side length of H centered on the center point is determined as the decoding area 1. The angle between the two opposite sides of the square area and the X1 axis is angle β, and the other two sides are perpendicular to the line segment between touch point 801 and touch point 803. Similarly, each other decoding area can be determined.

[0242] When encoded as binary data, for decoding region 1, it is determined whether a touch point (i.e., a second touch point) exists within decoding region 1. If a second touch point exists, the corresponding code element for decoding region 1 is set to 1; if no second touch point exists, the corresponding code element is set to 0 (i.e., a default code element). This process is repeated to determine the code element for each decoding region. Then, based on the code element and bit index of each decoding region, all code elements are combined to obtain the encoding information of the input device.

[0243] Optionally, determining the code corresponding to the decoding region based on the pixel values ​​of the pixels within the decoding region includes: determining the target pixel value interval where the pixel values ​​of the pixels within the decoding region are located from multiple pixel value intervals; wherein the multiple pixel value intervals correspond to different code symbols; and determining the code symbol corresponding to the decoding region based on the code symbol corresponding to the target pixel value interval.

[0244] As shown in Figure 25, when the input device's encoding is a binary number, the pixel value range can be divided into two: a first pixel value range (where the pixel value is less than a preset threshold) and a second pixel value range (where the pixel value is greater than or equal to the preset threshold). The code element corresponding to the first pixel value range is 0, and the code element corresponding to the second pixel value range is 1. After determining multiple decoding regions from the capacitance image, for each decoding region, if the pixel value of each pixel within the decoding region is less than the preset threshold, it can be determined that there is no second touch point within the decoding region, and the code element corresponding to the decoding region is the code element 0 corresponding to the second pixel value range. If there are pixels within the decoding region whose pixel value is greater than or equal to the preset threshold, it can be determined that there is a second touch point within the decoding region, and the code element corresponding to the decoding region is the code element 1 corresponding to the second pixel value range.

[0245] For example, when the input device encoding is a decimal number, multiple pixel value ranges can be set, each corresponding to a different level of capacitance change. As previously illustrated, the second conductive element can cause three levels of capacitance change, allowing for four pixel value ranges. The first pixel value range has a lower limit of 0 and an upper limit of a preset threshold, corresponding to code 0. The second pixel value range has a lower limit greater than the preset threshold and an upper limit less than the first pixel value corresponding to the first level of capacitance change, corresponding to code 1. The third pixel value range has a lower limit greater than the first pixel value and an upper limit less than the second pixel value corresponding to the second level of capacitance change, corresponding to code 2. The third pixel value range has a lower limit greater than the second pixel value and an upper limit less than the third pixel value corresponding to the third level of capacitance change, corresponding to code 3. The first pixel value is greater than the preset threshold and less than the second pixel value, and the second pixel value is less than the third pixel value.

[0246] For each decoding region, the maximum pixel value of all pixels within that region can be determined. From multiple pixel value intervals, a target pixel value interval containing the maximum pixel value is identified, and the code symbols corresponding to this target pixel value interval are used as the code symbols for the decoding region. Then, based on the bit index of each decoding region, the code symbols corresponding to all decoding regions are combined to obtain the encoding information of the input device.

[0247] In this embodiment, multiple decoding regions are first determined from the target coordinate system, and then the code elements corresponding to the decoding regions are determined based on the pixel values ​​of the pixels within the decoding regions. The code elements corresponding to the multiple decoding regions are combined to obtain the encoding information, which can quickly and accurately determine the encoding information of the input device.

[0248] Optionally, the step of decoding the M second target capacitors based on the target coordinate system to obtain encoded information may include: for each other touch point in the capacitor image (touch points other than the first touch point, including the second touch point), if the coordinates of the other touch point in the target coordinate system correspond to one of the preset coordinates, then determine a code element in the encoded information corresponding to the other touch point based on the pixel value of the other touch point; wherein, the pixel value of the other touch point is the pixel value of the other touch point in the capacitor image of the capacitor-sensitive surface; and, based on the preset coordinate corresponding to the other touch point, determine the bit index of the code element corresponding to the other touch point in the encoded information; and determine the encoded information based on all the determined code elements and the corresponding bit indices.

[0249] The coordinates of other touch points in the target coordinate system correspond to one of the preset coordinates. This means that the coordinates of other touch points overlap with the preset coordinates, or the distance between the coordinates of other touch points and a certain preset coordinate is less than or equal to a preset distance threshold, and they almost overlap with the preset coordinates.

[0250] For example, after constructing the target coordinate system, if it is determined that the capacitance image also includes other touch points, the coordinates of these other touch points in the target coordinate system can be directly determined. If the coordinates of these other touch points in the target coordinate system overlap with a preset coordinate, then these other touch points can be determined as the second touch point corresponding to the preset coordinate, and thus corresponding to the second target capacitor. Alternatively, if the distance between these other touch points and a certain touch point is less than a preset distance threshold (e.g., 3 pixels), then these other touch points can be determined as almost overlapping with the second touch point corresponding to the preset coordinate, and thus, these other touch points are the second touch point, corresponding to the second target capacitor.

[0251] At this point, a code element in the encoding information corresponding to other touch points can be determined based on the pixel values ​​of those other touch points. For example, when the input device's encoding is binary data, the code element corresponding to the other touch point (i.e., the second touch point) can be directly determined to be 1. When the input device's encoding is decimal data, the target pixel value range in which the pixel value of the other touch point (i.e., the second touch point) is located can be determined, and the code element corresponding to the target pixel value range can be used as the code element corresponding to the other touch point.

[0252] In this embodiment of the application, after constructing the target coordinate system, other touch points besides the first touch point are determined, and the code elements in the encoded information are determined according to the relationship between the other touch points and the preset coordinates. This allows processing of only a small number of touch points, reduces the amount of data processing, and improves the efficiency of determining the encoded information.

[0253] S130. Output the feedback information corresponding to the first touch operation according to the encoding information.

[0254] The feedback information includes at least one of the following: interface display, audio-visual prompts, and vibration.

[0255] In one embodiment, corresponding feedback information can be pre-set for the encoding information of each input device. After determining the encoding information of the input device, the corresponding feedback information can be determined and output based on the encoding information to achieve a response to the first touch operation. For example, if it is necessary to trigger the electronic device to open a certain software interface (the feedback information is the interface display) through one of the input devices, the feedback information corresponding to the encoding information of that input device can be set to the software interface. After decoding the encoding information of the input device, the feedback information corresponding to the encoding information can be determined to be the software interface, and the electronic device can be controlled to open the software interface to achieve a response to the first touch operation.

[0256] For example, regarding one of the input devices, if it is necessary to trigger an electronic device to play an audio signal (with audio-visual feedback) through the input device, the feedback information corresponding to the encoding information of the input device can be set to an audio signal. After decoding the encoding information of the input device, it can be determined that the feedback information corresponding to the encoding information is an audio signal, and the audio signal can be played through the speaker to realize the response to the first touch operation.

[0257] For example, regarding one of the input devices, if it is necessary to trigger the electronic device to output an indicator light signal (the feedback information is an audio-visual prompt) through the input device, the feedback information corresponding to the encoded information of the input device can be set as the indicator light signal. After decoding the encoded information of the input device, it can be determined that the feedback information corresponding to the encoded information is the indicator light signal, and then the indicator light can be controlled to turn on to output the indicator light signal, thereby realizing the response to the first touch operation.

[0258] For example, if it is necessary to trigger the electronic device to output a vibration signal (the feedback information is vibration) through one of the input devices, the feedback information corresponding to the encoded information of the input device can be set to vibration. After decoding the encoded information of the input device, it can be determined that the feedback information corresponding to the encoded information is vibration, and then the linear motor can be controlled to start running to output a vibration signal, thereby realizing the response to the first touch operation.

[0259] As shown in Figure 3, the SOC has an operating system installed, and the operating system has applications (APP1, APP2 and APP1) installed. Feedback information can be output by the applications according to the encoding information, or it can be output by the operating system according to the encoding information. This embodiment does not limit this.

[0260] It should be understood that the above are merely illustrative examples, and the specific types of feedback information may include, but are not limited to, the examples above.

[0261] In this embodiment, during the touch response process, when it is determined that the input device forms multiple touch points on the capacitive touch-sensitive surface, it is determined whether the multiple touch points include N first touch points that constitute a preset non-rotationally symmetric pattern. If N first touch points are included, a target coordinate system is constructed based on the N first touch points. The other touch points are decoded based on the target coordinate system to obtain the encoding information of the input device. The other touch points are the touch points other than the N first touch points among the multiple touch points. The instruction corresponding to the encoding information is executed. This not only enables the capacitive touch-sensitive surface to respond to the input device, but also allows the encoding to be set with corresponding instructions (which can be complex or simple) according to requirements. This allows users to input simple or complex instructions to the capacitive touch-sensitive surface by performing simple touch operations on the capacitive touch-sensitive surface through the input device, which simplifies user operation and expands the application scenarios of the capacitive touch-sensitive surface, meeting the needs of users in some specific scenarios. Optionally, during the execution of S110-S130 shown in Figure 23, if the microcontroller detects a signal change caused by the capacitive touch surface when the input device acts on the capacitive touch surface, it can process the signal change of the capacitive touch surface to obtain a capacitance image and send the capacitance image to the system-on-a-chip. The capacitance image includes one frame or more frames; the system-on-a-chip is used to obtain encoded information based on the capacitance image.

[0262] As shown in Figure 23, during the operation of the electronic device, the sensing circuit can periodically scan the capacitor electrode array to obtain the capacitance change (i.e., signal change) of each capacitor in the array and send the capacitance change to the signal processing chip. The signal processing chip performs filtering and amplification on the received capacitance change and sends the processed capacitance change to the MCU. Based on the received capacitance change of each capacitor, the MCU constructs a capacitance image and sends the capacitance image to the SOC. After receiving the capacitance image, the SOC can execute S110-S130 as shown in Figure 23 to respond to the first touch operation.

[0263] Optionally, during the execution of S110-S130 shown in Figure 23, the microcontroller can, when the input device acts on the capacitive touch surface, if the capacitive touch surface causes a signal change, process the signal change of the capacitive touch surface to obtain a capacitance image, acquire encoding information based on the capacitance image, and send the encoding information to the system-on-a-chip. The capacitance image includes one frame or multiple frames; the system-on-a-chip is used to output feedback information according to the encoding information.

[0264] As shown in Figure 23, during the operation of the electronic device, the sensing circuit can periodically scan the capacitor electrode array to obtain the capacitance change (i.e., signal change) of each capacitor in the array and send the capacitance change to the signal processing chip. The signal processing chip performs filtering and amplification on the received capacitance change and sends the processed capacitance change to the MCU. The MCU constructs a capacitance image based on the received capacitance change of each capacitor. After obtaining the capacitance image, the MCU executes S110-S120 as shown in Figure 23 to obtain encoded information and sends the encoded information to the SOC. After receiving the encoded information, the SOC can execute S130 as shown in Figure 23 to respond to the first touch operation.

[0265] In the process of obtaining encoded information based on capacitance image decoding, in order to obtain accurate encoded information, the SOC or MCU can determine the encoded information based on multiple consecutive frames of capacitance images. Alternatively, the encoded information can be determined based on a single frame of capacitance image acquired at a time.

[0266] Optionally, the method may further include:

[0267] Based on N first touch points (i.e. first target capacitors), determine the reference coordinates of the reference point of the input device on the capacitive touch surface, and / or determine the rotation angle of the input device in the capacitive touch surface.

[0268] Based on the reference coordinates and / or rotation angle, execute the instructions corresponding to the encoded information.

[0269] The rotation angle of the input device on the capacitive touch-sensitive surface can be the deflection angle of the first reference line of the input device relative to the second reference line of the capacitive touch-sensitive surface.

[0270] For example, when the input device is encoded using the encoding method shown in Figure 22, the first reference line of the input device can be the straight line where the X2 axis of the constructed coordinate system is located, and the second reference line of the capacitive touch surface can be the horizontal line of the capacitive touch surface (i.e. the straight line where the X1 axis of the original coordinate system of the capacitive touch surface is located). Then the rotation angle is the deflection angle between the X2 axis and the X1 axis.

[0271] Optionally, in determining the rotation angle of the input device on the capacitive touch-sensitive surface, two fourth target touch points can first be determined from multiple touch points; the rotation angle is determined based on the angle between the first reference line formed by the two fourth target touch points and the second reference line of the capacitive touch-sensitive surface.

[0272] As shown in Figure 25, when the first reference line of the input device is the straight line containing the X2 axis, the two fourth target touch points are touch point 801 and touch point 802. After acquiring the capacitive image, the touch point coordinates of each touch point can be determined from the capacitive image. Simultaneously, N first touch points can be determined from the multiple touch points, and a target coordinate system is constructed in the capacitive image based on these N first touch points. At this point, the angle β between the X2 axis (i.e., the first reference line) containing the two fourth target touch points and the X1 axis (i.e., the second reference line) in the original coordinate system of the capacitive image can be determined, and this angle β is defined as the rotation angle of the input device on the capacitive touch-sensitive surface. It should be understood that the first reference line can also be other types of reference lines; this embodiment does not limit the specific setting method of the reference line.

[0273] For example, when the input device is encoded using the encoding method shown in FIG22, the reference point of the input device can be the center point of the arrangement area 311, and the reference coordinates are the coordinates of the center point of the arrangement area 311 on the capacitive touch-sensitive surface (i.e., the capacitive image). Of course, the reference point can also be located at other positions on the input device. After acquiring the capacitive image, N first touch points can be determined from the capacitive image using the aforementioned method, and a coordinate system can be constructed based on the N first touch points. As shown in FIG25, after constructing the target coordinate system, the center point C can be determined from the target coordinate system. The coordinates of the center point C in the target coordinate system are preset (1.5H, -1.5H), and the coordinates (1.5H, -1.5H) are the coordinates of the center point of the arrangement area 311 in the coordinate system formed by the X2 axis and the Y2 axis. Then, the coordinates of the center point C in the original coordinate system of the capacitive image can be determined, which are the reference coordinates. It should be understood that the reference point of the input device can include, but is not limited to, the center point of the conductive component arrangement surface.

[0274] During the process of outputting feedback information, feedback information can be output based on the reference coordinates, the rotation angle, or both.

[0275] Optionally, when the capacitive touch-sensitive surface is a capacitive screen, feedback information is output based on reference coordinates and / or rotation angle, including: displaying the object to be displayed corresponding to the input device on the capacitive screen based on the reference coordinates; or, displaying the object to be displayed on the capacitive screen with a rotation angle based on the reference coordinates.

[0276] For example, the feedback information corresponding to the encoded information can be the object to be displayed on the display input device. The object to be displayed can be a picture, symbol, or analog image of the input device, but is not limited to this.

[0277] As shown in Figure 25, the object to be displayed 806 can be a simulated image of the input device. When the feedback information corresponding to the encoded information is to display the object to be displayed 806 corresponding to the input device, the object to be displayed 806 can be displayed at the reference coordinates, or displayed near the reference coordinates. The rotation angle of the object to be displayed 806 in the capacitive image 80 is the same as the rotation angle of the total touch area in the capacitive image, or the rotation angle of the object to be displayed 806 in the capacitive image 80 can be different from the rotation angle of the total touch area in the capacitive image. This embodiment does not impose any restrictions on this.

[0278] In this embodiment of the application, the object to be displayed corresponding to the input device is displayed based on the reference coordinates and rotation angle of the input device, which can make the position and angle of the object to be displayed match the position and angle of the input device.

[0279] Optionally, the encoding information includes data codes and error correction codes, and the output feedback information includes:

[0280] The data code is corrected based on the error correction code to obtain the error-corrected data code;

[0281] Output feedback information corresponding to the data code after error correction.

[0282] Based on the above example, for the encoding method shown in Figure 22, the 10th and 12th bits of the encoding can be set as error correction codes, while bits 1-9 and the 11th bit are data codes. When setting the instructions corresponding to the encoding, corresponding feedback information can be set for the data codes. After obtaining the encoding information through the capacitance image, error correction can be performed on the encoding information based on the 10th and 12th bits. Then, the code elements of bits 1-9 and the 11th bit are obtained from the error-corrected encoding information to obtain the data codes, and the feedback information corresponding to the data codes is output.

[0283] Figure 26 shows a schematic flowchart of a data configuration method provided in an embodiment of this application. As shown in Figure 26, the data configuration method provided in this embodiment of the application is applied to an electronic device, and the method includes the following steps:

[0284] S110: Controls the capacitive touchscreen display to provide a first interface for configuring the input device.

[0285] S120: Upon receiving a function configuration operation for the first interface, obtain the target function configured for the input device based on the function configuration operation.

[0286] For example, each input device Si has one or more device identifiers, represented by IDs, which can be coded information. When a user needs to configure different functions for the input device Si, different functions can be configured for the input device Si through an electronic device.

[0287] Figure 27 illustrates an exemplary scenario of configuring the functions of an input device. The specific process of configuring the functions of the input device Si includes: the user triggers a function configuration option or icon for the input device in the display interface 200 of the electronic device. The electronic device receives the function configuration request for the input device, responds to the request, and switches from the display interface 200 to the first interface 201, thus displaying the first interface 201. The first interface 201 includes the ID of the input device Si and the corresponding function configuration area. The IDs displayed in the first interface 201 in Figure 27 include ID1 for input device S1, ID2 for input device S2, ID3 for input device S3, etc. The function configuration areas include function configuration area 1 corresponding to ID1, function configuration area 2 corresponding to ID2, function configuration area 3 corresponding to ID3, etc. After the user triggers the function configuration area Qi corresponding to the input device Si, they can set the functions they need to configure for the input device Si in the function configuration area Qi.

[0288] This application embodiment illustrates two configuration methods for setting the functions to be configured for the input device Si in the function configuration area Qi. For the first configuration method (i.e., the user selects the functions to be configured for the input device in the function option bar), when the user triggers the function configuration area Qi, the first interface 201 will display the function option bar Fi corresponding to the function configuration area Qi. The function option bar Fi provides multiple different function options for the user to select.

[0289] As shown in Figure 27, for example, after a user triggers the function configuration area Q1, the first interface 201 will display the function option bar F1 corresponding to the function configuration area Q1. The function option bar F1 provides function 11, function 12, ..., etc. If the user clicks (i.e. performs a function configuration operation) on function 11 in the function option bar F1, then the target function configured for input device S1 is function 11. The process of configuring functions for other input devices such as input device S2 and input device S3 using the first configuration method is the same as the process of configuring functions for input device S1 using the first configuration method, and will not be described again in this application. For the second configuration method (i.e., the user directly enters the function name of the function to be configured for the input device in the function input field), after the user triggers the function configuration area Qi, the first interface 201 will display the function input field Ei corresponding to the function configuration area Qi. The user can enter (i.e., perform a function configuration operation) the function name of the function to be configured in the function input field Ei. As shown in Figure 27, for example, after the user triggers the function configuration area Q1, the first interface 201 will display the function input field E1 corresponding to the function configuration area Q1. The function input field E1 displays a writing cursor B. If the user enters the function name "Function 11" in the function input field E1, then the target function configured for input device S1 is function 11. The process of configuring functions for other input devices such as input device S2 and input device S3 using the second configuration method is the same as the process of configuring functions for input device S1 using the second configuration method, and will not be described again in this application.

[0290] For example, after a user performs a function configuration operation on the first interface 201 to configure the input device Si, the electronic device updates the first interface 201 to a function interface 202 in response to the function configuration operation on the input device Si. The function interface 202 includes the input device Si's IDi and the target function configured for the input device Si, and the target function configured for the input device Si is displayed in the corresponding function configuration area Qi of the input device Si.

[0291] As shown in Figure 27, after the user completes the function configuration for input devices S1-S3 respectively, the function interface 202 displays the target function configured by the user for input device S1 as function 11, for input device S2 as function 21, and for input device S3 as function 31. Note that after configuring the function for each input device, the functions of the multiple input devices may be different, and there may also be input devices with the same function. S130: Generate the function configuration data for the input devices based on the device identifier and target function.

[0292] After the user configures the functions of the input device Si, the electronic device generates the function configuration data of the input device Si based on the ID of the input device Si and the target function of the input device Si. One data structure of the function configuration data of the input device Si is shown in Table 1:

[0293] Table 1

[0294] As shown in Table 1, the data structure of the function configuration data of the input device Si includes ID, function name, function code, and data content. The data content can be empty or not. When the data content is not empty, it can be text, a webpage link, an image link, a video link, etc. For function implementation, after the electronic device obtains the ID of the input device Si, it queries the function configuration data using the ID to obtain the function code corresponding to the ID of the input device Si. The corresponding function is then obtained through the function code, and the corresponding operation is executed to achieve the desired function.

[0295] S140: Store the function configuration data in the local space of the electronic device, or send the function configuration data to the server so that the electronic device can perform the target function according to the function configuration data when interacting with the input device.

[0296] After generating the functional configuration data of the input device Si, the functional configuration data of the input device Si is added to the functional configuration data list and then stored. When the electronic device detects that the input device Si is interacting with the electronic device, it reads the ID of the input device Si and then queries the functional configuration data list based on the ID of the input device Si, thereby executing the operation to implement the target function corresponding to the input device Si.

[0297] For example, after a user configures the functions of an input device through an electronic device, the electronic device stores the function configuration data in its local space so that it can execute the target function according to the function configuration data when interacting with the input device. And / or, the electronic device sends the function configuration data of the input device to a server. This serves two purposes: firstly, it enables data backup; secondly, the server provides the data to other electronic devices, ensuring that the same input device can perform its target function not only when interacting with one electronic device but also when interacting with another, thus guaranteeing that the same input device can be used across devices.

[0298] This application employs a method that, in response to a function configuration request for an input device interacting with an electronic device, displays a first interface including a device identifier for the input device and a corresponding function configuration area. Upon receiving a function configuration operation on the first interface, it obtains the target function configured for the input device based on the operation, generates function configuration data for the input device based on the device identifier and the target function, and stores the function configuration data in the local space of the electronic device, or sends the function configuration data to a server. This allows the electronic device to execute the target function based on the function configuration data when interacting with the input device. On one hand, this not only enables the reuse of a single input device but also expands the usage scenarios of the input device. On the other hand, users can interact with the electronic device for different functions by carrying a small number of input devices, improving the portability of the input devices. For businesses, this reduces the design cost of input devices; for customers, it eliminates the need to purchase additional input devices when buying electronic devices, thus reducing procurement costs. The following is an embodiment of an interaction method provided in this application.

[0299] Figure 28 shows a schematic flowchart of an interaction method provided in an embodiment of this application. As shown in Figure 28, the interaction method provided in this embodiment is applied to an electronic device with a capacitive touch-sensitive surface, which is a capacitive screen. The electronic device carries a variety of applications. The interaction method provided in this embodiment includes the following steps:

[0300] S210: In response to the target application's open command, display the target application's interface.

[0301] In one exemplary embodiment, the target application can be understood as an application capable of triggering a target function of the input device, such as a smart stamp, and the target application includes a whiteboard application, a drawing application, etc. After receiving an opening command from the target application, the electronic device responds to the opening command by displaying the application interface of the target application on its capacitive screen.

[0302] S220: When the input device is used to interact with the capacitive touchscreen, obtain the device identifier of the input device, which is used to interact with the electronic device.

[0303] When the target application's interface is displayed on the capacitive screen, if the electronic device detects a touch operation (i.e., a first touch operation) performed by the input device on the capacitive screen, it acquires the device identifier of the input device. The device identifier (i.e., ID) is, for example, encoded information. The process of acquiring the encoded information can be referred to the example above, and will not be repeated here.

[0304] S230: Obtain the function to be executed corresponding to the device identifier from the function configuration data cached by the target application.

[0305] The function configuration data cached by the target application comes from the function configuration data stored in the local space of the electronic device. In other words, the function configuration data cached by the target application is obtained from the local space of the electronic device, and the function configuration data stored in the local space of the electronic device is configured according to the data configuration method described above.

[0306] After obtaining the input device ID, the function configuration data cached by the target application is queried using the input device ID to obtain the function configuration data corresponding to the input device ID. For example, the function configuration data cached by the target application includes data 1-data 10, where the input device ID is specifically ID1, and the ID in data 2 is also ID1. Therefore, the function configuration data corresponding to the input device ID is data 2.

[0307] S240: Execute the target operation corresponding to the function to be executed in the application interface.

[0308] After obtaining the function configuration data corresponding to the input device ID, the function code corresponding to the input device ID can be obtained. The specific function can be obtained through the function code, that is, the function to be executed. Then, the electronic device executes the target operation corresponding to the function to be executed in the application interface.

[0309] As shown in Figure 29, this figure illustrates a scenario of interaction between an input device and an electronic device according to an embodiment of this application. 300 represents the application interface of the target application, 400 represents the input device, and 500 represents "circle". In scenario J1 of Figure 29, the user touches the input device with the capacitive screen of the electronic device. The electronic device obtains the ID (i.e., encoding information) of the input device, specifically ID1. The electronic device queries the cached function configuration data of the target application using the input device ID, obtaining the function configuration data corresponding to the input device ID as data 2. In data 2, the function code corresponding to ID1 is 1001. The first function corresponding to 1001 is drawing a graphic, and the second function is "circle", meaning the function to be executed is drawing a "circle". As shown in scenario J2 of Figure 29, the electronic device executes the target operation corresponding to drawing a "circle" in the application interface, thereby displaying a "circle" graphic at the location touched by the input device in the application interface, thus realizing the function of the input device drawing a "circle".

[0310] This application embodiment employs a technical solution that displays the application interface of the target application in response to the target application's opening command. When the input device is applied to the capacitive screen of the electronic device, the device identifier of the input device is obtained, and the function to be executed corresponding to the device identifier is obtained from the function configuration data cached by the target application according to the above data configuration method. The target operation corresponding to the function to be executed is then executed in the application interface. This solution enables the execution of the operation corresponding to the target function of each input device based on the function configuration data of the input device obtained by the above data configuration method. This ensures that the target function of each input device is accurately implemented, improves the reliability of implementing the target function of each input device, and makes the interaction between the electronic device and the input device more intelligent, convenient, and efficient.

[0311] Figure 30 shows a schematic flowchart of an interaction method provided in an embodiment of this application. This method is applied to an electronic device with a capacitive touchscreen. In this method, the first touch operation is an operation performed on a second interface displayed on the capacitive touchscreen, and the feedback information is the interface display. As shown in Figure 30, the method includes the following steps:

[0312] S110: In response to a first touch operation performed by the input device on the second interface displayed on the capacitive screen, determine the encoding information of the input device.

[0313] S120: Obtain the device identifier of the electronic device based on the encoding information.

[0314] S130: Controls the target element associated with the identifier of the capacitive touchscreen display device.

[0315] The target element includes at least one element configured for a specified application, and the second interface is the operation interface of the specified application mounted on the electronic device. The specified application is a specific application among multiple applications mounted on the electronic device. When the specified application is open, after the electronic device interacts with the input device, a specific operation can be triggered. This application uses a whiteboard application as an example for illustration. After the user opens the whiteboard application, the electronic device displays the operation interface of the whiteboard application, and the user can perform various operations on the whiteboard application's operation interface, such as writing, drawing, and inserting elements.

[0316] When developing a specific application, multiple elements (also known as operable elements) are configured for it. The input device is pre-associated with at least one of these elements; specifically, the unique device identifier of the input device is associated with at least one of the elements, generating an input device-element association table. These elements include drawing tools (e.g., rulers, erasers), graphics (e.g., lines, triangles, rectangles), emoticons, and other resources. When the capacitive screen of the electronic device displays the application's interface (i.e., the second interface), the elements can be displayed in the application's toolbar, allowing the user to drag and drop selected elements from the toolbar into the interface. Alternatively, when the capacitive screen displays the application's interface, the elements may not be displayed; the user can insert elements into the interface by interacting with it through the input device.

[0317] The following section provides a detailed explanation of how users interact with the user interface via input devices to insert elements into the interface.

[0318] When an electronic device's capacitive screen displays the interface of a specified application, if a first touch operation by an input device on the interface is detected, the input device's encoding information, i.e., the device identifier, is first obtained. Then, the device identifier is used to query an association table to obtain the elements associated with the device identifier, i.e., the target element associated with the input device. The target element is then displayed. This can also be understood as referring to the interface as a second interface; after responding to the first touch operation, the second interface is updated to a new second interface, which includes the target element.

[0319] Figure 31 illustrates a scenario where a ruler element is inserted via an input device. As shown in Figure 31, 101 represents the second interface, 102 represents the new second interface, 200 represents the input device (specifically a smart stamp), and 301 represents the target element (specifically a ruler). For example, before the input device contacts the second interface, the displayed second interface is blank. When the user contacts the input device with the second interface, if the first touch operation is detected as a contact action or a pressing action, the encoding information of the input device is obtained. This encoding information is used as a device identifier. The target element is determined to be a ruler through the device identifier, and the second interface is updated. The updated second interface includes the ruler, allowing the user to visually see the displayed ruler, thus achieving quick ruler insertion.

[0320] Optionally, after displaying the target element, the method may further include: receiving a second touch operation applied to the target element by the outer surface, adjusting the target element according to the second touch operation, controlling the capacitive screen to display the adjusted target element, and / or displaying text and / or patterns triggered by the adjusted target element.

[0321] For example, the second touch operation can be understood as the user contacting the outer surface of the input device with the location of the target element in the second interface; the second touch operation can be a single operation or multiple operations. After the target element is displayed, if the user needs to adjust the target element, such as adjusting the target element's position, orientation (including position, rotation angle, and state), or attribute information (including at least one of geometric attributes, visual attributes, and text attributes), if a second touch operation (which can be called an element adjustment operation) is detected on the outer surface of the input device acting on the target element, the adjustment operation on the target element is performed according to the second touch operation, and the adjusted target element is displayed, that is, the second interface is updated. The updated second interface includes the adjusted target element, and the adjusted target element can be seen intuitively.

[0322] In one possible implementation, adjusting the target element according to the second touch operation includes at least one of the following steps: S1201: adjusting the position of the target element according to the second touch operation;

[0323] S1202: Adjust the pose of the target element according to the second touch operation;

[0324] S1203: Adjust the attribute information of the target element according to the second touch operation.

[0325] The second touch operation is generated by the user through the control input device according to their own needs for using the target element.

[0326] For S1201, if the user has a need to adjust the target element, the second touch operation generated by the control input device and applied to the target element is used, that is, the second touch operation is an element position adjustment operation, and then the position of the second target element is adjusted according to the element position adjustment operation.

[0327] Figure 32 shows a schematic diagram of a scenario where the position of an element is adjusted via an input device. As shown in Figure 32, for example, the target element 301 displayed on the second interface 102 is a ruler. The second touch operation performed by the user on the ruler through the outer surface of the input device 200 is an element position adjustment operation, specifically, an operation to move the ruler to the right. After the second interface 102 is updated, the user can intuitively see the ruler after it has been moved to the right in the updated second interface 103.

[0328] For S1202, if the user has a need to adjust the target element, the second touch operation generated by the control input device and applied to the target element is used, that is, the second touch operation is an element posture adjustment operation, and then the posture of the second target element is adjusted according to the element posture adjustment operation.

[0329] Figure 33 shows a schematic diagram of a scenario where the posture of an element is adjusted via an input device. As shown in Figure 33, the target element 301 displayed on the second interface 102 is a ruler. The second touch operation performed by the user on the ruler via the input device 200 is the first element posture adjustment operation, which is to rotate the ruler counterclockwise by a certain angle. After the second interface 102 is updated, the user can intuitively see the ruler after it has been rotated counterclockwise by a certain angle on the updated second interface 103.

[0330] The target element's attribute information includes at least one of geometric attributes, visual attributes, and text attributes. Geometric attributes include size, visual attributes include color, transparency, etc., and text attributes include text content.

[0331] For S1203, if the user has a need to adjust the target element, a second touch operation generated by the control input device and applied to the target element is performed, i.e., the second touch operation is an element attribute adjustment operation, and then the attribute information of the second target element is adjusted according to the element attribute adjustment operation.

[0332] Taking adjusting the geometric properties of a target element as an example, Figure 34 shows a schematic diagram of a scenario where element properties are adjusted via an input device. As shown in Figure 34, the target element 301 displayed on the second interface 102 is a square. The second touch operation performed by the user on the square via the input device 200 is a geometric property adjustment operation, specifically a zoom-in operation. After the second interface 102 is updated, the user can intuitively see the zoomed-in square in the updated second interface 103. The operation of zooming in and zooming out of the square is similar and will not be elaborated further here.

[0333] Optionally, after displaying the adjusted target element, the corresponding text and / or pattern can be obtained, and the text and / or pattern can be displayed around the adjusted target element. As shown in Figure 33, the rotation angle (i.e., text) of the ruler can be displayed around the rotated ruler.

[0334] Furthermore, the input device can not only enlarge or shrink the target element, but also adjust only the length or width of the target element. Additionally, this application allows for the adjustment of the target element's attribute information in conjunction with user gestures while the input device is applied to the target element. For example, when the input device is applied to the target element, if the user's finger touches the second interface and then decreases the distance between their fingers, the target element can be reduced; conversely, if the user's finger touches the second interface and then increases the distance between their fingers, the target element can be enlarged.

[0335] Figure 35 shows a schematic flowchart of an interaction method provided in an embodiment of this application. In this method, the first touch operation is an operation performed on a third interface displayed on a capacitive screen, and the feedback information is the interface display. As shown in Figure 35, the method includes the following steps:

[0336] S110: In response to a first touch operation by the input device on a third interface displayed on the capacitive touchscreen, determine the encoding information of the input device.

[0337] S120: Obtain the device identifier of the electronic device based on the encoding information.

[0338] S130: The function type of the target function configured for the input device is determined based on the device identifier.

[0339] S140: Determine the application type of the application to which the third interface belongs and the operation type of the first touch operation.

[0340] S150: Based on the function type, application type, and operation type, respond to the first touch operation and control the capacitive screen to output the interface display triggered by the first touch operation.

[0341] In one exemplary embodiment, when an input device is detected acting on a third interface, if a user triggers a first touch operation on the third interface by manipulating the input device, the function type of the target function configured for the input device, the application type of the application to which the third interface belongs, and the operation type of the first touch operation are determined respectively. The third interface can be understood as the application interface of an application currently running on the electronic device. Application types are divided into designated applications and non-designated applications. For example, the application type of a whiteboard application in an electronic device is a designated application, while the application types of other applications in the electronic device besides the whiteboard application are non-designated applications. This embodiment uses the whiteboard application as the designated application and a browser application as the non-designated application for illustration.

[0342] The operation types include at least two. When the function of the input device remains unchanged, the response result output by the electronic device in response to one type of operation triggered by the input device differs from the response result in response to another type of operation triggered by the input device. For example, the operation types include a first preset operation and a second preset operation. Specifically, the first preset operation is a click operation, and the second preset operation is a movement operation. That is, the response result output by the electronic device after responding to the click operation is different from the response result after responding to the movement operation. This application embodiment uses an example where the operation types include a first preset operation and a second preset operation, with the first preset operation being a click operation and the second preset operation being a movement operation. Specifically, when the input device comes into contact with the capacitive screen of the input device, it can be considered that the input device has triggered a click operation.

[0343] The process of determining the function type of the target function configured for the input device includes: obtaining the device identifier of the input device; after obtaining the device identifier, querying the function configuration list through the device identifier to obtain the function type associated with the device identifier, thereby obtaining the function type of the target function. The process of obtaining the device identifier of the input device can be referred to the aforementioned example, and will not be repeated here.

[0344] Operation response strategies are pre-set based on the function type, application type, and operation type of the response input device. That is, one operation response strategy corresponds to one function type, one application type, and one operation type, resulting in multiple operation response strategies, and each operation response strategy corresponds to a different response result.

[0345] When the function type and application type are the same, but the operation type is different, the operation response strategy triggered by the input device will be different, and the output response result will also be different. Similarly, when the function type and operation type are the same, but the application type is different, the operation response strategy triggered by the input device will be different, and the output response result will also be different. The correspondence between function type, application type, operation type, and operation response strategy is shown in Table 2.

[0346] Table 2

[0347] After obtaining the function type of the target function, the application type of the application to which the third interface belongs, and the operation type of the first touch operation, the corresponding relationship is queried through the function type of the target function, the application type of the application to which the third interface belongs, and the operation type of the first touch operation to obtain the response strategy for the first touch operation, and the response strategy is executed to realize the response to the first touch operation.

[0348] In this embodiment, when the input device interacts with a third interface displayed on a capacitive touchscreen, the system responds to a first touch operation based on the function type of the target function configured for the input device, the application type of the application to which the third interface belongs, and the operation type of the first touch operation. This controls the capacitive touchscreen to output the interface display triggered by the first touch operation. On one hand, this ensures that when a user interacts with an application using the input device, the response to the operation triggered by the input device is determined by the function type of the function configured for the input device, the application type of the interface to which the input device interacts, and the operation type of the operation triggered by the input device. This ensures that the operation triggered when the input device interacts with the application is accurately responded to. On the other hand, this enables a single input device to interact with applications of different application types. Users can interact with different applications using the same input device, allowing seamless switching between various applications. This not only improves the versatility and adaptability of a single input device but also enhances its practical value and user experience.

[0349] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0350] S1211: If the function type is the third function, the application type is a non-specified application, and the operation type is the first preset operation, display the first window; wherein, the first window includes partial page content in the third interface;

[0351] S1212: If the function type is the third function, the application type is a non-specified application, and the operation type is the second preset operation, display the second window; wherein, the second window includes the global page content in the third interface.

[0352] For S1211, if the function type is the third function, the application type is the non-specified application, and the operation type is the first preset operation, then by querying Table 2 above through the third function, the non-specified application, and the first preset operation, the response strategy corresponding to the third function, the non-specified application, and the first preset operation is obtained, which is called the first target strategy. The first target strategy is used to instruct the electronic device to display the partial page content of the third interface in the floating window (hereinafter referred to as the window). Specifically, the partial page content of the third interface refers to the page content at the position where the input device contacts the third interface, and this page content is the content closest to the position where the input device contacts the third interface.

[0353] After the first target policy is obtained, the first touch operation is responded to according to the first target policy, so as to output a first response result of the first touch operation. FIG. 36 shows a schematic diagram of an exemplary scenario for outputting the first response result of the first touch operation. As shown in FIG. 36, for example, the page content of the third interface 101 is the poetry content of "Shanxi Village Tour", a user attaches the input device to a position P1 on the third interface 101, the electronic device detects that the input device triggers the first touch operation acting on the third interface 101, the first touch operation is a first preset operation (a click operation), after responding to the first preset operation according to the first target policy, a screenshot of the page content at the position P1 is captured, and a first window 201 is displayed. The text of "At midnight, I'll knock on your door with my walking stick at any time" is displayed in the first window 201, and the user can perform custom operations on the content in the first window 201, where the custom operations include editing, sharing, saving, annotating, and the like.

[0354] If the user triggers the first preset operation through the input device at another position on the third interface 101, the first window 201 will display the text content of each captured partial page content screenshot in the form of a list, supporting the user to view the text content of each partial page content screenshot in a list manner.

[0355] For S1212, if the function type is a third function, the application type is a non-specified application, and the operation type is a second preset operation, the aforementioned Table 2 is queried through the third function, the non-specified application and the second preset operation, to obtain a first touch operation response policy corresponding to the third function, the non-specified application and the second preset operation, which is referred to as a second target policy, and the second target policy is used to instruct the electronic device to display the global page content in the third interface in a second window.

[0356] After the second target policy is obtained, the first touch operation is responded to according to the second target policy, so as to output a second response result of the first touch operation. FIG. 37 shows a schematic diagram of an exemplary scenario for outputting the second response result of the first touch operation. As shown in FIG. 37, for example, the page content of the third interface 101 is the poetry content of "Shanxi Village Tour", the electronic device detects that the input device triggers the first touch operation acting on the third interface 101, the first touch operation is a second preset operation (a sliding operation), after responding to the second preset operation according to the second target policy, a screenshot of the global page content of the third interface 101 is captured, and a second window 202 is displayed. The text of "the poetry content of 'Shanxi Village Tour'" is displayed in the second window 202, and the user can perform custom operations on the content in the second window 202, where the custom operations include editing, sharing, saving, annotating, and the like. The user may use the input device to trigger the second preset operation at any position on the third interface.

[0357] By adopting the above-mentioned technical solutions based on S1211 and S1212, text extraction can be achieved quickly, improving the convenience of text extraction and enhancing the user experience.

[0358] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0359] S1221: If the function type is a third function, the application type is a specified application, and the operation type is a first preset operation, the third interface is updated to the first target interface, and a first content list and / or a first bird's-eye view of the first target interface are displayed; wherein, the first target interface includes partial page content in the third interface with markings, and the first content list includes partial page content with markings.

[0360] S1222: If the function type is the third function, the application type is the specified application, and the operation type is the second preset operation, update the third interface to the second target interface, and display the second content list and / or the second bird's-eye view of the second target interface; wherein, the second target interface includes the global page content in the third interface with the marker, and the second content list includes the global page content with the marker.

[0361] For S1221, if the function type is a third function, the application type is a specified application, and the operation type is a first preset operation, then by querying Table 2 above through the third function, the specified application, and the first preset operation, the first touch operation response strategy corresponding to the third function, the specified application, and the first preset operation is obtained, which is called the third target strategy. The third target strategy is used to instruct the electronic device to update the third interface to the first target interface, and to display the first content list and / or the first bird's-eye view of the first target interface. The first target interface includes partial page content in the third interface with markings, and the first content list includes partial page content with markings.

[0362] After the third target policy is obtained, the first touch operation is responded to according to the third target policy, so as to output a third response result of the first touch operation. FIG. 38 shows a schematic diagram of an exemplary scenario for outputting the third response result of the first touch operation. As shown in FIG. 38, for example, the page content of the third interface 101 is the content of the poem "The Village of West Mountain", the user attaches the input device to the position P2 of the third interface 101, the electronic device detects the first touch operation triggered by the input device and acting on the third interface 101, where the first touch operation is a first preset operation (a click operation). After responding to the first preset operation according to the third target policy, the third interface 101 is updated to the first target interface 102, and then the first content list L1 and the first bird's-eye view F1 of the first target interface 102 are displayed. The first target interface 102 includes partial page content in the third interface 101 that carries a mark, specifically, the line "At dusk, leaning on a staff, I knock on the door at will" in the third interface 101 is marked, and the mark is represented by a five-pointed star pattern "☆", and the first target interface 102 includes the marked line "At dusk, leaning on a staff, I knock on the door at will" with "☆". The text of the marked line "At dusk, leaning on a staff, I knock on the door at will" with "☆" is displayed in the first content list L1, and the user can perform custom operations on the content in the first content list L1, where the custom operations include editing, sharing, saving, annotating and the like.

[0363] If the user triggers the first preset operation through the input device at another position on the first target interface 102, the partial page content at the other position on the first target interface 102 will also be marked and added to the first content list L1, so that the user can view the text content of each partial page content screenshot in the list. For the first bird's-eye view F1, the user can intuitively see which page contents in the first target interface 102 carry marks through the first bird's-eye view F1, and can quickly locate the position where the specific page content is located through the first bird's-eye view F1.

[0364] For S1222, if the function type is the third function, the application type is a specified application, and the operation type is a second preset operation, the above-mentioned Table 2 is queried through the third function, the specified application and the second preset operation to obtain a first touch operation response policy corresponding to the third function, the specified application and the second preset operation, which is referred to as a fourth target policy. The fourth target policy is used to instruct the electronic device to update the third interface to a second target interface, and display a second content list and / or a second bird's-eye view of the second target interface. The second target interface includes the global page content in the third interface that carries marks, and the second content list includes the marked global page content.

[0365] After obtaining the fourth target strategy, the first touch operation is responded to according to the fourth target strategy, thereby outputting the fourth response result of the first touch operation. Figure 39 shows an exemplary scenario diagram of outputting the fourth response result of the first touch operation. As shown in Figure 39, for example, the page content of the third interface 101 is the poem "Visiting Shanxi Village". The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a second preset operation (slide operation). After responding to the second preset operation according to the fourth target strategy, the third interface 101 is updated to the second target interface 103, and then the second content list L2 and the second bird's-eye view F2 of the second target interface 103 are displayed.

[0366] The second target interface 103 includes all page content of the third interface 101 with markings. Specifically, the poem content of "Visiting Shanxi Village" in the third interface 101 is marked with a five-pointed star "☆". The first target interface 102 includes the poem content of "Visiting Shanxi Village" marked with "☆". The second content list L2 displays the poem content of "Visiting Shanxi Village" marked with "☆". Users can customize the content in the second content list L2, including editing, sharing, saving, and annotating. The second bird's-eye view F2 allows users to visually see that all page content in the first target interface 102 is marked, and users can quickly locate the specific page content using the second bird's-eye view F2.

[0367] By adopting the above-mentioned technical solutions based on S1221 and S1222, page content can be quickly marked, improving the convenience of marking page content and enhancing the user experience.

[0368] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0369] S1231: If the function type is the fourth function, the application type is a non-specified application, and the operation type is the first preset operation, a third window is displayed; wherein, the third window includes first auxiliary content and partial page content in the third interface, and the first auxiliary content is used to assist in understanding the partial page content;

[0370] S1232: If the function type is the fourth function, the application type is the specified application, and the operation type is the first preset operation, the third interface is updated to the third target interface, and the fourth window is displayed; wherein, the fourth window includes the second auxiliary content and the partial page content in the third interface, the second auxiliary content is used to assist in understanding the partial page content in the third interface, and the third target interface includes at least part of the content in the second auxiliary content.

[0371] For S1231, if the function type is the fourth function, the application type is a non-specified application, and the operation type is the first preset operation, then by querying Table 2 above using the fourth function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the fourth function, the non-specified application, and the first preset operation is obtained, which is called the fifth target strategy. The fifth target strategy is used to instruct the electronic device to display a third window, which includes the first auxiliary content and the partial page content in the third interface. After obtaining the fifth target strategy, the first touch operation is responded to according to the fifth target strategy, thereby outputting the fifth response result of the first touch operation. Figure 40 illustrates an exemplary scenario of the fifth response result of the first touch operation. As shown in Figure 40, for example, the page content of the third interface 101 includes "2x+5=6, find the solution for x", and other content is not shown. The user places the input device at position P3 of the third interface 101. The electronic device detects that the input device triggers the first touch operation on the third interface 101. The first touch operation is the first preset operation (click operation). After responding to the first preset operation according to the fifth target strategy, the third window 203 is displayed. The third window 203 includes a portion of the page content in the third interface 101, namely "2x+5=6, find the solution for x". The first auxiliary content includes the problem-solving ideas, problem-solving process, answer and other related knowledge content for calculating "2x+5=6".

[0372] When the content of a partial page in the third interface is other than formulas and test questions, the first auxiliary content in the third window includes explanations, translations, and sources of the content on the partial page.

[0373] For S1232, if the function type is the fourth function, the application type is the specified application, and the operation type is the first preset operation, then by querying Table 2 above through the fourth function, the specified application, and the first preset operation, the first touch operation response strategy corresponding to the fourth function, the specified application, and the first preset operation is obtained, which is called the sixth target strategy. The sixth target strategy is used to instruct the electronic device to update the third interface to the third target interface and to display the fourth window. The fourth window includes the second auxiliary content and the partial page content in the third interface. The third target interface includes at least part of the content in the second auxiliary content.

[0374] After obtaining the sixth objective strategy, the first touch operation is responded to according to the sixth objective strategy, thereby outputting the sixth response result of the first touch operation. Figure 41 shows an exemplary scenario diagram of outputting the sixth response result of the first touch operation. As shown in Figure 41, for example, the page content of the third interface 101 includes "2x+5=6, find the solution for x", and other content is not shown. The user places the input device on position P4 of the third interface 101. The electronic device detects that the input device triggers the first touch operation on the third interface 101. The first touch operation is the first preset operation (click operation). After responding to the first preset operation according to the sixth objective strategy, the third interface 101 is updated to the third target interface 104, and then the fourth window 204 is displayed. The fourth window 204 includes a part of the page content in the third interface 101, namely "2x+5=6, find the solution for x". The second auxiliary content includes the problem-solving ideas, problem-solving process, answer and other related knowledge content for calculating "2x+5=6". The third target interface 104 includes the problem-solving process of "2x+5=6".

[0375] When the content of a partial page in the third interface is other than formulas and test questions, the first auxiliary content in the third window and the third target interface includes explanations, translations, and sources of the content on the partial page.

[0376] By adopting the above-mentioned technical solutions based on S1231 and S1232, page content can be quickly calculated and interpreted, making it easier for users to understand the page content and improving the user experience.

[0377] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0378] S1241: If the function type is the fifth function, the application type is a non-specified application, and the operation type is the first preset operation, output the audio information of the partial page content in the third interface;

[0379] S1242: If the function type is the fifth function, the application type is a non-specified application, and the operation type is the second preset operation, output the audio information of the global page content in the third interface.

[0380] For S1241, if the function type is the fifth function, the application type is the non-specified application, and the operation type is the first preset operation, then by querying Table 2 above through the fifth function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the fifth function, the non-specified application, and the first preset operation is obtained, which is called the seventh target strategy. The seventh target strategy is used to instruct the electronic device to output the audio information of the local page content at the position where the input device and the third interface are in contact in the third interface.

[0381] After the seventh target policy is obtained, the first touch operation is responded to according to the seventh target policy, so as to output a seventh response result of the first touch operation. As shown in FIG. 38, for example, the page content of the third interface 101 is the poetry content of "Visiting a Village at the Foot of the Mountain", the user attaches the input device to the position P2 of the third interface 101, the electronic device detects the first touch operation triggered by the input device and acting on the third interface 101, the first touch operation is a first preset operation (a click operation), and after the first preset operation is responded to according to the seventh target policy, a reading tool is invoked to read aloud "At midnight, with a cane, I'll knock on your door when I please".

[0382] For S1242, if the function type is a fifth function, the application type is a non-specified application, and the operation type is a second preset operation, the above Table 2 is queried through the fifth function, the non-specified application and the second preset operation, to obtain a first touch operation response policy corresponding to the fifth function, the non-specified application and the second preset operation, which is referred to as an eighth target policy, and the eighth target policy is used to instruct the electronic device to output audio information of the global page content in the third interface.

[0383] After the eighth target policy is obtained, the first touch operation is responded to according to the eighth target policy, so as to output an eighth response result of the first touch operation. As shown in FIG. 38, for example, the page content of the third interface 101 is the poetry content of "Visiting a Village at the Foot of the Mountain", the user uses the input device to trigger the first touch operation acting on the third interface 101 at any position on the third interface 101, the first touch operation is a first preset operation (a sliding operation), and after the second preset operation is responded to according to the eighth target policy, a reading tool is invoked to read aloud "the poetry content of 'Visiting a Village at the Foot of the Mountain'".

[0384] In a possible implementation manner, the above-mentioned responding to the first touch operation according to the function type, the application type and the operation type includes the following steps:

[0385] S1251: If the function type is a sixth function, the application type is a non-specified application, and the operation type is a first preset operation, display a fifth window, where the fifth window includes a search result obtained by using local page content in the third interface as search information;

[0386] S1252: If the function type is a sixth function, the application type is a non-specified application, and the operation type is a second preset operation, display a sixth window, where the sixth window includes a search result obtained by using global page content in the third interface as search information.

[0387] For S1251, if the function type is the sixth function, the application type is a non-specified application, and the operation type is the first preset operation, then by querying Table 2 above through the sixth function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the sixth function, the non-specified application, and the first preset operation is obtained, which is called the ninth target strategy. The ninth target strategy is used to instruct the electronic device to display the fifth window. The fifth window includes the search results obtained by using the partial page content in the third interface as search information.

[0388] After obtaining the ninth target strategy, the first touch operation is responded to according to the ninth target strategy, thereby outputting the ninth response result of the first touch operation. Figure 42 shows an exemplary scenario diagram of outputting the ninth response result of the first touch operation. As shown in Figure 42, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields." The user places the input device on position P5 of the third interface 101. The electronic device detects that the input device triggers the first touch operation on the third interface 101. The first touch operation is the first preset operation (click operation). After responding to the first preset operation according to the tenth target strategy, the fifth window 205 is displayed. The fifth window 205 includes the search results obtained with "tablet computer" as the search information, namely "Search results: Tablet computer is a portable mobile device, between smartphones and laptops, and its common uses include entertainment, learning, office, etc."

[0389] For S1252, if the function type is the sixth function, the application type is the non-specified application, and the operation type is the second preset operation, then by querying Table 2 above through the sixth function, the non-specified application, and the second preset operation, the first touch operation response strategy corresponding to the sixth function, the non-specified application, and the second preset operation is obtained, which is called the tenth target strategy. The tenth target strategy is used to instruct the electronic device to display the fifth window. The fifth window includes the search results obtained by using the global page content in the third interface as search information.

[0390] After obtaining the tenth target strategy, the first touch operation is responded to according to the tenth target strategy, thereby outputting the tenth response result of the first touch operation. Figure 43 shows an exemplary scenario diagram of outputting the tenth response result of the first touch operation. As shown in Figure 43, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields: ......". The electronic device detects that the input device triggers the first touch operation on the third interface 101. The first touch operation is the second preset operation (slide operation). After responding to the second preset operation according to the tenth target strategy, the sixth window 206 is displayed. The sixth window 206 includes the search results obtained with the search information "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields", namely "Search results: The rapid development of touch screen technology has indeed brought about a wide range of applications and changes, especially in education, office and entertainment fields. The following are the specific applications and impacts of touch screen technology in these fields: ......". The above search results are obtained by calling the search function (such as the circle search function).

[0391] By adopting the technical solutions based on S1251 and S1252 described above, page content searching can be quickly achieved, improving the user experience. Furthermore, the translation of page content is achieved in the same way as the technical solutions based on S1251 and S1252 described above, and will not be repeated in the embodiments of this application.

[0392] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0393] S1261: If the function type is the seventh function, the application type is a non-specified application, and the operation type is the first preset operation, a seventh window is displayed. The seventh window includes the first content after structuring the partial page content in the third interface. S1262: If the function type is the seventh function, the application type is a non-specified application, and the operation type is the second preset operation, an eighth window is displayed. The eighth window includes the second content after structuring the global page content in the third interface. The structured content mentioned in this application can be understood as a mind map, also known as a brain map.

[0394] For S1261, if the function type is the seventh function, the application type is the non-specified application, and the operation type is the first preset operation, then by querying Table 2 above through the seventh function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the seventh function, the non-specified application, and the first preset operation is obtained, which is called the eleventh target strategy. The eleventh target strategy is used to instruct the electronic device to display the seventh window. The seventh window includes the first content after structuring the partial page content in the third interface, which is called the first mind map.

[0395] After obtaining the eleventh target strategy, the first touch operation is responded to according to the eleventh target strategy, thereby outputting the eleventh response result of the first touch operation. Figure 44 shows an exemplary scenario diagram of outputting the eleventh response result of the first touch operation. As shown in Figure 44, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields." The user places the input device (not shown in Figure 44) at position P6 of the third interface 101. The electronic device detects that the input device triggers the first touch operation on the third interface 101. The first touch operation is the first preset operation (click operation). After responding to the first preset operation according to the eleventh target strategy, the seventh window 207 is displayed. The seventh window 207 includes a first mind map N1 about "tablet computer".

[0396] For S1262, if the function type is the seventh function, the application type is the non-specified application, and the operation type is the second preset operation, then by querying Table 2 above through the seventh function, the non-specified application, and the second preset operation, the first touch operation response strategy corresponding to the seventh function, the non-specified application, and the second preset operation is obtained, which is called the twelfth target strategy. The twelfth target strategy is used to instruct the electronic device to display the eighth window. The eighth window includes the second content after structuring the global page content in the third interface, which is called the second mind map.

[0397] After obtaining the twelfth objective strategy, the first touch operation is responded to according to the twelfth objective strategy, thereby outputting the twelfth response result of the first touch operation. Figure 45 shows an exemplary scenario diagram of outputting the twelfth response result of the first touch operation. As shown in Figure 45, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields". The electronic device detects that the input device triggers the first touch operation on the third interface 101. The first touch operation is the second preset operation (slide operation). After responding to the second preset operation according to the twelfth objective strategy, the eighth window 208 is displayed. The eighth window 208 includes a second mind map N2 about "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields".

[0398] By adopting the above-mentioned technical solutions based on S1261 and S1262, structured information of page content can be generated quickly, improving the user experience.

[0399] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0400] S1271: If the function type is the seventh function, the application type is the specified application, and the operation type is the first preset operation, the third interface is updated to the fourth target interface. The fourth target interface includes the third content after the partial page content in the third interface has been structured.

[0401] S1272: If the function type is the seventh function, the application type is the specified application, and the operation type is the second preset operation, the third interface is updated to the fifth target interface. The fifth target interface includes the fourth content after the global page content in the third interface has been structured.

[0402] For S1271, if the function type is the seventh function, the application type is the specified application, and the operation type is the first preset operation, then by querying Table 2 above through the seventh function, the specified application, and the first preset operation, the first touch operation response strategy corresponding to the seventh function, the specified application, and the first preset operation is obtained, which is called the thirteenth target strategy. The thirteenth target strategy is used to instruct the electronic device to update the third interface to the fourth target interface. The fourth target interface includes the third content after structuring the partial page content in the third interface, which is called the third mind map.

[0403] After obtaining the thirteenth target strategy, the first touch operation is responded to according to the thirteenth target strategy, thereby outputting the thirteenth response result of the first touch operation. Figure 46 shows an exemplary scenario diagram of outputting the thirteenth response result of the first touch operation. As shown in Figure 46, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields." The user places the input device (on position P7 of the third interface 101). The electronic device detects the input device triggering the first touch operation on the third interface 101. The first touch operation is the first preset operation (click operation). After responding to the first preset operation according to the thirteenth target strategy, the third interface 101 is updated to the fourth target interface 105. The fourth target interface 105 includes a third mind map N3 about "tablet computer".

[0404] For S1272, if the function type is the seventh function, the application type is the specified application, and the operation type is the second preset operation, then by querying Table 2 above through the seventh function, the specified application, and the second preset operation, the first touch operation response strategy corresponding to the seventh function, the specified application, and the second preset operation is obtained, which is called the fourteenth target strategy. The fourteenth target strategy is used to instruct the electronic device to update the third interface to the fifth target interface. The fifth target interface includes the fourth content after structuring the global page content in the third interface, which is called the fourth mind map.

[0405] After obtaining the fourteenth target strategy, the first touch operation is responded to according to the fourteenth target strategy, thereby outputting the fourteenth response result of the first touch operation. Figure 47 shows an exemplary scenario diagram of outputting the fourteenth response result of the first touch operation. As shown in Figure 47, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields". The electronic device detects that the input device triggers the first touch operation on the third interface 101. The first touch operation is the second preset operation (slide operation). After responding to the second preset operation according to the fourteenth target strategy, the third interface 101 is updated to the fifth target interface 106. The fifth target interface 106 includes a fourth mind map N4 about "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields".

[0406] By adopting the above-mentioned technical solutions based on S1271 and S1272, structured information of page content can be generated quickly, and structured information of page content can be quickly inserted into the interface, thereby improving the user experience.

[0407] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0408] S1281: If the function type is the eighth function, the application type is the specified application, and the operation type is the first preset operation, determine whether the input device is acting on the preset area in the third interface;

[0409] S1282: If the input device operates on a preset area in the third interface, the third interface is updated to the sixth target interface, which includes option icons for the data to be transmitted.

[0410] S1283: In response to the selection operation of the option icon, the data to be transmitted is associated with the device identifier of the input device to obtain associated data, and the associated data is sent to the server. In the case of interaction between the input device and other electronic devices, if the input device triggers a data import operation, the other electronic devices retrieve the associated data from the server based on the device identifier. If the function type is the eighth function, the application type is a non-specified application (specifically, the finder application), and the operation type is the first preset operation, then by querying Table 2 above using the eighth function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the eighth function, the specified application, and the first preset operation is obtained, referred to as the fifteenth target strategy. The fifteenth target strategy is used to instruct the electronic device to update the third interface to the sixth target interface when it determines that the input device is acting on a preset area in the third interface, and when detecting the selection operation of the option icon for data to be transmitted acting on the sixth target interface, associate the data to be transmitted with the device identifier of the input device to obtain associated data, and send the associated data to the server for storage.

[0411] After obtaining the fifteenth target strategy, the first touch operation is responded to according to the fifteenth target strategy, thereby outputting the fifteenth response result of the first touch operation. Figure 48 shows an exemplary scenario diagram of outputting the fifteenth response result of the first touch operation. As shown in Figure 48, for example, the third interface 101 includes a preset area P8. Electronic device A detects that the input device 300 triggers a first touch operation on the third interface 101. The first touch operation is a second preset operation (slide operation), and the input device 300 acts on the preset area P8. After responding to the second preset operation according to the fifteenth target strategy, the third interface 101 is updated to the sixth target interface 107. The sixth target interface 107 includes the preset area P8 and option icons for the data to be transmitted, namely file 1-file 3. For example, if the user selects file 1, electronic device A detects the selection operation of the option icon of file 1, associates the device identifier of the input device 300 with file 1, obtains associated data 1, and then sends associated data 1 to the server. The server stores associated data 1.

[0412] When a user interacts with electronic device B (another electronic device) using input device 300, after input device 300 operates on a preset area P9 in the interface of a non-designated application (finder application) displayed on the capacitive screen of electronic device B, electronic device B obtains the device identifier of input device 300, adds the device identifier of input device 300 to a data acquisition request, and sends the data acquisition request to the server. The server obtains the device identifier of input device 300 from the data acquisition request, and then queries the stored associated data based on the device identifier of input device 300 to obtain associated data 1. The server then sends file 1 from associated data 1 to electronic device B, and electronic device B stores file 1 in its local space. This realizes the import of data from one electronic device to another electronic device using an input device, that is, it realizes cross-device data transmission using an input device.

[0413] Optionally, if the input device 300 has a power supply and storage function, when electronic device A detects the selection operation of the option icon for file 1, it sends file 1 to the input device 300, and the input device 300 stores file 1. When the user interacts with electronic device B using the input device 300, after the input device 300 operates on the preset area P9 in the interface of the non-designated application (finder application) displayed on the capacitive screen of electronic device B, the input device 300 sends file 1 to electronic device B, and electronic device B stores file 1 in its local space. This realizes the import of data from one electronic device to another using the input device, that is, it realizes cross-device data transfer using the input device.

[0414] Figure 49 shows a schematic flowchart of an interaction method provided in an embodiment of this application. In this method, the first touch operation is an operation performed on a fourth interface displayed on a capacitive screen, and the feedback information is the interface display. As shown in Figure 49, the method includes the following steps:

[0415] S110: In response to a first touch operation by the input device on the fourth interface of the capacitive touchscreen display, determine the encoding information of the input device.

[0416] S120: Obtain the device identifier of the electronic device based on the encoding information.

[0417] S130: Determine the target function configured for the input device based on the device identifier.

[0418] S140: Obtain user information corresponding to the target function in the input device.

[0419] S150: Responds to the first touch operation based on user information to execute the target function and controls the capacitive screen to output the interface display triggered by the execution of the target function.

[0420] In this system, since the input device is pre-configured with target functions and user information, the electronic device pre-stores configuration data generated based on the target functions and user information configured on the input device. After determining the device identifier of the input device, the electronic device queries the stored configuration data through the device identifier to obtain the function associated with the input device identifier, i.e., the target function configured on the input device. Alternatively, the input device sends its own configuration data to the electronic device. After determining the device identifier of the input device, the electronic device queries the configuration data sent by the input device through the device identifier to obtain the function associated with the input device ID, i.e., the target function configured on the input device.

[0421] After obtaining the target function configured for the input device, the configuration data is queried based on the target function configured for the input device to obtain the user information corresponding to the target function configured for the input device, i.e., the user information configured for the input device is obtained. Then, the target function configured for the input device is executed based on the user information configured for the input device. This realizes the use of user information as input for function execution. When the user interacts with the electronic device using the input device, the electronic device can quickly execute the function that needs to be implemented based on the user information, ensuring the immediacy of function execution and allowing the user to feel that the function is responded to quickly.

[0422] For example, for the same input device, after configuring its configuration data, the input device corresponds to only one target function, and the user information corresponding to that target function is only used by the electronic device to execute the target function configured for the input device. Taking login and resource transfer functions as examples, if the target function configured for the input device is login, the user information configured for the input device includes information related to account login, such as authentication information. If the target function configured for the input device is resource transfer, the user information configured for the input device includes information related to receiving resources, such as the user account (this user account is referred to as the receiving account of the resource recipient).

[0423] Furthermore, for the same input device, assuming its current target function and user information are already determined, if other functions are needed, the current target function of the input device must be changed to the other function via an electronic device or other terminal, and the current user information must be changed to the user information corresponding to the other function. For example, if the current target function of the input device is login and the user information is authentication information, and the user wants to use the resource transfer function, the current target function of the input device must be changed from login to resource transfer via an electronic device or other terminal, and the authentication information must be changed to the user account corresponding to the resource transfer function.

[0424] In one possible implementation, when the target function configured on the input device is a login function, and the user information corresponding to the target function includes authentication information, the above-mentioned execution of the target function based on the user information includes the following steps:

[0425] If the input device triggers a first touch operation on the fourth interface, the user logs into the application belonging to the fourth interface based on the authentication information.

[0426] The fourth interface refers to the login interface of an application, such as the login interface of an educational application. When an input device is applied to the fourth interface, if the first touch operation (such as a click operation) triggered by the input device is detected, the legality and correctness of the identity verification information are verified. After the legality and correctness verification is passed, the user logs into the educational application, thus realizing quick login to the application.

[0427] In one possible implementation, the above-mentioned method of logging into the application to which the fourth interface belongs based on authentication information if the input device triggers a first touch operation on the fourth interface includes the following steps: if the input device triggers a first touch operation on the fourth interface, determine whether the input device is acting on a preset area of ​​the fourth interface; if yes, log into the application to which the fourth interface belongs based on authentication information; if no, do not execute the target function, and continue to execute the step of determining whether the input device is acting on a preset area of ​​the fourth interface.

[0428] Figure 50 illustrates a scenario of logging into an application using an input device. As shown in Figure 50, assuming the fourth interface 101 is the login interface for an educational application, after the input device 103 triggers a first touch operation on the fourth interface 101, it is determined whether the input device 103 operates on a preset area 102 of the fourth interface 101. If it is determined that the input device 103 operates on the preset area 102, it means that the input device 103 triggered a first touch operation in the preset area 102, and it is considered that the user needs to log in to the educational application. Then, the user logs in to the educational application based on the authentication information in the input device 103. The username and password in Figure 50 are generally not directly displayed, but are represented by "××××××".

[0429] In one possible implementation, when the target function configured on the input device is a resource transfer function, and the user information corresponding to the target function includes a user account (referring to the receiving account of the resource recipient), the above-mentioned execution of the target function based on user information includes the following steps: if the input device triggers a first touch operation on the fourth interface, the target resource is determined from the data resources of the fourth interface according to the first touch operation; the target window is displayed; in response to the selection operation of the user account in the target window, the target resource is transferred to the user account selected by the selection operation.

[0430] The input device triggers a first touch operation on the fourth interface. In response to the first touch operation, the target resource is determined from the data resources displayed on the fourth interface. The target resource includes at least a portion of the data resources. That is, the target resource may be all the data resources displayed on the fourth interface or only a portion of the data resources. The data resources displayed on the fourth interface include page content (such as text, images, etc.), storage files stored on the electronic device (such as pictures, multimedia files, etc.), and so on.

[0431] After the target resource is identified, a target window, which is a floating window, is displayed. The target window includes user information configured on the input device. If this user information includes at least one user account, the target window will also include at least one user account. The user account in the target window can be understood as the receiving account of the resource recipient. The user can select one or more accounts from the target window as the target account (i.e., the account ultimately selected by the user to receive the target resource). After receiving a selection operation on the user account in the target window, the user account selected by the selection operation is obtained, i.e., the target account selected by the user. The target resource is then transferred to the target account, enabling rapid retrieval of the resource recipient's user account. This eliminates the tedious process of manually retrieving the resource recipient's user account, improving the efficiency of resource transfer.

[0432] It is worth noting that the resource "transfer" mentioned in the embodiments of this application includes sending, sharing, and forwarding resources. In one possible implementation, when the target function configured on the input device is a resource transfer function, and the user information corresponding to the target function includes a user account, the above-mentioned execution of the target function based on the user information includes the following steps:

[0433] If the input device triggers a first touch operation on the fourth interface, the target resource is determined from the data resources of the fourth interface based on the first touch operation;

[0434] The target resource is passed to the user account configured on the input device, and the target window is displayed, which includes the receiving account for receiving the target resource.

[0435] The input device triggers a first touch operation on the fourth interface. In response to the first touch operation, the target resource is determined from the data resources displayed on the fourth interface. The target resource includes at least a portion of the data resources. That is, the target resource may be all the data resources displayed on the fourth interface or a portion of the data resources.

[0436] Once the target resource is identified, it is directly transferred to the user account configured on the input device. At the same time, the target window is displayed, allowing the user to see which other user accounts the target resource has been transferred to. This enables quick resource transfer, eliminating the tedious process of manually transferring resources and improving the efficiency of resource transfer.

[0437] The type of application to which the fourth interface belongs differs, resulting in different types of target resources.

[0438] For example, application types include specified applications and unspecified applications. Specified applications are those that store files, such as the Finder application. Unspecified applications are those other than specified applications that include various page content, such as browser applications. If the application type of the fourth interface is an unspecified application, the resource type of the target resource is page content; if the application type of the fourth interface is a specified application, the resource type of the target resource is an independent file.

[0439] In one possible implementation, when the data resource is page content and the application type of the application to which the fourth interface belongs is a non-specified application, the above-mentioned determination of the target resource from the data resource of the fourth interface based on the first touch operation includes the following steps:

[0440] If the first touch operation is a click operation on a part of the page content, the part of the page content clicked by the click operation is determined as the target resource.

[0441] If the data resource displayed on the fourth interface is page content and the application type of the application to which the fourth interface belongs is not a specified application, and if the first touch operation is a click operation on a local part of the page content, the local part clicked by the click operation is extracted from the page content, and the extracted local part is determined as the target resource. The extracted local part can be in the form of text, screenshots, etc.

[0442] Taking the user account configured on the input device as an electronic address as an example, Figure 51 shows an exemplary scenario of using the input device to realize resource transfer. As shown in Figure 51, the page content displayed in the fourth interface 101 is an essay about "Spring is coming". The user clicks on a part of the page content using the input device ("Spring flowers will bloom, and birds are free" in the dashed box 105 in Figure 51). The part of the content in the dashed box 105 is then identified as the target resource. Then the target window 106 is displayed, which displays addresses 1-3. After seeing the addresses displayed in the target window 106, the user selects address 1. That is, the user corresponding to address 1 is the resource recipient of the target resource, and the target resource is then transferred to address 1. This facilitates the quick transfer of the part of the page content in the fourth interface.

[0443] In one possible implementation, when the data resource is page content and the application type of the application to which the fourth interface belongs is a non-specified application, the above-mentioned determination of the target resource from the data resource of the fourth interface based on the first touch operation includes the following steps:

[0444] If the first touch operation is a swipe operation applied to any area of ​​the fourth interface, the global page content of the fourth interface will be determined as the target resource.

[0445] If the data resource displayed on the fourth interface is page content and the application type of the application to which the fourth interface belongs is a non-specified application, and if the first touch operation is a swipe operation on any area of ​​the fourth interface (i.e., the user swipes on any area of ​​the fourth interface using an input device), the global page content of the fourth interface is extracted, and the extracted global page content is determined as the target resource. The extracted global page content can be in text format, screenshot format, etc.

[0446] Taking the user account configured on the input device as an electronic address as an example, Figure 52 illustrates another exemplary scenario of resource transfer using the input device. As shown in Figure 52, the page content displayed in the fourth interface 101 is an essay about "Spring is Coming". The user uses the input device 103 to slide from left to right in the left area of ​​"Spring is Coming" in the fourth interface 101, thus identifying the entire content about "Spring is Coming" as the target resource. Then, the target window 107 is displayed, showing addresses 1-3. After seeing the addresses displayed in the target window 107, the user selects address 1 and address 2, meaning the users corresponding to addresses 1 and 2 are the resource recipients of the target resource. This allows the target resource to be transferred to addresses 1 and 2, facilitating the quick transfer of global page content in the fourth interface. The checkmark "√" indicates address selection.

[0447] In one possible implementation, when the data resource is a storage file of the electronic device and the application type of the application to which the fourth interface belongs belongs to a specified application, the above steps for determining the target resource from the data resource of the fourth interface based on the first touch operation are as follows:

[0448] If the first touch operation is a click operation on a file icon, the file clicked by the click operation in the stored files is determined as the target resource.

[0449] If the data resource displayed on the fourth interface is a storage file stored on the electronic device and the application type of the application to which the fourth interface belongs is a specified application, then if the first touch operation is a click operation on the file icon in the fourth interface, it is considered that the user has selected a file, and the file clicked by the click operation in the storage file is identified as the target resource.

[0450] Taking the user account configured on the input device as the electronic address as an example, Figure 53 shows another exemplary scenario of using the input device to realize resource transfer. As shown in Figure 53, the fourth interface 101 displays three storage files, namely file 1 to file 3. When the user clicks the file icon of file 1 on the fourth interface 101 using the input device 103, file 1 is identified as the target resource. Then, the target window 108 is displayed, which displays addresses 1 to 3. After seeing the addresses displayed in the target window 108, the user selects address 1. That is, the user corresponding to address 1 is the resource recipient of the target resource, and the target resource is transferred to address 1. This facilitates the quick transfer of storage files of electronic devices.

[0451] Figure 54 shows a schematic flowchart of an interaction method provided in an embodiment of this application. In this method, the first touch operation is an operation performed on the fifth interface displayed on the capacitive screen, and the feedback information is the interface display. As shown in Figure 54, the method includes the following steps:

[0452] S110: Upon detecting that the input device has triggered a first touch operation on the fifth interface, the encoding information of the input device is determined;

[0453] S120: Determine the device identifier of the input device based on the encoding information.

[0454] S130: Determine the target function configured for the input device based on the device identifier.

[0455] S140: Determine the target object from the objects to be started in the electronic device based on the target function.

[0456] S150: Responds to the first touch operation to launch the target object and controls the capacitive screen to output the interface display triggered by launching the target object.

[0457] The objects to be started include applications and / or functional modules.

[0458] In one exemplary embodiment, the interface currently displayed on the capacitive touchscreen of the electronic device is referred to as the fifth interface. The fifth interface can be the desktop of the electronic device or the interface of a certain application. If a first touch operation triggered by an input device on the fifth interface displayed on the capacitive touchscreen is detected, the encoding information of the input device is obtained, and the device identifier of the input device is determined based on the encoding information. The determination of the target function configured for the input device includes: since the target function has been configured for the input device in advance, the target function is associated with the ID of the input device. The electronic device has stored configuration data about the input device in advance. After determining the ID of the input device, the electronic device queries the stored configuration data through the ID of the input device to obtain the function associated with the ID of the input device, that is, to obtain the target function configured for the input device. Alternatively, the input device sends its own configuration data to the electronic device. After determining the ID of the input device, the electronic device queries the configuration data sent by the input device through the ID of the input device to obtain the function associated with the ID of the input device, that is, to obtain the target function configured for the input device.

[0459] The objects to be launched include applications and / or functional modules in electronic devices. After obtaining the target function configured on the input device, the configuration data is queried according to the target function configured on the input device to obtain the identifier corresponding to the target function configured on the input device, called the target object identifier. Then, the object with the object identifier of the target object identifier is obtained from the objects to be launched, thus obtaining the target object. For example, if the target object identifier is identifier 1, and the object identifier of application 1 in the objects to be launched is identifier 1, then application 1 is the target object; if the target object identifier is identifier 2, and the object identifier of functional module 2 in the objects to be launched is identifier 2, then functional module 2 is the target object.

[0460] After identifying the target object from the list of objects to be launched, the target object is then started. From the user's perspective, assuming the fifth interface is the desktop of an electronic device, for example, if the target object is a whiteboard application, the whiteboard application will immediately open on the desktop after the user places the input device there; if the target object is a calculator, the calculator will immediately open on the desktop after the user places the input device there; and if the target object is a countdown timer, the countdown timer will start on the desktop and begin counting down after the user places the input device there, thus achieving rapid launch of applications and / or functional modules on the electronic device.

[0461] This application embodiment illustrates two target functions configured for an input device. For the same input device, after configuration data is configured, the input device corresponds to only one target function. The example illustrates target functions as launching an application and launching a gadget (also known as launching a function module or launching a function control). For instance, if the target function configured for the input device is launching an application, the input device is used to launch the application associated with that target function; if the target function configured for the input device is launching a gadget, the input device is used to launch the function module associated with that target function.

[0462] Furthermore, for the same input device, assuming the current target function and user information are already determined, if other functions are needed, the current target function of the input device needs to be changed to another function via an electronic device or other terminal, and the identifier of the object associated with the target function also needs to be modified accordingly. For example, if the current target function of the input device is to launch an application, and the application associated with the application launch function is application 1, if the user wants to use the widget launch function, the current target function of the input device needs to be changed from the application launch function to the widget launch function via an electronic device or other terminal, and application 1 needs to be changed to the user-defined function module of the widget launch function (e.g., a countdown timer). In one possible implementation, determining the target object from the objects to be launched includes the following steps:

[0463] Retrieve multiple objects associated with the target function from the objects to be started, and obtain multiple candidate objects;

[0464] Display a ninth window; this ninth window includes multiple candidate objects;

[0465] In response to the first selection operation of the candidate objects in the ninth window, the candidate object selected by the first selection operation in the ninth window is determined as the target object.

[0466] For cases where the target function of the input device is associated with multiple objects, taking the target function as launching an application and the associated objects as applications as an example, this will be explained. Considering that although the target function is associated with multiple applications, users may not necessarily need to launch all of them at once, a method is provided that allows users to select the application they actually need to launch from among the multiple applications associated with the target function. As shown in Figure 55, Figure 55 illustrates a scenario where the target object is determined based on the target function. 101 represents the fifth interface, 200 represents the input device, and 301 represents the ninth window. Assuming the input device's target function (application launch function) is associated with three application identifiers, and the fifth interface is specifically the electronic device's desktop, when the user triggers a first touch operation (e.g., a click) on any area of ​​the fifth interface using the input device, the input device's ID is obtained based on the encoded information. From this ID, the target function of the input device is determined to be the application launch function, thus obtaining the three application identifiers associated with this function. These three application identifiers are then used to identify the corresponding applications from the list of objects to be launched: Application 1, Application 2, and Application 3. These three applications are then selected as candidate applications. Next, a ninth window is displayed, showing Application 1, Application 2, and Application 3. The user triggers a first selection operation for Application 2 and Application 3, indicating that they have chosen Application 2 and Application 3 as the target objects. Subsequently, Application 2 and Application 3 will be launched, thus enabling the launch of the required applications from multiple applications associated with the target function based on the user's selection. A checkmark ("√") indicates a selected application.

[0467] In one possible implementation, if the target object belongs to a functional module, after activating the target object, the interaction method further includes the following steps:

[0468] In response to a second touch operation performed by the input device on the fifth interface, the function of the target object is executed.

[0469] When the target object is a functional module, after activating the target object, the user can further trigger its function using an input device. Specifically, the user triggers a second touch operation on the fifth interface using the input device. After the electronic device responds to the second touch operation, it executes the target object's function, enabling quick access to the functional module. For example, if the target object is a selection tool, the selection function is executed; if the target object is a screenshot tool, the screenshot function is executed; if the target object is a magnifying glass, the content magnification function is executed; if the target object is a timer, the timer function (including countdown and up-and-down functions) is executed; if the target object is an eraser tool, the eraser function is executed; and so on. The second touch operation can be the same as or different from the first touch operation.

[0470] The application types of the fifth interface are pre-defined into two categories: designated applications and non-designated applications. Different application types result in different execution strategies for the electronic device to perform functions on the target object. Designated applications are interactive collaborative applications where users can design and create, such as drawing applications and whiteboard applications. Non-designated applications can be understood as applications other than designated applications, such as browser applications. This application embodiment uses a whiteboard application as the designated application and a browser application as the non-designated application for illustration.

[0471] In one possible implementation, if the application type of the application to which the fifth interface belongs is a specified application, the above-mentioned execution of the target object's function includes the following steps:

[0472] If the target object is an erasing tool and the second touch operation is an erasing operation performed by the input device on the second area of ​​the fifth interface, the interface content in the second area is erased.

[0473] For applications belonging to the fifth interface whose application type is a specified application and whose target object is an erasure tool (e.g., a whiteboard eraser), if the second touch operation is an erasure operation (e.g., a swipe operation, also known as a move operation) performed by the input device on the second area of ​​the fifth interface, then the interface content in the second area will be erased. It can be understood that the input device currently acts as an erasure tool; when the user swipes on the fifth interface using the input device, the interface content along the swipe path of the input device will be erased. Figure 56 illustrates a scenario where the smart interactive whiteboard performs the erasure function. 101 represents the fifth interface, 101-1 represents the updated fifth interface, and P1 represents the second area. The interface content displayed on the fifth interface is the written "5+2=7". The user swipes on the second area using the input device, thus erasing the written "2". After the fifth interface is updated, the written "2" is no longer displayed in the second area of ​​the updated fifth interface, allowing the user to quickly use the erasure function via the input device.

[0474] In one possible implementation, if the application type of the application to which the fifth interface belongs is a specified application or a non-specified application, the above-mentioned execution of the target object's function includes the following steps:

[0475] If the target object is a selection tool and the second touch operation is a second selection operation performed by the input device on the first area of ​​the fifth interface, the target content is selected; wherein, the target content is the interface content in the first area.

[0476] For applications belonging to the fifth interface that are either specified or non-specified applications, and whose target object is a selection tool, if the second touch operation is a second selection operation performed by the input device on the first area of ​​the fifth interface, then the interface content in the first area is selected, and the selected interface content is called the target content. The second selection operation can be a click or a swipe. If the second selection operation is a click, then the first area is the area where the input device contacts the fifth interface; if the second selection operation is a swipe, then the first area is the area traversed by the swipe path of the input device after it contacts the fifth interface.

[0477] Figure 57 illustrates a scenario where an electronic device performs a selection function. 101 represents the fifth interface, 101-2 represents the updated fifth interface, P2 represents the first area, and K1 represents the selection marker. The fifth interface displays "rectangular, circular, and triangular patterns." When the user slides an input device across the fifth interface, the sliding trajectory of the input device passes over the "rectangular, circular, and triangular patterns," indicating that the user has selected them. Therefore, the "rectangular, circular, and triangular patterns" are selected. After the fifth interface is updated, the selected "rectangular, circular, and triangular patterns" are displayed in the second area of ​​the updated fifth interface, allowing the user to quickly use the selection function via the input device.

[0478] In one possible implementation, if the application type of the fifth interface is a specified application, after selecting the target content, the interaction method also includes the following steps:

[0479] In response to an adjustment operation performed by the input device on the target content, the target content is moved and / or rotated.

[0480] For applications on the fifth interface whose application type is a specified application and whose target object is a selection tool, the response to the second touch operation is a second selection operation performed by the input device on the first area of ​​the fifth interface to obtain the selected target content. If an adjustment operation is detected on the target content by the input device, the target content is adjusted according to the adjustment operation. Adjusting the target content includes moving and / or rotating it, allowing the user to adjust the position and angle of the selected content using the input device. If the adjustment operation is a move operation, the target content is moved; if the adjustment operation is a rotation operation, the target content is rotated; if the adjustment operation is both a move and a rotation operation, the target content is both moved and rotated.

[0481] Figure 58 illustrates a scenario where a user adjusts the target content. 101-3 represents the interface displaying the moved target content; interface 101-3 displays a "rectangular, circular, and triangular pattern" based on interface 101-2 after it has been moved downwards. 101-4 represents the interface displaying the rotated target content; interface 101-4 displays a "rectangular, circular, and triangular pattern" based on interface 101-2 after it has been rotated clockwise.

[0482] In one possible implementation, if the application type of the application to which the fifth interface belongs is a non-specified application, the above-mentioned execution of the target object's function includes the following steps:

[0483] If the target object is a screenshot tool and the second touch operation is a screenshot operation performed by an input device on the second area of ​​the fifth interface, the interface content in the second area is captured to obtain a content screenshot.

[0484] For applications belonging to the fifth interface that are not specified applications and whose target is a screenshot tool, if the second touch operation is a screenshot operation performed by the input device on the second area of ​​the fifth interface, then the interface content in the second area is captured to obtain a content screenshot, meaning the content screenshot includes the interface content in the second area. The screenshot operation includes click and swipe operations. The process of the user performing a screenshot operation using the input device is as follows: first, the user clicks on a certain location, which is considered the starting point; then, the user moves the input device away from the starting point. The user will see a small rectangle gradually enlarge as the input device moves away from the starting point. The location where the input device stops moving is the ending point. The interface content covered by the rectangle formed by the starting point and the ending point is the interface content in the second area. Therefore, the interface content in the second area is captured to obtain a content screenshot, which includes the interface content in the second area, allowing users to quickly use the screenshot function via the input device.

[0485] Figure 59 illustrates a scenario where a smart interactive whiteboard performs a screenshot function. 101 represents the fifth interface, P3 represents the second area, and F represents the content screenshot. The interface content displayed on the fifth interface includes a short essay titled "Spring is Here." The user performs a screenshot operation on the fifth interface using an input device. After the input device stops performing the screenshot operation, the content covered by the rectangle formed by the start and end points of the screenshot operation is "In the morning, under the slightly white sky... spring has truly arrived." Thus, the content screenshot shows the second paragraph of the text "Spring is Here." In one possible implementation, after capturing the interface content in the second area and obtaining the content screenshot, the interaction method further includes the following steps:

[0486] Display the tenth window; the tenth window includes editing options and save options;

[0487] In response to the third selection of the editing options in the tenth window, the eleventh window is displayed; wherein the eleventh window includes the interface content in the second area which is in an editable state; or, in response to the fourth selection of the save option in the tenth window, a screenshot of the content is saved.

[0488] For applications belonging to the fifth interface that are not specified applications and whose target is a screenshot tool, if the second touch operation is a screenshot operation performed by the input device on the second area of ​​the fifth interface to capture the content of the interface in the second area, the tenth window is displayed. The tenth window displays editing and saving options for the content screenshot. Users can edit the content screenshot first and then save it, or save it directly, according to their actual needs. As shown in Figure 60, Figure 60 illustrates a scenario where the user edits the content screenshot. 101 represents the fifth interface, K2 represents the rectangle formed by the start and end positions of the screenshot operation, 302 represents the tenth window, and 303 represents the eleventh window. If the smart interactive whiteboard detects the third selection operation of the editing option in the tenth window, indicating that the user has selected the editing option, the eleventh window is displayed. The eleventh window displays the second paragraph of the text "Spring is coming," and the user can edit this text in the eleventh window.

[0489] If the smart interactive whiteboard detects the fourth selection of the save option in the tenth window, it means that the user has selected the save option. The whiteboard will then save the content screenshot and prompt the user with the save path for the content screenshot.

[0490] In one possible implementation, if the application type of the application to which the fifth interface belongs is a non-specified application, the above-mentioned execution of the target object's function includes the following steps:

[0491] If the target object is a magnifying glass tool, the magnified page content in the first area is displayed; where the first area is the area where the input device acts on the fifth interface, that is, the area where the input device contacts the fifth interface is the first area.

[0492] If the application type of the fifth interface is a non-specified application and the target object is the magnifying glass tool, and the second touch operation is a click operation of the input device on the first area of ​​the fifth interface, the magnified page content in the first area will be displayed. As shown in Figure 61, Figure 61 illustrates a scenario where an electronic device performs the interface content magnification function. 101 represents the fifth interface, P4 represents the first area, and K3 represents the magnified page content. If the user clicks "Freedom" using the input device, the magnified "Freedom" will be displayed, allowing the user to quickly use the magnifying glass tool's magnification function via the input device.

[0493] In one possible implementation, if the application type of the fifth interface is a non-specified application, executing the function of the target object includes the following steps:

[0494] If the target object is a timer, the timer is displayed in the second area and started to begin timing; the second area can be any area of ​​the fifth interface.

[0495] For applications belonging to the fifth interface that are not specified applications and whose target object is a timer, if the second touch operation is a click operation of the input device on the second area of ​​the fifth interface, the timer is displayed in the second area and started to begin counting down, allowing users to quickly use the timer function through the input device. If the timer is a positive timer, it starts counting down; if the timer is a countdown timer, it starts counting down. As shown in Figure 62, Figure 62 illustrates a scenario where an electronic device performs a timing function. 101 represents the fifth interface, P5 represents the second area, and K4 represents the countdown timer. Referring to Figure 62a, the countdown timer has a countdown duration of 60 seconds, and the countdown timer starts counting down from 60 seconds.

[0496] After starting the timer as described above, the interaction method further includes the following steps:

[0497] In response to a stop operation on the timer performed by the input device, the timer is controlled to stop counting.

[0498] If the smart interactive whiteboard detects an input device performing a stop operation on the timer (e.g., a click), it controls the timer to stop, thus enabling the user to control the timer's stop time using the input device. Referring to Figure 62b, the user clicked the countdown timer with the input device, and the countdown timer stopped at 30 seconds, meaning there are 30 seconds left.

[0499] In one possible implementation, the interaction method further includes the following steps:

[0500] In response to an input device operating on a preset area of ​​the sixth interface, a twelfth window is displayed; wherein the twelfth window includes a setting area for the timing duration;

[0501] The target duration is obtained in response to the setting operation in the settings area;

[0502] Associate the target duration with the target function so that if the timer is started based on the target function, the timer will start based on the target duration.

[0503] Users can set the duration of a timer through an electronic device, and then associate the set duration with the target function of the input device. When the electronic device starts the timer based on the target function of the input device, the electronic device obtains the duration corresponding to the target function of the input device, and then controls the timer to keep time according to the duration corresponding to the target function of the input device.

[0504] The sixth interface can be understood as the interface for setting the timing duration. If the electronic device detects that the input device is acting on the preset area of ​​the sixth interface and triggers the operation of the first area, the twelfth window is displayed. The twelfth window includes a setting area for the timing duration. The user can set the timing duration in this setting area by directly inputting the duration or selecting a duration from the provided durations, allowing the user to configure the timing duration for the input device according to their own needs. Both directly inputting the duration and selecting a duration from the provided durations are considered setting operations.

[0505] The set timing duration is called the target duration. This target duration is then associated with the target function of the input device. When the smart interactive whiteboard starts the timer based on the target function of the input device, it obtains the target duration corresponding to that function and controls the timer to keep track of the time. The set timing duration can be either a positive countdown or a countdown duration.

[0506] As shown in Figure 63, this diagram illustrates a scenario where a user sets the countdown duration. 102 represents the sixth interface, P6 represents the preset area within the sixth interface, 304 represents the twelfth window, and 200 represents the input device. If the smart interactive whiteboard detects that the input device is operating on the preset area of ​​the sixth interface and triggers the first area operation, it displays the twelfth window. The twelfth window includes countdown duration options of 60 seconds and 30 seconds. If the user selects 30 seconds, the target duration is 30 seconds, thus associating the target duration with the target function of the input device. After the smart interactive whiteboard starts the countdown timer based on the target function of the input device, it obtains the target duration corresponding to the input device's target function as 30 seconds and then controls the countdown timer to run in 30-second increments.

[0507] In one possible implementation, if the target object belongs to an application, the above interaction method further includes the following steps:

[0508] In response to an input device operating on a preset area of ​​the seventh interface, a thirteenth window is displayed; wherein the thirteenth window includes application identifiers for multiple applications;

[0509] In response to the fifth selection operation of the application identifier in the thirteenth window, the application identifier selected in the fifth selection operation in the thirteenth window is associated with the target function.

[0510] The seventh interface can be understood as the interface used to configure applications for the input device. If the smart interactive whiteboard detects that the input device is acting on a preset area in the seventh interface and triggers a second area operation (such as a click operation), it displays a thirteenth window. The thirteenth window displays application icons for multiple applications for the user to select. The user can select one application icon from the multiple application icons, or select two or more application icons. After the user selects an application icon, the selected application icon is associated with the target function of the input device. When the input device interacts with the smart interactive whiteboard, the application corresponding to the selected application icon can be quickly launched. If the input device is an active interactive tool, the input device must remain in the preset area of ​​the seventh interface during the configuration of the application to be launched. As shown in Figure 64, Figure 64 illustrates a scenario where the user configures the application to be launched on the input device. 103 represents the seventh interface, P7 represents the preset area in the seventh interface, 305 represents the thirteenth window, and 200 represents the input device. If the smart interactive flat panel detects that the input device is acting on a preset area in the seventh interface and triggers the second area operation, it displays a thirteenth window. The thirteenth window displays application identifiers including application identifier 1 and application identifier 2. The smart interactive flat panel detects the fifth selection operation of application identifier 2 in the thirteenth window, indicating that the user has selected application identifier 2. Then, application identifier 2 is associated with the target function of the input device. When the input device interacts with the smart interactive flat panel, the application corresponding to application identifier 2 can be quickly launched, making it convenient for users to configure the application that needs to be quickly launched to the input device according to their own needs. See Figure 65, which shows a schematic flowchart of another interaction method provided by an embodiment of this application. This interaction method can be executed by the electronic device of the interaction system in the above embodiments, and the interaction method may include the following steps:

[0511] S110, when the outer surfaces of multiple input devices simultaneously trigger multiple first touch operations on the capacitive touch-sensitive surface, the encoding information of each input device is determined.

[0512] S120: For each first touch operation, output corresponding feedback information based on the encoding information of the corresponding input device. Multiple first touch operations correspond one-to-one with multiple input devices.

[0513] In practical applications, multiple input devices can be used simultaneously by one or more users. When each user uses one input device to interact with the capacitive touch-sensitive surface, multiple input devices may interact with the capacitive touch-sensitive surface at the same time. In this case, the conductive elements of each input device can capacitively couple with the capacitive touch-sensitive surface, and each input device can also trigger a touch operation (i.e., the first touch operation) relative to the capacitive touch-sensitive surface.

[0514] When an electronic device detects multiple input devices simultaneously triggering touch operations on a capacitive touch-sensitive surface, the aforementioned method can be used to determine the encoding information of each input device. Subsequently, for each touch operation triggered by an input device, corresponding feedback information can be output based on the input device's encoding information.

[0515] For example, multiple input devices include input device Z1 and input device Z2. A user can configure first feedback information for input device Z1 in the electronic device, then associate and store the first feedback information with the encoding information of input device Z1. Similarly, a user can configure second feedback information for input device Z2 in the electronic device, then associate and store the second feedback information with the encoding information of input device Z2.

[0516] In the scenario where user A controls input device Z1 to trigger a touch operation on the capacitive screen, and simultaneously user B controls input device Z2 to trigger a touch operation on the capacitive screen, the electronic device can obtain the encoding information of input device Z1 and input device Z2 using the method described above. Then, for the touch operation triggered by input device Z1, the electronic device can output first feedback information based on the encoding information of input device Z1 to respond to the touch operation triggered by input device Z1; for the touch operation triggered by input device Z2, it can output second feedback information based on the encoding information of input device Z2 to respond to the touch operation triggered by input device Z2.

[0517] The solution provided in this application addresses multiple input devices that simultaneously trigger touch operations on a capacitive touch-sensitive surface. By responding to each touch operation based on the encoding information of each input device, it enables interaction between multiple input devices and electronic devices, effectively expanding the application scenarios of input devices and further improving the user's interactive experience with electronic devices.

[0518] Optionally, for multiple input devices, the output order of multiple feedback information can be determined based on the encoding information of the multiple input devices, and the multiple feedback information can be output according to the output order.

[0519] For example, multiple input devices include input device Z1 and input device Z2. A user can configure first feedback information for input device Z1 and second feedback information for input device Z2 in the electronic device. Simultaneously, the priority of the encoded information of input device Z1 can be set to be higher than the priority of the encoded information of input device Z2.

[0520] When user A controls input device Z1 to trigger a touch operation on the capacitive screen, and user B simultaneously controls input device Z2 to trigger a touch operation on the capacitive screen, the electronic device can obtain the encoding information of input device Z1 and input device Z2. Then, based on a pre-set priority, it can be determined that the priority of the encoding information corresponding to input device Z1 is higher than that corresponding to the encoding information corresponding to input device Z2. Therefore, the output order can be determined as follows: first output the first feedback information, then output the second feedback information. During the output of feedback information, the first feedback information corresponding to input device Z1 can be output first, followed by the second feedback information corresponding to input device Z2.

[0521] In the process of outputting the first feedback information followed by the second feedback information, the first feedback information can be output first, and the second feedback information can be output after the first feedback information has been output. Alternatively, the first feedback information can be output first, and after a preset time, the second feedback information can be output directly regardless of whether the first feedback information has been output. It should be understood that the methods for sequentially outputting multiple feedback information can include, but are not limited to, the examples above.

[0522] The solution provided in this application sets the output order of multiple feedback information by using the encoding information of the input device, which can improve the accuracy and logic of multiple feedback information output, enable the electronic device to correctly understand the user's intention, and avoid conflicts when multiple feedback information is output at the same time, thereby further improving the user's interactive experience with the electronic device.

[0523] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An interactive system, wherein, include: Electronic devices with capacitively sensitive touch surfaces; An input device includes at least one outer surface, the outer surface being provided with a plurality of conductive elements, the conductive elements being capable of capacitively coupling with the capacitive touch-sensitive surface; The electronic device is configured to, when the outer surface triggers a first touch operation on the capacitive touch-sensitive surface, determine a target capacitor that is capacitively coupled to a target conductive element from among a plurality of capacitors on the capacitive touch-sensitive surface, determine the encoding information corresponding to the target conductive element based on the target capacitor, and output feedback information corresponding to the first touch operation based on the encoding information. The target conductive element includes a grounded conductive element among the plurality of conductive elements disposed on the outer surface.

2. The system as claimed in claim 1, wherein, The target conductive component includes N first target conductive components and M second target conductive components, where N is an integer greater than 2 and M is an integer greater than or equal to 0. The electronic device is specifically used for: determining N first target capacitors and M second target capacitors from a plurality of target capacitors; constructing a target coordinate system based on the N first target capacitors; and decoding the M second target capacitors based on the target coordinate system to obtain the encoded information. The N first target capacitors correspond one-to-one with the N first target conductive components, and the M second target capacitors correspond one-to-one with the M second target conductive components.

3. The system as described in claim 2, wherein, Specifically, the electronic device is used to determine the bit index corresponding to each second target capacitor based on the coordinates of the second target capacitor in the target coordinate system. Specifically, the electronic device is used to determine the code element in the encoding information corresponding to each second target capacitor based on the capacitance change of the second target capacitor, and to determine the encoding information based on the bit index and code element corresponding to each of the M second target capacitors.

4. The system as described in claim 2, wherein, The plurality of conductive components are arranged on the outer surface in a first preset manner, and all of the plurality of conductive components are grounded; The target conductive component includes N first conductive components and M second conductive components. The N first conductive components form a non-rotationally symmetric shape on the outer surface. The size of the non-rotationally symmetric shape is a preset size. The first target conductive element includes the N first conductive elements, and the second target conductive element includes the M second conductive elements.

5. The system as described in claim 2, wherein, The plurality of conductive elements are arranged on the outer surface in a second preset arrangement, and the plurality of conductive elements includes N third conductive elements and M fourth conductive elements; The input device further includes a grounding component and a control module. The grounding component is connected to the M fourth conductive components one by one through M electronically controlled switches. The control module is electrically connected to the M electronically controlled switches. The control module is used to control at least one of the electronically controlled switches to be turned on, so that at least one of the fourth conductive components is electrically connected to the grounding component; The first target conductive element includes the N third conductive elements, and the second target conductive element includes the conductive element among the M fourth conductive elements that is electrically connected to the grounding element.

6. The system as claimed in claim 1, wherein, If the capacitive touch-sensitive surface is a capacitive screen, the electronic device is further configured to: control the capacitive screen to display a first interface for configuring the input device; upon receiving a function configuration operation for the first interface, obtain a target function configured for the input device according to the function configuration operation; generate function configuration data for the input device according to the device identifier of the input device and the target function; store the function configuration data in the local space of the electronic device; or send the function configuration data to a server so that the electronic device can execute the target function according to the function configuration data when interacting with the input device.

7. The system as claimed in claim 1, wherein, The feedback information includes at least one of interface display, audio-visual prompts, and vibration.

8. The system of claim 7, wherein, If the capacitive touch-sensitive surface is a capacitive screen, the first touch operation is an operation performed on the second interface displayed on the capacitive screen, and the feedback information is an interface display; the electronic device is specifically used for: The device identifier of the electronic device is obtained based on the encoded information, and the capacitive screen is controlled to display the target element associated with the device identifier. The target element includes at least one of the elements configured for a specified application, and the second interface is the operation interface of the specified application mounted on the electronic device.

9. The system of claim 8, wherein, The electronic device is also specifically used for: Upon receiving a second touch operation applied to the target element by the outer surface, the target element is adjusted according to the second touch operation, and the capacitive screen is controlled to display the adjusted target element, and / or, the text and / or pattern triggered by the adjusted target element is displayed.

10. The system of claim 7, wherein, If the capacitive touch-sensitive surface is a capacitive screen, the first touch operation is an operation performed on a third interface displayed on the capacitive screen, and the feedback information is an interface display, the electronic device is specifically used for: The device identifier of the electronic device is obtained based on the encoded information. The function type of the target function configured for the input device is determined based on the device identifier. The application type of the application to which the third interface belongs and the operation type of the first touch operation are determined. Based on the function type, the application type and the operation type, the first touch operation is responded to, and the capacitive screen is controlled to output the interface display triggered by the first touch operation.

11. The system of claim 7, wherein, If the capacitive touch-sensitive surface is a capacitive screen, the first touch operation is an operation performed on the fourth interface displayed on the capacitive screen, and the feedback information is an interface display, the electronic device is specifically used for: The device identifier of the electronic device is obtained based on the encoded information. The target function configured for the input device is determined based on the device identifier. The user information corresponding to the target function in the input device is obtained. The first touch operation is responded to based on the user information to execute the target function. The capacitive screen is controlled to output the interface display triggered by the execution of the target function.

12. The system of claim 7, wherein, If the capacitive touch-sensitive surface is a capacitive screen, the first touch operation is an operation performed on the fifth interface displayed on the capacitive screen, and the feedback information is an interface display, the electronic device is specifically used for: The device identifier of the electronic device is obtained according to the encoded information. The target function configured by the input device is determined according to the device identifier. The target object is determined from the objects to be launched of the electronic device according to the target function. The first touch operation is responded to to launch the target object. The capacitive screen is controlled to output the interface display triggered by launching the target object. The objects to be launched include applications and / or functional modules.

13. The system of claim 1, wherein, There are multiple input devices; The electronic device is used to determine the encoding information of each input device when the outer surfaces of the multiple input devices simultaneously trigger multiple first touch operations on the capacitive touch-sensitive surface, wherein the multiple first touch operations correspond one-to-one with the multiple input devices. For each of the first touch operations, the corresponding feedback information is output according to the encoding information of the corresponding input device.

14. The system of claim 1, wherein, The outer surface is provided with a skin layer, and the plurality of conductive components are arranged on the outer surface in a first preset arrangement. The skin layer is provided with a mark corresponding to the first preset arrangement; and / or, the outer surface is provided with a mark corresponding to the first preset arrangement.

15. The system of claim 1, wherein, The input device further includes an insulating housing, the outer surface is located on the insulating housing, the shell wall of the insulating housing is provided with a plurality of through holes, the number of the plurality of conductive elements is less than or equal to the number of the plurality of through holes, and one of the conductive elements is at least partially disposed in one of the through holes.

16. The system of claim 15, wherein, The plurality of through holes are arranged in an array, and the plurality of through holes are arranged at least partially in a preset arrangement.

17. The system of claim 15, wherein, The end face of the first end of the conductive element is located inside the through hole, or the end face of the first end of the conductive element protrudes from the outer surface of the insulating shell.

18. The system of claim 15, wherein, The outer surface of the insulating shell is provided with a skin layer, which covers a plurality of the through holes, and the skin layer is provided with markings corresponding to a preset arrangement of the plurality of conductive components.

19. The system of claim 15, wherein, The insulating housing has edges, and conductors are provided on the edges, which are electrically connected to the plurality of conductive components.

20. The system of claim 1, wherein, The input device has a grip portion, which is provided with a conductor, and the conductor is electrically connected to the plurality of conductive elements.

21. The system of claim 1, wherein, The electronic device also includes a system-on-a-chip, and the capacitive touch-sensitive surface includes a microcontroller unit, with the system-on-a-chip connected to the microcontroller unit; The microcontroller unit is used to process a capacitance image based on the signal change caused by the capacitive touch surface when the input device acts on the capacitive touch surface, and send the capacitance image to the system-on-a-chip. The capacitance image includes one frame or multiple frames. The system-on-a-chip is used to acquire the encoded information based on the capacitance image.

22. The system of claim 1, wherein, The electronic device also includes a system-on-a-chip, and the capacitive touch-sensitive surface includes a microcontroller unit, with the system-on-a-chip connected to the microcontroller unit; The microcontroller unit is used to, when the input device acts on the capacitive touch surface, if the capacitive touch surface causes a signal change, process the signal change of the capacitive touch surface to obtain a capacitance image, obtain the encoded information based on the capacitance image, and send the encoded information to the system-on-a-chip. The capacitance image includes one frame or multiple frames. The system-on-a-chip is used to output the feedback information according to the encoded information.

23. The system as claimed in claim 21 or 22, wherein, The system-on-a-chip has an application program installed in its operating system, and the application program or the operating system outputs the feedback information based on the encoded information.

24. The system as claimed in claim 21 or 22, wherein, The capacitive touch-sensitive surface integrates an external or internal capacitive electrode array, wherein the capacitor electrodes in the capacitive electrode array are self-capacitive or mutual-capacitive electrodes.

25. The system of claim 24, wherein, The capacitive touch-sensitive surface also includes a driving circuit, a sensing circuit, and a signal processing chip; The driving circuit is used to drive the capacitor electrode array; The sensing circuit is used to sense the signal changes of the capacitor electrode array and send the sensed signal to the signal processing chip. The signal processing chip is used to process the signals sensed by the sensing circuit and send the processing results to the microcontroller unit; The microcontroller unit is used to obtain the capacitance image based on the processing result.

Images