An interactive system

Abstract

The application provides an interactive system applied to the field of electronic technology, which comprises an electronic device and an input device. The electronic device has a capacitive touch-sensitive surface. The input device comprises at least one outer surface, and the outer surface is provided with a plurality of conductive parts. The conductive parts can be capacitively coupled with the capacitive touch-sensitive surface. The electronic device determines a target capacitance which is capacitively coupled with a target conductive part from a plurality of capacitances of the capacitive touch-sensitive surface when the outer surface triggers a first touch operation on the capacitive touch-sensitive surface. The electronic device determines coding information corresponding to the target conductive part according to the target capacitance, and outputs feedback information corresponding to the first touch operation according to the coding information. The touch response system provided by the application can make the electronic device respond to a touch object, thereby expanding the application scenarios of the electronic device and meeting the needs of users in some specific scenarios.

Description

Technical Field

[0001] This application relates to the field of electronic technology, and more specifically, to an interactive system. Background Technology

[0002] When an electronic device integrates a capacitive touch-sensitive surface, the device can not only display various data through the capacitive touch-sensitive surface, but also receive and respond to various operations through the capacitive touch-sensitive surface to realize command input, making it convenient for users to control the electronic device.

[0003] Currently, the touch operation response process involves the electronic device first determining touch parameters such as the touch position and number of touch points on the touchscreen, and then responding to the touch operation based on these parameters. The problem with this method is that it can only respond to touch operations, not to the object being touched. Summary of the Invention

[0004] This application provides an interactive system that enables electronic devices to respond to input devices, thereby expanding the application scenarios of electronic devices.

[0005] This application provides an interactive system, the system comprising:

[0006] Electronic devices with capacitively sensitive touch surfaces;

[0007] An input device includes at least one outer surface, the outer surface being provided with a plurality of conductive elements, the conductive elements being capable of capacitively coupling with the capacitive touch-sensitive surface;

[0008] The electronic device is configured to, when the outer surface triggers a first touch operation on the capacitive touch-sensitive surface, determine a target capacitor that is capacitively coupled to a target conductive element from among a plurality of capacitors on the capacitive touch-sensitive surface, determine the encoding information corresponding to the target conductive element based on the target capacitor, and output feedback information corresponding to the first touch operation based on the encoding information. The target conductive element includes a grounded conductive element among the plurality of conductive elements disposed on the outer surface.

[0009] The interactive system provided in this application allows the input device to perform a touch operation on a capacitive touch-sensitive surface. The electronic device can obtain the encoded information of the input device from the target capacitor that is capacitively coupled to the conductive components on the input device in the capacitive touch-sensitive surface. Based on the encoded information, the electronic device responds to the touch operation performed by the input device, thereby enabling the electronic device to respond to the touched object. This expands the application scenarios of the electronic device and meets the needs of users in certain specific scenarios. Attached Figure Description

[0010] Figure 1 This is a partial schematic diagram of the composition of a capacitive touchscreen provided in an embodiment of this application;

[0011] Figure 2 This is a schematic diagram of a capacitor electrode array provided in an embodiment of this application;

[0012] Figure 3 This is a schematic diagram of the internal composition of an electronic device provided in an embodiment of this application;

[0013] Figure 4 This is an exemplary schematic diagram of an interactive system provided in an embodiment of this application;

[0014] Figure 5 This is a schematic diagram of the structure of an input device provided in an embodiment of this application;

[0015] Figure 6 This is a schematic diagram of another input device provided in an embodiment of this application;

[0016] Figure 7 yes Figure 5 A cross-sectional view along line AA in the input device;

[0017] Figure 8 This is a schematic diagram of the structure of a sub-shell of an insulating shell;

[0018] Figure 9 yes Figure 7 Schematic diagram of the structure of the conductive component;

[0019] Figure 10 This is a schematic diagram of the structure of a sub-shell of another type of insulating shell;

[0020] Figure 11 yes Figure 10 Schematic diagram of the structure of the conductive component;

[0021] Figure 12 This is a schematic diagram of the structure of another input device provided in the embodiments of this application;

[0022] Figure 13 yes Figure 11 A partial structural diagram of the mounting frame in the input device;

[0023] Figure 14 This is a schematic diagram of the structure of an input device provided in an embodiment of this application;

[0024] Figure 15 yes Figure 14 A schematic diagram of a circuit structure for an input device;

[0025] Figure 16 yes Figure 14 Another circuit diagram of the input device;

[0026] Figure 17 yes Figure 14 Another circuit diagram of the input device;

[0027] Figure 18 yes Figure 14 A schematic diagram of a conductive component of an input device mounted on the wall of an insulating housing.

[0028] Figure 19 yes Figure 14 A schematic diagram of another conductive component of the input device being mounted on the wall of the insulating housing;

[0029] Figure 20 yes Figure 14 A schematic diagram of another type of conductive component of the input device being mounted on the wall of an insulating housing;

[0030] Figure 21 yes Figure 14 A schematic diagram of another type of conductive component of the input device being mounted on the wall of an insulating housing;

[0031] Figure 22 This is an exemplary encoding diagram of an input device provided in an embodiment of this application;

[0032] Figure 23 This is a schematic diagram of a touch operation response flow provided in an embodiment of this application;

[0033] Figure 24 Through Figure 22 A schematic diagram of a local capacitance image when the input device performs a touch operation;

[0034] Figure 25 A schematic diagram illustrating the construction of a coordinate system provided in an embodiment of this application is shown;

[0035] Figure 26 A schematic flowchart of a data configuration method provided in an embodiment of this application is shown;

[0036] Figure 27 An exemplary scenario diagram illustrating the functional configuration of the input device is shown;

[0037] Figure 28 A schematic flowchart of an interaction method provided in an embodiment of this application is shown;

[0038] Figure 29 This illustration shows a scenario of interaction between an input device and an electronic device according to an embodiment of this application;

[0039] Figure 30 A schematic flowchart of an interaction method provided in an embodiment of this application is shown;

[0040] Figure 31A schematic diagram of a scenario where a ruler element is inserted via an input device is shown;

[0041] Figure 32 A schematic diagram of a scenario where the position of an element is adjusted via an input device is shown;

[0042] Figure 33 A schematic diagram of a scene where the pose of an element is adjusted via an input device is shown;

[0043] Figure 34 This diagram illustrates a scenario where element properties are adjusted via an input device.

[0044] Figure 35 A schematic flowchart of an interaction method provided in an embodiment of this application is shown;

[0045] Figure 36 An exemplary scenario diagram showing the output of the first response result of the first touch operation is shown;

[0046] Figure 37 An exemplary scenario diagram showing the output of a second response result of a first touch operation is illustrated.

[0047] Figure 38 An exemplary scenario diagram showing the output of a third response result of a first touch operation is illustrated;

[0048] Figure 39 An exemplary scenario diagram showing the output of a fourth response result of the first touch operation is illustrated;

[0049] Figure 40 An exemplary scenario diagram showing the fifth response result of the first touch operation is illustrated;

[0050] Figure 41 An exemplary scenario diagram showing the output of a sixth response result of the first touch operation is illustrated;

[0051] Figure 42 An exemplary scenario diagram showing the ninth response result of the first touch operation is illustrated;

[0052] Figure 43 An exemplary scenario diagram showing the output of the tenth response result of the first touch operation is illustrated;

[0053] Figure 44 An exemplary scenario diagram showing the output of the eleventh response result of the first touch operation is illustrated;

[0054] Figure 45 An exemplary scenario diagram showing the output of the twelfth response result of the first touch operation is illustrated;

[0055] Figure 46An exemplary scenario diagram showing the output of the thirteenth response result of the first touch operation is illustrated;

[0056] Figure 47 An exemplary scenario diagram showing the output of the fourteenth response result of the first touch operation is illustrated;

[0057] Figure 48 An exemplary scenario diagram showing the fifteenth response result of the first touch operation is illustrated.

[0058] Figure 49 A schematic flowchart of an interaction method provided in an embodiment of this application is shown;

[0059] Figure 50 A schematic diagram illustrating a scenario where an input device is used to log in to an application;

[0060] Figure 51 This diagram illustrates an exemplary scenario of resource transfer using an input device.

[0061] Figure 52 This diagram illustrates another exemplary scenario for resource transfer using an input device;

[0062] Figure 53 This diagram illustrates yet another exemplary scenario of using an input device to transfer resources;

[0063] Figure 54 A schematic flowchart of an interaction method provided in an embodiment of this application is shown;

[0064] Figure 55 This diagram illustrates a scenario where the target object is determined based on the target function.

[0065] Figure 56 This diagram illustrates a scenario where a smart interactive whiteboard performs an erasure function.

[0066] Figure 57 This diagram illustrates a scenario where an electronic device performs a selection function.

[0067] Figure 58 This illustration shows a scenario where a user adjusts the target content.

[0068] Figure 59 This diagram illustrates a scenario where a smart interactive whiteboard performs a screenshot function.

[0069] Figure 60 This illustration shows a scenario where a user edits a screenshot of content.

[0070] Figure 61 This diagram illustrates a scenario where an electronic device performs an interface content magnification function.

[0071] Figure 62 A schematic diagram illustrating a scenario where an electronic device performs a timing function is shown.

[0072] Figure 63 This diagram illustrates a scenario where a user sets the countdown duration.

[0073] Figure 64 This illustration shows a scenario where a user configures the applications to be launched for their input device.

[0074] Figure 65 A schematic flowchart of another interaction method provided in an embodiment of this application is shown. Detailed Implementation

[0075] The technical solutions in this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0076] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0077] Currently, some electronic devices integrate capacitive touch-sensitive surfaces, allowing users to perform touch operations. These surfaces sense and respond to user touch inputs. The capacitive touch-sensitive surface integrates a capacitive electrode array, which can be either self-capacitive or mutual-capacitive. In the self-capacitive type, each electrode forms a capacitance with ground; in the mutual-capacitive type, capacitance is formed at the intersection of two sets of electrodes.

[0078] For example, the capacitive touch-sensitive surface can be a capacitive screen with an integrated transparent array of capacitive electrodes (also known as an electrode pattern). See also Figure 1 , Figure 1 This is a partial schematic diagram of the composition of a capacitive touchscreen provided in an embodiment of this application. For example... Figure 1As shown, the capacitive screen includes a cover plate 11, a capacitive conductive film 12, and a display module 13 (including a display panel) arranged in sequence. The cover plate 11 and the capacitive conductive film 12 are connected by a transparent optical adhesive (OCA) 14, and the display module 13 is also connected to the capacitive conductive film 12 by a transparent optical adhesive 14.

[0079] The cover plate 11 can be made of transparent glass or acrylic and other materials. The capacitive conductive film 12 can be a double-layer capacitive conductive film, including a substrate 121 and electrode layers 122 and 123 located on both sides of the substrate. The substrate 121 can be made of polyethylene terephthalate (PET).

[0080] See Figure 2 , Figure 2 This is a schematic diagram of a capacitor electrode array provided in an embodiment of this application. Figure 2 The capacitor electrode array 20 shown is a mutual capacitance capacitor electrode array, including an X-axis capacitor electrode arranged along the lateral direction of the capacitor screen. Figure 2 The symbols T1, T2, and T3 represent the Y-axis capacitor electrodes arranged along the longitudinal direction of the capacitive screen. Figure 2 Represented by symbols R1, R2, and R3. Combined Figure 1 As shown, the substrate 121 is located between the display module 13 and the cover plate 11. The electrode layer 122, composed of X-axis capacitor electrodes, is located on the side of the substrate 121 away from the cover plate 11, and the electrode layer 123, composed of Y-axis capacitor electrodes, is located on the side of the substrate 121 away from the display module 13.

[0081] The intersection of each X-axis and Y-axis capacitive electrode forms a capacitor, generally called a capacitor node. Taking an 86-inch capacitive touchscreen as an example, the number of X-axis capacitive electrodes is typically 160, and the number of Y-axis electrodes is typically 284. The pitch of each capacitor node is 6.7mm. Each capacitor node corresponds to a coordinate on the capacitive touchscreen.

[0082] For example, the capacitive touch-sensitive surface further includes a driving circuit, a sensing circuit, and a signal processing chip; the driving circuit is used to drive the capacitive electrode array; the sensing circuit is used to sense signal changes in the capacitive electrode array and send the sensed signal to the signal processing chip; the signal processing chip is used to process the signal sensed by the sensing circuit and send the processing result to the microcontroller unit; the microcontroller unit is used to obtain a capacitance image based on the processing result.

[0083] See Figure 3 , Figure 3This is a schematic diagram of the internal composition of an electronic device provided in an embodiment of this application. The electronic device includes a capacitive touch-sensitive surface and a system-on-chip (SOC), also known as a host. The capacitive touch-sensitive surface (e.g., a capacitive screen) also includes a microcontroller unit (MCU), driving circuits, sensing circuits, and signal processing chips, etc. Figure 2 As shown, the driving circuit is connected to the X-axis capacitor electrode, allowing it to apply an excitation signal. The sensing circuit is connected to the Y-axis capacitor electrode, enabling it to detect signal changes (i.e., capacitance changes) at each capacitor node. A signal processing chip is connected to both the sensing circuit and the MCU, amplifying, filtering, and digitizing the signal detected by the sensing circuit to obtain a processing result, which is then sent to the MCU. The MCU processes the processing result sent by the signal processing chip to obtain a capacitance image.

[0084] A capacitance image is an image constructed based on the capacitance change of each capacitor in a capacitance electrode array. A capacitance image is typically a grayscale image, where each pixel corresponds to a capacitor in the array, and the pixel value (grayscale value) corresponds to the magnitude of the capacitance change. Furthermore, since each capacitor corresponds to a coordinate on the capacitive touch surface, the position of each pixel in the capacitance image is the same as the position of the corresponding capacitor on the capacitive touch surface.

[0085] When an input device (such as a finger) touches a capacitive touchscreen and a touch operation is performed, the capacitance at the touch location changes. The MCU can determine the number and corresponding coordinates of these capacitors based on the capacitance image, and thus determine touch parameters such as the user's touch position and number of touch points on the capacitive touch-sensitive surface. The MCU can then send these touch parameters to the SOC, which can convert them into corresponding instructions and execute them.

[0086] The above description of the working principle of capacitive touch surface is based on mutual capacitive electrode as an example. It should be understood that the capacitor electrode array in capacitive touch surface can also be a self-capacitive electrode array. When it is a self-capacitive electrode array, it can also achieve similar functions. This embodiment will not elaborate on this.

[0087] like Figure 1 As described above, when the capacitive touch-sensitive surface is a capacitive screen, the capacitive electrode array can be an on-cell capacitive electrode array, located between the cover plate 11 and the display panel of the display module 13. Alternatively, the capacitive electrode array can be an in-cell capacitive electrode array, integrated within the display module 13. Each capacitive electrode in the capacitive electrode array can be as follows: Figure 1The diamond-shaped electrode shown can also be a Manhattan-shaped electrode; this embodiment does not limit this.

[0088] Electronic devices can include mobile phones, tablets, laptops, desktop computers, smartwatches, smart home devices (such as smart speakers, smart light bulbs, and smart door locks), and also include, but are not limited to, automotive electronic devices (such as in-vehicle capacitive touchscreens), educational electronic devices (such as electronic dictionaries, learning machines, and smart blackboards), and medical electronic devices. Capacitive touchscreens can be LCD screens, OLED screens, LED screens, MicroLED screens, and capacitive touchscreens with integrated capacitive electrode arrays, such as those found in electronic paper lamps.

[0089] It should be noted that, in addition to integrating capacitive touch-sensitive surfaces, electronic devices may also integrate signal output modules. These signal output modules can include optical signal output modules such as indicator lights, light strips, light rings, and light groups; audio output modules such as speakers and buzzers; and vibration signal output modules such as linear motors and piezoelectric elements. It should be understood that the types of signal output modules may include, but are not limited to, the examples mentioned above.

[0090] See Figure 4 , Figure 4 This is an exemplary schematic diagram of an interactive system provided in an embodiment of this application. The system includes an electronic device 41 and an input device 42. The electronic device 41 integrates a capacitive touch-sensitive surface 411, which can receive touch operations, including but not limited to single-click, double-click, pressing, sliding, and rotation. The input device 42 has at least one outer surface, on which multiple conductive elements 421 can be disposed. These conductive elements 421 can encode the input device 42, and each conductive element 421 can be capacitively coupled to a capacitor in the capacitive touch-sensitive surface. The encoded information can serve as a device identifier for the input device.

[0091] When a touch operation (hereinafter referred to as the first touch operation) is performed on the capacitive touch-sensitive surface via the input device 42, the electronic device 41 determines a target capacitor capacitively coupled to each conductive element 421 from a plurality of capacitors on the capacitive touch-sensitive surface, thereby determining a plurality of target capacitors, and then determines the encoding information of the input device 42 based on the plurality of target capacitors, and responds to the touch operation based on the encoding information.

[0092] Optionally, the input device further includes an insulating housing, with the outer surface located on the insulating housing. The housing wall is provided with a plurality of through holes, and the number of multiple conductive elements is less than or equal to the number of multiple through holes. Each conductive element is at least partially disposed in one through hole.

[0093] See Figure 5 , Figure 5This is an exemplary schematic diagram of an input device provided in an embodiment of this application. The input device 100 includes an insulating housing 1, which is a hexahedron with six outer surfaces. At least one outer surface (i.e., the shell wall) is provided with a plurality of through holes 12. On each outer surface, the number of conductive elements 2 is less than or equal to the number of through holes 12. One conductive element 2 is at least partially disposed in one through hole 12. The plurality of conductive elements 2 are electrically connected to each other and can be capacitively coupled to the capacitor on the capacitive touch-sensitive surface. The plurality of conductive elements 2 are disposed on the outer surface in a preset arrangement. The input device 100 can take many forms, such as a Rubik's Cube, a stamp, an educational toy (such as a set square), a toy (such as a doll or model), or an ornament (such as a pendant).

[0094] The insulating housing 1 is a shell structure with excellent electrical insulation properties, used to isolate live conductors. The insulating housing 1 is typically made of plastic, ceramic, or composite materials. Designers can choose suitable insulating materials to manufacture the insulating housing 1 based on factors such as cost, weight, mechanical strength, and durability; this application embodiment does not impose specific limitations in this regard. The insulating housing 1 can provide a mounting base for multiple conductive components 2. The shape of the insulating housing 1 can vary depending on the product form of the input device 100.

[0095] Insulating housing 1 can be Figure 5 The regularly shaped hexahedron shown can also be a tetrahedron, triangular prism, cylinder, frustum, or other regularly or irregularly shaped object with at least one outer surface. The insulating shell 1 has multiple through holes 12 on its shell wall. The size and structure of the through holes 12 are adapted to the size and structure of the conductive component 2, allowing the designer to flexibly set them according to actual needs.

[0096] Conductive component 2 is a structural component capable of conducting electric current. Conductive component 2 is made of materials with good conductivity, such as metals or conductive composite materials. For example, conductive component 2 can be made of copper (metal), conductive rubber (composite material), conductive plastic (composite material), carbon fiber (carbon-based material), or cadmium-copper alloy (alloy material). The shape of conductive component 2 can be columnar, stepped, etc.

[0097] On each outer surface, the number of conductive elements 2 is less than or equal to the number of through holes 12, and each conductive element 2 is at least partially disposed in one through hole 12. The number of conductive elements 2 can also be equal to the number of through holes 12. In this case, multiple through holes 12 are arranged according to a preset arrangement, with one conductive element 2 disposed in each through hole 12. Alternatively, the number of conductive elements 2 can be less than the number of through holes 12. In this case, some through holes 12 are provided with conductive elements 2, while others are not. When some through holes 12 are arranged according to a preset arrangement, the other through holes 12 can be arranged in any manner. Thus, by placing the conductive elements 2 on the insulating housing 1 through the through holes 12, a tight connection between the conductive elements 2 and the insulating housing 1 can be ensured, improving the overall structural stability of the input device 100. Furthermore, by using through holes 12 to install the conductive elements 2, complex bonding and snap-fit ​​processes can be avoided, simplifying the assembly steps of the conductive elements 2, reducing assembly difficulty, improving assembly efficiency, and thereby reducing production costs.

[0098] Multiple conductive elements 2 are electrically connected to each other, and all conductive elements 2 have the same potential. In use, the user holds the input device 100, so that the conductive elements 2 on the input device 100 act on the capacitive touch-sensitive surface, that is, facing the capacitive touch-sensitive surface. When multiple conductive elements 2 approach or contact the capacitive touch-sensitive surface, for example, when the distance between the conductive element 2 and the capacitive touch-sensitive surface is less than or equal to 3 mm and greater than or equal to 0 mm, capacitive coupling can occur with the capacitor on the capacitive touch-sensitive surface.

[0099] Optionally, the multiple through holes are arranged in an array, and the multiple through holes are arranged at least partially according to a preset arrangement.

[0100] like Figure 5 As shown, multiple through holes on each outer surface of the insulating housing 1 are arranged in an array. When a conductive element is provided in some of the through holes on the outer surface, the multiple conductive elements can be arranged on the outer surface in a preset arrangement. Alternatively, the multiple through holes are at least partially arranged in a preset arrangement so that the multiple conductive elements on the outer surface are arranged on the outer surface in a preset arrangement.

[0101] Optionally, the outer surface is provided with a skin layer, and multiple conductive components are arranged on the outer surface in a first preset arrangement, and the skin layer is provided with a mark corresponding to the first preset arrangement; and / or, the outer surface is provided with a mark corresponding to the first preset arrangement.

[0102] like Figure 5 As shown, on each outer surface of the input device 100, a plurality of conductive elements are arranged in a preset arrangement (i.e., the first preset arrangement).

[0103] See Figure 6In some embodiments, the outer surface of the insulating shell 1 is provided with a skin layer, which covers multiple through holes 12. The skin layer is provided with markings 16 corresponding to a preset arrangement of multiple conductive components 2. The skin layer can partially or completely cover the insulating shell 1. The skin layer can be made of insulating materials such as rubber, plastic, and textiles. Designers can flexibly choose suitable materials as the skin layer according to actual needs, and this application does not make specific limitations in this regard.

[0104] The skin layer covers the through-holes, serving two purposes: firstly, it prevents dust, insects, and other foreign objects from entering the insulating shell through the through-holes 12; secondly, it protects the conductive components from excessive wear. Furthermore, markings 16 can be set on the surface of the skin layer; these markings can be text, symbols, images, etc. Figure 6 As shown, the identifier 16 can be a symbol such as "×" or "-". In this way, users can quickly and easily select the conductive component 2 that needs to be capacitively coupled to the capacitive touch-sensitive surface by observing the identifier 16.

[0105] In other embodiments, the outer surface may not have a skin layer, and the markings corresponding to the first preset arrangement can be directly placed on the outer surface. For example, marking 16 can be a sticker pasted on the outer surface or a mark sprayed on the outer surface. Marking 16 can be text, symbols, images, etc. In this way, users can quickly and conveniently select the conductive component 2 that needs to be capacitively coupled with the capacitive touch-sensitive surface by observing marking 16.

[0106] Optionally, the outer surface of the insulating housing is provided with a skin layer, which covers multiple through holes and has markings corresponding to a preset arrangement of multiple conductive components.

[0107] See Figure 6 As shown, when a skin layer is provided on the outer surface of the insulating housing 1, the skin layer covers multiple through holes, which can protect the conductive components inside the through holes. At the same time, the skin layer is provided with markings 16 corresponding to the preset arrangement of multiple conductive components on the outer surface. In this way, the user can quickly and conveniently select the conductive component 2 that needs to be capacitively coupled to the capacitive touch-sensitive surface by observing the markings 16.

[0108] Optionally, the end face of the first end of the conductive element is located inside the through hole, or the end face of the first end of the conductive element protrudes from the outer surface of the insulating housing.

[0109] like Figure 7 As shown, the insulating housing 1 has a receiving cavity 11 communicating with the through hole 12. The conductive element 2 is disposed in the through hole 12 and located outside the receiving cavity 11. The first end of the conductive element 2 is further away from the receiving cavity 11 than the second end of the conductive element 2. For Figure 7Regarding the conductive element 2 provided on the insulating housing 1 in the lower middle part, such as Figure 8 and Figure 9 As shown, the first end of the conductive element 2 is the lower end of the conductive element 2, and the second end of the conductive element 2 is the upper end of the conductive element 2. The lower end of the conductive element 2 is further away from the receiving cavity 11 than the upper end of the conductive element 2.

[0110] See Figure 8 and Figure 9 The end face of the first end of the conductive element 2, which is disposed in the through hole 12 and located outside the receiving cavity 11, is located inside the through hole 12, for example, it can be flush with the outer surface of the insulating housing 1. In this way, the appearance of the input device 100 can be made neater and more beautiful, thereby enhancing the overall sense and refinement of the input device 100, and improving the visual effect and user experience of the input device 100.

[0111] In addition, see Figure 10 and Figure 11 The end face of the first end of the conductive element 2 can also protrude from the outer surface of the insulating housing 1. The designer can determine the protrusion height of the first end face of the conductive element 2 based on factors such as the structural strength, wear rate, and processing accuracy of the conductive element 2; this embodiment does not impose a specific limitation on this. Thus, when the input device 100 acts on the capacitive touch-sensitive surface, the end face of the first end of the conductive element 2 can be closer to or in closer contact with the capacitive touch-sensitive surface, thereby improving the reliability of capacitive coupling between the conductive element 2 and the capacitive touch-sensitive surface and ensuring the accuracy of the electronic device in recognizing the arrangement of multiple conductive elements 2.

[0112] It should be noted that regardless of whether the end face of the first end of the conductive element 2 is located inside the through hole 2 or protrudes from the outer surface of the insulating housing 1, the user will come into contact with part of the conductive element 2 when holding the input device 100. Since multiple conductive elements 2 are electrically connected, all of them can be grounded through the human body. Therefore, when multiple conductive elements 2 on the input device 100 act on the capacitive touch-sensitive surface, capacitive coupling can occur with the capacitive touch-sensitive surface. It should be noted that grounding means the conductive element is in a conductive state.

[0113] It should be noted that, in addition to being a straight hole, through hole 12 can also be a stepped hole or other structures. See [link / reference] Figures 8 to 11In some embodiments, the through-hole 12 may include an extension 121 and a fixing section 122. The fixing section 122 communicates with the extension 121; the fixing section 122 is further away from the outer surface of the insulating housing 1 than the extension 121; the inner diameter of the fixing section 122 is larger than the inner diameter of the extension 121. Correspondingly, the conductive element 2 may include a fixing part 21 and a detection part 22. The fixing part 21 is adapted to the inner diameter of the fixing section 122 and is disposed on the fixing section 122; the detection part 22 is connected to the fixing part 21 and is disposed on the extension 121.

[0114] The fixing part 21 and the detection part 22 of the conductive element 2 can be an integral structure or separate structures. When the fixing part 21 and the detection part 22 are separate structures, they can be connected by a plug-in method. The structural dimensions of the detection part 22 are smaller than those of the fixing part 21. For example, the detection part 22 can be a metal pin, and the fixing part 21 can be a DuPont plug.

[0115] This application uses a detector 22 with a smaller structural size, which can reduce the material of the detector 22 and thus reduce production costs. Furthermore, by connecting the larger fixing part 21 to the fixing section 122, the smaller detector 22 connected to the fixing part 21 can be firmly installed in the extension section 121, thus achieving a firm connection of the conductive element 2.

[0116] See Figure 8 and Figure 9 In some embodiments, the outer surface of the insulating shell 1 is provided with a limiting groove 13, the limiting groove 13 is provided corresponding to the through hole 12 and communicates with the through hole 12; the detection part 22 is plugged into the fixing part 21, and the end of the detection part 22 away from the fixing part 21 is provided with a limiting part 23, the size of the limiting part 23 is larger than the hole diameter of the extension section 121, and smaller than or equal to the inner diameter of the limiting groove 13.

[0117] The shape of the limiting part 23 matches the shape of the limiting groove 13. For example, the limiting groove 13 can be a circular groove or a square groove, and the limiting part 23 can be a disc shape or a square shape accordingly. The limiting part 23 can be integrally formed with the detection part 22, or it can be fixedly connected to the detection part 22 by welding, bonding or other methods. The bottom wall of the limiting groove 13 communicates with the extension section 121. The end of the detection part 22 near the fixing part 21 passes through the bottom wall of the limiting groove 13 and the extension section 121 and extends into the fixing section 122, where it can be connected to the fixing part 21 inside the fixing section 122.

[0118] In this embodiment, a limiting part 23 is provided at the end of the detection part 22 away from the fixing part 21. During the process of connecting the detection part 22 and the fixing part 21, the limiting part 23 can abut against the bottom wall of the limiting groove 13 to limit the detection part 22, thereby preventing the detection part 22 from being inserted too far into the fixing part 21. This ensures that when the input device 100 acts on the capacitive touch surface, the conductive element 2 and the capacitive touch surface form a reliable capacitive coupling, thereby improving the working reliability of the input device 100.

[0119] See Figure 7 In some embodiments, the second ends of multiple conductive elements 2 are electrically connected via multiple wires 24 disposed within the receiving cavity 11. Each conductive element 2 has its second end connected to one wire 24, and the ends of the multiple wires 24 are interconnected. The specifications, length, and other parameters of the conductive elements 2 can be flexibly selected according to actual needs, and this application does not impose specific limitations.

[0120] In this embodiment, multiple conductive elements 2 are electrically connected to each other by wires 24, so that the potential of multiple conductive elements 2 is the same. Therefore, when applied to the capacitive touch surface, it can be ensured that multiple conductive elements 2 can be capacitively coupled to the capacitive touch surface.

[0121] Optionally, the input device further includes: a mounting frame, which is fixedly disposed in the receiving cavity, and a plurality of conductive elements disposed in the mounting frame.

[0122] See Figure 12 and Figure 13 In some embodiments, the input device 100 may further include a mounting frame 3, which is fixedly disposed in the receiving cavity 11; the conductive element 2 is disposed on the mounting frame 3. The mounting frame 3 may be an integral frame or an assembled frame. The integral frame may be integrally formed by casting, stamping, or other methods, while the assembled frame may be obtained by assembling structural components such as beams and columns. By using the mounting frame 3 as the mounting base for the conductive element 2, stable support can be provided for the conductive element 2.

[0123] The structural forms of mounting frame 3 are diverse; see [link / reference] Figure 13 In some embodiments, the mounting frame 3 may include a bracket 31, the bracket 31 including a plurality of branches 312, the plurality of branches 312 being interconnected, each branch 312 being tree-shaped and provided with a conductive element 2.

[0124] The number of branches 312 can be two, three, four, etc. Multiple branches 312 can be integrally formed by injection molding, stamping, or other methods, or assembled from separate structures. The side of each branch 312 away from the connector 32 has a mounting surface. The conductive component 2 is detachably mounted on the mounting surface by screwing, or it can be fixed to the mounting surface by welding, bonding, or other methods. The mounting surface is adapted to the surface shape of the insulating housing 1; for example, when the surface of the insulating housing 1 is a plane or an inclined plane, the mounting surface can also be a plane or an inclined plane.

[0125] In this embodiment, the tree-like branch 312 has a tree-like structure, and the conductive element 2 can be disposed at the forking points and ends of the branch 312. This facilitates the spatial arrangement of the conductive element 2 and reduces the space occupied and weight of the branch 312, thus contributing to the lightweight design of the input device 100. The support 31 formed by the interconnection of multiple branches 312 can support multiple conductive elements 2. Figure 13 As shown, each branch 312 can be equipped with four conductive elements 2, and the four branches 312 can accommodate a total of 16 conductive elements 2. Furthermore, since the conductive elements 2 are detachably connected to the branch 312, when a conductive element 2 on the branch 312 is damaged, only the damaged conductive element 2 needs to be replaced, effectively reducing the maintenance and replacement costs of the input device 100.

[0126] Please continue reading Figure 13 In some embodiments, the number of brackets 31 can be multiple; the mounting frame 3 may also include connectors 32, and multiple brackets 31 are connected by connectors 32.

[0127] The connector 32 can be a connecting shaft, connecting beam, or other structural component. The number of supports 31 can vary depending on the structural shape of the insulating shell 1. For example, if the insulating shell 1 has a tetrahedral or hexahedral structure, the number of supports 31 can be four or six, respectively, with each support 31 corresponding to one side of the insulating shell 1. Every two supports 31 can be connected by a connector 32, and the connectors 32 are then connected to each other by welding, bonding, or other methods.

[0128] The embodiments of this application employ multiple brackets 31, and connect the multiple brackets 31 into a whole through connectors 32. This not only improves the structural strength of the mounting frame 3, but also enables the arrangement of a larger number of conductive parts 2, effectively improving the expandability of the mounting frame 3, and thus increasing the amount of information carried on the input device 100.

[0129] Please continue reading Figure 13 In some embodiments, the connector 32 can be a connecting shaft, with multiple branches 312 evenly distributed around the axis of the connecting shaft. For example,... Figure 13As shown, there are four branches 312 in the left and right side brackets 31, and these four branches 312 can be symmetrically arranged about the axis center of the connector 32. In this way, not only can the stress be distributed more evenly in the mounting frame 3, reducing local stress concentration and thus improving the stability and strength of the structure, but also when the conductive part 2 on one bracket 31 of the mounting frame 3 is subjected to the action of the capacitive touch-sensitive surface, the load can be distributed more evenly to the other brackets 31, reducing the deformation or damage to the mounting frame 3 caused by unbalanced force.

[0130] In addition to being electrically connected via the wires 24 described above, the multiple conductive components 2 can also be electrically connected via supporting structural components. In some embodiments, the mounting frame 3 can be a conductor; the multiple conductive components 2 can also be electrically connected to each other via the mounting frame 3.

[0131] The mounting frame 3 can be made of materials with good conductivity, such as metals or conductive composite materials. For example, the mounting frame 3 can be made of copper (metal), aluminum (metal), conductive rubber (composite material), conductive plastic (composite material), carbon fiber (carbon-based material), or cadmium-copper alloy (alloy material). It is understood that if the material of the mounting frame 3 is the same as that of the conductive component 2, for example, if both the mounting frame 3 and the conductive component 2 are made of aluminum, then the mounting frame 3 and the conductive component 2 can be integrally formed using methods such as casting.

[0132] In this embodiment, the mounting frame 3 is made of a conductor. By connecting the mounting frame 3 to the conductive component 2, the electrical connection between multiple conductive components 2 can be achieved conveniently and reliably. This not only eliminates the need for multiple wires and avoids problems such as increased resistance and maintenance difficulties caused by wire tangling, but also reduces the risk of the wires detaching from the conductive component 2 due to insufficient connection strength, thereby further improving the reliability of the electrical connection between multiple conductive components 2.

[0133] Optionally, the number of through holes is greater than the number of conductive elements, and at least two adjacent through holes are connected; at least one conductive element is movably connected to the mounting frame and is movable among the connected through holes.

[0134] To further meet customer needs for adjusting input information and to enable autonomous adjustment of the arrangement of multiple conductive components 2, this application optimizes the structure of the insulating housing 1, conductive components 2, and mounting frame 3. For each outer surface, the number of through holes 12 is greater than the number of conductive components 2, and at least two adjacent through holes 12 are connected; at least one conductive component 2 is movably connected to the mounting frame 3 and can move between the connected through holes 12.

[0135] The conductive component 2 can be movably connected to the mounting frame 3 using a sliding connection or other means, allowing the conductive component 2 to move relative to the mounting frame 3. The number of through holes 12 is greater than the number of conductive components 2, and at least two adjacent through holes 12 are connected, providing a movement channel for the conductive component 2.

[0136] For example, the insulating housing 1 has 16 through holes 12 arranged in four rows and four columns. Four through holes 12 in one column are connected to form a strip-shaped channel. Only one conductive element 2 is disposed in each of the four through holes 12. This conductive element 2 can move along the channel to any one of the four through holes 12. It is understood that when the user moves the conductive element 2 to different positions within the four through holes 12, the arrangement of multiple conductive elements 2 can be changed, forming four different arrangements. The user can select the desired arrangement from the four different arrangements as needed.

[0137] In this embodiment of the application, by moving the conductive element 2 among the multiple interconnected through holes 12, the arrangement of the multiple conductive elements 2 can be changed, allowing the user to independently select the desired arrangement of the multiple conductive elements 2, thereby further improving the user experience.

[0138] In some embodiments, at least one conductive element 2 is movably connected to the mounting frame 3 in a manner that allows it to move relative to the mounting frame 3, and the conductive element 2 can be moved away from or close to the outer surface of the insulating housing 1.

[0139] There are various ways to implement the movable connection between the conductive element 2 and the mounting frame 3. For example, a ratchet structure similar to a press-type ballpoint pen can be used. This application will not describe this in detail.

[0140] It should be noted that when multiple conductive elements 2 face the capacitive touch-sensitive surface, the conductive element 2 can only capacitively couple with the capacitive touch-sensitive surface when it is in contact with or close enough to it. Therefore, by movably connecting the conductive element 2 relative to the mounting frame 3, the conductive element 2 can extend outward from the input device 100 to approach the insulating housing 1, or retract inward from the input device 100 to move away from the insulating housing 1. In this way, the user can increase or decrease the number of conductive elements 2 that are effectively capacitively coupled with the capacitive touch-sensitive surface, thereby changing the arrangement of the conductive elements 2.

[0141] This embodiment of the application allows the user to control the number of conductive elements 2 that are effectively capacitively coupled to the capacitive touch-sensitive surface by making the conductive element 2 retractably connected to the mounting frame 3. This enables the user to independently select the arrangement of the multiple conductive elements 2 as needed, further improving the user experience.

[0142] See Figure 13In some embodiments, the input device 100 may further include a metal ball 4, which is disposed in the receiving cavity 11 and electrically connected to the conductive element 2. The metal ball 4 may be made of steel, copper, etc. The diameter of the metal ball 4 can be flexibly set according to the size of the receiving cavity 11. The metal ball 4 may be a solid sphere or a hollow sphere. The metal ball 4 can be fixedly connected to the cavity wall of the receiving cavity 11 via a connector 32. For an input device 100 equipped with a mounting frame 3, such as... Figure 13 As shown, the metal ball 4 can also be fixedly connected to the connector 32 of the mounting frame 3 by means of screwing, welding or other methods.

[0143] In this embodiment, the metal ball 4 is electrically connected to the conductive element 2, which can serve a similar purpose to grounding the human body when it comes into contact with the conductive element 2, further ensuring that the conductive element 2 is capacitively coupled to the capacitive touch surface when it acts on the capacitive touch surface.

[0144] In some embodiments, the metal sphere 4 is disposed at the geometric center of the insulating housing 1. It is understood that the geometric center of the insulating housing 1 is the central location of the insulating housing 1 in space. The specific location of the insulating housing 1 depends on its geometry, and this application does not impose any specific limitations on it.

[0145] In this embodiment, placing the metal ball 4 at the geometric center of the insulating housing 1 can make the weight distribution of the input device 100 more uniform, thereby improving the user's grip on the input device 100 and ensuring that the user can remain comfortable even when using the input device 100 for a long time, further improving the user experience.

[0146] It should be noted that, in addition to being disposed on the insulating housing 1 through the through hole 12 mentioned above, the conductive component 2 can also be disposed on the insulating housing 1 in other ways.

[0147] In some embodiments, the arrangement of the plurality of conductive elements 2 on at least two outer surfaces is different.

[0148] When multiple conductive elements 2 are provided on multiple outer surfaces, the arrangement of the conductive elements 2 on two or more outer surfaces can be set differently. For example, for an insulating shell 1 with a hexahedral structure, the arrangement of the conductive elements 2 on adjacent outer surfaces can be set differently, while the arrangement of the conductive elements 2 on opposite outer surfaces can be set the same. In this case, the insulating shell 1 has multiple conductive elements 2 arranged in three different ways. As another example, for an insulating shell 1 with a tetrahedral structure, the arrangement of the conductive elements 2 on each of the four outer surfaces can be set differently, in which case the insulating shell 1 has multiple conductive elements 2 arranged in four different ways.

[0149] In this embodiment of the application, by arranging the multiple conductive elements 2 on at least two outer surfaces in different ways, multiple conductive elements 2 with different arrangements can be provided to the user to meet the user's various needs.

[0150] See Figure 7 and Figure 8 In some embodiments, the insulating housing 1 includes a plurality of sub-housings 14, the edges of which have bevels 141; wherein the bevels 141 of two adjacent sub-housings 14 are connected by splicing.

[0151] The number of sub-shells 14 can be determined based on the number of outer surfaces of the insulating shell 1. For example, when the insulating shell 1 is hexahedral, six sub-shells 14 can be used, and each sub-shell 14 has a bevel 141 on all four sides. The inclination angle of the bevel 141 can be flexibly set according to actual needs, and this application does not impose a specific limitation on it.

[0152] In this embodiment, by setting a bevel 141 on the edge of the sub-shell 14 and splicing multiple sub-shells 14 into the whole insulating shell 1, the assembly of the insulating shell 1 can be realized conveniently and quickly, effectively improving the production efficiency of the input device 100.

[0153] Optionally, the insulating housing has edges with conductors provided on the edges, the conductors being electrically connected to a plurality of conductive elements.

[0154] See Figure 6 and Figure 12 The contact points of two adjacent outer surfaces on the insulating housing 1 form an edge, and the edge is provided with a conductor 15, which is electrically connected to each conductive element. When the user holds the insulating housing 1, if the user's finger comes into contact with the conductor 15, the conductor 15 can short-circuit the conductive element 2 with the user's finger. At this time, the conductive element 2 is grounded through the user's human body, and can then be capacitively coupled with the capacitor in the capacitive touch-sensitive surface.

[0155] When the insulating housing 1 has a skin layer covering the conductor 15, and the user's fingers are separated from the conductor 15 by the skin layer when the user holds the insulating housing 1, the conductive element 2 is approximately grounded through the user's fingers. This also allows the conductive element 2 to capacitively couple with the capacitor in the capacitive touch-sensitive surface. It should be noted that grounding or approximately grounding are both conductive states, and the approximately grounding state after the skin layer is applied can be equated with grounding.

[0156] Optionally, the input device has a grip portion, which is provided with a conductor that is electrically connected to a plurality of conductive elements.

[0157] See Figure 14 and Figure 15The input device 100 includes an insulating housing 1, conductive elements 2, a grip portion 3, and a control module 5. Multiple conductive elements 2 are spaced apart on the outer surface of the insulating housing 1. The grip portion 3 is disposed on the insulating housing 1, allowing the user to hold the input device 100. A conductor 31 is provided on the grip portion 3, and the conductor 31 is electrically connected to multiple conductive elements 2 via multiple electronic switches 4 (or the entire grip portion 3 can be made of conductive material, with the conductor 31 integrally formed with the grip portion 31). The control module 5 is electrically connected to the multiple electronic switches 4, and the control module 5 is used to control at least one electronic switch 4 to be turned on, so that at least one conductive element 2 is electrically connected to the grip portion 3. The input device 100 can take many forms, such as a Rubik's Cube or a stamp.

[0158] Optionally, a skin layer may be provided on the outer surface of the insulating shell 1. The skin layer may partially or completely cover the insulating shell 1.

[0159] The conductor is a structural component used to achieve an electrical connection between the conductive component and the ground. The conductor is made of a metal material with good conductivity, such as copper rods, copper alloys, stainless steel, or new composite materials such as carbon fiber.

[0160] like Figure 14 As shown, the grip part 3 is disposed on the insulating housing 1. When the user takes the input device through the grip part 3, the conductor 31 can contact the user's hand to ground through the human body.

[0161] Conductor 31 is connected to multiple conductive elements 2 via multiple electrically controlled switches 4. Each conductive element 2 is connected to one end of one of the multiple electrically controlled switches 4, and one end of each electrically controlled switch 4 is connected to conductor 31. When an electrically controlled switch 4 is closed, the conductive element 2 is connected to conductor 31, allowing grounding through the human body. The electrically controlled switch 4 is a device that uses electrical signals to control the on / off state of the circuit.

[0162] There are various types of electronic switches, including semiconductor switches and relays. A relay is an electronic switch based on electromagnetic induction, where a magnetic field generated by an electromagnetic coil drives the closing or opening of mechanical contacts. Semiconductor switches include bipolar junction transistors (BJTs), metal-oxide-semiconductor field-effect transistors (MOSFETs), and insulated-gate bipolar transistors (IGBTs). BJTs control the switching of the collector and emitter by controlling the base current. MOSFETs control the conduction state between the drain and source through the gate voltage. Specifically, NMOS transistors conduct when the gate voltage is above a threshold value, while PMOS transistors conduct when the gate voltage is below a threshold value. IGBTs combine the features of MOSFETs and BJTs, controlling the switching of the collector and emitter through the base current.

[0163] The control module 5 is electrically connected to multiple electronic switches 4 and is used to control at least one electronic switch 4 to be turned on, so that at least one conductive element 2 can be electrically connected to the conductor 31; wherein the conductive element 2 electrically connected to the conductor 31 can be capacitively coupled to the capacitive touch-sensitive surface.

[0164] For example, for four conductive elements 2 arranged in a row, the four conductive elements 2 are connected to the conductor 31 in sequence through four electronically controlled switches 4.

[0165] When control module 5 controls the first and fourth electronic switches 4 to close, and the second and third electronic switches 4 to open, the first and fourth conductive elements 2 are electrically connected to conductor 31, enabling capacitive coupling with the capacitive touch-sensitive surface. If the electronic device identifies the conductive element 2 that is capacitively coupled to the capacitive touch-sensitive surface and records it as 1, and records the other conductive elements 2 as 0, then the arrangement is 1001.

[0166] When control module 5 controls the first, second, and third electronic switches 4 to close and the fourth electronic switch 4 to open, the first, second, and third conductive elements 2 are electrically connected to conductor 31, enabling capacitive coupling with the capacitive touch-sensitive surface. If the electronic device identifies the conductive element 2 that is capacitively coupled to the capacitive touch-sensitive surface and records it as 1, and records the other conductive elements 2 as 0, then the arrangement is 1110. It can be seen that control module 5 can quickly adjust the number and position of the conductive elements 2 electrically connected to conductor 31.

[0167] The solution provided in this application involves multiple electrically controlled switches 4 connected to multiple conductive elements 2 and conductors 31 on an insulating housing 1. A control module 5 is electrically connected to the multiple electrically controlled switches 4. By controlling the on / off state of the multiple electrically controlled switches 4 through the control module 5, the multiple conductive elements 2 electrically connected to the conductors 31 can be arranged in a preset pattern. In use, simply applying the multiple conductive elements 2 to the capacitive touch-sensitive surface—that is, facing the capacitive touch-sensitive surface and being close to or in contact with it—for example, when the distance between the conductive elements 2 and the capacitive touch-sensitive surface is less than or equal to 3mm and greater than or equal to 0mm, capacitive coupling can be achieved between the multiple conductive elements 2 electrically connected to the conductors 31 and the capacitive touch-sensitive surface. This enables the electronic device to recognize the arrangement of the multiple conductive elements 2 electrically connected to the conductors 31, thereby quickly acquiring information. Therefore, the solution of this application can shorten the time for complex information input and effectively improve the user experience.

[0168] Furthermore, this application can also adjust the arrangement of the conductive parts 2 electrically connected to the conductor 31 by controlling the corresponding conductive parts 2 to the conductor 31 according to the user's requirements for the number and arrangement of the conductive parts 2 electrically connected to the conductor 31, thereby further improving the user experience.

[0169] See Figure 14 Considering that the conductive element 2 electrically connected to the conductor 31 needs to contact or be close to the capacitive touch-sensitive surface to achieve capacitive coupling with the capacitive touch-sensitive surface, in some embodiments, multiple conductive elements 2 are disposed on the first outer surface of the insulating housing 1; the gripping part 3 is disposed on the second outer surface of the insulating housing 1, wherein the second outer surface is disposed opposite to the first outer surface. In this way, when the conductive element 2 electrically connected to the conductor 31 contacts or is close to the capacitive touch-sensitive surface, interference between the conductor 31 and the capacitive touch-sensitive surface can be prevented, thereby avoiding affecting the user's operation input device 100.

[0170] See Figure 16 In some embodiments, the control module 5 includes a controller 51 and a plurality of latches 52. The plurality of latches 52 are electrically connected to the controller 51, and the plurality of latches 52 are electrically connected to a plurality of electronic switches 4 in a one-to-one correspondence. The latches 52 are able to maintain the on / off state of the electronic switches 4 before the controller 51 was powered off when the controller 51 is powered off.

[0171] The controller 51 can acquire control commands and send control signals to multiple latches 52 based on these commands. The latches 52 then generate switching signals to control the electronic switch 4 based on these control signals. When a control signal is valid, the latches 52 latch the control signal to their output and maintain this state until the next control signal arrives. Therefore, after the controller 51 controls the on / off state of the electronic switch 4, the controller 51 can enter a low-power mode and no longer send control signals to the latches 52. In this mode, the latches 52 can keep the electronic switch 4 either on or off.

[0172] For example, such as Figure 16 As shown, the electronic switch 4 uses NMOS transistors. The controller 51 sends a control command to the latch 52 to turn on the first, second, and last NMOS transistors from left to right. Based on this control signal, the latch 52 generates a high-level signal to turn on the first, second, and last NMOS transistors. When the first, second, and last NMOS transistors are turned on, the first conductive element 2, the second conductive element 2, and the last conductive element 2 are electrically connected to the conductor 31. After the controller 51 turns on the first, second, and last NMOS transistors, the controller 51 can enter a low-power mode and no longer send control signals to the latch 52. At this time, the latch 52 can maintain the high-level signal controlling the first, second, and last NMOS transistors.

[0173] It should be noted that even if the controller 51 loses power due to a malfunction or other reasons, the latch 52 will continue to maintain the on / off state of each electronic switch 4. When the power supply to the controller 51 is restored, the controller 51 will read the state information stored in the latch 52 to ensure that the conductive parts 2 on the input device 100 can be seamlessly restored to the working state before the controller 51 lost power.

[0174] The solution provided in this application embodiment can not only effectively improve the working reliability and robustness of the input device 100 and ensure stable operation when the power is exhausted, but also reduce the working time of the controller 51, thereby effectively extending the battery life of the input device 100.

[0175] See Figure 17In some embodiments, the input device 100 may further include a storage module 6, which is electrically connected to the control module 5 and is used to provide control commands to the control module 5. The storage module 6 may be a USB flash drive, SD card, external hard drive, Flash memory, etc. The storage module 6 may pre-store the coding pattern, arrangement rules, or other information of the conductive element 2, which can be sent to the control module 5 via control commands, so that the control module 5 controls the on / off state of the electronic switch 4 based on this information.

[0176] This embodiment of the application, by setting up a storage module 6, allows users to conveniently control the on / off state of the conductive element 2 and the conductor 31, realize complex arrangement of the conductive element 2 electrically connected to the conductor 31 and quickly adjust the arrangement, further improving the user experience.

[0177] See Figure 17 In some embodiments, the input device 100 may further include a communication module 7, which is electrically connected to the control module 5 and the storage module 6, for communicating with external electronic devices to obtain control commands and provide control commands to the control module 5 and / or the storage module 6.

[0178] The communication module 7 can be a wired communication module or can transmit data via radio waves. Wireless communication modules may include cellular communication modules (such as 2G / 3G / 4G / 5G modules), Wi-Fi modules, Bluetooth modules, ZigBee modules, etc. The communication module 7 can easily obtain control commands by communicating with other external electronic devices or cloud platforms. These control commands can be directly sent to the control module 5 to control the electric switch 4, or they can be stored in the storage module 6 and then sent to the control module 5 according to user needs.

[0179] By setting up a communication module 7 in this embodiment, the controller 51 can interact with other external electronic devices or cloud platforms, further facilitating the user's control over the on / off state of the conductive component 2 and the conductor 31.

[0180] In addition, see Figures 15 to 17 The input device 100 also includes a power supply module VCC, which may include a battery. The battery capacity can be determined based on factors such as the size of the input device 100 and its standby time. For smaller input devices 100, the battery can be a micro battery such as a button cell (e.g., CR2032). Many types and specifications of micro batteries are available, and designers can choose flexibly according to actual needs; this application does not impose specific limitations on this. Furthermore, the input device 100 may also include a solar panel, which can utilize natural light to charge the battery, further extending its usage time.

[0181] To ensure battery safety during charging, prevent overcharging and over-discharging, and optimize energy acquisition and storage efficiency, the input device 100 may also include a charging management integrated circuit. The charging management integrated circuit is electrically connected to the solar panel and the battery to manage the electrical energy acquired by the battery from the solar panel and to charge the battery.

[0182] The following combination Figures 18 to 21 The specific connection method between the insulating shell 1 and the conductive component 2 will be described in detail.

[0183] In some embodiments, the insulating housing 1 has a receiving cavity, in which the control module 5 and the electric control switch 4 are disposed; the shell wall of the insulating housing 1 has a plurality of through holes, each through hole corresponding to a conductive element 2, and the conductive element 2 is at least partially disposed in the through hole. The conductive element 2 can be electrically connected to the electric control switch 4 via a wire 24.

[0184] In this embodiment, the conductive element 2 is disposed on the insulating housing 1 through a through hole, which ensures a tight connection between the conductive element 2 and the insulating housing 1, improving the overall structural stability of the input device 100. Furthermore, by using a through hole to install the conductive element 2, complex bonding and snap-fit ​​processes are avoided, simplifying the assembly steps of the conductive element 2, reducing assembly difficulty, improving assembly efficiency, and ultimately reducing production costs.

[0185] In some embodiments, the first end of the conductive element 2 is further away from the receiving cavity than the second end of the conductive element 2. Figures 18 to 21 Regarding the conductive element 2 provided on the insulating shell 1 in the middle part, the first end of the conductive element 2 is the lower end of the conductive element 2, and the second end of the conductive element 2 is the upper end of the conductive element 2. The lower end of the conductive element 2 is farther away from the receiving cavity than the upper end of the conductive element 2.

[0186] See Figure 18 The end face of the first end of the conductive element 2 can be flush with the outer surface of the insulating housing 1. This makes the input device 100 look neater and more aesthetically pleasing, thereby enhancing the overall feel and sophistication of the input device 100, and improving the visual effect and user experience of the input device 100.

[0187] In addition, see Figure 19The end face of the first end of the conductive element 2 can also protrude from the outer surface of the insulating housing 1. The designer can determine the protrusion height of the first end face of the conductive element 2 based on factors such as the structural strength, wear rate, and processing precision of the conductive element 2; this embodiment does not impose a specific limitation on this. Thus, when the input device 100 acts on the capacitive touch-sensitive surface, the end face of the first end of the conductive element 2 can be closer to or in closer contact with the capacitive touch-sensitive surface, thereby improving the reliability of the capacitive coupling between the conductive element 2 and the capacitive touch-sensitive surface and ensuring the accuracy of the electronic device in recognizing the arrangement of multiple conductive elements 2.

[0188] See Figure 21 In some embodiments, the conductive element 2 can be directly disposed on the outer surface of the insulating housing 1. Exemplarily, the conductive element 2, the control module 5, and the electronic switch 4 are located on the outside of the insulating housing 1 and connected to the outer surface of the insulating housing 1. The conductive element 2, the control module 5, and the electronic switch 4 can be directly disposed on the surface of the insulating housing 1 using methods such as bonding, welding, or snap-fitting.

[0189] In this embodiment, the conductive element 2 is directly provided on the outer surface of the insulating shell 1, which can eliminate the step of machining the through hole 12 on the insulating shell 1, and has the advantages of simple processing and low cost.

[0190] In other embodiments, the conductive element 2 may also be disposed entirely inside the insulating housing 1. For example, see... Figure 20 The insulating housing 1 has a receiving cavity (not shown in the figure); the conductive element 2 is at least partially disposed in the receiving cavity, and the distance d1 between the conductive element 2 and the outer surface of the insulating housing 1 is greater than or equal to 0.1 mm and less than or equal to 2 mm. For example, d1 can be 0.1 mm, 0.2 mm, 0.5 mm, 0.6 mm, 0.8 mm, 1 mm, 1.2 mm, 1.4 mm, 1.6 mm, 1.8 mm, 2 mm, etc.

[0191] The distance between the conductive element 2 and the outer surface of the insulating shell 1 can be directly controlled by controlling the thickness of the insulating shell 1, or it can be... Figure 20As shown, a blind hole is provided on the inner wall of the insulating housing 1, and the depth of the blind hole is indirectly controlled. For the insulating housing 1 with the blind hole, the thickness of the insulating housing 1 can be relatively thick, for example, 30-65mm. For example, the thickness of the insulating housing 1 can be directly set to 0.15mm, or a blind hole can be opened on the inner wall of a thicker insulating housing 1, so that the distance between the bottom wall of the blind hole and the outer surface of the insulating housing 1 is 0.15mm. In this case, the distance between the conductive element 2 and the outer surface of the insulating housing 1 is very small. When the user holds the input device 100 and acts on the capacitive touch surface, even if there is an insulating housing 1 between the conductive element 2 and the capacitive touch surface, it will not affect the capacitive coupling between the conductive element 2 and the capacitive touch surface.

[0192] See Figure 22 , Figure 22 This is an exemplary encoding diagram of an input device provided in an embodiment of this application. (In conjunction with...) Figure 5 As shown, an arrangement area 311 is provided on the outer surface of the input device. N first conductive elements 331 (N is an integer greater than 2, such as 3) and M second conductive elements 332 (M is an integer greater than or equal to 0) are provided on the arrangement area 311. The arrangement of the N first conductive elements and the M second conductive elements on the outer surface is a first preset arrangement. The N first conductive elements 331 form a preset non-rotationally symmetric pattern, which is used to identify the input device as a recognizable input device. The M second conductive elements 332 are used to encode the input device.

[0193] like Figure 22 As shown, N is 3, and the non-rotationally symmetric figure formed by the three first conductive elements 331 is "L"-shaped. A Cartesian coordinate system is constructed based on the three first conductive elements, and multiple coding regions are divided within the Cartesian coordinate system. M second conductive elements 332 are set within each coding region. Specifically, a Cartesian coordinate system is constructed with the center point of one of the first conductive elements as the origin of the coordinate system, and the two directions pointing from the center point of the first conductive element to the center points of the other two first conductive elements as the horizontal and vertical axes of the Cartesian coordinate system. Multiple adjacent coding regions are divided within the coordinate system.

[0194] In practical applications, the shape and size of each conductive element (including the first and second conductive elements) can be designed so that the size of the touch point formed by each conductive element on the capacitive touch-sensitive surface is less than or equal to K. Based on the size of the touch point, the arrangement area 311 is divided as follows: Figure 22 The diagram shows 15 identical square regions, each with a side length of H, where H is greater than or equal to K. The relative distance between the center points of any two adjacent regions is H. Figure 4The number in the upper left corner of each region is the region number. Regions 1, 4 and 13 are reference regions. The reference regions are used to set the first conductive elements so that the three first conductive elements form a non-rotationally symmetric "L" shape.

[0195] When placing conductive components within each region, the center point of the conductive component coincides with the center point of the region. The center point of the first conductive component in region 1 can be set as the origin of a Cartesian coordinate system. The direction from the center point of region 1 to the center point of the first conductive component in region 4 is the positive (or negative) direction of the X-axis (horizontal axis) in the Cartesian coordinate system. The direction from the center point of region 1 to the center point of the first conductive component in region 13 is the negative (or positive) direction of the Y-axis (vertical axis) in the Cartesian coordinate system. Figure 22 In the constructed rectangular coordinate system, the symbol X2 represents the X-axis and the symbol Y2 represents the Y-axis.

[0196] Among them, regions 2 and 3, regions 5-12, and regions 14 and 15 are coding regions. Each coding region corresponds to a symbol in the encoding of the input device. The number in the lower right corner of each coding region is the region number of the coding region. The region number also represents the bit index of the coding region. The bit index is the position of the symbol in the encoding.

[0197] When the arrangement area 311 abuts against the capacitive touch-sensitive surface, both the first conductive element 331 and the second conductive element 332 can come into contact with the capacitive touch-sensitive surface and undergo capacitive coupling with the capacitor on the capacitive touch-sensitive surface. To avoid confusion, the capacitor capacitively coupled with the first conductive element 331 will be referred to as the first target capacitor, and the capacitor capacitively coupled with the second conductive element 332 will be referred to as the second target capacitor. The first target capacitor and the second target capacitor are collectively referred to as the target capacitor.

[0198] like Figure 22 As shown, when a touch operation is performed via an input device, each area in arrangement area 311 corresponds to an area in the capacitive touch-sensitive surface. The area in the capacitive touch-sensitive surface corresponding to the reference area (hereinafter referred to as the positioning area) has a first target capacitor capacitively coupled to the first conductive element, and the center point of the first target capacitor is located at the center point of the positioning area. When a second conductive element is provided in the encoding area, the area in the capacitive touch-sensitive surface corresponding to the encoding area (hereinafter referred to as the decoding area) has a second target capacitor capacitively coupled to the second conductive element, and the center point of the second target capacitor is located at the center of the decoding area. When no second conductive element is provided in the encoding area, there is no second target capacitor capacitively coupled to the second conductive element in the decoding area corresponding to the encoding area.

[0199] Based on the above examples, the coordinates of the encoded region in this rectangular coordinate system can be represented by the coordinates of the center point of the encoded region in the rectangular coordinate system. The coordinates of the encoded region in this rectangular coordinate system can be called the preset coordinates. Since the relative positional relationship between the encoded region and the reference region is fixed and known, the relative positional relationship between each decoded region and the positioning region is also fixed and known.

[0200] Furthermore, the relative distance between any two first target capacitors matches a preset distance, and the included angle between any two sides matches a preset angle. One endpoint of each side is the center point of one first target capacitor, and the other endpoint is the center point of another first target capacitor. For example... Figure 22 As shown, since the distance between the center point of region 1 and the center point of region 4 is fixed, the distance between the first target capacitor corresponding to the first conductive element in region 1 and the first target capacitor corresponding to the first conductive element in region 4 is a preset distance 3H. Furthermore, the angle between a side formed by the first target capacitor corresponding to the first conductive element in region 1 and the first target capacitor corresponding to the first conductive element in region 4 as their two endpoints, and another side formed by the first target capacitor corresponding to the first conductive element in region 1 and the first target capacitor corresponding to the first conductive element in region 13 as their two endpoints, is equal to a preset angle of 90 degrees.

[0201] For example, the encoding of the input device can be a binary number. When the encoding region has a second conductive element, the corresponding code element of the encoding region is 1; when the encoding region does not have a second conductive element, the corresponding code element of the encoding region is 0. The decoding region corresponds one-to-one with the encoding region. Therefore, for each encoding region, when a second target capacitor formed by the second conductive element exists in the decoding region, the corresponding code element of the decoding region is 1; when a second target capacitor formed by the second conductive element does not exist in the decoding region, the corresponding code element of the decoding region is 0. Furthermore, since the relative positional relationship between the decoding region and the first target capacitor is the same as the relative positional relationship between the corresponding encoding region and the first conductive element, the decoding region and the corresponding encoding region correspond to the same bit index.

[0202] like Figure 22 As shown, the arrangement area 311 has a total of 12 coding areas. Therefore, the encoding of the input device is a 12-bit binary number. Coding area 1 has no second conductive element, so the first bit of the binary number is 0. Coding area 2 has a second conductive element, so the second bit of the binary number is 1, and so on. This allows us to determine... Figure 22The input device shown is coded as “010111101010”. It can be understood that when no second conductive element is provided in any of the coded areas, the input device is coded as “000000000000”, while when a second conductive element is provided in all coded areas, the input device is coded as “111111111111”.

[0203] Each input device has one or more outer surfaces, and each outer surface can be provided with an arrangement area 311. A set of conductive elements on each arrangement area 311 can encode the input device to form a 12-bit binary number (i.e., an encoding). For each symbol in the binary number, the corresponding encoding area is determined from the 12 encoding areas according to the bit index of the symbol in the binary number. When the symbol is 1, a second conductive element is provided in the corresponding encoding area; when the symbol is 0, no second conductive element is provided in the corresponding encoding area.

[0204] Of course, the encoding of the input device can also be a non-binary number; for example, the encoding of the input device can be a decimal number. In this case, the second conductive element can be designed so that it can cause different levels of capacitance change on the capacitive touch surface. For example, if the second conductive element can cause three levels of capacitance change, then when the second conductive element is not set in the encoding area, the corresponding code element of the encoding area is 0; when the second conductive element is set in the encoding area, and the capacitance change caused by the second conductive element is the first level out of three, the corresponding code element of the encoding area is 1; when the second conductive element is set in the encoding area, and the capacitance change caused by the second conductive element is the second level out of three, the corresponding code element of the encoding area is 2; when the second conductive element is set in the encoding area, and the capacitance change caused by the second conductive element is the third level out of three, the corresponding code element of the encoding area is 3. Thus, each code element can be one of 0, 1, 2, and 3.

[0205] like Figure 22 As shown, the arrangement area 311 has a total of 12 coding areas. Therefore, when the code is a decimal number, there is no second conductive element in coding area 1, so the first digit of the decimal number is 0. There is a second conductive element in coding area 2. If the capacitance change caused by the second conductive element is at the second level, then the second digit of the decimal number is 2. And so on, the corresponding second conductive element can be set in the corresponding coding area according to the code element in the encoding of the input device.

[0206] like Figure 22As shown, the non-rotationally symmetric shape formed by multiple first conductive elements 331 is "L"-shaped, and the relative distance between any two first conductive elements 331 is a preset distance (hereinafter referred to as the preset distance). Based on this, when a touch operation is performed through the input device, multiple target capacitors exist on the capacitive touch-sensitive surface, and each target capacitor is capacitively coupled to one of the conductive elements. Among the multiple target capacitors, each first target capacitor is located within the positioning area corresponding to the reference area. The electronic device can identify each first target capacitor from the multiple target capacitors based on the relative positional relationship between the various target capacitors.

[0207] Simultaneously, each second target capacitor is located within the corresponding decoding area of ​​the encoding area. The electronic device can determine the bit index corresponding to the decoding area based on the relative positional relationship between the decoding area and multiple first target capacitors (i.e., positioning areas), and determine whether there is a second target capacitor within the decoding area. When there is a second target capacitor, the corresponding code is determined based on the pixel value of the second target capacitor. When there is no second target capacitor (i.e., no second conductive element is provided), the code can be determined as the default code 0. In this way, each code in the encoding can be determined. The encoding of the input device can be obtained by combining all the code and the bit index corresponding to each decoding area.

[0208] In practical applications, by properly setting the size of each conductive component, the target capacitances generated by each conductive component on the capacitive touch surface can be prevented from interfering with each other, and each target capacitance can be clearly identified and distinguished by electronic devices.

[0209] Among them, when the input device is Figure 14-16 In the aforementioned input device, the outer surface of the input device is provided with multiple conductive elements, including N third conductive elements and M fourth conductive elements. The third conductive elements have similar functions to the first conductive elements and are always grounded. The fourth conductive elements have similar functions to the second conductive elements and are grounded through an electronically controlled switch among all the conductive elements on the outer surface except for the third conductive elements. The arrangement of the N third conductive elements and the M fourth conductive elements on the outer surface is a second preset arrangement.

[0210] Optionally, in order to improve the accuracy of the decoding process, when using... Figure 22 When encoding using the method shown, one or more error correction codes can be set in the encoding of the input device. These error correction codes can be Reed-Solomon error correction codes, Hamming codes, turbine codes, polar codes, etc. For example, for... Figure 22 The encoding method shown allows the 10th and 12th bits of the encoding to be set as error correction codes.

[0211] It should be understood that the above are merely illustrative examples, and the encoding methods for input devices may include, but are not limited to, the examples described above. In practical applications, the input device can be encoded using any encoding method through conductive components on the input device, as long as the encoding is feasible and can be recognized by the capacitive touch-sensitive surface.

[0212] See Figure 23 , Figure 23 This is a schematic diagram of a touch operation response flow provided in an embodiment of this application. For example... Figure 23 As shown, this method is performed by the electronic device in the example above and includes the following steps:

[0213] S110. When the outer surface triggers the first touch operation on the capacitive touch-sensitive surface, determine the target capacitor that is capacitively coupled to the target conductive component from among the multiple capacitors on the capacitive touch-sensitive surface.

[0214] The target conductive component includes a grounded conductive component among multiple conductive components disposed on the outer surface. For example... Figure 5 As shown, multiple conductive components are fixedly mounted on the outer surface. When... Figure 5 When the outer surface of the input device shown performs a first touch operation, multiple conductive elements on the outer surface are grounded, and the target conductive elements include all conductive elements on the outer surface. For example... Figure 14 As shown, the control module can control some or all of the conductive parts on the outer surface to be grounded when... Figure 14 When the outer surface of the input device shown performs a first touch operation, the target conductive element includes a grounded conductive element among a plurality of conductive elements disposed on the outer surface.

[0215] And, combined Figure 22 As shown, in order to accurately determine the encoding information of the input device, regardless of the method used... Figure 5 or Figure 14 Which input device performs the touch operation? The first and third conductive elements used for positioning are both grounded, meaning the target conductive element includes either the first or the third conductive element.

[0216] And, when through Figure 5 When the outer surface of the input device shown performs a first touch operation, the target capacitor includes a first target capacitor capacitively coupled to a first conductive element, and a second target capacitor capacitively coupled to a second conductive element on the outer surface (the second conductive element is always grounded). Based on this, when... Figure 14 When the outer surface of the input device shown performs a first touch operation, the target capacitor includes a first target capacitor that is capacitively coupled to a third conductive element, and a second target capacitor that is capacitively coupled to a fourth conductive element on the outer surface (the fourth conductive element is grounded via an electronically controlled switch).

[0217] S120. Determine the coding information corresponding to the target conductive component based on the target capacitance.

[0218] Optionally, S120 may include:

[0219] N first target capacitors and M second target capacitors are determined from multiple target capacitors. A target coordinate system is constructed based on the N first target capacitors. Based on the target coordinate system, the M second target capacitors are decoded to obtain the encoded information.

[0220] In this configuration, N first target capacitors correspond one-to-one with N first target conductive elements, and M second target capacitors correspond one-to-one with M second target conductive elements. When a first target conductive element includes a first conductive element, a second target conductive element includes a second conductive element; when a second target conductive element includes a third conductive element, a second target conductive element includes a fourth conductive element that is in a grounded state.

[0221] For example, during operation, an electronic device can periodically scan the capacitive electrode array on a capacitive touch-sensitive surface. During each scan, the capacitance change of each capacitor in the array can be acquired, and a capacitance image can be drawn based on the capacitance change of each capacitor. After acquiring each capacitance image, it can be determined whether multiple touch points exist in the image, each touch point corresponding to a target capacitor. If multiple touch points are determined to exist in the capacitance image, it can be determined that multiple target capacitors exist on the capacitive touch-sensitive surface.

[0222] See Figure 24 , Figure 24 Through Figure 22 The diagram shows a partial capacitance image of the input device during a touch operation. In this capacitance image 70, the pixel value of each pixel represents the change in capacitance of the corresponding capacitor. A larger pixel value indicates a greater change in capacitance, and consequently, a higher pixel brightness. (Combined with...) Figure 22 As shown, when passing through Figure 22 When the outer surface shown is touched, each conductive element in the arrangement area 311 is in contact with the capacitive touch-sensitive surface. Each conductive element is a target conductive element. Each conductive element can capacitively couple with the capacitor (i.e., the target capacitor) at the contact position, causing the capacitance change of the target capacitor to change. Each first conductive element 331 (or third conductive element) can form a first touch point 71 in the capacitance image 70, and each second conductive element 332 (or fourth conductive element) can form a second touch point 72 in the capacitance image 70. The first touch point 71 corresponds to the first target capacitor on the capacitive touch-sensitive surface, and the second touch point 72 corresponds to the second target capacitor on the capacitive touch-sensitive surface.

[0223] When the capacitance image includes Figure 24 When multiple touch points are shown, due to Figure 24 The multiple touch points shown are Figure 22 The multiple conductive components shown correspond one-to-one, through Figure 24 Multiple touch points can be determined Figure 22 The input device is encoded by encoding multiple conductive elements (i.e. target conductive elements).

[0224] The touch point, also known as the touch area, is typically composed of one or more pixels with a value greater than a preset threshold. A pixel value greater than the preset threshold indicates that the capacitance change of the corresponding pixel has changed significantly due to the presence of conductive components. Generally, the pixel located at the center of the touch area (hereinafter referred to as the center pixel) has the largest pixel value. The coordinates of the center pixel are usually the coordinates of the touch point on the capacitive touch-sensitive surface, and the capacitance corresponding to the center pixel is the target capacitance.

[0225] It should be understood that when an electronic device periodically scans the array of capacitive electrodes in a capacitive touch-sensitive surface to acquire a capacitance image, if it does not pass through... Figure 22 When the input device shown performs a touch operation, the capacitance image acquired by the electronic device generally does not contain [the following]. Figure 24 The touch point shown.

[0226] As described above, when encoding the input device, the size of each conductive element can be reasonably set so that the size of the touch point formed by each conductive element in the capacitance image is less than or equal to K, for example, 3 pixels. After acquiring the capacitance image, the electronic device can find each pixel in the capacitance image whose pixel value is greater than a preset threshold. For each pixel whose pixel value is greater than the preset threshold, the pixel values ​​of other pixels within a square area with a side length of 3 pixels (the size of both the first touch point and the second touch point is less than or equal to 3 pixels) centered on that pixel are determined. If the pixel values ​​of other pixels are all greater than the preset threshold and less than the pixel value of that pixel, then the square area is determined to be either the first touch point or the second touch point.

[0227] Next, for each pixel within the square region, the product of the pixel value and its X-axis coordinate in the original coordinate system of the capacitive image is calculated, yielding a first product result. The product of the pixel value and its Y-axis coordinate in the original coordinate system of the capacitive image is then calculated, yielding a second product result. For all pixels within the square region, all first product results are summed to obtain a first summation result, and the pixel values ​​of all pixels within the square region are summed to obtain a second summation result. Dividing the first summation result by the second summation result yields the X-axis coordinate of the center of the square region. Similarly, summing all second product results yields a third summation result, and dividing the third summation result by the second summation result yields the Y-axis coordinate of the center of the square region. This provides the center coordinates of the square region, which are the center coordinates of the touch point in the original coordinate system of the capacitive image. Therefore, all touch points in the capacitive image and the center coordinates of each touch point can be determined.

[0228] As described above, if the capacitance image is determined to include multiple touch points, then it can be determined that the capacitive touch-sensitive surface contains multiple target capacitors. In the case where the capacitance image includes multiple touch points, it can be determined whether there are N first touch points among the multiple touch points. If it is determined that there are N first touch points, then it can be determined that the capacitive touch-sensitive surface contains N first target capacitors, and the conductive component that capacitively couples with the first target capacitors is the first target conductive component.

[0229] If there are N first touch points, a target coordinate system can be constructed based on these N first touch points (i.e., the first target capacitors). Conversely, if there are no N first touch points, the input device is determined to be a normal input device, and touch operations are processed according to the conventional procedure.

[0230] Optionally, the step of constructing a target coordinate system based on N first touch points may include: determining a first target touch point, a second target touch point, and a third target touch point from the N first touch points; the relative distance between each pair of the first target touch point, the second target touch point, and the third target touch point is a preset distance; and constructing the target coordinate system by taking the first target touch point as the origin of the rectangular coordinate system, taking the direction from the first target touch point to the second target touch point as the X-axis direction of the rectangular coordinate system, and taking the direction from the first target touch point to the third target touch point as the Y-axis direction of the rectangular coordinate system.

[0231] like Figure 22As shown, during the setting of the encoding area, a Cartesian coordinate system is constructed based on three first conductive elements. The center point of the first conductive element in region 1 is the origin. The direction from the center point of the first conductive element in region 1 to the center point of the first conductive element in region 4 is the positive direction of the X-axis in the coordinate system, and the direction from the center point of the first conductive element in region 1 to the center point of the first conductive element in region 13 is the negative direction of the Y-axis in the coordinate system. Furthermore, based on the relative distances between the regions, it can be determined that the relative distance between the first touch point corresponding to region 1 and the first touch point corresponding to region 4 is approximately equal to or close to a preset distance 3H; the relative distance between the first touch point corresponding to region 1 and the first touch point corresponding to region 13 is approximately equal to or close to a preset distance 3H; and the relative distance between the first touch point corresponding to region 4 and the first touch point corresponding to region 13 is approximately equal to or close to a preset distance 3H. The touch point corresponding to the area refers to the touch point formed by the conductive parts within the area, and the relative distance between two touch points is specified as the distance between the center coordinates of the two touch points.

[0232] After determining the presence of multiple touch points in the capacitive image using the above method, the relative distance between each pair of touch points is calculated. If the relative distance between two touch points is... These two touch points are then identified as the two first touch points corresponding to regions 4 and 13, respectively. If the relative distance between one of the touch points and both of these first touch points is a preset distance of 3H, then the touch point can be identified as the first touch point corresponding to region 1, and this first touch point is the first target touch point.

[0233] See Figure 25 , Figure 25 A schematic diagram of the construction of a coordinate system provided in an embodiment of this application is shown. Figure 25 In the capacitance image 80 shown, each dashed box represents a decoding region. The number in the lower right corner of the decoding region is the region number, which is consistent with the bit index of the corresponding decoding region. Touch point 801 is the first touch point corresponding to the first conductive element in region 1, touch point 802 is the first touch point corresponding to the first conductive element in region 4, and touch point 803 is the first touch point corresponding to the first conductive element in region 13.

[0234] After determining that touch point 801 is the first touch point (i.e., the first target touch point) corresponding to region 1 using the above method, the center point of touch point 801 can be used as the origin of the target coordinate system. For touch points 802 and 803, a first vector 804 pointing from the center of touch point 801 to the center of touch point 802 is determined, as well as a second vector 805 pointing from the center of touch point 801 to the center of touch point 803. If the cross product between the first vector 804 and the second vector 805 is negative, then the first vector 804 is located on the X2 axis of the target coordinate system, and the second vector 805 is located on the Y2 axis of the coordinate system. Therefore, touch point 802 can be determined as the first touch point (i.e., the second target touch point) corresponding to region 4, and touch point 803 as the first touch point (i.e., the third target touch point) corresponding to region 13.

[0235] Next, the direction from the center point of touch point 801 to the center point of touch point 802 can be determined as the positive direction of the X2 axis in the target coordinate system, and the direction from the center point of touch point 801 to the center point of touch point 803 can be determined as the negative direction of the Y2 axis in the coordinate system. This allows the construction of a target coordinate system composed of the X2 and Y2 axes. Simultaneously, the angle β between the X1 and X2 axes in the original coordinate system of the capacitance image can be calculated and determined.

[0236] It can be understood that after determining the first vector 804 and the second vector 805, if the cross product between the first vector 804 and the second vector 805 is determined to be positive, then the first vector 804 can be determined to be located on the Y2 axis of the coordinate system, and the second vector 805 can be determined to be located on the X2 axis of the coordinate system. Therefore, touch point 802 can be determined to be the first touch point (i.e., the third target touch point) corresponding to region 13, and touch point 803 can be determined to be the first touch point (i.e., the second target touch point) corresponding to region 4. Subsequently, the direction from the center point of touch point 801 to the center point of touch point 803 can be determined to be the X2 axis direction of the coordinate system, and the direction from the center point of touch point 801 to the center point of touch point 802 can be determined to be the Y2 axis direction of the coordinate system.

[0237] In this embodiment, after the target coordinate system is constructed, the second touch point (i.e. the second target capacitor) in the capacitance image can be decoded based on the target coordinate system to obtain the encoding information of the input device.

[0238] Optionally, in the process of decoding M second target capacitors to obtain encoded information based on the target coordinate system, for each second target capacitor, the code element in the encoded information corresponding to the second target capacitor can be determined according to the capacitance change of the second target capacitor, and the encoded information can be determined based on the bit index and code element corresponding to the M second target capacitors respectively.

[0239] For example, the second target capacitor corresponds to the second touch point in the capacitance image, and the capacitance change of the second target capacitor corresponds to the pixel value of the second touch point. During the decoding process based on the second target capacitor, M second touch points can be determined from the other touch points included in the capacitance image besides the first touch point; M is an integer greater than or equal to 0, and the M second touch points are located within the target area in the target coordinate system; for each second touch point, the bit index corresponding to the second touch point (i.e., the second target capacitor) is determined based on the coordinates of the second touch point in the target coordinate system; for each second touch point, the code element in the encoding information corresponding to the second touch point (i.e., the second target capacitor) is determined based on the pixel value of the second touch point; wherein, the pixel value of the second touch point is the pixel value of the second touch point in the capacitance image of the capacitive touch-sensitive surface; the encoding information is determined based on the bit index and code element corresponding to each of the M second touch points.

[0240] In one implementation, after establishing the target coordinate system, the presence of a second touch point can be determined from among the touch points other than the first touch point. For example... Figure 22 As shown, the X-axis coordinate of the center point of each second conductive element is not less than the X-axis coordinate of the center point of the first conductive element in region 1 (which is 0), and not greater than the X-axis coordinate of the center point of the first conductive element in region 4 (3H). The Y-axis coordinate of the center point of each second conductive element is not greater than the Y-axis coordinate of the center point of the first conductive element in region 1 (which is 0), and not less than the Y-axis coordinate of the center point of the first conductive element in region 13 (which is -3H). That is, all the second conductive elements are located within a rectangular area of ​​the coordinate system. The coordinates of the upper left corner of this rectangular area are (0, 0), and the coordinates of the lower right corner are (3H, -3H).

[0241] Correspondingly, such as Figure 25 As shown, in the target coordinate system, the X-axis coordinate of the center point of each second touch point is not less than the X-axis coordinate of touch point 801 (0) and not greater than the X-axis coordinate of touch point 802 (3H). The Y-axis coordinate of each second touch point is not greater than the Y-axis coordinate of touch point 801 (0) and not less than the Y-axis coordinate of touch point 803 (-3H). That is, all second touch points are located within a rectangular target area in the target coordinate system. The coordinates of the upper left corner of the target area are (0, 0) and the coordinates of the lower right corner are (3H, -3H).

[0242] After constructing the target coordinate system, when determining that the capacitance image also includes other touch points, if the other touch points are located within the target area, that is, the X-axis coordinate of the touch point is greater than or equal to 0 and less than or equal to 3H, and the Y-axis coordinate is less than or equal to 0 and greater than or equal to -3H, then the touch point is determined to be the second touch point. Otherwise, the touch point is determined not to be the second touch point.

[0243] When the capacitive image includes a second touch point, the coordinates of the second touch point in the target coordinate system are determined. If the coordinates are one of the preset coordinates, or the distance between the coordinates and a preset coordinate is less than or equal to 3 pixels, then the bit index corresponding to the second touch point is determined to be the bit index corresponding to the decoding area corresponding to the preset coordinates.

[0244] When the input device uses binary data, the code corresponding to each second touch point can be directly determined to be 1. When the input device uses decimal data, multiple pixel value ranges can be set, each corresponding to a different level of capacitance change, with each range containing a code element. For each second touch point, the target pixel value range containing the center pixel of the second touch point can be determined, and the code element corresponding to the target pixel range is used as the code element for the second touch point.

[0245] For example, when through Figure 22 When the input device shown performs a touch operation, there will be 7 second touch points in the target area. The bit index and code element corresponding to each second touch point can be determined. At the same time, the code element corresponding to other bit indices in the encoded information can be determined as the default code element 0. All code elements can be combined based on the bit index corresponding to each code element, and thus the encoded information can be determined as 010111101010.

[0246] It should be noted that after constructing the coordinate system, if it is determined that there are no other touch points in the capacitance image, it can be determined that each symbol in the encoded information is a default symbol.

[0247] In this embodiment of the application, after constructing the target coordinate system, the second touch point is determined, and the encoding information is determined according to the bit index and code element corresponding to the second touch point. Only the second touch point can be processed, which can reduce the amount of data processing and improve the efficiency of determining the encoding information.

[0248] Optionally, in the process of determining the second touch point, for each other touch point, if the coordinates of the other touch point in the target coordinate system correspond to one of the preset coordinates, then the other touch point is determined as the second touch point.

[0249] Combination Figure 22As shown, after constructing the target coordinate system, for each other touch point present in the capacitive image, the coordinates of the other touch points in the target coordinate system can be determined. If the coordinates of another touch point in the target coordinate system overlap with a certain preset coordinate or the distance between the other touch point and the preset coordinate is less than or equal to a preset distance threshold (i.e., close to overlap), then the other touch point can be determined as the second touch point. Conversely, if an other touch point does not overlap with any of the preset coordinates and the distance between the other touch point and each of the preset coordinates is greater than the preset distance threshold, then the other touch point is determined not to be the second touch point.

[0250] Optionally, in the process of decoding M second target capacitors to obtain encoded information based on the target coordinate system, multiple decoding regions can be determined from the target coordinate system based on multiple preset coordinates; the multiple decoding regions correspond one-to-one with multiple bits of code in the encoded information; for each decoding region, the code corresponding to the decoding region is determined according to the pixel value of the pixel in the decoding region; the pixel in the decoding region is the pixel in the capacitance image of the decoding region on the capacitive touch-sensitive surface; the encoded information is obtained by combining the code corresponding to the multiple decoding regions respectively.

[0251] like Figure 22 As shown, multiple preset coordinates represent the coordinates of the center points of multiple encoding regions in the coordinate system. These preset coordinates correspond one-to-one with the multiple encoding regions and are consistent with the bit index of each encoding region. Similarly, the multiple encoding regions correspond one-to-one with the multiple decoding regions; therefore, the multiple preset coordinates also correspond one-to-one with the multiple decoding regions and the multiple bit indices.

[0252] For example, with Figure 25 Taking decoding region 1 as an example, after the target coordinate system is constructed, the preset coordinates of the pre-stored encoding region 1 can be obtained. These preset coordinates correspond to decoding region 1 and are associated with the bit index of decoding region 1. Based on these preset coordinates, the position of the center point of the corresponding decoding region 1 is determined from the target coordinate system. Then, a square region with a side length of H centered on the center point is determined as decoding region 1. The angle between the two opposite sides of the square region and the X1 axis is angle β, and the other two sides are perpendicular to the line segment between touch point 801 and touch point 803. Similarly, each other decoding region can be determined.

[0253] When encoded as binary data, for decoding region 1, it is determined whether a touch point (i.e., a second touch point) exists within decoding region 1. If a second touch point exists, the corresponding code element for decoding region 1 is set to 1; if no second touch point exists, the corresponding code element is set to 0 (i.e., a default code element). This process is repeated to determine the code element for each decoding region. Then, based on the code element and bit index of each decoding region, all code elements are combined to obtain the encoding information of the input device.

[0254] Optionally, determining the code corresponding to the decoding region based on the pixel values ​​of the pixels within the decoding region includes: determining the target pixel value interval where the pixel values ​​of the pixels within the decoding region are located from multiple pixel value intervals; wherein the multiple pixel value intervals correspond to different code symbols; and determining the code symbol corresponding to the decoding region based on the code symbol corresponding to the target pixel value interval.

[0255] like Figure 25 As shown, when the input device's encoding is a binary number, the pixel value range can be divided into two: a first pixel value range (where the pixel value is less than a preset threshold) and a second pixel value range (where the pixel value is greater than or equal to the preset threshold). The code element corresponding to the first pixel value range is 0, and the code element corresponding to the second pixel value range is 1. After determining multiple decoding regions from the capacitive image, for each decoding region, if the pixel value of each pixel within the decoding region is less than the preset threshold, it can be determined that there is no second touch point within the decoding region, and the code element corresponding to the decoding region is the code element 0 corresponding to the second pixel value range. If there are pixels within the decoding region whose pixel value is greater than or equal to the preset threshold, it can be determined that there is a second touch point within the decoding region, and the code element corresponding to the decoding region is the code element 1 corresponding to the second pixel value range.

[0256] For example, when the input device encoding is a decimal number, multiple pixel value ranges can be set, each corresponding to a different level of capacitance change. As previously illustrated, the second conductive element can cause three levels of capacitance change, allowing for four pixel value ranges. The first pixel value range has a lower limit of 0 and an upper limit of a preset threshold, corresponding to code 0. The second pixel value range has a lower limit greater than the preset threshold and an upper limit less than the first pixel value corresponding to the first level of capacitance change, corresponding to code 1. The third pixel value range has a lower limit greater than the first pixel value and an upper limit less than the second pixel value corresponding to the second level of capacitance change, corresponding to code 2. The third pixel value range has a lower limit greater than the second pixel value and an upper limit less than the third pixel value corresponding to the third level of capacitance change, corresponding to code 3. The first pixel value is greater than the preset threshold and less than the second pixel value, and the second pixel value is less than the third pixel value.

[0257] For each decoding region, the maximum pixel value of all pixels within that region can be determined. From multiple pixel value intervals, a target pixel value interval containing the maximum pixel value is identified, and the code symbols corresponding to this target pixel value interval are used as the code symbols for the decoding region. Then, based on the bit index of each decoding region, the code symbols corresponding to all decoding regions are combined to obtain the encoding information of the input device.

[0258] In this embodiment, multiple decoding regions are first determined from the target coordinate system, and then the code elements corresponding to the decoding regions are determined based on the pixel values ​​of the pixels within the decoding regions. The code elements corresponding to the multiple decoding regions are combined to obtain the encoding information, which can quickly and accurately determine the encoding information of the input device.

[0259] Optionally, the step of decoding the M second target capacitors based on the target coordinate system to obtain the encoded information may include:

[0260] For each other touch point in the capacitive image (touch points other than the first touch point, including the second touch point), if the coordinates of the other touch point in the target coordinate system correspond to one of the preset coordinates, then a code element in the encoding information corresponding to the other touch point is determined based on the pixel value of the other touch point; wherein, the pixel value of the other touch point is the pixel value of the other touch point in the capacitive image of the capacitive touch-sensitive surface; and, based on the preset coordinates corresponding to the other touch point, the bit index of the code element corresponding to the other touch point in the encoding information is determined; the encoding information is determined based on all determined code elements and the corresponding bit indices.

[0261] The coordinates of other touch points in the target coordinate system correspond to one of the preset coordinates. This means that the coordinates of other touch points overlap with the preset coordinates, or the distance between the coordinates of other touch points and a certain preset coordinate is less than or equal to a preset distance threshold, and they almost overlap with the preset coordinates.

[0262] For example, after constructing the target coordinate system, if it is determined that the capacitance image also includes other touch points, the coordinates of these other touch points in the target coordinate system can be directly determined. If the coordinates of these other touch points in the target coordinate system overlap with a preset coordinate, then these other touch points can be determined as the second touch point corresponding to the preset coordinate, and thus corresponding to the second target capacitor. Alternatively, if the distance between these other touch points and a certain touch point is less than a preset distance threshold (e.g., 3 pixels), then these other touch points can be determined as almost overlapping with the second touch point corresponding to the preset coordinate, and thus, these other touch points are the second touch point, corresponding to the second target capacitor.

[0263] At this point, a code element in the encoding information corresponding to other touch points can be determined based on the pixel values ​​of those other touch points. For example, when the input device's encoding is binary data, the code element corresponding to the other touch point (i.e., the second touch point) can be directly determined to be 1. When the input device's encoding is decimal data, the target pixel value range in which the pixel value of the other touch point (i.e., the second touch point) is located can be determined, and the code element corresponding to the target pixel value range can be used as the code element corresponding to the other touch point.

[0264] In this embodiment of the application, after constructing the target coordinate system, other touch points besides the first touch point are determined, and the code elements in the encoded information are determined according to the relationship between the other touch points and the preset coordinates. This allows processing of only a small number of touch points, reducing the amount of data processing and improving the efficiency of determining the encoded information.

[0265] S130. Output the feedback information corresponding to the first touch operation according to the encoding information.

[0266] The feedback information includes at least one of the following: interface display, audio-visual prompts, and vibration.

[0267] In one embodiment, corresponding feedback information can be pre-set for the encoding information of each input device. After determining the encoding information of the input device, the corresponding feedback information can be determined and output based on the encoding information to achieve a response to the first touch operation. For example, if it is necessary to trigger the electronic device to open a certain software interface (the feedback information is the interface display) through one of the input devices, the feedback information corresponding to the encoding information of that input device can be set to the software interface. After decoding the encoding information of the input device, the feedback information corresponding to the encoding information can be determined to be the software interface, and the electronic device can be controlled to open the software interface to achieve a response to the first touch operation.

[0268] For example, regarding one of the input devices, if it is necessary to trigger an electronic device to play an audio signal (with audio-visual feedback) through the input device, the feedback information corresponding to the encoding information of the input device can be set to an audio signal. After decoding the encoding information of the input device, it can be determined that the feedback information corresponding to the encoding information is an audio signal, and the audio signal can be played through the speaker to realize the response to the first touch operation.

[0269] For example, regarding one of the input devices, if it is necessary to trigger the electronic device to output an indicator light signal (the feedback information is an audio-visual prompt) through the input device, the feedback information corresponding to the encoded information of the input device can be set as the indicator light signal. After decoding the encoded information of the input device, it can be determined that the feedback information corresponding to the encoded information is the indicator light signal, and then the indicator light can be controlled to turn on to output the indicator light signal, thereby realizing the response to the first touch operation.

[0270] For example, if it is necessary to trigger the electronic device to output a vibration signal (the feedback information is vibration) through one of the input devices, the feedback information corresponding to the encoded information of the input device can be set to vibration. After decoding the encoded information of the input device, it can be determined that the feedback information corresponding to the encoded information is vibration, and then the linear motor can be controlled to start running to output a vibration signal, thereby realizing the response to the first touch operation.

[0271] like Figure 3 As shown, the SOC has an operating system installed, and the operating system has applications (APP1, APP2 and APP1) installed. Feedback information can be output by the applications according to the encoding information, or it can be output by the operating system according to the encoding information. This embodiment does not limit this.

[0272] It should be understood that the above are merely illustrative examples, and the specific types of feedback information may include, but are not limited to, the examples above.

[0273] In this embodiment, during the touch response process, when it is determined that the input device forms multiple touch points on the capacitive touch-sensitive surface, it is determined whether the multiple touch points include N first touch points that constitute a preset non-rotationally symmetric pattern. If N first touch points are included, a target coordinate system is constructed based on the N first touch points. The other touch points are decoded based on the target coordinate system to obtain the encoding information of the input device. The other touch points are the touch points other than the N first touch points among the multiple touch points. The instruction corresponding to the encoding information is executed. This not only enables the capacitive touch-sensitive surface to respond to the input device, but also allows the encoding to be set with corresponding instructions (which can be complex or simple) according to requirements. This allows users to input simple or complex instructions to the capacitive touch-sensitive surface by performing simple touch operations on the capacitive touch-sensitive surface through the input device, which simplifies user operation and expands the application scenarios of the capacitive touch-sensitive surface, meeting the needs of users in some specific scenarios.

[0274] Optionally, in Figure 23 During the execution of S110-S130 shown, when the input device acts on the capacitive touch surface, if a signal change is detected caused by the capacitive touch surface, the microcontroller can process the signal change of the capacitive touch surface to obtain a capacitance image and send the capacitance image to the system-on-a-chip. The capacitance image includes one frame or more frames; the system-on-a-chip is used to obtain encoded information based on the capacitance image.

[0275] like Figure 23As shown, during the operation of the electronic device, the sensing circuit can periodically scan the capacitor electrode array to obtain the capacitance change (i.e., signal change) of each capacitor in the array, and send the capacitance change to the signal processing chip. The signal processing chip performs filtering and amplification on the received capacitance change, and sends the processed capacitance change to the MCU. Based on the received capacitance change of each capacitor, the MCU constructs a capacitance image and sends the capacitance image to the SOC. After receiving the capacitance image, the SOC can perform operations based on the capacitance image. Figure 23 S110-S130 shown implements the response to the first touch operation.

[0276] Optionally, in Figure 23 During the execution of S110-S130 shown, when the input device acts on the capacitive touch surface, if the capacitive touch surface causes a signal change, the microcontroller can process the signal change of the capacitive touch surface to obtain a capacitance image, obtain encoded information based on the capacitance image, and send the encoded information to the system-on-a-chip. The capacitance image includes one frame or multiple frames; the system-on-a-chip is used to output feedback information according to the encoded information.

[0277] like Figure 23 As shown, during the operation of the electronic device, the sensing circuit can periodically scan the capacitor electrode array to obtain the capacitance change (i.e., signal change) of each capacitor in the array, and send the capacitance change to the signal processing chip. The signal processing chip performs filtering and amplification on the received capacitance change, and sends the processed capacitance change to the MCU. The MCU constructs a capacitance image based on the received capacitance change of each capacitor. After obtaining the capacitance image, the MCU executes... Figure 23 As shown in steps S110-S120, the encoded information is obtained and sent to the SOC. After receiving the encoded information, the SOC can perform operations based on the encoded information. Figure 23 S130, as shown, implements the response to the first touch operation.

[0278] In the process of obtaining encoded information based on capacitance image decoding, in order to obtain accurate encoded information, the SOC or MCU can determine the encoded information based on multiple consecutive frames of capacitance images. Alternatively, the encoded information can be determined based on a single frame of capacitance image acquired at a time.

[0279] Optionally, the method may further include:

[0280] Based on N first touch points (i.e. first target capacitors), determine the reference coordinates of the reference point of the input device on the capacitive touch surface, and / or determine the rotation angle of the input device in the capacitive touch surface.

[0281] Based on the reference coordinates and / or rotation angle, execute the instructions corresponding to the encoded information.

[0282] The rotation angle of the input device on the capacitive touch-sensitive surface can be the deflection angle of the first reference line of the input device relative to the second reference line of the capacitive touch-sensitive surface.

[0283] For example, when using Figure 22 When encoding the input device using the encoding method shown, the first reference line of the input device can be the straight line where the X2 axis of the constructed coordinate system is located, and the second reference line of the capacitive touch surface can be the horizontal line of the capacitive touch surface (i.e., the straight line where the X1 axis of the original coordinate system of the capacitive touch surface is located). Then the rotation angle is the deflection angle between the X2 axis and the X1 axis.

[0284] Optionally, in determining the rotation angle of the input device on the capacitive touch-sensitive surface, two fourth target touch points can first be determined from multiple touch points; the rotation angle is determined based on the angle between the first reference line formed by the two fourth target touch points and the second reference line of the capacitive touch-sensitive surface.

[0285] like Figure 25 As shown, when the first reference line of the input device is the straight line containing the X2 axis, the two fourth target touch points are touch point 801 and touch point 802. After acquiring the capacitive image, the touch point coordinates of each touch point can be determined from the capacitive image. Simultaneously, N first touch points can be determined from multiple touch points, and a target coordinate system is constructed in the capacitive image based on these N first touch points. At this point, the angle β between the X2 axis (i.e., the first reference line) containing the two fourth target touch points and the X1 axis (i.e., the second reference line) in the original coordinate system of the capacitive image can be determined, and this angle β is defined as the rotation angle of the input device on the capacitive touch-sensitive surface. It should be understood that the first reference line can also be other types of reference lines; this embodiment does not limit the specific setting method of the reference line.

[0286] For example, when through Figure 22 When encoding the input device using the shown encoding method, the reference point of the input device can be the center point of the arrangement area 311, and the reference coordinates are the coordinates of the center point of the arrangement area 311 on the capacitive touch-sensitive surface (i.e., the capacitive image). Of course, the reference point can also be located at other positions on the input device. After acquiring the capacitive image, N first touch points can be determined from the capacitive image using the aforementioned method, and a coordinate system can be constructed based on the N first touch points.

[0287] like Figure 25As shown, after constructing the target coordinate system, the center point C can be determined from the target coordinate system. The coordinates of the center point C in the target coordinate system are preset (1.5H, -1.5H). The coordinates (1.5H, -1.5H) are the coordinates of the center point of the arrangement area 311 in the coordinate system formed by the X2 axis and the Y2 axis. Then, the coordinates of the center point C in the original coordinate system of the capacitance image can be determined, which are the reference coordinates. It should be understood that the reference point of the input device may include, but is not limited to, the center point of the conductive component arrangement surface.

[0288] During the process of outputting feedback information, feedback information can be output based on the reference coordinates, the rotation angle, or both.

[0289] Optionally, when the capacitive touch-sensitive surface is a capacitive screen, feedback information is output based on reference coordinates and / or rotation angle, including: displaying the object to be displayed corresponding to the input device on the capacitive screen based on the reference coordinates; or, displaying the object to be displayed on the capacitive screen with a rotation angle based on the reference coordinates.

[0290] For example, the feedback information corresponding to the encoded information can be the object to be displayed on the display input device. The object to be displayed can be a picture, symbol, or analog image of the input device, but is not limited to this.

[0291] like Figure 25 As shown, the object to be displayed 806 can be a simulated image of the input device. When the feedback information corresponding to the encoded information is to display the object to be displayed 806 corresponding to the input device, the object to be displayed 806 can be displayed at the reference coordinates, or displayed near the reference coordinates. The rotation angle of the object to be displayed 806 in the capacitive image 80 is the same as the rotation angle of the total touch area in the capacitive image, or the rotation angle of the object to be displayed 806 in the capacitive image 80 can be different from the rotation angle of the total touch area in the capacitive image. This embodiment does not limit this.

[0292] In this embodiment of the application, the object to be displayed corresponding to the input device is displayed based on the reference coordinates and rotation angle of the input device, which can make the position and angle of the object to be displayed match the position and angle of the input device.

[0293] Optionally, the encoding information includes data codes and error correction codes, and the output feedback information includes:

[0294] The data code is corrected based on the error correction code to obtain the error-corrected data code;

[0295] Output feedback information corresponding to the data code after error correction.

[0296] Based on the examples above, regarding Figure 22The encoding method shown allows setting bits 10 and 12 as error correction codes, while bits 1-9 and 11 become data codes. When setting the corresponding instructions for the encoding, feedback information can be set for the data codes. After obtaining the encoded information through a capacitance image, error correction can be performed on the encoded information based on bits 10 and 12. Then, bits 1-9 and 11 are obtained from the corrected encoded information to obtain the data codes, and the feedback information corresponding to the data codes is output.

[0297] Figure 26 A schematic flowchart illustrating a data configuration method provided in an embodiment of this application is shown, such as... Figure 26 As shown in the embodiments of this application, the data configuration method is applied to an electronic device, and the method includes the following steps:

[0298] S110: Controls the capacitive touchscreen display to provide a first interface for configuring the input device.

[0299] S120: Upon receiving a function configuration operation for the first interface, obtain the target function configured for the input device based on the function configuration operation.

[0300] For example, each input device Si has one or more device identifiers, represented by IDs, which can be coded information. When a user needs to configure different functions for the input device Si, different functions can be configured for the input device Si through an electronic device.

[0301] like Figure 27 As shown, Figure 27 An exemplary scenario diagram of the functional configuration of an input device is shown. The specific process of configuring the function of the input device Si includes: the user can trigger a functional configuration option or icon for the input device in the display interface 200 of the electronic device, then the electronic device will receive a functional configuration request for the input device, and then respond to the functional configuration request for the input device, thereby switching from the display interface 200 to the first interface 201, thereby displaying the first interface 201, which includes the ID of the input device Si and the functional configuration area corresponding to the ID. Figure 27 The first interface 201 displays IDs including ID1 for input device S1, ID2 for input device S2, ID3 for input device S3, and so on. The function configuration areas include function configuration area 1 corresponding to ID1, function configuration area 2 corresponding to ID2, function configuration area 3 corresponding to ID3, and so on. After the user triggers the function configuration area Qi corresponding to input device S1, they can set the functions they need to configure for input device S1 in the function configuration area Qi.

[0302] This application embodiment illustrates two configuration methods for setting the functions to be configured for the input device Si in the function configuration area Qi. For the first configuration method (i.e., the user selects the functions to be configured for the input device in the function option bar), when the user triggers the function configuration area Qi, the first interface 201 will display the function option bar Fi corresponding to the function configuration area Qi. The function option bar Fi provides multiple different function options for the user to select.

[0303] like Figure 27 For example, after a user triggers the function configuration area Q1, the first interface 201 will display the function option bar F1 corresponding to the function configuration area Q1. The function option bar F1 provides function 11, function 12, ..., etc. If the user clicks (i.e. performs a function configuration operation) on function 11 in the function option bar F1, then the target function configured for input device S1 is function 11. The process of configuring functions for other input devices such as input device S2 and input device S3 using the first configuration method is the same as the process of configuring functions for input device S1 using the first configuration method, and will not be described again in this application.

[0304] For the second configuration method (i.e., the user directly enters the function name of the function to be configured for the input device in the function input field), after the user triggers the function configuration area Qi, the first interface 201 will display the function input field Ei corresponding to the function configuration area Qi. The user can enter (i.e., perform the function configuration operation) the function name of the function to be configured in the function input field Ei. For example... Figure 27 As shown, for example, after a user triggers the function configuration area Q1, the first interface 201 will display the function input field E1 corresponding to the function configuration area Q1. The function input field E1 displays a writing cursor B. If the user enters the function name "Function 11" in the function input field E1, then the target function configured for input device S1 is function 11. The process of configuring functions for other input devices such as input device S2 and input device S3 using the second configuration method is the same as the process of configuring functions for input device S1 using the second configuration method, and will not be described again in this application.

[0305] For example, after a user performs a function configuration operation on the first interface 201 to configure the input device Si, the electronic device updates the first interface 201 to a function interface 202 in response to the function configuration operation on the input device Si. The function interface 202 includes the input device Si's IDi and the target function configured for the input device Si, and the target function configured for the input device Si is displayed in the corresponding function configuration area Qi of the input device Si.

[0306] like Figure 27As shown, after the user completes the function configuration of input devices S1-S3 respectively, the function interface 202 displays the target function configured by the user for input device S1 as function 11, for input device S2 as function 21, and for input device S3 as function 31. It should be noted that after configuring the function for each input device, the functions of the multiple input devices may be different, and there may also be input devices with the same function.

[0307] S130: Generate functional configuration data for the input device based on the device identifier and target function of the input device.

[0308] After the user configures the functions of the input device Si, the electronic device generates the function configuration data of the input device Si based on the ID of the input device Si and the target function of the input device Si. One data structure of the function configuration data of the input device Si is shown in Table 1:

[0309] Table 1

[0310] ID Function Name Function code Data content ID1 Function 11 101 Date 11 ID2 Function 21 201 Date 21 ID3 Function 31 301 Date 31 ... ... ... ...

[0311] As shown in Table 1, the data structure of the function configuration data of the input device Si includes ID, function name, function code, and data content. The data content can be empty or not. When the data content is not empty, it can be text, a webpage link, an image link, a video link, etc. For function implementation, after the electronic device obtains the ID of the input device Si, it queries the function configuration data using the ID to obtain the function code corresponding to the ID of the input device Si. The corresponding function is then obtained through the function code, and the corresponding operation is executed to achieve the desired function.

[0312] S140: Store the function configuration data in the local space of the electronic device, or send the function configuration data to the server so that the electronic device can perform the target function according to the function configuration data when interacting with the input device.

[0313] After generating the functional configuration data of the input device Si, the functional configuration data of the input device Si is added to the functional configuration data list and then stored. When the electronic device detects that the input device Si is interacting with the electronic device, it reads the ID of the input device Si and then queries the functional configuration data list based on the ID of the input device Si, thereby executing the operation to implement the target function corresponding to the input device Si.

[0314] For example, after a user configures the functions of an input device through an electronic device, the electronic device stores the function configuration data in its local space so that it can execute the target function according to the function configuration data when interacting with the input device. And / or, the electronic device sends the function configuration data of the input device to a server. This serves two purposes: firstly, it enables data backup; secondly, the server provides the data to other electronic devices, ensuring that the same input device can perform its target function not only when interacting with one electronic device but also when interacting with another, thus guaranteeing that the same input device can be used across devices.

[0315] This application employs a method that, in response to a function configuration request for an input device interacting with an electronic device, displays a first interface including a device identifier for the input device and a corresponding function configuration area. Upon receiving a function configuration operation on the first interface, it obtains the target function configured for the input device based on the operation, generates function configuration data for the input device based on the device identifier and the target function, and stores the function configuration data in the local space of the electronic device, or sends the function configuration data to a server. This allows the electronic device to execute the target function based on the function configuration data when interacting with the input device. On one hand, this not only enables the reuse of a single input device but also expands the usage scenarios of the input device. On the other hand, users can interact with electronic devices for different functions by carrying only a small number of input devices, improving the portability of the input devices. For businesses, this reduces the design cost of input devices; for customers, it eliminates the need to purchase additional input devices when buying electronic devices, thus reducing procurement costs.

[0316] The following is an embodiment of an interaction method provided in this application specification.

[0317] Figure 28 A schematic flowchart of an interaction method provided in an embodiment of this application is shown, such as... Figure 28 As shown, the interaction method provided in this application embodiment is applied to an electronic device with a capacitive touch-sensitive surface, which is a capacitive screen. The electronic device carries a variety of applications. The interaction method provided in this application embodiment includes the following steps:

[0318] S210: In response to the target application's open command, display the target application's application interface.

[0319] In one exemplary embodiment, the target application can be understood as an application capable of triggering a target function of the input device, such as a smart stamp, and the target application includes a whiteboard application, a drawing application, etc. After receiving an opening command from the target application, the electronic device responds to the opening command by displaying the application interface of the target application on its capacitive screen.

[0320] S220: When the input device is used on the capacitive screen, obtain the device identifier of the input device, which is used to interact with the electronic device.

[0321] When the target application's interface is displayed on the capacitive screen, if the electronic device detects a touch operation (i.e., a first touch operation) performed by the input device on the capacitive screen, it acquires the device identifier of the input device. The device identifier (i.e., ID) is, for example, encoded information. The process of acquiring the encoded information can be referred to the example above, and will not be repeated here.

[0322] S230: Obtain the function to be executed corresponding to the device identifier from the function configuration data cached by the target application.

[0323] The function configuration data cached by the target application comes from the function configuration data stored in the local space of the electronic device. In other words, the function configuration data cached by the target application is obtained from the local space of the electronic device, and the function configuration data stored in the local space of the electronic device is configured according to the data configuration method described above.

[0324] After obtaining the input device ID, the function configuration data cached by the target application is queried using the input device ID to obtain the function configuration data corresponding to the input device ID. For example, the function configuration data cached by the target application includes data 1-data 10, where the input device ID is specifically ID1, and the ID in data 2 is also ID1. Therefore, the function configuration data corresponding to the input device ID is data 2.

[0325] S240: Execute the target operation corresponding to the function to be executed in the application interface.

[0326] After obtaining the function configuration data corresponding to the input device ID, the function code corresponding to the input device ID can be obtained. The specific function can be obtained through the function code, that is, the function to be executed. Then, the electronic device executes the target operation corresponding to the function to be executed in the application interface.

[0327] like Figure 29 As shown, Figure 29 This diagram illustrates a scenario of interaction between an input device and an electronic device, as provided in an embodiment of this application. 300 represents the application interface of the target application, 400 represents the input device, and 500 represents a "circle". Figure 29As shown in scenario J1, the user touches the input device with the capacitive screen of the electronic device. The electronic device obtains the input device's ID (i.e., encoded information), specifically ID1. The electronic device queries the target application's cached function configuration data using the input device's ID, obtaining the function configuration data corresponding to the input device's ID as data 2. In data 2, the function code corresponding to ID1 is 1001. The first function corresponding to 1001 is drawing a shape, and the second function is "circle," meaning the function to be executed is drawing a "circle." Figure 29 As shown in scenario J2, the electronic device performs the target operation of drawing a "circle" in the application interface, thereby displaying a "circle" graphic at the position touched by the input device in the application interface, thus realizing the function of the input device drawing a "circle" graphic.

[0328] This application embodiment employs a technical solution that displays the application interface of the target application in response to the target application's opening command. When the input device is applied to the capacitive screen of the electronic device, the device identifier of the input device is obtained, and the function to be executed corresponding to the device identifier is obtained from the function configuration data cached by the target application according to the above data configuration method. The target operation corresponding to the function to be executed is then executed in the application interface. This solution enables the execution of the operation corresponding to the target function of each input device based on the function configuration data of the input device obtained by the above data configuration method. This ensures that the target function of each input device is accurately implemented, improves the reliability of implementing the target function of each input device, and makes the interaction between the electronic device and the input device more intelligent, convenient, and efficient.

[0329] Figure 30 A schematic flowchart illustrating an interaction method provided in an embodiment of this application is shown. This method is applied to an electronic device with a capacitive touchscreen. In this method, the first touch operation is an operation performed on a second interface displayed on the capacitive touchscreen, and the feedback information is the interface display, such as... Figure 30 As shown, the method includes the following steps:

[0330] S110: In response to a first touch operation performed by the input device on the second interface displayed on the capacitive screen, determine the encoding information of the input device.

[0331] S120: Obtain the device identifier of the electronic device based on the encoding information.

[0332] S130: Controls the target element associated with the identifier of the capacitive touchscreen display device.

[0333] The target element includes at least one element configured for a specified application, and the second interface is the operation interface of the specified application mounted on the electronic device. The specified application is a specific application among multiple applications mounted on the electronic device. When the specified application is open, after the electronic device interacts with the input device, a specific operation can be triggered. This application uses a whiteboard application as an example for illustration. After the user opens the whiteboard application, the electronic device displays the operation interface of the whiteboard application, and the user can perform various operations on the whiteboard application's operation interface, such as writing, drawing, and inserting elements.

[0334] When developing a specific application, multiple elements (also known as operable elements) are configured for it. The input device is pre-associated with at least one of these elements; specifically, the unique device identifier of the input device is associated with at least one of the elements, generating an input device-element association table. These elements include drawing tools (e.g., rulers, erasers), graphics (e.g., lines, triangles, rectangles), emoticons, and other resources. When the capacitive screen of the electronic device displays the application's interface (i.e., the second interface), the elements can be displayed in the application's toolbar, allowing the user to drag and drop selected elements from the toolbar into the interface. Alternatively, when the capacitive screen displays the application's interface, the elements may not be displayed; the user can insert elements into the interface by interacting with it through the input device.

[0335] The following section provides a detailed explanation of how users interact with the user interface via input devices to insert elements into the interface.

[0336] When an electronic device's capacitive screen displays the interface of a specified application, if a first touch operation by an input device on the interface is detected, the input device's encoding information, i.e., the device identifier, is first obtained. Then, the device identifier is used to query an association table to obtain the elements associated with the device identifier, i.e., the target element associated with the input device. The target element is then displayed. This can also be understood as referring to the interface as a second interface; after responding to the first touch operation, the second interface is updated to a new second interface, which includes the target element.

[0337] Figure 31 The illustration shows a scenario where a ruler element is inserted via an input device, as shown below. Figure 31As shown, 101 represents the second interface, 102 represents the new second interface, 200 represents the input device (specifically a smart stamp), and 301 represents the target element (specifically a ruler). For example, before the input device comes into contact with the second interface, the displayed second interface is blank. When the user brings the input device into contact with the second interface, if the first touch operation is detected as a contact action or a pressing action, the encoding information of the input device is obtained. This encoding information is used as a device identifier. By identifying the target element as a ruler through the device identifier, the second interface is updated. The updated new second interface includes the ruler, which the user can intuitively see, thus realizing the quick insertion of the ruler.

[0338] Optionally, after displaying the target element, the method may further include: receiving a second touch operation applied to the target element by the outer surface, adjusting the target element according to the second touch operation, controlling the capacitive screen to display the adjusted target element, and / or displaying text and / or patterns triggered by the adjusted target element.

[0339] For example, the second touch operation can be understood as the user contacting the outer surface of the input device with the location of the target element in the second interface; the second touch operation can be a single operation or multiple operations. After the target element is displayed, if the user needs to adjust the target element, such as adjusting the target element's position, orientation (including position, rotation angle, and state), or attribute information (including at least one of geometric attributes, visual attributes, and text attributes), if a second touch operation (which can be called an element adjustment operation) is detected on the outer surface of the input device acting on the target element, the adjustment operation on the target element is performed according to the second touch operation, and the adjusted target element is displayed, that is, the second interface is updated. The updated second interface includes the adjusted target element, and the adjusted target element can be seen intuitively.

[0340] In one possible implementation, adjusting the target element according to the second touch operation includes at least one of the following steps:

[0341] S1201: Adjust the position of the target element according to the second touch operation;

[0342] S1202: Adjust the pose of the target element according to the second touch operation;

[0343] S1203: Adjust the attribute information of the target element according to the second touch operation.

[0344] The second touch operation is generated by the user through the control input device according to their own needs for using the target element.

[0345] For S1201, if the user has a need to adjust the target element, the second touch operation generated by the control input device and applied to the target element is used, that is, the second touch operation is an element position adjustment operation, and then the position of the second target element is adjusted according to the element position adjustment operation.

[0346] Figure 32 This illustrates a scenario where the position of an element is adjusted via an input device, such as... Figure 32 As shown, for example, the target element 301 displayed on the second interface 102 is a ruler. The second touch operation of the user on the ruler through the outer surface of the input device 200 is an element position adjustment operation, specifically a rightward movement of the ruler. After the second interface 102 is updated, the user can intuitively see the rightward movement of the ruler in the updated second interface 103.

[0347] For S1202, if the user has a need to adjust the target element, the second touch operation generated by the control input device and applied to the target element is used, that is, the second touch operation is an element posture adjustment operation, and then the posture of the second target element is adjusted according to the element posture adjustment operation.

[0348] Figure 33 This illustrates a scenario where the pose of an element is adjusted via an input device, such as... Figure 33 As shown, the target element 301 displayed on the second interface 102 is a ruler. The second touch operation performed by the user on the ruler through the input device 200 is the first element posture adjustment operation, which is to rotate the ruler counterclockwise by a certain angle. After the second interface 102 is updated, the user can intuitively see the ruler after rotating it counterclockwise by a certain angle on the updated second interface 103.

[0349] The target element's attribute information includes at least one of geometric attributes, visual attributes, and text attributes. Geometric attributes include size, visual attributes include color, transparency, etc., and text attributes include text content.

[0350] For S1203, if the user has a need to adjust the target element, a second touch operation generated by the control input device and applied to the target element is performed, i.e., the second touch operation is an element attribute adjustment operation, and then the attribute information of the second target element is adjusted according to the element attribute adjustment operation.

[0351] Taking adjusting the geometric properties of the target element as an example, Figure 34 This illustrates a scenario where element properties are adjusted via an input device, such as... Figure 34As shown, the target element 301 displayed on the second interface 102 is a square. The second touch operation performed by the user on the square through the input device 200 is a geometric attribute adjustment operation, specifically a zoom-in operation. After the second interface 102 is updated, the user can intuitively see the zoomed-in square in the updated second interface 103. The operation of zooming out of the square is the same as that of zooming in, and will not be described in detail here.

[0352] Optionally, after displaying the adjusted target element, the corresponding text and / or pattern can be obtained, and the text and / or pattern can be displayed around the adjusted target element. For example... Figure 33 As shown, the rotation angle (i.e., text) of the ruler can be displayed around the rotated ruler.

[0353] Furthermore, the input device can not only enlarge or shrink the target element, but also adjust only the length or width of the target element. Additionally, this application allows for the adjustment of the target element's attribute information in conjunction with user gestures while the input device is applied to the target element. For example, when the input device is applied to the target element, if the user's finger touches the second interface and then decreases the distance between their fingers, the target element can be reduced; conversely, if the user's finger touches the second interface and then increases the distance between their fingers, the target element can be enlarged.

[0354] Figure 35 This illustration shows a schematic flowchart of an interaction method provided in an embodiment of this application. In this method, the first touch operation is an operation performed on a third interface displayed on a capacitive screen, and the feedback information is the interface display, such as... Figure 35 As shown, the method includes the following steps:

[0355] S110: In response to a first touch operation by the input device on a third interface displayed on the capacitive touchscreen, determine the encoding information of the input device.

[0356] S120: Obtain the device identifier of the electronic device based on the encoding information.

[0357] S130: The function type of the target function configured for the input device is determined based on the device identifier.

[0358] S140: Determine the application type of the application to which the third interface belongs and the operation type of the first touch operation.

[0359] S150: Based on the function type, application type, and operation type, respond to the first touch operation and control the capacitive screen to output the interface display triggered by the first touch operation.

[0360] In one exemplary embodiment, when an input device is detected acting on a third interface, if a user triggers a first touch operation on the third interface by manipulating the input device, the function type of the target function configured for the input device, the application type of the application to which the third interface belongs, and the operation type of the first touch operation are determined respectively. The third interface can be understood as the application interface of an application currently running on the electronic device. Application types are divided into designated applications and non-designated applications. For example, the application type of a whiteboard application in an electronic device is a designated application, while the application types of other applications in the electronic device besides the whiteboard application are non-designated applications. This embodiment uses the whiteboard application as the designated application and a browser application as the non-designated application for illustration.

[0361] The operation types include at least two. When the function of the input device remains unchanged, the response result output by the electronic device in response to one type of operation triggered by the input device differs from the response result in response to another type of operation triggered by the input device. For example, the operation types include a first preset operation and a second preset operation. Specifically, the first preset operation is a click operation, and the second preset operation is a movement operation. That is, the response result output by the electronic device after responding to the click operation is different from the response result after responding to the movement operation. This application embodiment uses an example where the operation types include a first preset operation and a second preset operation, with the first preset operation being a click operation and the second preset operation being a movement operation. Specifically, when the input device comes into contact with the capacitive screen of the input device, it can be considered that the input device has triggered a click operation.

[0362] The process of determining the function type of the target function configured for the input device includes: obtaining the device identifier of the input device; after obtaining the device identifier, querying the function configuration list through the device identifier to obtain the function type associated with the device identifier, thereby obtaining the function type of the target function. The process of obtaining the device identifier of the input device can be referred to the aforementioned example, and will not be repeated here.

[0363] Operation response strategies are pre-set based on the function type, application type, and operation type of the response input device. That is, one operation response strategy corresponds to one function type, one application type, and one operation type, resulting in multiple operation response strategies, and each operation response strategy corresponds to a different response result.

[0364] When the function type and application type are the same, but the operation type is different, the operation response strategy triggered by the input device will be different, and the output response result will also be different. Similarly, when the function type and operation type are the same, but the application type is different, the operation response strategy triggered by the input device will be different, and the output response result will also be different. The correspondence between function type, application type, operation type, and operation response strategy is shown in Table 1.

[0365] Table 1

[0366]

[0367] After obtaining the function type of the target function, the application type of the application to which the third interface belongs, and the operation type of the first touch operation, the corresponding relationship is queried through the function type of the target function, the application type of the application to which the third interface belongs, and the operation type of the first touch operation to obtain the response strategy for the first touch operation, and the response strategy is executed to realize the response to the first touch operation.

[0368] In this embodiment, when the input device interacts with a third interface displayed on a capacitive touchscreen, the system responds to a first touch operation based on the function type of the target function configured for the input device, the application type of the application to which the third interface belongs, and the operation type of the first touch operation. This controls the capacitive touchscreen to output the interface display triggered by the first touch operation. On one hand, this ensures that when a user interacts with an application using the input device, the response to the operation triggered by the input device is determined by the function type of the function configured for the input device, the application type of the interface to which the input device interacts, and the operation type of the operation triggered by the input device. This ensures that the operation triggered when the input device interacts with the application is accurately responded to. On the other hand, this enables a single input device to interact with applications of different application types. Users can interact with different applications using the same input device, allowing seamless switching between various applications. This not only improves the versatility and adaptability of a single input device but also enhances its practical value and user experience.

[0369] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0370] S1211: If the function type is the third function, the application type is a non-specified application, and the operation type is the first preset operation, display the first window; wherein, the first window includes partial page content in the third interface;

[0371] S1212: If the function type is the third function, the application type is a non-specified application, and the operation type is the second preset operation, display the second window; wherein, the second window includes the global page content in the third interface.

[0372] For S1211, if the function type is the third function, the application type is the non-specified application, and the operation type is the first preset operation, then by querying Table 1 above through the third function, the non-specified application, and the first preset operation, the response strategy corresponding to the third function, the non-specified application, and the first preset operation is obtained, which is called the first target strategy. The first target strategy is used to instruct the electronic device to display the partial page content of the third interface in the floating window (hereinafter referred to as the window). Specifically, the partial page content in the third interface refers to the page content at the position where the input device contacts the third interface, and this page content is the content closest to the position where the input device contacts the third interface.

[0373] After obtaining the first target strategy, respond to the first touch operation according to the first target strategy, and thus output the first response result of the first touch operation. Figure 36 An exemplary scenario diagram showing the output of the first response result of the first touch operation is shown, such as... Figure 36 As shown, for example, the page content of the third interface 101 is the poem "Visiting Shanxi Village". The user places the input device on position P1 of the third interface 101. The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a first preset operation (click operation). After responding to the first preset operation according to the first target strategy, a screenshot of the page content at position P1 is captured, and the first window 201 is displayed. The first window 201 displays the text "Walking with a cane, knocking on the door at night". The user can perform custom operations on the content in the first window 201, including editing, sharing, saving, and annotation.

[0374] If the user triggers the first preset operation through the input device at other locations on the third interface 101, the first window 201 will display the text content of each captured partial page content screenshot in the form of a list, allowing the user to view the text content of each partial page content screenshot in a list.

[0375] For S1212, if the function type is the third function, the application type is the non-specified application, and the operation type is the second preset operation, then by querying Table 1 above through the third function, the non-specified application, and the second preset operation, the first touch operation response strategy corresponding to the third function, the non-specified application, and the second preset operation is obtained, which is called the second target strategy. The second target strategy is used to instruct the electronic device to display the global page content in the third interface in the second window.

[0376] After obtaining the second target strategy, respond to the first touch operation according to the second target strategy, and thus output the second response result of the first touch operation. Figure 37 An exemplary scenario diagram illustrating the output of a second response result of a first touch operation is shown, such as... Figure 37 As shown, for example, the page content of the third interface 101 is the poem "Visiting Shanxi Village". The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a second preset operation (slide operation). After responding to the second preset operation according to the second target strategy, a screenshot of the global page content of the third interface 101 is captured, and a second window 202 is displayed. The second window 202 displays the text "Poem content of 'Visiting Shanxi Village'". The user can perform custom operations on the content in the second window 202, including editing, sharing, saving, and annotation. The user can trigger the second preset operation at any position on the third interface using the input device.

[0377] By adopting the above-mentioned technical solutions based on S1211 and S1212, text extraction can be achieved quickly, improving the convenience of text extraction and enhancing the user experience.

[0378] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0379] S1221: If the function type is a third function, the application type is a specified application, and the operation type is a first preset operation, the third interface is updated to the first target interface, and a first content list and / or a first bird's-eye view of the first target interface are displayed; wherein, the first target interface includes partial page content in the third interface with markings, and the first content list includes partial page content with markings.

[0380] S1222: If the function type is the third function, the application type is the specified application, and the operation type is the second preset operation, update the third interface to the second target interface, and display the second content list and / or the second bird's-eye view of the second target interface; wherein, the second target interface includes the global page content in the third interface with the marker, and the second content list includes the global page content with the marker.

[0381] For S1221, if the function type is the third function, the application type is the designated application, and the operation type is the first preset operation, the above-mentioned Table 1 is queried through the third function, the designated application and the first preset operation to obtain the first touch operation response strategy corresponding to the third function, the designated application and the first preset operation, which is referred to as the third target strategy. The third target strategy is configured to instruct the electronic device to update the third interface to the first target interface, and display the first content list and / or the first bird's-eye view of the first target interface. The first target interface includes the marked partial page content in the third interface, and the first content list includes the marked partial page content.

[0382] After the third target strategy is obtained, the first touch operation is responded according to the third target strategy, so as to output a third response result of the first touch operation. Figure 38 shows a schematic diagram of an exemplary scenario for outputting the third response result of the first touch operation, as shown in Figure 38 shown in the figure, for example, the page content of the third interface 101 is the poetry content of "Shanxi Village Tour", the user attaches the input device to the position P2 of the third interface 101, the electronic device detects the first touch operation triggered by the input device acting on the third interface 101, and the first touch operation is the first preset operation (click operation). After responding to the first preset operation according to the third target strategy, the third interface 101 is updated to the first target interface 102, and then the first content list L1 and the first bird's-eye view F1 of the first target interface 102 are displayed. The first target interface 102 includes the marked partial page content in the third interface 101, specifically, the line "Holding a staff, I knock on the door at any hour of the night" in the third interface 101 is marked, the mark is represented by a five-pointed star pattern "☆", and the first target interface 102 includes the line "Holding a staff, I knock on the door at any hour of the night" marked with "☆". The text of the line "Holding a staff, I knock on the door at any hour of the night" marked with "☆" is displayed in the first content list L1, and the user can perform custom operations on the content in the first content list L1. The custom operations include editing, sharing, saving, annotating and the like.

[0383] If the user triggers the first preset operation through the input device at another position on the first target interface 102, the partial page content at the other position of the first target interface 102 will also be marked and added to the first content list L1, which supports the user to view the text content of each partial page content screenshot in a list form. For the first bird's-eye view F1, the user can intuitively see which page contents in the first target interface 102 are marked through the first bird's-eye view F1, and can quickly locate the position where the specific page content is located through the first bird's-eye view F1.

[0384] For S1222, if the function type is the third function, the application type is the specified application, and the operation type is the second preset operation, then by querying Table 1 above through the third function, the specified application, and the second preset operation, the first touch operation response strategy corresponding to the third function, the specified application, and the second preset operation is obtained, which is called the fourth target strategy. The fourth target strategy is used to instruct the electronic device to update the third interface to the second target interface, and to display the second content list and / or the second bird's-eye view of the second target interface. The second target interface includes the global page content in the third interface with the label, and the second content list includes the global page content with the label.

[0385] After obtaining the fourth objective strategy, the first touch operation is responded to according to the fourth objective strategy, thereby outputting the fourth response result of the first touch operation. Figure 39 An exemplary scenario diagram illustrating the output of a fourth response result of the first touch operation is shown, such as... Figure 39 As shown, for example, the page content of the third interface 101 is the poem "Visiting Shanxi Village". The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a second preset operation (slide operation). After responding to the second preset operation according to the fourth target strategy, the third interface 101 is updated to the second target interface 103, and then the second content list L2 and the second bird's-eye view F2 of the second target interface 103 are displayed.

[0386] The second target interface 103 includes all page content of the third interface 101 with markings. Specifically, the poem content of "Visiting Shanxi Village" in the third interface 101 is marked with a five-pointed star "☆". The first target interface 102 includes the poem content of "Visiting Shanxi Village" marked with "☆". The second content list L2 displays the poem content of "Visiting Shanxi Village" marked with "☆". Users can customize the content in the second content list L2, including editing, sharing, saving, and annotating. The second bird's-eye view F2 allows users to visually see that all page content in the first target interface 102 is marked, and users can quickly locate the specific page content using the second bird's-eye view F2.

[0387] By adopting the above-mentioned technical solutions based on S1221 and S1222, page content can be quickly marked, improving the convenience of marking page content and enhancing the user experience.

[0388] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0389] S1231: If the function type is the fourth function, the application type is a non-specified application, and the operation type is the first preset operation, a third window is displayed; wherein, the third window includes first auxiliary content and partial page content in the third interface, and the first auxiliary content is used to assist in understanding the partial page content;

[0390] S1232: If the function type is the fourth function, the application type is the specified application, and the operation type is the first preset operation, the third interface is updated to the third target interface, and the fourth window is displayed; wherein, the fourth window includes the second auxiliary content and the partial page content in the third interface, the second auxiliary content is used to assist in understanding the partial page content in the third interface, and the third target interface includes at least part of the content in the second auxiliary content.

[0391] For S1231, if the function type is the fourth function, the application type is the non-specified application, and the operation type is the first preset operation, then by querying Table 1 above through the fourth function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the fourth function, the non-specified application, and the first preset operation is obtained, which is called the fifth target strategy. The fifth target strategy is used to instruct the electronic device to display the third window, which includes the first auxiliary content and the partial page content in the third interface.

[0392] After obtaining the fifth objective strategy, respond to the first touch operation according to the fifth objective strategy, and thus output the fifth response result of the first touch operation. Figure 40 An exemplary scenario diagram illustrating the fifth response result of the first touch operation is shown, such as... Figure 40 As shown, for example, the page content of the third interface 101 includes "2x + 5 = 6, find the solution for x", and other content is not shown. The user places the input device on position P3 of the third interface 101. The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a first preset operation (click operation). After responding to the first preset operation according to the fifth target strategy, the third window 203 is displayed. The third window 203 includes a portion of the page content in the third interface 101, namely "2x + 5 = 6, find the solution for x". The first auxiliary content includes the problem-solving ideas, problem-solving process, answer and other related knowledge content for calculating "2x + 5 = 6".

[0393] When the content of a partial page in the third interface is other than formulas and test questions, the first auxiliary content in the third window includes explanations, translations, and sources of the content on the partial page.

[0394] For S1232, if the function type is the fourth function, the application type is the specified application, and the operation type is the first preset operation, then by querying Table 1 above through the fourth function, the specified application, and the first preset operation, the first touch operation response strategy corresponding to the fourth function, the specified application, and the first preset operation is obtained, which is called the sixth target strategy. The sixth target strategy is used to instruct the electronic device to update the third interface to the third target interface and to display the fourth window. The fourth window includes the second auxiliary content and the partial page content in the third interface. The third target interface includes at least part of the content in the second auxiliary content.

[0395] After obtaining the sixth objective strategy, respond to the first touch operation according to the sixth objective strategy, and thus output the sixth response result of the first touch operation. Figure 41 An exemplary scenario diagram illustrating the output of a sixth response result of the first touch operation is shown, such as... Figure 41 As shown, for example, the page content of the third interface 101 includes "2x+5=6, find the solution for x", and other content is not shown. The user places the input device on position P4 of the third interface 101. The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a first preset operation (click operation). After responding to the first preset operation according to the sixth target strategy, the third interface 101 is updated to the third target interface 104, and then the fourth window 204 is displayed. The fourth window 204 includes a portion of the page content in the third interface 101, namely "2x+5=6, find the solution for x". The second auxiliary content includes the problem-solving ideas, problem-solving process, answer and other related knowledge content for calculating "2x+5=6". The third target interface 104 includes the problem-solving process for "2x+5=6".

[0396] When the content of a partial page in the third interface is other than formulas and test questions, the first auxiliary content in the third window and the third target interface includes explanations, translations, and sources of the content on the partial page.

[0397] By adopting the above-mentioned technical solutions based on S1231 and S1232, page content can be quickly calculated and interpreted, making it easier for users to understand the page content and improving the user experience.

[0398] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0399] S1241: If the function type is the fifth function, the application type is a non-specified application, and the operation type is the first preset operation, output the audio information of the partial page content in the third interface;

[0400] S1242: If the function type is the fifth function, the application type is a non-specified application, and the operation type is the second preset operation, output the audio information of the global page content in the third interface.

[0401] For S1241, if the function type is the fifth function, the application type is the non-specified application, and the operation type is the first preset operation, then by querying Table 1 above through the fifth function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the fifth function, the non-specified application, and the first preset operation is obtained, which is called the seventh target strategy. The seventh target strategy is used to instruct the electronic device to output the audio information of the local page content at the position where the input device and the third interface are in contact in the third interface.

[0402] After obtaining the seventh objective strategy, the first touch operation is responded to according to the seventh objective strategy, thereby outputting the seventh response result of the first touch operation. For example... Figure 38 As shown, for example, the content of the page of the third interface 101 is the poem "Visiting Shanxi Village". The user places the input device on position P2 of the third interface 101. The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a first preset operation (click operation). After responding to the first preset operation according to the seventh target strategy, the reading tool is called to read "Walking with a cane at night".

[0403] For S1242, if the function type is the fifth function, the application type is the non-specified application, and the operation type is the second preset operation, then by querying Table 1 above through the fifth function, the non-specified application, and the second preset operation, the first touch operation response strategy corresponding to the fifth function, the non-specified application, and the second preset operation is obtained, which is called the eighth target strategy. The eighth target strategy is used to instruct the electronic device to output the audio information of the global page content in the third interface.

[0404] After obtaining the eighth objective strategy, the first touch operation is responded to according to the eighth objective strategy, thereby outputting the eighth response result of the first touch operation. For example... Figure 38 As shown, for example, the page content of the third interface 101 is the poem "Visiting Shanxi Village". The user uses the input device to trigger the first touch operation on the third interface 101 at any position. The first touch operation is the first preset operation (slide operation). After responding to the second preset operation according to the eighth target strategy, the reading tool is called to read the poem "Visiting Shanxi Village".

[0405] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0406] S1251: If the function type is the sixth function, the application type is a non-specified application, and the operation type is the first preset operation, the fifth window is displayed; wherein, the fifth window includes the search results obtained by using the partial page content in the third interface as search information;

[0407] S1252: If the function type is the sixth function, the application type is a non-specified application, and the operation type is the second preset operation, the sixth window is displayed; wherein, the sixth window includes the search results obtained by using the global page content in the third interface as search information.

[0408] For S1251, if the function type is the sixth function, the application type is the non-specified application, and the operation type is the first preset operation, then by querying Table 1 above through the sixth function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the sixth function, the non-specified application, and the first preset operation is obtained, which is called the ninth target strategy. The ninth target strategy is used to instruct the electronic device to display the fifth window. The fifth window includes the search results obtained by using the partial page content in the third interface as search information.

[0409] After obtaining the ninth objective strategy, respond to the first touch operation according to the ninth objective strategy, and thus output the ninth response result of the first touch operation. Figure 42 An exemplary scenario diagram showing the ninth response result of the first touch operation is illustrated, such as... Figure 42 As shown, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office work, entertainment and other fields." The user places the input device on position P5 of the third interface 101. The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a first preset operation (click operation). After responding to the first preset operation according to the tenth target strategy, the fifth window 205 is displayed. The fifth window 205 includes the search results obtained with "tablet computer" as the search information, namely "Search results: Tablet computer is a portable mobile device, between a smartphone and a laptop computer. Common uses include entertainment, learning, office work, etc."

[0410] For S1252, if the function type is the sixth function, the application type is the non-specified application, and the operation type is the second preset operation, then by querying Table 1 above through the sixth function, the non-specified application, and the second preset operation, the first touch operation response strategy corresponding to the sixth function, the non-specified application, and the second preset operation is obtained, which is called the tenth target strategy. The tenth target strategy is used to instruct the electronic device to display the fifth window. The fifth window includes the search results obtained by using the global page content in the third interface as search information.

[0411] After obtaining the tenth objective strategy, respond to the first touch operation according to the tenth objective strategy, and thus output the tenth response result of the first touch operation. Figure 43 An exemplary scenario diagram illustrating the output of the tenth response result of the first touch operation is shown, such as... Figure 43 As shown, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablets and smart whiteboards have been widely used in education, office, entertainment and other fields:...". The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a second preset operation (slide operation). After responding to the second preset operation according to the tenth target strategy, the sixth window 206 is displayed. The sixth window 206 includes the search results obtained with the search information "With the rapid development of touch screen technology, touch screen devices such as tablets and smart whiteboards have been widely used in education, office, entertainment and other fields," namely, "Search results: The rapid development of touch screen technology has indeed brought about widespread applications and changes, especially in education, office and entertainment fields. The following are the specific applications and impacts of touch screen technology in these fields:...". The above search results are obtained by calling the search function (such as the circle search function).

[0412] By adopting the technical solutions based on S1251 and S1252 described above, page content searching can be quickly achieved, improving the user experience. Furthermore, the translation of page content is achieved in the same way as the technical solutions based on S1251 and S1252 described above, and will not be repeated in the embodiments of this application.

[0413] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0414] S12161: If the function type is the seventh function, the application type is a non-specified application, and the operation type is the first preset operation, the seventh window is displayed. The seventh window includes the first content after the partial page content in the third interface has been structured.

[0415] S12162: If the function type is the seventh function, the application type is a non-specified application, and the operation type is the second preset operation, display the eighth window. The eighth window includes the second content after the global page content in the third interface has been structured.

[0416] The structured content mentioned in this application can be understood as a mind map, also known as a brain map.

[0417] For S1261, if the function type is the seventh function, the application type is the non-specified application, and the operation type is the first preset operation, then by querying Table 1 above through the seventh function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the seventh function, the non-specified application, and the first preset operation is obtained, which is called the eleventh target strategy. The eleventh target strategy is used to instruct the electronic device to display the seventh window. The seventh window includes the first content after structuring the partial page content in the third interface, which is called the first mind map.

[0418] After obtaining the eleventh target strategy, respond to the first touch operation according to the eleventh target strategy, and thus output the eleventh response result of the first touch operation. Figure 44 An exemplary scenario diagram illustrating the output of the eleventh response result of the first touch operation is shown, such as... Figure 44 As shown, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office work, entertainment and other fields." The user will input the device ( Figure 44 (Not shown) is pasted at position P6 on the third interface 101. The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a first preset operation (click operation). After responding to the first preset operation according to the eleventh target strategy, the seventh window 207 is displayed. The seventh window 207 includes a first mind map N1 about the "tablet computer".

[0419] For S1262, if the function type is the seventh function, the application type is the non-specified application, and the operation type is the second preset operation, then by querying Table 1 above through the seventh function, the non-specified application, and the second preset operation, the first touch operation response strategy corresponding to the seventh function, the non-specified application, and the second preset operation is obtained, which is called the twelfth target strategy. The twelfth target strategy is used to instruct the electronic device to display the eighth window. The eighth window includes the second content after structuring the global page content in the third interface, which is called the second mind map.

[0420] After obtaining the twelfth objective strategy, respond to the first touch operation according to the twelfth objective strategy, and thus output the twelfth response result of the first touch operation. Figure 45 An exemplary scenario diagram showing the output of the twelfth response result of the first touch operation is shown, such as... Figure 45As shown, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields". The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a second preset operation (slide operation). After responding to the second preset operation according to the twelfth target strategy, the eighth window 208 is displayed. The eighth window 208 includes a second mind map N2 about "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields".

[0421] By adopting the above-mentioned technical solutions based on S1261 and S1262, structured information of page content can be generated quickly, improving the user experience.

[0422] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0423] S1271: If the function type is the seventh function, the application type is the specified application, and the operation type is the first preset operation, the third interface is updated to the fourth target interface. The fourth target interface includes the third content after the partial page content in the third interface has been structured.

[0424] S1272: If the function type is the seventh function, the application type is the specified application, and the operation type is the second preset operation, the third interface is updated to the fifth target interface. The fifth target interface includes the fourth content after the global page content in the third interface has been structured.

[0425] For S1271, if the function type is the seventh function, the application type is the specified application, and the operation type is the first preset operation, then by querying Table 1 above through the seventh function, the specified application, and the first preset operation, the first touch operation response strategy corresponding to the seventh function, the specified application, and the first preset operation is obtained, which is called the thirteenth target strategy. The thirteenth target strategy is used to instruct the electronic device to update the third interface to the fourth target interface. The fourth target interface includes the third content after structuring the partial page content in the third interface, which is called the third mind map.

[0426] After obtaining the thirteenth objective strategy, respond to the first touch operation according to the thirteenth objective strategy, and thus output the thirteenth response result of the first touch operation. Figure 46 An exemplary scenario diagram showing the output of the thirteenth response result of the first touch operation is illustrated, such as... Figure 46As shown, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office, entertainment and other fields." The user places the input device (on the third interface 101 at position P7). The electronic device detects the input device and triggers a first touch operation on the third interface 101. The first touch operation is a first preset operation (click operation). After responding to the first preset operation according to the thirteenth target strategy, the third interface 101 is updated to the fourth target interface 105. The fourth target interface 105 includes a third mind map N3 about "tablet computer".

[0427] For S1272, if the function type is the seventh function, the application type is the specified application, and the operation type is the second preset operation, then by querying Table 1 above through the seventh function, the specified application, and the second preset operation, the first touch operation response strategy corresponding to the seventh function, the specified application, and the second preset operation is obtained, which is called the fourteenth target strategy. The fourteenth target strategy is used to instruct the electronic device to update the third interface to the fifth target interface. The fifth target interface includes the fourth content after structuring the global page content in the third interface, which is called the fourth mind map.

[0428] After obtaining the fourteenth objective strategy, respond to the first touch operation according to the fourteenth objective strategy, and thus output the fourteenth response result of the first touch operation. Figure 47 An exemplary scenario diagram showing the output of the fourteenth response result of the first touch operation is illustrated, such as... Figure 47 As shown, for example, the page content of the third interface 101 is "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office work, entertainment and other fields". The electronic device detects that the input device triggers a first touch operation on the third interface 101. The first touch operation is a second preset operation (slide operation). After responding to the second preset operation according to the fourteenth target strategy, the third interface 101 is updated to the fifth target interface 106. The fifth target interface 106 includes a fourth mind map N4 about "With the rapid development of touch screen technology, touch screen devices such as tablet computers and smart whiteboards have been widely used in education, office work, entertainment and other fields".

[0429] By adopting the above-mentioned technical solutions based on S1271 and S1272, structured information of page content can be generated quickly, and structured information of page content can be quickly inserted into the interface, thereby improving the user experience.

[0430] In one possible implementation, responding to the first touch operation based on the function type, application type, and operation type includes the following steps:

[0431] S1281: If the function type is the eighth function, the application type is the specified application, and the operation type is the first preset operation, determine whether the input device is acting on the preset area in the third interface;

[0432] S1282: If the input device operates on a preset area in the third interface, the third interface is updated to the sixth target interface, which includes option icons for the data to be transmitted.

[0433] S1283: In response to the selection operation of the option icon, the data to be transmitted is associated with the device identifier of the input device to obtain the associated data, and the associated data is sent to the server. In the case of interaction between the input device and other electronic devices, if the input device triggers a data import operation, the other electronic devices obtain the associated data from the server according to the device identifier.

[0434] If the function type is the eighth function, the application type is a non-specified application (specifically the Finder application), and the operation type is the first preset operation, then by querying Table 1 above through the eighth function, the non-specified application, and the first preset operation, the first touch operation response strategy corresponding to the eighth function, the specified application, and the first preset operation is obtained, which is called the fifteenth target strategy. The fifteenth target strategy is used to instruct the electronic device to update the third interface to the sixth target interface when it determines that the input device is acting on a preset area in the third interface, and when detecting the selection operation of the option icon of the data to be transmitted in the sixth target interface, associate the data to be transmitted with the device identifier of the input device to obtain the associated data, and send the associated data to the server for storage.

[0435] After obtaining the fifteenth objective strategy, respond to the first touch operation according to the fifteenth objective strategy, and thus output the fifteenth response result of the first touch operation. Figure 48 An exemplary scenario diagram showing the output of the fifteenth response result of the first touch operation is shown, such as... Figure 48 As shown, for example, the third interface 101 includes a preset area P8. Electronic device A detects that the input device 300 triggers a first touch operation on the third interface 101. The first touch operation is a second preset operation (slide operation), and the input device 300 operates on the preset area P8. After responding to the second preset operation according to the fifteenth target strategy, the third interface 101 is updated to the sixth target interface 107. The sixth target interface 107 includes the preset area P8 and option icons for the data to be transmitted, namely file 1-file 3. For example, if the user selects file 1, electronic device A detects the selection operation of the option icon for file 1, associates the device identifier of the input device 300 with file 1, obtains associated data 1, and then sends associated data 1 to the server. The server stores associated data 1.

[0436] When a user interacts with electronic device B (another electronic device) using input device 300, after input device 300 operates on a preset area P9 in the interface of a non-designated application (finder application) displayed on the capacitive screen of electronic device B, electronic device B obtains the device identifier of input device 300, adds the device identifier of input device 300 to a data acquisition request, and sends the data acquisition request to the server. The server obtains the device identifier of input device 300 from the data acquisition request, and then queries the stored associated data based on the device identifier of input device 300 to obtain associated data 1. The server then sends file 1 from associated data 1 to electronic device B, and electronic device B stores file 1 in its local space. This realizes the import of data from one electronic device to another electronic device using an input device, that is, it realizes cross-device data transmission using an input device.

[0437] Optionally, if the input device 300 has a power supply and storage function, when electronic device A detects the selection operation of the option icon for file 1, it sends file 1 to the input device 300, and the input device 300 stores file 1. When the user interacts with electronic device B using the input device 300, after the input device 300 operates on the preset area P9 in the interface of the non-designated application (finder application) displayed on the capacitive screen of electronic device B, the input device 300 sends file 1 to electronic device B, and electronic device B stores file 1 in its local space. This realizes the import of data from one electronic device to another using the input device, that is, it realizes cross-device data transfer using the input device.

[0438] Figure 49 This illustration shows a schematic flowchart of an interaction method provided in an embodiment of this application. In this method, the first touch operation is an operation performed on a fourth interface displayed on a capacitive screen, and the feedback information is the interface display, such as... Figure 49 As shown, the method includes the following steps:

[0439] S110: In response to a first touch operation by the input device on the fourth interface of the capacitive touchscreen display, determine the encoding information of the input device.

[0440] S120: Obtain the device identifier of the electronic device based on the encoding information.

[0441] S130: Determine the target function configured for the input device based on the device identifier.

[0442] S140: Obtain user information corresponding to the target function in the input device.

[0443] S150: Responds to the first touch operation based on user information to execute the target function and controls the capacitive screen to output the interface display triggered by the execution of the target function.

[0444] In this system, since the input device is pre-configured with target functions and user information, the electronic device pre-stores configuration data generated based on the target functions and user information configured on the input device. After determining the device identifier of the input device, the electronic device queries the stored configuration data through the device identifier to obtain the function associated with the input device identifier, i.e., the target function configured on the input device. Alternatively, the input device sends its own configuration data to the electronic device. After determining the device identifier of the input device, the electronic device queries the configuration data sent by the input device through the device identifier to obtain the function associated with the input device ID, i.e., the target function configured on the input device.

[0445] After obtaining the target function configured for the input device, the configuration data is queried based on the target function configured for the input device to obtain the user information corresponding to the target function configured for the input device, i.e., the user information configured for the input device is obtained. Then, the target function configured for the input device is executed based on the user information configured for the input device. This realizes the use of user information as input for function execution. When the user interacts with the electronic device using the input device, the electronic device can quickly execute the function that needs to be implemented based on the user information, ensuring the immediacy of function execution and allowing the user to feel that the function is responded to quickly.

[0446] For example, for the same input device, after configuring its configuration data, the input device corresponds to only one target function, and the user information corresponding to that target function is only used by the electronic device to execute the target function configured for the input device. Taking login and resource transfer functions as examples, if the target function configured for the input device is login, the user information configured for the input device includes information related to account login, such as authentication information. If the target function configured for the input device is resource transfer, the user information configured for the input device includes information related to receiving resources, such as the user account (this user account is referred to as the receiving account of the resource recipient).

[0447] Furthermore, for the same input device, assuming its current target function and user information are already determined, if other functions are needed, the current target function of the input device must be changed to the other function via an electronic device or other terminal, and the current user information must be changed to the user information corresponding to the other function. For example, if the current target function of the input device is login and the user information is authentication information, and the user wants to use the resource transfer function, the current target function of the input device must be changed from login to resource transfer via an electronic device or other terminal, and the authentication information must be changed to the user account corresponding to the resource transfer function.

[0448] In one possible implementation, when the target function configured on the input device is a login function, and the user information corresponding to the target function includes authentication information, the above-mentioned execution of the target function based on the user information includes the following steps:

[0449] If the input device triggers a first touch operation on the fourth interface, the user logs into the application belonging to the fourth interface based on the authentication information.

[0450] The fourth interface refers to the login interface of an application, such as the login interface of an educational application. When an input device is applied to the fourth interface, if the first touch operation (such as a click operation) triggered by the input device is detected, the legality and correctness of the identity verification information are verified. After the legality and correctness verification is passed, the user logs into the educational application, thus realizing quick login to the application.

[0451] In one possible implementation, the above-mentioned method of logging into the application to which the fourth interface belongs based on authentication information if the input device triggers a first touch operation on the fourth interface includes the following steps: if the input device triggers a first touch operation on the fourth interface, determine whether the input device is acting on a preset area of ​​the fourth interface; if yes, log into the application to which the fourth interface belongs based on authentication information; if no, do not execute the target function, and continue to execute the step of determining whether the input device is acting on a preset area of ​​the fourth interface.

[0452] Figure 50 The illustration shows a scenario where an input device is used to log in to an application, such as... Figure 50 As shown, assuming the fourth interface 101 is the login interface of the teaching application, after detecting the first touch operation triggered by the input device 103 on the fourth interface 101, it is determined whether the input device 103 operates on the preset area 102 of the fourth interface 101. If it is determined that the input device 103 operates on the preset area 102, it means that the input device 103 triggered the first touch operation in the preset area 102, and it is considered that the user needs to log in to the teaching application. Then, the user logs in to the teaching application based on the authentication information in the input device 103. Figure 50 The username and password are usually not displayed directly, but are represented by "××××××".

[0453] In one possible implementation, when the target function configured on the input device is a resource transfer function, and the user information corresponding to the target function includes a user account (referring to the receiving account of the resource recipient), the above-mentioned execution of the target function based on user information includes the following steps: if the input device triggers a first touch operation on the fourth interface, the target resource is determined from the data resources of the fourth interface according to the first touch operation; the target window is displayed; in response to the selection operation of the user account in the target window, the target resource is transferred to the user account selected by the selection operation.

[0454] The input device triggers a first touch operation on the fourth interface. In response to the first touch operation, the target resource is determined from the data resources displayed on the fourth interface. The target resource includes at least a portion of the data resources. That is, the target resource may be all the data resources displayed on the fourth interface or only a portion of the data resources. The data resources displayed on the fourth interface include page content (such as text, images, etc.), storage files stored on the electronic device (such as pictures, multimedia files, etc.), and so on.

[0455] After the target resource is identified, a target window is displayed. This target window is a floating window. The target window includes user information configured on the input device. If the user information includes at least one user account, the target window will include at least one user account. The user account in the target window can be understood as the receiving account of the resource recipient. The user can select one or more accounts in the target window as the target account (i.e., the account ultimately determined by the user to receive the target resource).

[0456] After receiving a user account selection operation applied to the target window, the user account selected by the selection operation is obtained, which is the target account selected by the user. Then, the target resource is transferred to the target account, realizing the quick retrieval of the user account of the resource recipient. This saves the user from the tedious process of manually retrieving the user account of the resource recipient and improves the efficiency of resource transfer.

[0457] It is worth noting that the "transmission" of resources mentioned in the embodiments of this application includes sending, sharing, forwarding, etc.

[0458] In one possible implementation, when the target function configured on the input device is a resource transfer function, and the user information corresponding to the target function includes a user account, the above-mentioned execution of the target function based on the user information includes the following steps:

[0459] If the input device triggers a first touch operation on the fourth interface, the target resource is determined from the data resources of the fourth interface based on the first touch operation;

[0460] The target resource is transferred to the user account configured on the input device, and the target window is displayed, which includes the receiving account for receiving the target resource.

[0461] The input device triggers a first touch operation on the fourth interface. In response to the first touch operation, the target resource is determined from the data resources displayed on the fourth interface. The target resource includes at least a portion of the data resources. That is, the target resource may be all the data resources displayed on the fourth interface or a portion of the data resources.

[0462] Once the target resource is identified, it is directly transferred to the user account configured on the input device. At the same time, the target window is displayed, allowing the user to see which other user accounts the target resource has been transferred to. This enables quick resource transfer, eliminating the tedious process of manually transferring resources and improving the efficiency of resource transfer.

[0463] The type of application to which the fourth interface belongs differs, resulting in different types of target resources.

[0464] For example, application types include specified applications and unspecified applications. Specified applications are those that store files, such as the Finder application. Unspecified applications are those other than specified applications that include various page content, such as browser applications. If the application type of the fourth interface is an unspecified application, the resource type of the target resource is page content; if the application type of the fourth interface is a specified application, the resource type of the target resource is an independent file.

[0465] In one possible implementation, when the data resource is page content and the application type of the application to which the fourth interface belongs is a non-specified application, the above-mentioned determination of the target resource from the data resource of the fourth interface based on the first touch operation includes the following steps:

[0466] If the first touch operation is a click operation on a part of the page content, the part of the page content clicked by the click operation is determined as the target resource.

[0467] If the data resource displayed on the fourth interface is page content and the application type of the application to which the fourth interface belongs is not a specified application, and if the first touch operation is a click operation on a local part of the page content, the local part clicked by the click operation is extracted from the page content, and the extracted local part is determined as the target resource. The extracted local part can be in the form of text, screenshots, etc.

[0468] Taking the user account configured on the input device as the electronic address as an example, Figure 51This diagram illustrates an exemplary scenario of resource transfer using an input device, such as... Figure 51 As shown, the page content displayed on the fourth interface 101 is an essay about "Spring is Coming". The user clicked on a portion of the page content using an input device. Figure 51 The phrase "Spring flowers will bloom, birds will roam freely" in the dashed box 105 indicates that the local content within the dashed box 105 is identified as the target resource. Then, the target window 106 is displayed, which shows addresses 1-3. After seeing the addresses displayed in the target window 106, the user selects address 1, meaning that the user corresponding to address 1 is the recipient of the target resource. This allows the target resource to be transferred to address 1, which facilitates the quick transfer of local page content in the fourth interface.

[0469] In one possible implementation, when the data resource is page content and the application type of the application to which the fourth interface belongs is a non-specified application, the above-mentioned determination of the target resource from the data resource of the fourth interface based on the first touch operation includes the following steps:

[0470] If the first touch operation is a swipe operation applied to any area of ​​the fourth interface, the global page content of the fourth interface will be determined as the target resource.

[0471] If the data resource displayed on the fourth interface is page content and the application type of the application to which the fourth interface belongs is a non-specified application, and if the first touch operation is a swipe operation on any area of ​​the fourth interface (i.e., the user swipes on any area of ​​the fourth interface using an input device), the global page content of the fourth interface is extracted, and the extracted global page content is determined as the target resource. The extracted global page content can be in text format, screenshot format, etc.

[0472] Taking the user account configured on the input device as the electronic address as an example, Figure 52 This diagram illustrates another exemplary scenario for resource transfer using an input device, such as... Figure 52 As shown, the page content displayed in the fourth interface 101 is an essay about "Spring is Coming". The user uses the input device 103 to slide from left to right across the left side of the "Spring is Coming" section in the fourth interface 101, thus identifying the entire content about "Spring is Coming" as the target resource. Then, the target window 107 is displayed, showing addresses 1-3. After seeing the addresses displayed in the target window 107, the user selects addresses 1 and 2, making the users corresponding to addresses 1 and 2 the recipients of the target resource. This facilitates the quick transfer of the global page content in the fourth interface. The checkmark "√" indicates address selection.

[0473] In one possible implementation, when the data resource is a storage file of the electronic device and the application type of the application to which the fourth interface belongs belongs to a specified application, the above steps for determining the target resource from the data resource of the fourth interface based on the first touch operation are as follows:

[0474] If the first touch operation is a click operation on a file icon, the file clicked by the click operation in the stored files is determined as the target resource.

[0475] If the data resource displayed on the fourth interface is a storage file stored on the electronic device and the application type of the application to which the fourth interface belongs is a specified application, then if the first touch operation is a click operation on the file icon in the fourth interface, it is considered that the user has selected a file, and the file clicked by the click operation in the storage file is identified as the target resource.

[0476] Taking the user account configured on the input device as the electronic address as an example, Figure 53 This diagram illustrates yet another exemplary scenario for resource transfer using an input device, such as... Figure 53 As shown, the fourth interface 101 displays three storage files, namely File 1 to File 3. When the user clicks the file icon of File 1 in the fourth interface 101 using the input device 103, File 1 is identified as the target resource. Then, the target window 108 is displayed, which displays Address 1 to Address 3. After seeing the addresses displayed in the target window 108, the user selects Address 1, meaning that the user corresponding to Address 1 is the resource recipient of the target resource. This facilitates the quick transfer of storage files in electronic devices.

[0477] Figure 54 This illustration shows a schematic flowchart of an interaction method provided in an embodiment of this application. In this method, the first touch operation is an operation performed on the fifth interface displayed on the capacitive screen, and the feedback information is the interface display, such as... Figure 54 As shown, the method includes the following steps:

[0478] S110: Upon detecting that the input device has triggered a first touch operation on the fifth interface, the encoding information of the input device is determined;

[0479] S120: Determine the device identifier of the input device based on the encoding information.

[0480] S130: Determine the target function configured for the input device based on the device identifier.

[0481] S140: Determine the target object from the objects to be started in the electronic device based on the target function.

[0482] S150: Responds to the first touch operation to launch the target object and controls the capacitive screen to output the interface display triggered by launching the target object.

[0483] The objects to be started include applications and / or functional modules.

[0484] In one exemplary embodiment, the interface currently displayed on the capacitive touchscreen of the electronic device is referred to as the fifth interface. The fifth interface can be the desktop of the electronic device or the interface of a certain application. If a first touch operation triggered by an input device on the fifth interface displayed on the capacitive touchscreen is detected, the encoding information of the input device is obtained, and the device identifier of the input device is determined based on the encoding information.

[0485] Determining the target function configured for the input device includes the following steps: Since the target function is pre-configured for the input device and associated with its ID, and the electronic device has pre-stored configuration data about the input device, the electronic device, after determining the input device's ID, queries the stored configuration data using that ID to obtain the function associated with the input device's ID, i.e., the target function configured for the input device. Alternatively, the input device sends its configuration data to the electronic device. After determining the input device's ID, the electronic device, using that ID, queries the configuration data sent by the input device to obtain the function associated with the input device's ID, i.e., the target function configured for the input device.

[0486] The objects to be launched include applications and / or functional modules in electronic devices. After obtaining the target function configured on the input device, the configuration data is queried according to the target function configured on the input device to obtain the identifier corresponding to the target function configured on the input device, called the target object identifier. Then, the object with the object identifier of the target object identifier is obtained from the objects to be launched, thus obtaining the target object. For example, if the target object identifier is identifier 1, and the object identifier of application 1 in the objects to be launched is identifier 1, then application 1 is the target object; if the target object identifier is identifier 2, and the object identifier of functional module 2 in the objects to be launched is identifier 2, then functional module 2 is the target object.

[0487] After identifying the target object from the list of objects to be launched, the target object is then started. From the user's perspective, assuming the fifth interface is the desktop of an electronic device, for example, if the target object is a whiteboard application, the whiteboard application will immediately open on the desktop after the user places the input device there; if the target object is a calculator, the calculator will immediately open on the desktop after the user places the input device there; and if the target object is a countdown timer, the countdown timer will start on the desktop and begin counting down after the user places the input device there, thus achieving rapid launch of applications and / or functional modules on the electronic device.

[0488] This application embodiment illustrates two target functions configured for an input device. For the same input device, after configuration data is configured, the input device corresponds to only one target function. The example illustrates target functions as launching an application and launching a gadget (also known as launching a function module or launching a function control). For instance, if the target function configured for the input device is launching an application, the input device is used to launch the application associated with that target function; if the target function configured for the input device is launching a gadget, the input device is used to launch the function module associated with that target function.

[0489] Furthermore, for the same input device, assuming its current target function and user information are already determined, if other functions are needed, the current target function of the input device needs to be changed to the other function via an electronic device or other terminal, and the identifier of the object associated with the target function also needs to be modified accordingly. For example, if the current target function of the input device is to launch an application, and the application associated with the application launch function is application 1, if the user wants to use the widget launch function, the current target function of the input device needs to be changed from the application launch function to the widget launch function via an electronic device or other terminal, and application 1 needs to be changed to the user-defined function module for the widget launch function (e.g., a countdown timer).

[0490] In one possible implementation, determining the target object from the objects to be started includes the following steps:

[0491] Retrieve multiple objects associated with the target function from the objects to be started, and obtain multiple candidate objects;

[0492] Display a ninth window; this ninth window includes multiple candidate objects;

[0493] In response to the first selection operation of the candidate objects in the ninth window, the candidate object selected by the first selection operation in the ninth window is determined as the target object.

[0494] For cases where the target function of an input device is associated with multiple objects, taking the example of the target function being the application launch function and the associated objects being applications, the explanation is as follows: Considering that although the target function is associated with multiple applications, the user may not necessarily need to launch all of them at once, a method is provided that allows the user to select the actual application to launch from among the multiple applications associated with the target function. For example... Figure 55 As shown, Figure 55This diagram illustrates a scenario where a target object is determined based on a target function. 101 represents the fifth interface, 200 represents the input device, and 301 represents the ninth window. Assuming the input device's target function (launching an application) is associated with three application identifiers, and the fifth interface is specifically the desktop of the electronic device, a user triggers a first touch operation (e.g., a click) on any area of ​​the fifth interface using the input device. The input device's ID is obtained based on the encoded information. The target function of the input device is determined to be the "launching an application" function, thus obtaining the three application identifiers associated with this function. These three application identifiers are then used to identify the corresponding applications from the objects to be launched: Application 1, Application 2, and Application 3. Application 1, Application 2, and Application 3 are the candidate objects. Then, a ninth window is displayed, showing Application 1, Application 2, and Application 3. The user has triggered the first selection action for Application 2 and Application 3, indicating that the user has chosen Application 2 and Application 3 as the target objects. Subsequently, Application 2 and Application 3 will be launched, realizing the launch of multiple applications associated with the target function based on the user's selection. The checkmark "√" indicates selection.

[0495] In one possible implementation, if the target object belongs to a functional module, after activating the target object, the interaction method further includes the following steps:

[0496] In response to a second touch operation performed by the input device on the fifth interface, the function of the target object is executed.

[0497] When the target object is a functional module, after activating the target object, the user can further trigger its function using an input device. Specifically, the user triggers a second touch operation on the fifth interface using the input device. After the electronic device responds to the second touch operation, it executes the target object's function, enabling quick access to the functional module. For example, if the target object is a selection tool, the selection function is executed; if the target object is a screenshot tool, the screenshot function is executed; if the target object is a magnifying glass, the content magnification function is executed; if the target object is a timer, the timer function (including countdown and up-and-down functions) is executed; if the target object is an eraser tool, the eraser function is executed; and so on. The second touch operation can be the same as or different from the first touch operation.

[0498] The application types of the fifth interface are pre-defined into two categories: designated applications and non-designated applications. Different application types result in different execution strategies for the electronic device to perform functions on the target object. Designated applications are interactive collaborative applications where users can design and create, such as drawing applications and whiteboard applications. Non-designated applications can be understood as applications other than designated applications, such as browser applications. This application embodiment uses a whiteboard application as the designated application and a browser application as the non-designated application for illustration.

[0499] In one possible implementation, if the application type of the application to which the fifth interface belongs is a specified application, the above-mentioned execution of the target object's function includes the following steps:

[0500] If the target object is an erasing tool and the second touch operation is an erasing operation performed by the input device on the second area of ​​the fifth interface, the interface content in the second area is erased.

[0501] If the application type of the application belonging to the fifth interface is a specified application and the target object is an erasure tool (e.g., a whiteboard eraser), and if the second touch operation is an erasure operation (e.g., a swipe operation, also called a move operation) performed by the input device on the second area of ​​the fifth interface, then the interface content in the second area will be erased. It can be understood that the input device is currently acting as an erasure tool; when the user swipes on the fifth interface using the input device, the interface content along the swipe path of the input device will be erased. Figure 56 As shown, Figure 56 This diagram illustrates a scenario where the smart interactive whiteboard performs an erase function. 101 represents the fifth interface, 101-1 represents the updated fifth interface, and P1 represents the second area. The fifth interface displays the written text "5+2=7". The user uses an input device to slide across the second area, erasing the written "2". After the fifth interface is updated, the written "2" is no longer displayed in the second area, allowing the user to quickly use the erase function via the input device.

[0502] In one possible implementation, if the application type of the application to which the fifth interface belongs is a specified application or a non-specified application, the above-mentioned execution of the target object's function includes the following steps:

[0503] If the target object is a selection tool and the second touch operation is a second selection operation performed by the input device on the first area of ​​the fifth interface, the target content is selected; wherein, the target content is the interface content in the first area.

[0504] For applications belonging to the fifth interface that are either specified or non-specified applications, and whose target object is a selection tool, if the second touch operation is a second selection operation performed by the input device on the first area of ​​the fifth interface, then the interface content in the first area is selected, and the selected interface content is called the target content. The second selection operation can be a click or a swipe. If the second selection operation is a click, then the first area is the area where the input device contacts the fifth interface; if the second selection operation is a swipe, then the first area is the area traversed by the swipe path of the input device after it contacts the fifth interface.

[0505] like Figure 57 As shown, Figure 57 This diagram illustrates a scenario where an electronic device performs a selection function. 101 represents the fifth interface, 101-2 represents the updated fifth interface, P2 represents the first area, and K1 represents the selection marker. The fifth interface displays content including "rectangular, circular, and triangular patterns." When the user slides an input device across the fifth interface, the sliding trajectory of the input device passes over the "rectangular, circular, and triangular patterns," indicating that the user has selected them. Therefore, the "rectangular, circular, and triangular patterns" are selected. After the fifth interface is updated, the selected "rectangular, circular, and triangular patterns" are displayed in the second area of ​​the updated fifth interface, allowing the user to quickly use the selection function via the input device.

[0506] In one possible implementation, if the application type of the fifth interface is a specified application, after selecting the target content, the interaction method also includes the following steps:

[0507] In response to an adjustment operation performed by the input device on the target content, the target content is moved and / or rotated.

[0508] For applications on the fifth interface whose application type is a specified application and whose target object is a selection tool, the response to the second touch operation is a second selection operation performed by the input device on the first area of ​​the fifth interface to obtain the selected target content. If an adjustment operation is detected on the target content by the input device, the target content is adjusted according to the adjustment operation. Adjusting the target content includes moving and / or rotating it, allowing the user to adjust the position and angle of the selected content using the input device. If the adjustment operation is a move operation, the target content is moved; if the adjustment operation is a rotation operation, the target content is rotated; if the adjustment operation is both a move and a rotation operation, the target content is both moved and rotated.

[0509] like Figure 58 As shown, Figure 58This diagram illustrates a scenario where a user adjusts the target content. Interface 101-3 shows the interface displaying the moved target content; interface 101-3 displays a "rectangular, circular, and triangular pattern" based on interface 101-2 after it has been moved downwards. Interface 101-4 shows the interface displaying the rotated target content; interface 101-4 displays a "rectangular, circular, and triangular pattern" based on interface 101-2 after it has been rotated clockwise.

[0510] In one possible implementation, if the application type of the application to which the fifth interface belongs is a non-specified application, the above-mentioned execution of the target object's function includes the following steps:

[0511] If the target object is a screenshot tool and the second touch operation is a screenshot operation performed by an input device on the second area of ​​the fifth interface, the interface content in the second area is captured to obtain a content screenshot.

[0512] For applications belonging to the fifth interface that are not specified applications and whose target is a screenshot tool, if the second touch operation is a screenshot operation performed by the input device on the second area of ​​the fifth interface, then the interface content in the second area is captured to obtain a content screenshot, meaning the content screenshot includes the interface content in the second area. The screenshot operation includes click and swipe operations. The process of the user performing a screenshot operation using the input device is as follows: first, the user clicks on a certain location, which is considered the starting point; then, the user moves the input device away from the starting point. The user will see a small rectangle gradually enlarge as the input device moves away from the starting point. The location where the input device stops moving is the ending point. The interface content covered by the rectangle formed by the starting point and the ending point is the interface content in the second area. Therefore, the interface content in the second area is captured to obtain a content screenshot, which includes the interface content in the second area, allowing users to quickly use the screenshot function via the input device.

[0513] like Figure 59 As shown, Figure 59 This diagram illustrates a scenario where a smart interactive whiteboard performs a screenshot. 101 represents the fifth interface, P3 represents the second area, and F represents the content screenshot. The content displayed on the fifth interface includes a short essay titled "Spring is Here." The user performs a screenshot operation on the fifth interface using an input device. After the input device stops performing the screenshot operation, the content covered by the rectangle formed by the start and end positions of the screenshot operation is "In the morning, under the slightly white sky... spring has truly arrived." Thus, the content screenshot shows the second paragraph of the essay, "Spring is Here."

[0514] In one possible implementation, after capturing the interface content in the second area and obtaining the content screenshot, the interaction method further includes the following steps:

[0515] Display the tenth window; the tenth window includes editing options and save options;

[0516] In response to a third selection of editing options in the tenth window, an eleventh window is displayed; wherein the eleventh window includes the interface content in the second area, which is in an editable state; or,

[0517] In response to the fourth selection of the save option in the tenth window, a screenshot of the saved content is taken.

[0518] If the application type of the application belonging to the fifth interface is a non-specified application and the target object is a screenshot tool, and if the second touch operation is a screenshot operation performed by the input device on the second area of ​​the fifth interface to capture the interface content in the second area, then the tenth window is displayed. The tenth window displays editing and saving options for the screenshot content. Users can edit the screenshot content before saving it, or save it directly, according to their actual needs. For example... Figure 60 As shown, Figure 60 This diagram illustrates a scenario where a user edits a screenshot. 101 represents the fifth interface, K2 represents the rectangle formed by the start and end points of the screenshot operation, 302 represents the tenth window, and 303 represents the eleventh window. If the smart interactive whiteboard detects the third selection of the editing option in the tenth window, indicating that the user has selected the editing option, the eleventh window will be displayed. The eleventh window displays the second paragraph of the text "Spring is Coming," which the user can edit.

[0519] If the smart interactive whiteboard detects the fourth selection of the save option in the tenth window, it means that the user has selected the save option. The whiteboard will then save the content screenshot and prompt the user with the save path for the content screenshot.

[0520] In one possible implementation, if the application type of the application to which the fifth interface belongs is a non-specified application, the above-mentioned execution of the target object's function includes the following steps:

[0521] If the target object is a magnifying glass tool, the magnified page content in the first area is displayed; where the first area is the area where the input device acts on the fifth interface, that is, the area where the input device contacts the fifth interface is the first area.

[0522] If the application type of the application belonging to the fifth interface is a non-specified application and the target object is a magnifying glass tool, and if the second touch operation is a click operation of the input device on the first area of ​​the fifth interface, the magnified page content in the first area will be displayed. For example... Figure 61 As shown, Figure 61This diagram illustrates a scenario where an electronic device performs a magnification function on its interface. 101 represents the fifth interface, P4 represents the first area, and K3 represents the magnified page content. When a user clicks "Freedom" using an input device, the magnified version of "Freedom" is displayed, allowing the user to quickly access the magnification function of the magnifying glass tool via the input device.

[0523] In one possible implementation, if the application type of the fifth interface is a non-specified application, executing the function of the target object includes the following steps:

[0524] If the target object is a timer, the timer is displayed in the second area and started to begin timing; the second area can be any area of ​​the fifth interface.

[0525] For applications on the fifth interface that are not specified applications and whose target object is a timer, if the second touch operation is a click operation of the input device on the second area of ​​the fifth interface, the timer is displayed in the second area and started to begin timing, allowing the user to quickly use the timer function via the input device. If the timer is a positive timer, it starts counting forward; if the timer is a countdown timer, it starts counting down. Figure 62 As shown, Figure 62 This diagram illustrates a scenario where an electronic device performs a timing function. 101 represents the fifth interface, P5 represents the second area, and K4 represents the countdown timer. (Reference) Figure 62 In Figure a, the countdown timer has a duration of 60 seconds, and the countdown starts at 60 seconds.

[0526] After starting the timer as described above, the interaction method further includes the following steps:

[0527] In response to a stop operation on the timer performed by the input device, the timer is controlled to stop counting.

[0528] If the smart interactive whiteboard detects an input device performing a stop operation on the timer (e.g., a click), it controls the timer to stop, thus enabling the use of an input device to control the timer's stop. (Reference) Figure 62 In image b, the user clicked the countdown timer using the input device, and the countdown timer stopped at 30 seconds, meaning there are 30 seconds left.

[0529] In one possible implementation, the interaction method further includes the following steps:

[0530] In response to an input device operating on a preset area of ​​the sixth interface, a twelfth window is displayed; wherein the twelfth window includes a setting area for the timing duration;

[0531] The target duration is obtained in response to the setting operation in the settings area;

[0532] Associate the target duration with the target function so that if the timer is started based on the target function, the timer will start based on the target duration.

[0533] Users can set the duration of a timer through an electronic device, and then associate the set duration with the target function of the input device. When the electronic device starts the timer based on the target function of the input device, the electronic device obtains the duration corresponding to the target function of the input device, and then controls the timer to keep time according to the duration corresponding to the target function of the input device.

[0534] The sixth interface can be understood as the interface for setting the timing duration. If the electronic device detects that the input device is acting on the preset area of ​​the sixth interface and triggers the operation of the first area, the twelfth window is displayed. The twelfth window includes a setting area for the timing duration. The user can set the timing duration in this setting area by directly inputting the duration or selecting a duration from the provided durations, allowing the user to configure the timing duration for the input device according to their own needs. Both directly inputting the duration and selecting a duration from the provided durations are considered setting operations.

[0535] The set timing duration is called the target duration. This target duration is then associated with the target function of the input device. When the smart interactive whiteboard starts the timer based on the target function of the input device, it obtains the target duration corresponding to that function and controls the timer to keep track of the time. The set timing duration can be either a positive countdown or a countdown duration.

[0536] like Figure 63 As shown, Figure 63 The diagram illustrates a scenario where a user sets the countdown duration. 102 represents the sixth interface, P6 represents the preset area within the sixth interface, 304 represents the twelfth window, and 200 represents the input device. If the smart interactive whiteboard detects that the input device is operating on the preset area of ​​the sixth interface and triggers the first area operation, it displays the twelfth window. The twelfth window includes countdown duration options of 60 seconds and 30 seconds. If the user selects 30 seconds, the target duration is 30 seconds, and the target duration is then associated with the target function of the input device. After the smart interactive whiteboard starts the countdown timer based on the target function of the input device, the smart interactive whiteboard obtains the target duration corresponding to the target function of the input device as 30 seconds, and then controls the countdown timer to proceed according to the 30-second timer.

[0537] In one possible implementation, if the target object belongs to an application, the above interaction method further includes the following steps:

[0538] In response to an input device operating on a preset area of ​​the seventh interface, a thirteenth window is displayed; wherein the thirteenth window includes application identifiers for multiple applications;

[0539] In response to the fifth selection operation of the application identifier in the thirteenth window, the application identifier selected in the fifth selection operation in the thirteenth window is associated with the target function.

[0540] The seventh interface can be understood as the interface used to configure applications for the input device. If the smart interactive whiteboard detects that the input device is acting on a preset area in the seventh interface and triggers a second area operation (such as a click), a thirteenth window is displayed. The thirteenth window displays application icons for multiple applications for the user to select. The user can choose one application icon from the multiple application icons, or two or more application icons. After the user selects an application icon, the selected application icon is associated with the target function of the input device. When the input device interacts with the smart interactive whiteboard, the application corresponding to the user's selected application icon can be quickly launched. If the input device is an active interactive tool, the input device must remain in the preset area of ​​the seventh interface during the process of configuring the application to be launched on the input device.

[0541] like Figure 64 As shown, Figure 64 This diagram illustrates a scenario where a user configures an input device to launch an application. 103 represents the seventh interface, P7 represents a preset area within the seventh interface, 305 represents the thirteenth window, and 200 represents the input device. If the smart interactive whiteboard detects that the input device is operating on the preset area of ​​the seventh interface and triggers a second area operation, it displays the thirteenth window. The thirteenth window displays application identifiers, including application identifier 1 and application identifier 2. The smart interactive whiteboard detects the fifth selection operation of application identifier 2 in the thirteenth window, indicating that the user has selected application identifier 2. It then associates application identifier 2 with the target function of the input device. When the input device interacts with the smart interactive whiteboard, the application corresponding to application identifier 2 can be quickly launched, allowing users to configure applications that need to be quickly launched according to their own needs.

[0542] See Figure 65 , Figure 65 A schematic flowchart of another interaction method provided in an embodiment of this application is shown. This interaction method can be executed by an electronic device of the interaction system described above, and the interaction method may include the following steps:

[0543] S110, when the outer surfaces of multiple input devices simultaneously trigger multiple first touch operations on the capacitive touch-sensitive surface, the encoding information of each input device is determined.

[0544] S120: For each first touch operation, output corresponding feedback information based on the encoding information of the corresponding input device.

[0545] Among them, each of the multiple first touch operations corresponds to a multiple input device.

[0546] In practical applications, multiple input devices can be used simultaneously by one or more users. When each user uses one input device to interact with the capacitive touch-sensitive surface, multiple input devices may interact with the capacitive touch-sensitive surface at the same time. In this case, the conductive elements of each input device can capacitively couple with the capacitive touch-sensitive surface, and each input device can also trigger a touch operation (i.e., the first touch operation) relative to the capacitive touch-sensitive surface.

[0547] When an electronic device detects multiple input devices simultaneously triggering touch operations on a capacitive touch-sensitive surface, the aforementioned method can be used to determine the encoding information of each input device. Subsequently, for each touch operation triggered by an input device, corresponding feedback information can be output based on the input device's encoding information.

[0548] For example, multiple input devices include input device Z1 and input device Z2. A user can configure first feedback information for input device Z1 in the electronic device, then associate and store the first feedback information with the encoding information of input device Z1. Similarly, a user can configure second feedback information for input device Z2 in the electronic device, then associate and store the second feedback information with the encoding information of input device Z2.

[0549] In the scenario where user A controls input device Z1 to trigger a touch operation on the capacitive screen, and simultaneously user B controls input device Z2 to trigger a touch operation on the capacitive screen, the electronic device can obtain the encoding information of input device Z1 and input device Z2 using the method described above. Then, for the touch operation triggered by input device Z1, the electronic device can output first feedback information based on the encoding information of input device Z1 to respond to the touch operation triggered by input device Z1; for the touch operation triggered by input device Z2, it can output second feedback information based on the encoding information of input device Z2 to respond to the touch operation triggered by input device Z2.

[0550] The solution provided in this application addresses multiple input devices that simultaneously trigger touch operations on a capacitive touch-sensitive surface. By responding to each touch operation based on the encoding information of each input device, it enables interaction between multiple input devices and electronic devices, effectively expanding the application scenarios of input devices and further improving the user's interactive experience with electronic devices.

[0551] Optionally, for multiple input devices, the output order of multiple feedback information can be determined based on the encoding information of the multiple input devices, and the multiple feedback information can be output according to the output order.

[0552] For example, multiple input devices include input device Z1 and input device Z2. A user can configure first feedback information for input device Z1 and second feedback information for input device Z2 in the electronic device. Simultaneously, the priority of the encoded information of input device Z1 can be set to be higher than the priority of the encoded information of input device Z2.

[0553] When user A controls input device Z1 to trigger a touch operation on the capacitive screen, and user B simultaneously controls input device Z2 to trigger a touch operation on the capacitive screen, the electronic device can obtain the encoding information of input device Z1 and input device Z2. Then, based on a pre-set priority, it can be determined that the priority of the encoding information corresponding to input device Z1 is higher than that corresponding to the encoding information corresponding to input device Z2. Therefore, the output order can be determined as follows: first output the first feedback information, then output the second feedback information. During the output of feedback information, the first feedback information corresponding to input device Z1 can be output first, followed by the second feedback information corresponding to input device Z2.

[0554] In the process of outputting the first feedback information followed by the second feedback information, the first feedback information can be output first, and the second feedback information can be output after the first feedback information has been output. Alternatively, the first feedback information can be output first, and after a preset time, the second feedback information can be output directly regardless of whether the first feedback information has been output. It should be understood that the methods for sequentially outputting multiple feedback information can include, but are not limited to, the examples above.

[0555] The solution provided in this application sets the output order of multiple feedback information by using the encoding information of the input device, which can improve the accuracy and logic of multiple feedback information output, enable the electronic device to correctly understand the user's intention, and avoid conflicts when multiple feedback information is output at the same time, thereby further improving the user's interactive experience with the electronic device.

[0556] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An interactive system, characterized in that, include: Electronic devices with capacitively sensitive touch surfaces; An input device includes at least one outer surface, the outer surface being provided with a plurality of conductive elements, the conductive elements being capable of capacitively coupling with the capacitive touch-sensitive surface; The electronic device is configured to, when the outer surface triggers a first touch operation on the capacitive touch-sensitive surface, determine a target capacitor that is capacitively coupled to a target conductive element from among a plurality of capacitors on the capacitive touch-sensitive surface, determine the encoding information corresponding to the target conductive element based on the target capacitor, and output feedback information corresponding to the first touch operation based on the encoding information. The target conductive element includes a grounded conductive element among the plurality of conductive elements disposed on the outer surface.

2. The system as described in claim 1, characterized in that, The target conductive component includes N first target conductive components and M second target conductive components, where N is an integer greater than 2 and M is an integer greater than or equal to 0. The electronic device is specifically used for: determining N first target capacitors and M second target capacitors from a plurality of target capacitors; constructing a target coordinate system based on the N first target capacitors; and decoding the M second target capacitors based on the target coordinate system to obtain the encoded information. The N first target capacitors correspond one-to-one with the N first target conductive components, and the M second target capacitors correspond one-to-one with the M second target conductive components.

3. The system as described in claim 2, characterized in that, Specifically, the electronic device is used to determine the bit index corresponding to each second target capacitor based on the coordinates of the second target capacitor in the target coordinate system. Specifically, the electronic device is used to determine the code element in the encoding information corresponding to each second target capacitor based on the capacitance change of the second target capacitor, and to determine the encoding information based on the bit index and code element corresponding to each of the M second target capacitors.

4. The system as described in claim 2, characterized in that, The plurality of conductive components are arranged on the outer surface in a first preset manner, and all of the plurality of conductive components are grounded; The target conductive component includes N first conductive components and M second conductive components. The N first conductive components form a non-rotationally symmetric shape on the outer surface. The size of the non-rotationally symmetric shape is a preset size. The first target conductive element includes the N first conductive elements, and the second target conductive element includes the M second conductive elements.

5. The system as described in claim 2, characterized in that, The plurality of conductive elements are arranged on the outer surface in a second preset arrangement, and the plurality of conductive elements includes N third conductive elements and M fourth conductive elements; The input device further includes a grounding component and a control module. The grounding component is connected to the M fourth conductive components one by one through M electronically controlled switches. The control module is electrically connected to the M electronically controlled switches. The control module is used to control at least one of the electronically controlled switches to be turned on, so that at least one of the fourth conductive components is electrically connected to the grounding component; The first target conductive element includes the N third conductive elements, and the second target conductive element includes the conductive element among the M fourth conductive elements that is electrically connected to the grounding element.

6. The system as described in claim 1, characterized in that, If the capacitive touch-sensitive surface is a capacitive screen, the electronic device is also used for: The system controls the capacitive touchscreen to display a first interface for configuring the input device. Upon receiving a function configuration operation for the first interface, the system obtains a target function configured for the input device based on the function configuration operation. The system generates function configuration data for the input device based on the device identifier of the input device and the target function. The system stores the function configuration data in the local space of the electronic device, or sends the function configuration data to a server so that the electronic device can execute the target function based on the function configuration data when interacting with the input device.

7. The system as described in claim 1, characterized in that, The feedback information includes at least one of interface display, audio-visual prompts, and vibration.

8. The system as described in claim 7, characterized in that, If the capacitive touch-sensitive surface is a capacitive screen, the first touch operation is an operation performed on the second interface displayed on the capacitive screen, and the feedback information is an interface display; the electronic device is specifically used for: The device identifier of the electronic device is obtained based on the encoded information, and the capacitive screen is controlled to display the target element associated with the device identifier. The target element includes at least one of the elements configured for a specified application, and the second interface is the operation interface of the specified application mounted on the electronic device.

9. The system as described in claim 8, characterized in that, The electronic device is also specifically used for: Upon receiving a second touch operation applied to the target element by the outer surface, the target element is adjusted according to the second touch operation, and the capacitive screen is controlled to display the adjusted target element, and / or, the text and / or pattern triggered by the adjusted target element is displayed.

10. The system as described in claim 7, characterized in that, If the capacitive touch-sensitive surface is a capacitive screen, the first touch operation is an operation performed on a third interface displayed on the capacitive screen, and the feedback information is an interface display, the electronic device is specifically used for: The device identifier of the electronic device is obtained based on the encoded information. The function type of the target function configured for the input device is determined based on the device identifier. The application type of the application to which the third interface belongs and the operation type of the first touch operation are determined. Based on the function type, the application type and the operation type, the first touch operation is responded to, and the capacitive screen is controlled to output the interface display triggered by the first touch operation.

11. The system as described in claim 7, characterized in that, If the capacitive touch-sensitive surface is a capacitive screen, the first touch operation is an operation performed on the fourth interface displayed on the capacitive screen, and the feedback information is an interface display, the electronic device is specifically used for: The device identifier of the electronic device is obtained based on the encoded information. The target function configured for the input device is determined based on the device identifier. The user information corresponding to the target function in the input device is obtained. The first touch operation is responded to based on the user information to execute the target function. The capacitive screen is controlled to output the interface display triggered by the execution of the target function.

12. The system as described in claim 7, characterized in that, If the capacitive touch-sensitive surface is a capacitive screen, the first touch operation is an operation performed on the fifth interface displayed on the capacitive screen, and the feedback information is an interface display, the electronic device is specifically used for: The device identifier of the electronic device is obtained according to the encoded information. The target function configured by the input device is determined according to the device identifier. The target object is determined from the objects to be launched of the electronic device according to the target function. The first touch operation is responded to to launch the target object. The capacitive screen is controlled to output the interface display triggered by launching the target object. The objects to be launched include applications and / or functional modules.

13. The system as claimed in claim 1, characterized in that, There are multiple input devices; The electronic device is used to determine the encoding information of each input device when the outer surfaces of the multiple input devices simultaneously trigger multiple first touch operations on the capacitive touch-sensitive surface, wherein the multiple first touch operations correspond one-to-one with the multiple input devices. For each of the first touch operations, the corresponding feedback information is output according to the encoding information of the corresponding input device.

14. The system as claimed in claim 1, characterized in that, The outer surface is provided with a skin layer, and the plurality of conductive components are arranged on the outer surface in a first preset arrangement. The skin layer is provided with a mark corresponding to the first preset arrangement; and / or, the outer surface is provided with a mark corresponding to the first preset arrangement.

15. The system as claimed in claim 1, characterized in that, The input device further includes an insulating housing, the outer surface is located on the insulating housing, the shell wall of the insulating housing is provided with a plurality of through holes, the number of the plurality of conductive elements is less than or equal to the number of the plurality of through holes, and one of the conductive elements is at least partially disposed in one of the through holes.

16. The system as described in claim 15, characterized in that, The plurality of through holes are arranged in an array, and the plurality of through holes are arranged at least partially according to the preset arrangement.

17. The system as claimed in claim 15, characterized in that, The end face of the first end of the conductive element is located inside the through hole, or the end face of the first end of the conductive element protrudes from the outer surface of the insulating shell.

18. The system as described in claim 15, characterized in that, The outer surface of the insulating shell is provided with a skin layer, which covers a plurality of the through holes, and the skin layer is provided with markings corresponding to a preset arrangement of the plurality of conductive components.

19. The system as claimed in claim 15, characterized in that, The insulating housing has edges, and conductors are provided on the edges, which are electrically connected to the plurality of conductive components.

20. The system as claimed in claim 1, characterized in that, The input device has a grip portion, the grip portion is provided with a conductor, and the conductor is electrically connected to the plurality of conductive elements.

21. The system as claimed in claim 1, characterized in that, The electronic device also includes a system-on-a-chip, and the capacitive touch-sensitive surface includes a microcontroller unit, with the system-on-a-chip connected to the microcontroller unit; The microcontroller unit is used to, when the input device acts on the capacitive touch surface, if the capacitive touch surface causes a signal change, process the signal change of the capacitive touch surface to obtain a capacitance image, and send the capacitance image to the system-on-a-chip, wherein the capacitance image includes one frame or multiple frames. The system-on-a-chip is used to acquire the encoded information based on the capacitance image.

22. The system as claimed in claim 1, characterized in that, The electronic device also includes a system-on-a-chip, and the capacitive touch-sensitive surface includes a microcontroller unit, with the system-on-a-chip connected to the microcontroller unit; The microcontroller unit is used to, when the input device acts on the capacitive touch surface, if the capacitive touch surface causes a signal change, process the signal change of the capacitive touch surface to obtain a capacitance image, obtain the encoded information based on the capacitance image, and send the encoded information to the system-on-a-chip. The capacitance image includes one frame or multiple frames. The system-on-a-chip is used to output the feedback information based on the encoded information.

23. The system as described in claim 21 or 22, characterized in that, The system-on-a-chip has an application program installed in its operating system, and the application program or the operating system outputs the feedback information based on the encoded information.

24. The system as described in claim 21 or 22, characterized in that, The capacitive touch-sensitive surface integrates an external or internal capacitive electrode array, wherein the capacitor electrodes in the capacitive electrode array are self-capacitive or mutual-capacitive electrodes.

25. The system as described in claim 24, characterized in that, The capacitive touch-sensitive surface also includes a driving circuit, a sensing circuit, and a signal processing chip; The driving circuit is used to drive the capacitor electrode array; The sensing circuit is used to sense the signal changes of the capacitor electrode array and send the sensed signal to the signal processing chip. The signal processing chip is used to process the signals sensed by the sensing circuit and send the processing results to the microcontroller unit; The microcontroller unit is used to obtain the capacitance image based on the processing result.

Images