Electronic equipment assembly, handwriting pen and detection method

Abstract

The invention discloses an electronic equipment assembly, a handwriting pen and a detection method. The electronic equipment assembly comprises electronic equipment and the handwriting pen capable of interacting with a display screen of the electronic equipment. A light-emitting part is arranged in the handwriting pen, and the light-emitting part emits light to a display screen when the handwriting pen interacts with the display screen of the electronic equipment; a display screen of the electronic equipment comprises a pixel layer, a first detection piece is embedded between pixel units of the pixel layer, and the first detection piece is used for detecting reflected light of fingerprints and lighting of a light-emitting piece; and the electronic equipment identifies fingerprints and calculates the pen point center of the handwriting pen on the display screen according to the detection result of the first detection piece. According to the electronic equipment, the first detection piece is embedded between the pixel layers of the display screen of the electronic equipment to realize lighting detection of the handwriting pen and reflected light detection of the fingerprint, so that positioning of the pen point center of the handwriting pen and identification of the fingerprint are realized.

Description

Technical Field

[0001] The present application relates to the technical field of terminal equipment, and in particular to an electronic equipment component, a stylus pen and a detection method. Background Art

[0002] With the development of electronic devices, accessories for interacting with electronic devices have also emerged. Among them, stylus is a widely used interactive accessory. In the prior art, the interaction between stylus and electronic devices is generally achieved by setting an infrared light LED lamp at the tip of the stylus. The infrared light emitted by the stylus is invisible, so users cannot perceive it with the naked eye. During use, the infrared light emitted by the stylus is detected by the infrared touch screen BM specially made for the electronic device, and then displayed at the corresponding position of the touch screen.

[0003] However, in the prior art, a screen structure needs to be designed separately, which makes the manufacturing cost of the electronic device high. Summary of the invention

[0004] In order to solve the above problems, the present application at least provides an electronic device component, a stylus pen and a detection method.

[0005] A first aspect of the present application provides an electronic device assembly, comprising: an electronic device and a stylus that can interact with a display screen of the electronic device;

[0006] A light-emitting element is provided in the stylus pen, and the light-emitting element illuminates the display screen when the stylus pen interacts with the display screen of the electronic device;

[0007] The display screen of the electronic device comprises a pixel layer, a first detection element is embedded between pixel units of the pixel layer, and the first detection element is used to detect the reflected light of the fingerprint and the lighting of the light emitting element;

[0008] The electronic device recognizes the fingerprint and calculates the center of the tip of the stylus on the display screen through the detection result of the first detection element.

[0009] A second aspect of the present application provides a stylus, wherein a light-emitting element is provided in the stylus, and the light-emitting element illuminates the display screen when the stylus interacts with the display screen of the electronic device;

[0010] The electronic device calculates the center of the tip of the stylus on the display screen by detecting lighting.

[0011] A third aspect of the present application provides a method for detecting a stylus, comprising:

[0012] determining whether the first detection element receives the target light;

[0013] If so, the center of the tip of the stylus emitting the target light on the display screen of the electronic device is calculated according to the target light.

[0014] The beneficial effect of the present application is that the present application realizes the lighting detection of the stylus pen and the reflected light detection of the fingerprint by embedding the first detection member between the pixel layers of the display screen of the electronic device, thereby realizing the positioning of the tip center of the stylus pen and the identification of the fingerprint. The present application is compatible with the in-screen fingerprint technology of the electronic device itself, without increasing the manufacturing cost of the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0016] Figure 1 is a schematic diagram of components of an embodiment of the present application;

[0017] Figure 2 It is a schematic diagram of the use of components in an embodiment of the present application;

[0018] Figure 3 is a schematic diagram of a pixel unit arrangement method in an embodiment of the present application;

[0019] Figure 4 This application Figure 3 A schematic diagram of a pixel block lighting method;

[0020] Figure 5 This application Figure 3 Schematic diagram of another pixel block lighting method;

[0021] Figure 6 is a schematic diagram of a pixel unit arrangement method in another embodiment of the present application;

[0022] Figure 7 is a schematic diagram of a pixel unit arrangement method in another embodiment of the present application;

[0023] Figure 8 is a schematic diagram of components of another embodiment of the present application;

[0024] Fig. 9 is a flow chart of an embodiment of the present application;

[0025] Fig.10 is a flow chart of another embodiment of the present application;

[0026] Fig.11This is a display diagram of the sensing area of ​​an embodiment of the present application;

[0027] Fig.12 is a display diagram of the sensing area of ​​another embodiment of the present application;

[0028] Fig.13 This is a display diagram of the sensing area of ​​another embodiment of the present application;

[0029] Fig.14 This is a display diagram of the sensing area of ​​another embodiment of the present application;

[0030] Fig.15 is a flow chart of another embodiment of the present application;

[0031] Fig.16 is a flow chart of another embodiment of the present application;

[0032] Fig.17 is a display diagram of the sensing area of ​​another embodiment of the present application;

[0033] Fig.18 This is a display diagram of the sensing area of ​​another embodiment of the present application;

[0034] Fig.19 It is a schematic diagram of the prior art;

[0035] Fig. 20 is a schematic diagram of an electronic device in an embodiment of the present application;

[0036] Fig.21 This application Fig. 20 BB cross-section diagram;

[0037] Fig. 22 It is a schematic diagram of a processor according to an embodiment of the present application.

[0038] Description of reference numerals:

[0039] 10-electronic device; 20-stylus; 201-light-emitting element; 101-display screen; 102-pixel layer; 103-first detection element; 202-second detection element; 120-shell assembly; 130-display screen module; 140-control circuit board; 110-flash; 121-back cover; 122-middle frame; 1000-accommodation space; 910-RF circuit; 920-memory; 930-input unit; 940-display unit; 950-sensor; 960-audio circuit; 970-wifi module; 980-processor; 990-power supply; 931-touch panel; 932-other input devices; 941-display panel. DETAILED DESCRIPTION

[0040] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0041] This embodiment provides the following Figure 1 An electronic device assembly shown includes: an electronic device 10 and a stylus 20 that can interact with a display screen 101 of the electronic device 10;

[0042] The stylus pen 20 is provided with a light emitting element 201 , and the light emitting element 201 illuminates the display screen 101 when the stylus pen 20 interacts with the display screen 101 of the electronic device 10 ;

[0043] The display screen 101 of the electronic device 10 includes a pixel layer 102, and a first detection element 103 is embedded between the pixel units of the pixel layer 102. The first detection element 103 is used to detect the reflected light of the fingerprint and the lighting of the light emitting element 201;

[0044] The electronic device 10 recognizes the fingerprint and calculates the center of the tip of the stylus pen 20 on the display screen 101 through the detection result of the first detection element 103 .

[0045] First, the application scenario of the present embodiment is introduced. For example, the application scenario of the technical solution in the present embodiment is: using the stylus 20 as an input device of the electronic device 10 for interaction. Among them, the stylus 20 includes an active capacitive pen, a passive capacitive pen, a touch pen or a laser pen, etc., and the present application does not make specific restrictions on this. The electronic device 10 includes terminal devices such as mobile phones and tablet computers, and the present application does not make specific restrictions on this. The stylus 20 and the electronic device 10 can communicate in a wireless communication manner, and the wireless communication manner can be wireless fidelity (WiFi) or Bluetooth communication, but is not limited to this. It should be noted that the above application scenario is only an exemplary scenario of the present application, and the application scenario of the present application is not limited to this.

[0046] Next, the display screen 101 of the electronic device 10 in this embodiment is introduced. The display screen 101 of the electronic device 10 in this embodiment includes a pixel layer 102. A first detection member 103 is embedded between the pixel units of the pixel layer 102. The first detection member 103 is used to detect the reflected light of the fingerprint and the lighting of the light emitting member 201. The light emitting member 201 is arranged in the stylus 20. In this way, the compatibility of the functions of identifying the fingerprint and detecting the stylus 20 can be achieved.

[0047] In the technical solution of this embodiment, it is a very important design that the first detection element 103 is embedded between the pixel units of the pixel layer 102. This is because in the prior art, as shown in the attached Fig.19 As shown, the detection component for detecting the lighting from the stylus pen is generally located below the pixel layer or the display panel of the display screen, and a through hole is provided in the pixel layer so that the lighting from the stylus pen can pass through the through hole to reach the detection component without interference as much as possible and be detected by the detection component. However, as described above, this type of setting requires a separate design for the structure of the display screen, which increases the cost of the display screen. Furthermore, the design of the through hole cannot guarantee that the lighting from the stylus pen will not be interfered by the pixel layer itself. There is a situation where the light does not pass through the through hole but passes through the pixel layer to reach the detection component. In this case, it is difficult to avoid the interference of the pixel layer on the detection of the light by the detection component.

[0048] Based on the above description, the location of the first detection member 103 in this embodiment is very important. It should be further explained that the present application does not limit the number of the first detection members 103. It is clear that in order to simultaneously realize fingerprint recognition and stylus positioning, there are multiple first detection members 103 in the present application, and they are arranged in the pixel layer 102 of the display screen 101.

[0049] Furthermore, the structure of the display screen 101 in this embodiment, when applied to detecting and identifying fingerprints, is as shown in the attached Figure 2 As shown, the light emitted by a certain pixel unit in the pixel layer 102 is reflected by the fingerprint of the finger above the display screen 101, and the light reflected by the finger is detected or sensed by the first detection element 103 in the pixel layer 102, and then the electronic device 10 performs fingerprint image recognition and comparison according to the different fingerprint textures. In this way, the fingerprint recognition function is realized. Based on this, further, other light-emitting elements can be added in the electronic device 10 to emit light to the finger fingerprint to realize the fingerprint reflection light function.

[0050] Furthermore, the structure of the display screen 101 in this embodiment is used for positioning the center of the tip of the stylus pen 20, as shown in the attached figure. Figure 1 As shown, the stylus pen 20 is illuminated by the built-in light emitting element 201, and the light emitted can be "infrared light", "ultraviolet light" or "visible light", etc., and the present application does not impose any specific restrictions on light. Furthermore, the first detection element 103 in the display screen 101 receives the illumination of the stylus pen 20, and further reports the position of the stylus pen 20 to the electronic device 10.

[0051] When displaying the corresponding position, in one of the optional examples, the electronic device 10 controls the display screen 101 to display a "dot" or "circle" for indicating the position.

[0052] When displaying the corresponding position, in one of the optional examples, due to the divergence of light, multiple first detection elements 103 in an area of ​​the display screen 101 all detect or sense the lighting of the stylus 20, and the intensity gradually decreases from the center to the surrounding areas. At this time, the electronic device 10 controls the display screen 101 to display a "dot" corresponding to the center of the area in the corresponding area, or displays a "small circle" around the center of the area.

[0053] When displaying the corresponding position, in one of the optional examples, the light-emitting component 201 of the stylus 20 is used to emit visible light. At this time, the light emitted by the stylus 20 is visible light. Since the user can directly see the display area of ​​the visible light on the display screen 101 with the naked eye, the electronic device 10 may not control the display screen 101 to make a corresponding display. However, during the interactive use of the electronic device 10 and the stylus 20, the electronic device 10 still needs to detect the light emitted by the stylus 20 through the first detection component 103 and then calculate to locate the center of the pen tip of the stylus 20.

[0054] Corresponding to the above example of displaying the corresponding position on the display screen 101, there is a change in the size of the area of ​​the display screen 101 receiving light caused by the distance between the stylus pen 20 and the display screen 101 of the electronic device 10, which helps the electronic device 10 to control the size of the "dot", "circle" or "small circle" displayed on the display screen 101. For example, the farther the stylus pen 20 is from the display screen 101, the larger the corresponding "dot", "circle" or "small circle" displayed, that is, all areas of the first detection member 103 that receive light from the stylus pen 20 are displayed. It should be noted that the shape of the controlled display in the present application is not limited to the above-mentioned shape. It should be understood that during use, based on the distance between the stylus 20 and the display screen 101, the tilt angle of the stylus 20, the irregular shape of the projection of the stylus 20 on the display screen 101 and other factors, the displayed shape will also change accordingly. For example, when the stylus 20 is illuminated perpendicular to the display screen 101 and displayed as a "circle", the "circle" displayed after the stylus 20 is tilted will also become an "ellipse" as the tilt angle changes.

[0055] Based on the above description, in one example, the positional relationship between the first detection element 103 and the pixel units in the pixel layer 102 is as shown in the attached figure. Figure 3 As shown, attached Figure 3The lighting condition of the stylus 20 and the arrangement of the pixel units and the first detection member 103 in a part of the display screen 101 are shown in FIG. First, a pixel unit includes three pixel blocks of R, G, and B (i.e., R corresponds to red, G corresponds to green, and B corresponds to blue. The principle is the prior art and will not be further described in detail here). In this example, a pixel unit is arranged in a straight line in the order of R, G, and B, while a plurality of pixel units are arranged in an array to form the entire pixel layer 102. On this basis, the first detection member 103 (i.e., the attached Figure 3 When one of the first detection elements 103 detects that the stylus 20 is lighting, the electronic device 10 controls the display of the light corresponding to the pixel blocks around the first detection element 103. For example, it can be set to display the light corresponding to the pixel block with the first detection element 103 as the center of the "cross", as shown in the attached figure. Figure 4 As shown in the shaded area in the middle, when the first detection element 103 corresponding to the number position detects the light of the stylus 20, the light corresponding to the R pixel block directly above it, the B pixel block directly below it, the B pixel block on its left, and the R pixel block on its right are displayed. For another example, it can be set to display the light corresponding to the pixel block with the first detection element 103 as the center of the "field shape", as shown in the attached figure. Figure 5 As shown in the middle shaded area, when the first detection element 103 corresponding to the labeled position detects light from the stylus 20, the corresponding light is displayed at the R pixel block directly above it, the G pixel block at its upper right corner, the B pixel block directly below it, the B pixel block to its left, the R pixel block to its right, and the G pixel block at its lower left corner.

[0056] It should be further explained that the present application does not limit the arrangement order of the three pixel blocks of R, G, and B in the pixel unit, nor does it limit the arrangement method of the three pixel blocks of R, G, and B in the pixel unit, nor does it limit the types of the pixel blocks of R, G, and B in the pixel unit, that is, a pixel unit can have only one or two pixel blocks or all three pixel blocks. At the same time, the present application does not limit the array arrangement method of several pixel units in the pixel layer 102. It should also be explained that the present application does not limit the layout method of the first detection element 103 in the pixel layer 102. Based on the above description, it can be understood that the pixel block adjacent to the first detection element 103 can have only one of R, G, and B, or any two or three of R, G, and B. Similarly, the present application does not limit the display range controlled by the electronic device 10 around the first detection element 103. Whether it is the above-mentioned "cross" display, or the "field" display, or a larger range, or only displaying part of the pixel blocks adjacent to the first detection element 103, etc., all are within the scope of interpretation of the present application.

[0057] Based on the above description, another specific example is further provided. Figure 6 As shown, attached Figure 6 Another arrangement of the pixel units and the first detection element 103 in a partial area of ​​the display screen 101. In this case, the arrangement of the R, G, and B pixel blocks in the pixel unit is R, B, and G in sequence, and the arrangement of the first detection element 103 is also the same as in the attached Figure 3-5 Therefore, the pixel blocks adjacent to the first detection element 103 in this example and the display result are the same as those in the attached example. Figure 3-5 At this time, the electronic device 10 can also control the display screen 101 to display in the above display manner.

[0058] Based on the above description, another specific example is further provided, as shown in the attached Figure 7 As shown, attached Figure 6 FIG. 1 is another arrangement of the pixel units and the first detection elements 103 in a partial area of ​​the display screen 101. In this case, there is only one pixel block R in a pixel unit, and the arrangement of the first detection elements 103 is also the same as the above-mentioned FIG. Figure 3-6 Therefore, the pixel blocks adjacent to the first detection element 103 and the display result in this example are the same as those in the attached example. Figure 3-6 At this time, the electronic device 10 can also control the display screen 101 to display in the above display manner.

[0059] In one example of this embodiment, the first detection element 103 is set to be a photodetector. The photodetector is an organic photodetector OPD (Organic Photo Detector), which has the advantages of a wide response band, suitable for a variety of optical sensing applications, and its own flexibility and stretchability are suitable for matching with the structure of the display screen 101, and a photodetector of a corresponding area can be prepared according to the size of the display screen 101.

[0060] In one example of this embodiment, as shown in the attached Figure 8 As shown, the stylus pen 20 is further provided with a second detection member 202, and the second detection member 202 detects the tilt angle of the stylus pen 20 when the stylus pen 20 interacts with the display screen 101 of the electronic device 10, and the electronic device 10 calculates the center of the pen tip according to the detection results of the first detection member 103 and the second detection member 202. For example, in other examples, the center of the corresponding sensing area displayed on the display screen 101 in response to the detection result of the first detection member 103 is used as the center of the pen tip.

[0061] In this example, the purpose of setting the second detection member 202 is to detect the tilt angle of the stylus 20 when the stylus 20 interacts with the display screen 101 of the electronic device 10, thereby helping the electronic device 10 to include the factor of the tilt of the stylus 20 during actual use into the calculation when calculating the center of the pen tip, further improving the accuracy of calculating the center of the pen tip, and thereby improving the accuracy of the center of the pen tip corresponding to the display screen 101 controlled by the electronic device 10. This setting also takes into account the influence on the accuracy of the center of the pen tip calculated by the electronic device 10 when the stylus 20 is not perpendicular to the display screen 101 but is tilted, the projection of the lighting of the stylus 20 on the display screen 101 is an irregular shape, and there is an obstruction between the stylus 20 and the display screen 101, etc., and further description is explained in the following example.

[0062] In one example of this embodiment, the second detection element 202 is set to be one of a gyroscope, an acceleration sensor, and a magnetometer, preferably a gyroscope. When the stylus 20 is tilted, the sensitive element inside the gyroscope will sense the change in the rotational angular velocity and convert the change into an electrical signal output.

[0063] This embodiment further provides a stylus pen, in which a light emitting element 201 is provided. The light emitting element 201 illuminates the display screen 101 when the stylus pen 20 interacts with the display screen 101 of the electronic device 10.

[0064] The electronic device 10 calculates the center of the tip of the stylus 20 on the display screen 101 by detecting the lighting.

[0065] In this embodiment, the light emitted by the stylus 20 through the light emitting element 201 may be visible light or invisible light, such as infrared light or ultraviolet light, etc. The light emitting element 201 may be an LED or other laser lighting elements.

[0066] In one example of this embodiment, the stylus pen 20 is further provided with a second detection member 202 , and the second detection member 202 detects the tilt angle of the stylus pen 20 when the stylus pen 20 interacts with the display screen 101 of the electronic device 10 ;

[0067] The electronic device 10 calculates the center of the sensing area as the center of the pen tip by detecting the lighting and the tilt angle.

[0068] Specifically, the second detection element 202 detects the tilt angle of the stylus 20, which is a factor included in the calculation and analysis when the electronic device 10 calculates the center of the pen tip, helping to eliminate the interference of the stylus 20 tilting in determining the center of the pen tip, and further description is provided in the following example. In this embodiment, the second detection element 202 can be one of a gyroscope, an acceleration sensor, and a magnetometer, preferably a gyroscope.

[0069] In one example of the present embodiment, the stylus 20 further includes a pen tip, which is used to control the shape and size of the area illuminated by the light-emitting element 201. Specifically, the pen tip is arranged at the bottom end of the stylus 20, and can control the pen tip structure of the stylus 20, thereby controlling the shape and size of the projection of the light-emitting element 201 on the display screen 101, thereby controlling the detection result of the first detection element 103 on the display screen 101, so that the electronic device 10 displays the corresponding shape and size according to the detection result. For example, the tip of the pen tip is provided with an opening for the light-emitting element 201 to pass through, and by controlling the shape of the opening, the shape of the projection of the light on the display screen 101 can be controlled, thereby affecting the shape of the corresponding display of the display screen 101; and by controlling the size of the opening, the size of the projection of the light on the display screen 101 can be controlled, thereby affecting the size of the pattern correspondingly displayed on the display screen 101. The pen tip can be selected and designed according to actual conditions.

[0070] This embodiment also provides the following Fig. 9 A method for detecting a stylus pen is provided, which includes but is not limited to the following steps, and the order of the steps is not fixed in the order described below.

[0071] Step S100, determining whether the first detection element 103 receives the target light;

[0072] Step S200 , if yes, then the center of the tip of the stylus 20 emitting the target light on the display screen 101 of the electronic device 10 is calculated according to the target light.

[0073] Based on the above embodiment, an execution method is provided: execute step S100, and execute step S200 or re-execute step S100 according to the judgment result of step S100, that is, calculate the center of the pen tip when it is judged that the target light is received, and continue to judge whether the first detection component receives the target light when it is judged that the target light is not received.

[0074] Based on the above embodiment, another execution method is provided: execute step S100, and execute step S200 or end according to the judgment result of step S100, that is, calculate the center of the pen tip when it is judged that the target light is received, and end the process when it is judged that the target light is not received. After the end, you can wait for the next time to restart step S100.

[0075] In this embodiment, the first detection element 103 is used to detect or sense target light; the target light is the light that the first detection element 103 needs to detect, such as the lighting of the stylus pen 20 in the above embodiment, including visible light, infrared light or ultraviolet light, etc., and other optical fibers different from the non-target stylus pen 20 are non-target light, which is not detected by the first detection element 103. How the first detection element 103 distinguishes between the target light and the non-target light can be designed according to the lighting of the stylus pen 20, so that the first detection element 103 can only react to the target light emitted by the stylus pen 20.

[0076] In step S200 of this embodiment, the center of the tip of the stylus pen 20 on the display screen 101 of the electronic device 10 can be calculated based on the target light to achieve non-contact tip alignment, and further the center of the tip of the stylus pen 20 can be positioned when the stylus pen 20 contacts the display screen 101.

[0077] In one example of this embodiment, as shown in the attached Fig.10 As shown, after step S100, step S200 is further optimized and executed as step S201, that is, the step of calculating the center of the pen tip of the stylus 20 emitting the target light on the display screen 101 of the electronic device 10 according to the target light includes: displaying the corresponding sensing area on the display screen 101 in response to the detection result of the first detection element 103, and calculating the center of the sensing area as the pen tip center according to the detection result of the first detection element 103.

[0078] In this example, by first determining the sensing area and then further calculating the center of the sensing area as the center of the pen tip, the accuracy of the calculation can be further improved, thereby ensuring the accuracy of positioning the center of the pen tip.

[0079] Based on the above, the following are provided: Fig.11 An example is shown for illustration. In this example, the target light emitted by the stylus 20 reaches the display screen 101 and is projected as a circular area in a certain area of ​​the display screen 101 as shown in the figure. At this time, the first detection element 103 in the circular area detects the corresponding target light and displays the corresponding circular sensing area on the display screen 101. According to the detection result, the center of the circular sensing area is calculated as the center of the pen tip.

[0080] Based on the above, the following are provided: Fig.12An example is shown for illustration. In this example, the target light emitted by the stylus 20 reaches the display screen 101 and is projected into an elliptical area as shown in a certain area of ​​the display screen 101. At this time, the first detection element 103 in the elliptical area detects the corresponding target light and displays the corresponding elliptical sensing area on the display screen 101. According to the detection result, the two foci of the elliptical sensing area are calculated, and the midpoint of the line connecting the two foci is further calculated, and the midpoint is used as the center of the pen tip; or according to the detection result, the major axis and the minor axis of the elliptical sensing area are calculated, and the intersection of the major axis and the minor axis is further calculated, and the intersection is used as the center of the pen tip.

[0081] Based on the above, the following are provided: Fig.13 An example is shown for illustration. In this example, the target light emitted by the stylus 20 reaches the display screen 101 and is projected into a regular polygon area in a certain area of ​​the display screen 101 as shown in the figure. At this time, the first detection element 103 in the regular polygon area detects the corresponding target light and displays the corresponding regular polygon sensing area on the display screen 101. According to the detection result, the center of the circumscribed circle or the center of the inscribed circle of the regular polygon sensing area is calculated, and the center of the circumscribed circle or the center of the inscribed circle is used as the center of the pen tip.

[0082] Based on the above, the following are provided: Fig.14 An example is shown for illustration. In this example, the target light emitted by the stylus 20 reaches the display screen 101 and is projected as a non-regular polygon area in a certain area of ​​the display screen 101 as shown in the figure. At this time, the first detection element 103 in the non-regular polygon area detects the corresponding target light and displays the corresponding non-regular polygon sensing area on the display screen 101. According to the detection result, the centroid of the non-regular polygon sensing area is calculated, that is, the centroid or geometric center of the non-regular polygon, and the centroid is used as the pen tip center.

[0083] It should be further explained that, in actual applications, the area projection described in the above example may only be displayed as a point to the naked eye because the area is too small. Correspondingly, the determined pen tip center can also be a smallest unit of pixel unit in the display screen 101, or a smallest unit of pixel block in the pixel unit, or an area, which only appears as a point when observed by the naked eye.

[0084] In one example of this embodiment, the following is provided Fig.15 The detection method shown includes but is not limited to the following steps, and the order of the steps is not fixed in the order described below.

[0085] Step S100, determining whether the first detection element 103 receives the target light;

[0086] Step S101, determining the color of the target light and the color of the pixel block adjacent to the first detection element 103;

[0087] Step S102, calculating the similarity between the target light color and the pixel block color according to the judgment result;

[0088] Step S103 : informing the stylus pen 20 to change the color of the target light according to the calculation result of the similarity.

[0089] In this embodiment, an execution method is provided: when executing step S100, if it is determined that the first detection element 103 receives the target light, then step S101 is continued to be executed; if it is determined that the first detection element 103 does not receive the target light, then it is continued to determine whether the first detection element 103 receives the target light.

[0090] In this embodiment, another execution method is provided: when executing step S100, if it is determined that the first detection component 103 receives the target light, step S101 is continued to be executed; if it is determined that the first detection component 103 does not receive the target light, the process is terminated. After the process is terminated, it is possible to wait for the next restart of step S100.

[0091] In this embodiment, an execution method is also provided. When executing step S100, step S101 is executed synchronously, and step S102 is executed according to the judgment result of step S101.

[0092] The purpose of this embodiment is to reduce and eliminate the interference of the pixel blocks in the pixel units adjacent to the first detection element 103 on the detection result. For example, when the target light is red light, and the pixel blocks adjacent to the first detection element 103 are all R pixel blocks (such as the attached Figure 7 As shown), the light generated by the R pixel block may interfere with the detection result of the first detection element 103 that the target light is red light. At this time, it is judged that the color of the target light is the same as the color of the pixel block, and the calculated similarity is 100%. According to the result, the stylus 20 is notified to change the lighting color to a non-red light color.

[0093] For another example, when the target light is red light, and the pixel blocks adjacent to the first detection element 103 are R pixel blocks (such as the attached Figure 3-6 As shown), the light generated by this part of the R pixel blocks may still interfere with the detection result of the first detection element 103 that the target light is red light. At this time, it is judged that the color of the target light is similar to the color of the pixel block, and the similarity of this part of the R pixel blocks is calculated. The calculation method is, for example, calculating the proportion of this part of the R pixel blocks in all the pixel blocks adjacent to the first detection element 103 as the similarity, or calculating the intensity value of the color displayed by this part of the R pixel blocks as the similarity, and notifying the stylus 20 to change the lighting color according to the calculation result.

[0094] For another example, when the target light is red light, and the corresponding projection area on the display screen 101 is displayed as red or close to red, then the judgment results of all the first detection components 103 in the projection area are comprehensively calculated to obtain the average value of the similarity, and the stylus 20 is notified to change the lighting color according to the calculation result.

[0095] The selection of the lighting color can be based on the color mode of RGB, CMYK or HSB. Taking the RGB mode as an example, when the lighting of the stylus pen 20 and the color displayed in the area projected on the display screen 101 are both red (R=255, G=0, B=0), the stylus pen 20 is notified to change its R value, G value or B value selection, and then the lighting color of the stylus pen 20 is changed to be different from the display color in the area projected on the display screen 101, so as to reduce the interference of the pixel blocks in the area with the detection of the first detection element 103 in the area.

[0096] In one example of this embodiment, the following is provided Fig.16 The detection method shown includes but is not limited to the following steps, and the order of the steps is not fixed in the order described below.

[0097] Step S01, preset frequency parameters or light intensity parameters;

[0098] Step S100 includes:

[0099] Step S1001, determining whether the first detection element receives light;

[0100] Step S1002, determining whether the light meets the frequency parameter or the light intensity parameter, and if so, determining whether the first detection element receives the target light;

[0101] Step S200 , calculating the center of the tip of the stylus 20 emitting the target light on the display screen 101 of the electronic device 10 according to the target light.

[0102] In this embodiment, an execution method is provided, that is, when executing step S1001, if it is determined that the first detection component detects light, then step S1002 is continued to be executed; if it is determined that the first detection component does not detect light, then step S1001 is continued to be executed or the process is ended. After the end, it is possible to wait for the next restart of step S1001.

[0103] In this embodiment, another execution method is provided, that is, when executing step S1002, if it is determined that the first detection component receives the target light, then continue to execute step S200; if it is determined that the first detection component does not receive the target light, then re-execute step S1001 or end the process. After the end, you can wait for the next restart of step S1001.

[0104] In this example, the purpose of this step is to reduce and eliminate the interference of other light in the environment on the detection result when the first detection member 103 is detecting. In actual use, there are other lights in the environment. In order to avoid interference with the detection of the first detection member 103, the frequency parameter or light intensity parameter is preset. When the first detection member 103 receives the interference signal of the ambient light, the stylus 20 is notified to illuminate with the preset frequency parameter or light intensity parameter, and then the frequency parameter or light intensity parameter is used to determine whether the target light meets the requirements. If it meets the requirements, it is determined that the first detection member 103 receives the target light. If it does not meet the requirements, it is regarded as other interfering light in the environment, and it is determined that the first detection member 103 does not receive the target light. Then, the center of the pen tip is calculated according to the judgment result to reduce the interference of ambient light on the calculation result.

[0105] In one example of this embodiment, step S200 includes: determining whether the sensing area is an arc area, if so, calculating the center of the sensing area as the pen tip center through a special processing algorithm, if not, continuing to calculate the center of the sensing area as the pen tip center.

[0106] The purpose of this setting is that in actual applications, there may be a situation where the light from the stylus 20 cannot reach the display screen 101 for projection. For example, when there is interference between the stylus 20 and the display screen 101, or when the stylus 20 is shining along the edge of the display screen 101, the projection will be incomplete, which will cause the sensing area to be displayed as an arc-shaped area, such as a semicircle, a fan or a "crescent", etc. At this time, a special processing algorithm is required to perform special processing, calculate the center position of the sensing area as the center of the pen tip and display it, to ensure that when there is an occlusion scene or the stylus 20 writes along the edge, the algorithm still calculates the center position to ensure that the positioning of the pen tip center can still be achieved.

[0107] Based on the above description, in one example, there is an obstruction between the stylus 20 and the display screen 101. The obstruction may be, for example, when the stylus 20 is used, the finger or other parts of the body block the light of the stylus 20, or when the stylus 20 is used, there is an obstruction on the display screen 101, such as paper, ruler, etc. This application does not limit the specific obstruction. In this example, as shown in the attached figure, Fig.17 As shown, at this time, the sensing area is affected by the obstruction and appears as a semicircle. Through a special processing algorithm, the center position of the semicircle can be calculated and displayed as the center of the pen tip.

[0108] Based on the above description, in one example, as shown in the attached Fig.18As shown, the stylus 20 writes along the edge of the display screen 101. At this time, only part of the lighting can reach the first detection member 103 at the edge of the display screen 101, and the sensing area also appears as a semicircle. Similarly, through a special processing algorithm, the center position of the semicircle can be calculated and displayed as the center of the pen tip.

[0109] Based on the above two examples, similarly, when the sensing area is displayed as a fan or other arc shape such as a "crescent", the center of the circle can still be calculated through special processing of the algorithm as the center of the pen tip for display, which is also applicable to the calculation processing under regular polygons (when the number of sides is greater than 4). For shapes other than arcs or semi-arcs, the calculation method for irregular polygons in the above embodiment can continue to be executed.

[0110] Further, Figure 20-22 For example, the electronic device 10 in this embodiment may include a housing assembly 120, a display screen module 130, a control circuit board 140, and a flash 110. The housing assembly 120 may include a back cover 121 and a middle frame 122. It should be noted that the embodiment of the present application is only described with the structure that the electronic device includes the middle frame 122. In other embodiments, the electronic device may not include the middle frame structure, that is, the structure in which the back cover 121 of the housing assembly 120 directly cooperates with the display screen module 130, which is not specifically limited here.

[0111] Optionally, the display screen module 130 and the back cover 121 of the housing assembly 120 are respectively disposed on opposite sides of the middle frame 122. The display screen module 130 and the housing assembly 120 cooperate to form an accommodation space 1000, and the control circuit board 140 is disposed in the accommodation space 1000. The control circuit board 140 is coupled to the display screen module 130, and the control circuit board 140 is used to control the working state of the display screen module 130.

[0112] For processor-specific instructions, see Fig. 22 , Fig. 22 1 is a block diagram of the structure of an embodiment of the electronic device of the present application. The structure of the electronic device 10 may include an RF circuit 910, a memory 920, an input unit 930, a display unit 940 (i.e., the display screen module 130 in the above embodiment), a sensor 950, an audio circuit 960, a wifi module 970, a processor 980 (i.e., the processor in the above embodiment), and a power supply 990. Among them, the RF circuit 910, the memory 920, the input unit 930, the display unit 940, the sensor 950, the audio circuit 960, and the wifi module 970 are respectively connected to the processor 980; the power supply 990 is used to provide power to the entire electronic device 10.

[0113] Specifically, the RF circuit 910 is used to receive and send signals; the memory 920 is used to store data instruction information; the input unit 930 is used to input information, which may specifically include a touch panel 931 and other input devices 932 such as operation buttons; the display unit 940 may include a display panel 941, etc.; the sensor 950 includes an infrared sensor, a laser sensor, etc., for detecting user approach signals, distance signals, etc.; the speaker 961 and the microphone (or microphone) 962 are connected to the processor 980 through the audio circuit 960 for receiving and sending sound signals; the wifi module 970 is used to receive and transmit wifi signals, and the processor 980 is used to process data information of the electronic device. For the specific structural features of the electronic device, please refer to the relevant description of the above embodiment, which will not be described in detail here.

[0114] It should also be added that in the present embodiment, the electronic device 10 used includes, but is not limited to, a device configured to receive / send communication signals via a wired line connection (e.g., via a public switched telephone network (PSTN), a digital subscriber line (DSL), a digital cable, a direct cable connection, and / or another data connection / network) and / or via a wireless interface (e.g., for a cellular network, a wireless local area network (WLAN), a digital television network such as a DVB-H network, a satellite network, an AM-FM broadcast transmitter, and / or another communication terminal). A communication terminal configured to communicate via a wireless interface may be referred to as a "wireless communication terminal", "wireless terminal" or "mobile terminal". Examples of mobile terminals include, but are not limited to, satellite or cellular phones; personal communication system (PCS) terminals that may combine cellular radiotelephones with data processing, fax and data communication capabilities; PDAs that may include radiotelephones, pagers, Internet / intranet access, web browsers, notepads, calendars and / or global positioning system (GPS) receivers; and conventional laptop and / or palmtop receivers or other electronic devices that include radiotelephone transceivers. A mobile phone is an electronic device equipped with a cellular communication module.

[0115] The above descriptions are merely embodiments of the present application and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. An electronic device component, characterized in that: include: An electronic device and a stylus that can interact with a display screen of the electronic device; A light-emitting element is provided in the stylus pen, and the light-emitting element illuminates the display screen when the stylus pen interacts with the display screen of the electronic device; The display screen of the electronic device comprises a pixel layer, a first detection element is embedded between pixel units of the pixel layer, and the first detection element is used to detect the reflected light of the fingerprint and the lighting of the light emitting element; The electronic device recognizes the fingerprint and calculates the center of the tip of the stylus on the display screen through the detection result of the first detection element.

2. The electronic device assembly according to claim 1, characterized in that: The first detection element is a photoelectric detector.

3. The electronic device assembly according to claim 1, characterized in that: The stylus is also provided with a second detection component, which detects the tilt angle of the stylus when the stylus interacts with the display screen of the electronic device. The electronic device comprehensively calculates the center of the pen tip based on the detection results of the first detection component and the second detection component.

4. A stylus pen, characterized in that: A light-emitting element is provided in the stylus pen, and the light-emitting element illuminates the display screen when the stylus pen interacts with the display screen of the electronic device; The electronic device calculates the center of the tip of the stylus on the display screen by detecting lighting.

5. The stylus pen according to claim 4, characterized in that: A second detection element is also provided in the stylus pen, and the second detection element detects the tilt angle of the stylus pen when the stylus pen interacts with the display screen of the electronic device; The electronic device calculates the center of the sensing area as the center of the pen tip by detecting the lighting and the tilt angle.

6. The stylus pen according to claim 4, characterized in that: The stylus pen further comprises a pen head, and the pen head is used to control the shape and size of the area illuminated by the light-emitting element.

7. A method for detecting a stylus pen, characterized in that: include: determining whether the first detection element receives the target light; If so, the center of the tip of the stylus emitting the target light on the display screen of the electronic device is calculated according to the target light.

8. The method for detecting a stylus pen according to claim 7, characterized in that: The step of calculating the center of the pen tip of the stylus emitting the target light on the display screen of the electronic device according to the target light includes: displaying a corresponding sensing area on the display screen in response to the detection result of the first detection element, and calculating the center of the sensing area as the pen tip center according to the detection result of the first detection element.

9. The method for detecting a stylus pen according to claim 7, characterized in that: After determining whether the first detection element receives the target light, the method further includes: determining the color of the target light and the color of a pixel block adjacent to the first detection element, calculating the similarity between the color of the target light and the color of the pixel block according to the determination result, and notifying the stylus to change the color of the target light according to the calculation result of the similarity.

10. The method for detecting a stylus pen according to claim 7, characterized in that: Before determining whether the first detection component receives the target light, it also includes: presetting a frequency parameter or a light intensity parameter. The step of determining whether the first detection component receives the target light includes: determining whether the first detection component receives the light, determining whether the light satisfies the frequency parameter or the light intensity parameter, and if so, determining that the first detection component receives the target light.

Images