Interaction method, stylus and electronic device

Abstract

The application discloses an interaction method, a handwriting pen and an electronic device, and relates to the technical field of terminals. The method can enrich the interaction mode of the handwriting pen and the electronic device, and can simulate a drawing technique in a certain specific scene, such as a splashing ink technique. The method comprises the following steps: the handwriting pen receives a target operation, wherein the target operation comprises one of a swinging operation, a knocking operation and a squeezing operation; the handwriting pen sends target information to the electronic device in response to the target operation, wherein the target information is generated based on the target operation; and the electronic device displays an ink mark according to the position of the handwriting pen on the display screen of the electronic device in response to the target information.

Description

[0001] This application claims priority to Chinese patent application filed on February 5, 2024, with application number 202410171798.X and entitled "Interactive Method, Stylus Pen and Electronic Device", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to interaction methods, styluses, and electronic devices. Background Technology

[0003] Currently, after a stylus is connected to an electronic device, users can use it to perform drawing operations. During the drawing process, the stylus can draw lines with different textures by contacting the screen of the electronic device. However, this interaction method is relatively simple and cannot simulate drawing techniques in certain specific drawing scenarios. Summary of the Invention

[0004] This application provides an interaction method, a stylus, and an electronic device, which can enrich the interaction between the stylus and the electronic device and can simulate painting techniques in certain specific scenarios, such as ink splashing techniques.

[0005] To achieve the above objectives, this application adopts the following technical solution:

[0006] In a first aspect, an interaction method is provided, applied to a system including an electronic device and a stylus, wherein the electronic device is configured with a display screen, and the electronic device and the stylus are connected, the method comprising: the stylus receiving a target operation, the target operation including one of a tapping operation, a flicking operation, and a squeezing operation; in response to the target operation, the stylus sending target information to the electronic device, the target information being generated based on the target operation; and in response to the target information, the electronic device displaying ink marks according to the position of the stylus on the display screen.

[0007] Based on the above technical solution, when the stylus receives a tapping, flicking, or squeezing operation, it can send target information generated based on the tapping or flicking operation to the electronic device in response. The electronic device, in turn, responds to this target information and displays ink marks based on the position of the stylus on the device's display screen. In this way, users can draw ink marks on the electronic device by performing tapping, flicking, or squeezing operations on the stylus, enriching the interaction methods between the stylus and the electronic device. This interaction method can simulate drawing techniques in certain specific drawing scenarios, improving the user experience.

[0008] In one possible design, the target operation is a tapping operation, and the target information includes information representing at least one of the tapping event and tapping force corresponding to the tapping operation; or, the target operation is a squeezing operation, and the target information includes information representing at least one of the squeezing event and squeezing force corresponding to the squeezing operation; or, the target operation is a flicking operation, and the target information includes information representing at least one of the flicking event, flicking force, flicking amplitude, and flicking direction corresponding to the flicking operation. Based on this design, when the stylus performs a tapping operation, the stylus can send information to the electronic device representing at least one of the tapping event and tapping force corresponding to the tapping operation; when the stylus performs a squeezing operation, the stylus can send information to the electronic device representing at least one of the squeezing event and squeezing force corresponding to the squeezing operation; when the stylus performs a flicking operation, the stylus can send information to the electronic device representing at least one of the flicking event, flicking force, flicking amplitude, and flicking direction corresponding to the flicking operation, so that the electronic device can display ink based on the aforementioned information. This allows for different ink effects to be displayed when different operations are performed on the stylus, and also makes the displayed ink effects more consistent with the actual ink splattering scene.

[0009] In one possible design, the target operation is a tapping or squeezing operation, and the ink stain is a sheet-like ink stain; or, the target operation is a flicking operation, and the ink stain is a strip-like ink stain. Based on this design, when the stylus receives a tapping or squeezing operation, the electronic device displays a sheet-like ink stain, while when the stylus receives a flicking operation, the electronic device displays a strip-like ink stain. This results in different ink stain effects under different interaction methods, meaning the ink stain corresponds to the interaction method, which better conforms to the rules of real ink splashing techniques and can improve the simulation effect.

[0010] In one possible design, in response to the target information, the electronic device displays ink marks based on the position of the stylus on the display screen. This includes: when the electronic device obtains the hover coordinates based on the position of the stylus on the display screen, in response to the target information, it displays the ink marks in a target display area. The target display area is related to the hover coordinates, which refer to the coordinates on the display screen when the stylus hovers over the screen to receive the target operation. Based on this design, when the electronic device can obtain the coordinates on the display screen when the stylus hovers over the screen, the electronic device responds to the target information and displays ink marks in the display area related to those coordinates; that is, it displays the ink marks based on those coordinates. This ensures that the displayed ink marks are related to those coordinates. In actual ink splatter techniques, the splashed ink marks are related to the splashing position, and the aforementioned coordinates can simulate the splashing position, thus making the ink mark effect more consistent with the real ink splatter scene and improving the simulation effect.

[0011] In one possible design, in response to the target information, the electronic device displays ink marks based on the position of the stylus on the display screen. This includes: if the electronic device fails to obtain the hovering coordinates of the stylus on the display screen, in response to the target information, randomly displaying the ink marks on the display screen. The hovering coordinates refer to the coordinates on the display screen corresponding to when the stylus hovers over the display screen to receive the target operation. In some scenarios, due to reasons such as the stylus being too far from the electronic device, the electronic device may not be able to obtain the coordinates on the display screen corresponding to when the stylus hovers over the electronic device's display screen. This scenario is similar to the situation in actual ink splatter techniques where the ink splatter position is too far from the drawing paper. In this ink splatter scenario, ink marks may appear at any position on the drawing paper. Thus, when the electronic device cannot obtain the coordinates on the display screen corresponding to when the stylus hovers over the electronic device's display screen, in response to the target information, the electronic device randomly displays ink marks on the display screen. This can also simulate the ink splatter technique in actual painting scenarios.

[0012] In one possible design, the ink mark is composed of multiple ink droplets. A first parameter of the ink mark is related to the brush style used by the stylus. This first parameter includes one or more of the following: ink color, droplet size, and ink density. Based on this design, the ink color, droplet size, and ink density are related to the brush style used by the stylus, and these parameters determine the ink mark's style. In other words, the ink mark's style can be determined based on the brush style. Thus, the ink mark style presented by the electronic device may differ depending on the user's brush selection. This can meet the user's needs in different drawing scenarios and also improve the simulation effect.

[0013] In one possible design, the ink mark is composed of multiple ink droplets. A second parameter of the ink mark is related to the target operation. This second parameter includes one or more of the following: ink mark range, ink mark length, ink mark direction, ink droplet size, ink droplet density, and ink droplet concentration. Based on this design, the ink mark range, length, direction, size, density, and concentration are related to the operation received by the stylus. These parameters determine the ink mark's style; that is, the style can be determined based on the brush style. Thus, the ink mark style presented by the electronic device may differ depending on the user's brush. This can meet the user's needs in different drawing scenarios. Furthermore, in actual drawing scenarios, the ink mark effect is also related to the style of the brush used (such as a calligraphy brush or a fountain pen), which can further enhance the simulation effect.

[0014] In one possible design, the target operation is a tapping operation, and the parameters of the tapping operation include tapping force, and at least one of the following: ink stain range, ink droplet size, ink droplet density, and ink droplet density is positively correlated with the tapping force; or, the target operation is a squeezing operation, and the parameters of the squeezing operation include squeezing force, and at least one of the following: ink stain range, ink droplet size, ink droplet density, and ink droplet density is positively correlated with the squeezing force; or, the target operation is a flicking operation, and the parameters of the flicking operation include at least one of flicking amplitude and flicking force, and at least one of the following: ink stain length, ink droplet size, ink droplet density, and ink droplet density is positively correlated with at least one of the flicking amplitude and flicking force. Based on this design, at least one of the following parameters of the ink splatter—its range, droplet size, droplet density, and ink density—is positively correlated with the striking or squeezing force; or at least one of the following parameters is positively correlated with the amplitude and force of the flicking motion. In other words, the parameters of the ink splatter are set to be positively correlated with striking force, squeezing force, flicking amplitude, and flicking force, which aligns with users' conventional thinking and makes the operation easier for them to learn. Furthermore, it better conforms to the rules of real ink splatter techniques, resulting in a better simulation effect.

[0015] In one possible design, the target operation is a flicking operation, and the direction of the ink stain is the same as the flicking direction. Based on this design, when the stylus receives a flicking operation, the direction of the ink stain displayed by the electronic device is the same as the flicking direction, which is more consistent with the presentation of ink stains in real ink splatter techniques and can result in a better ink stain effect.

[0016] In one possible design, one or more of the following parameters of the ink splatter—length, size, density, and intensity—are related to hover coordinates. These hover coordinates refer to the coordinates on the display screen corresponding to the pen's position when it hovers over the screen to receive the target operation. In actual ink splatter techniques, the pattern of the splattered ink is related to its location. Based on this design, the length, size, density, and intensity of the ink splatter are related to the hover coordinates. These parameters determine the effect of the ink splatter, and the hover coordinates can simulate the location of the splatter, thus making the ink effect more consistent with the real-world ink splatter scenario and improving the simulation effect.

[0017] In one possible design, the target operation is a tapping or squeezing operation. The ink stain includes a first ink stain and a second ink stain. The distance between the first ink stain and the hover coordinate is less than the distance between the second ink stain and the hover coordinate. The droplet size of the first ink stain is greater than the droplet size of the second ink stain, and / or the droplet density of the first ink stain is greater than the droplet density of the second ink stain, and / or the ink density of the first ink stain is greater than the ink density of the second ink stain. Based on this design, when the stylus receives a tapping or squeezing operation, the ink stain presented by the electronic device includes a first ink stain and a second ink stain. The distance between the first ink stain and the hover coordinate is less than the distance between the second ink stain and the hover coordinate. The droplet size of the first ink stain is greater than the droplet size of the second ink stain, and / or the droplet density of the first ink stain is greater than the droplet density of the second ink stain, and / or the ink density of the first ink stain is greater than the ink density of the second ink stain. In other words, the closer the ink is to the hovering coordinates, the greater the ink droplet density, and / or the larger the ink droplet size, and / or the thicker the ink droplet, etc. This makes the ink marks appear in accordance with the rules of ink marks under real ink splashing techniques, or in accordance with the rules of ink dripping, thus making the simulation effect better.

[0018] In one possible design, the target operation is a flicking operation. The hovering coordinates include a first hovering coordinate, which is the hovering coordinate when the stylus receives the flicking operation and begins to flick. The ink stain includes a third ink stain and a fourth ink stain. The distance between the third ink stain and the first hovering coordinate is less than the distance between the fourth ink stain and the first hovering coordinate. The droplet size of the third ink stain is greater than the droplet size of the fourth ink stain, and / or the droplet density of the third ink stain is greater than the droplet density of the fourth ink stain, and / or the ink density of the third ink stain is greater than the ink density of the fourth ink stain. Based on this design, when the stylus receives the flicking operation, the ink stain presented by the electronic device includes a third ink stain and a fourth ink stain. The distance between the third ink stain and the initial hovering coordinate is less than the distance between the fourth ink stain and the initial hovering coordinate, meaning the third ink stain is closer to the initial hovering coordinate. The third ink blot has a larger droplet size than the fourth ink blot, and / or the third ink blot has a higher droplet density than the fourth ink blot, and / or the third ink blot has a greater ink density than the fourth ink blot. In other words, the closer to the starting hover coordinates, the greater the ink droplet density, and / or the larger the droplet size, and / or the darker the droplet. This ensures that the presented ink blots conform to the rules of ink blot presentation in real ink splashing techniques, resulting in a better simulation effect.

[0019] In one possible design, before the stylus sends target information to the electronic device in response to the target operation, the method further includes: the electronic device displaying the running interface of a first application, and the stylus being used to draw on the running interface. For example, the first application could be a drawing application, etc. Based on this design, when the electronic device displays the running interface of the first application, the stylus will only display ink marks when it receives a tapping, flicking, or squeezing operation to simulate drawing techniques in certain specific scenarios. This avoids the electronic device displaying ink marks when the user is normally using the stylus to touch the electronic device, i.e., not in a drawing scenario, even when the stylus receives a tapping, flicking, or squeezing operation, thus affecting normal user operation and reducing user experience.

[0020] In one possible design, the target operation is a tapping operation, and the second parameter of the ink stain is related to the pen tip orientation when the stylus receives the tapping operation. In actual ink splatter techniques, the splashed ink stain is related to the direction of the splash. The orientation of the stylus pen tip can simulate the splashing direction. Thus, when the stylus receives a tapping operation, the second parameter of the ink stain presented by the electronic device is related to the pen tip orientation when the stylus receives the tapping operation. In other words, the style of the ink stain presented by the electronic device is related to the pen tip orientation when the stylus receives the tapping operation. This makes the ink stain effect more consistent with the ink stain effect in actual ink splatter scenarios.

[0021] In one possible design, the ink stain includes a fifth ink stain and a sixth ink stain. The fifth ink stain is displayed on the screen in the same direction as the pen tip, while the sixth ink stain is displayed on the screen in a different direction. The fifth ink stain has a larger area than the sixth ink stain, and / or the ink droplet density of the fifth ink stain is greater than that of the sixth ink stain, and / or the ink droplet size of the fifth ink stain is greater than that of the sixth ink stain. Based on this design, the ink stain presented in the same direction as the pen tip has a larger area, and / or a higher ink droplet density, and / or a denser ink droplet. This allows the presented ink stain to conform to the rules of ink stain presentation under real ink splatter techniques, resulting in a better simulation effect.

[0022] Secondly, an interaction method is provided for an electronic device including a display screen, the electronic device being connected to a stylus, the method comprising: receiving target information from the stylus, the target information being generated based on a target operation on the stylus, the target operation including one of a tapping operation, a flicking operation, and a squeezing operation; and, in response to the target information, displaying ink marks according to the position of the stylus on the display screen.

[0023] In one possible design, the target operation is a tapping operation, and the target information includes information representing at least one of the tapping event and tapping force corresponding to the tapping operation; or, the target operation is a squeezing operation, and the target information includes information representing at least one of the squeezing event and squeezing force corresponding to the squeezing operation; or, the target operation is a swinging operation, and the target information includes information representing at least one of the swinging event, swinging force, swinging amplitude, and swinging direction corresponding to the swinging operation.

[0024] In one possible design, the target operation is a tapping or squeezing operation, and the ink is a sheet-like ink stain; or, the target operation is a flicking operation, and the ink is a strip-like ink stain.

[0025] In one possible design, displaying ink marks in response to the target information based on the position of the stylus on the display screen includes: when hover coordinates are obtained based on the position of the stylus on the display screen, displaying the ink marks in a target display area in response to the target information, wherein the target display area is related to the hover coordinates, and the hover coordinates refer to the coordinates on the display screen corresponding to when the stylus hovers on the display screen to receive the target operation.

[0026] In one possible design, the step of displaying ink marks on the display screen in response to the target information, based on the position of the stylus on the display screen, includes: if no hover coordinates are obtained based on the position of the stylus on the display screen, in response to the target information, randomly displaying the ink marks on the display screen, wherein the hover coordinates refer to the coordinates on the display screen corresponding to when the stylus hovers on the display screen to receive the target operation.

[0027] In one possible design, the ink mark is composed of multiple ink droplets, and the first parameter of the ink mark is related to the style of the brush used by the stylus. The first parameter includes one or more of the following: ink mark color, ink droplet size, and ink droplet density.

[0028] In one possible design, the ink stain is composed of multiple ink droplets, and a second parameter of the ink stain is related to the target operation. The second parameter includes one or more of the following: ink stain range, ink stain length, ink stain direction, ink droplet size, ink droplet density, and ink droplet concentration.

[0029] In one possible design, the target operation is a tapping operation, and the parameters of the tapping operation include tapping force, and at least one of the following: ink stain range, ink droplet size, ink droplet density, and ink droplet density is positively correlated with the tapping force; or, the target operation is a squeezing operation, and the parameters of the squeezing operation include squeezing force, and at least one of the following: ink stain range, ink droplet size, ink droplet density, and ink droplet density is positively correlated with the squeezing force; or, the target operation is a flicking operation, and the parameters of the flicking operation include at least one of flicking amplitude and flicking force, and at least one of the following: ink stain length, ink droplet size, ink droplet density, and ink droplet density is positively correlated with at least one of the flicking amplitude and flicking force.

[0030] In one possible design, the target operation is a flicking operation, and the direction of the ink stain is the same as the flicking direction of the flicking operation.

[0031] In one possible design, one or more of the following: ink length, ink droplet size, ink droplet density, and ink droplet intensity are related to hover coordinates, which refer to the coordinates on the display screen when the stylus hovers over the display screen to receive the target operation.

[0032] In one possible design, the target operation is a tapping or squeezing operation, and the ink stain includes a first ink stain and a second ink stain. The distance between the first ink stain and the hover coordinate is less than the distance between the second ink stain and the hover coordinate. The droplet size of the first ink stain is greater than the droplet size of the second ink stain, and / or the droplet density of the first ink stain is greater than the droplet density of the second ink stain, and / or the ink droplet density of the first ink stain is greater than the ink droplet density of the second ink stain.

[0033] In one possible design, the target operation is a flicking operation, and the hovering coordinates include a first hovering coordinate, which is the hovering coordinate when the stylus receives the flicking operation and begins to flick. The ink stains include a third ink stain and a fourth ink stain. The distance between the third ink stain and the first hovering coordinate is less than the distance between the fourth ink stain and the first hovering coordinate. The droplet size of the third ink stain is greater than the droplet size of the fourth ink stain, and / or the droplet density of the third ink stain is greater than the droplet density of the fourth ink stain, and / or the ink droplet density of the third ink stain is greater than the ink droplet density of the fourth ink stain.

[0034] In one possible design, before receiving target information from the stylus, the method further includes: the electronic device displaying a running interface of a first application, the stylus being used to draw on the running interface.

[0035] In one possible design, the target operation is a tapping operation, and the second parameter of the ink is related to the pen tip orientation when the stylus receives the tapping operation.

[0036] In one possible design, the ink marks include a fifth ink mark and a sixth ink mark. The fifth ink mark is displayed on the display screen in a display area facing the same direction as the pen tip, and the sixth ink mark is displayed on the display screen in a display area facing a different direction than the pen tip. The ink mark range of the fifth ink mark is larger than that of the sixth ink mark, and / or the ink droplet concentration of the fifth ink mark is greater than that of the sixth ink mark, and / or the ink droplet size of the fifth ink mark is greater than that of the sixth ink mark.

[0037] Thirdly, an interaction method is provided for use with a stylus pen, wherein the stylus pen is connected to an electronic device. The method includes: receiving a target operation, wherein the target operation includes one of a tapping operation, a flicking operation, and a squeezing operation; and responding to the target operation by sending target information to the electronic device, wherein the target information is used by the electronic device to display ink marks according to the position of the stylus pen on the display screen of the electronic device.

[0038] In one possible design, the target operation is a tapping operation, and the target information includes information representing at least one of the tapping event and tapping force corresponding to the tapping operation; or, the target operation is a squeezing operation, and the target information includes information representing at least one of the squeezing event and squeezing force corresponding to the squeezing operation; or, the target operation is a swinging operation, and the target information includes information representing at least one of the swinging event, swinging force, swinging amplitude, and swinging direction corresponding to the swinging operation.

[0039] In one possible design, the target operation is a tapping or squeezing operation, and the ink is a sheet-like ink stain; or, the target operation is a flicking operation, and the ink is a strip-like ink stain.

[0040] In one possible design, the ink mark is composed of multiple ink droplets, and the first parameter of the ink mark is related to the style of the brush used by the stylus. The first parameter includes one or more of the following: ink mark color, ink droplet size, and ink droplet density.

[0041] In one possible design, the ink stain is composed of multiple ink droplets, and a second parameter of the ink stain is related to the target operation. The second parameter includes one or more of the following: ink stain range, ink stain length, ink stain direction, ink droplet size, ink droplet density, and ink droplet concentration.

[0042] In one possible design, the target operation is a tapping operation, and the parameters of the tapping operation include tapping force, and at least one of the following: ink stain range, ink droplet size, ink droplet density, and ink droplet density is positively correlated with the tapping force; or, the target operation is a squeezing operation, and the parameters of the squeezing operation include squeezing force, and at least one of the following: ink stain range, ink droplet size, ink droplet density, and ink droplet density is positively correlated with the squeezing force; or, the target operation is a flicking operation, and the parameters of the flicking operation include at least one of flicking amplitude and flicking force, and at least one of the following: ink stain length, ink droplet size, ink droplet density, and ink droplet density is positively correlated with at least one of the flicking amplitude and flicking force.

[0043] In one possible design, the target operation is a flicking operation, and the direction of the ink stain is the same as the flicking direction of the flicking operation.

[0044] In one possible design, one or more of the following: ink length, ink droplet size, ink droplet density, and ink droplet intensity are related to hover coordinates, which refer to the coordinates on the display screen when the stylus hovers over the display screen to receive the target operation.

[0045] In one possible design, the target operation is a tapping or squeezing operation, and the ink stain includes a first ink stain and a second ink stain. The distance between the first ink stain and the hover coordinate is less than the distance between the second ink stain and the hover coordinate. The droplet size of the first ink stain is greater than the droplet size of the second ink stain, and / or the droplet density of the first ink stain is greater than the droplet density of the second ink stain, and / or the ink droplet density of the first ink stain is greater than the ink droplet density of the second ink stain.

[0046] In one possible design, the target operation is a flicking operation, and the hovering coordinates include a first hovering coordinate, which is the hovering coordinate when the stylus receives the flicking operation and begins to flick. The ink stains include a third ink stain and a fourth ink stain. The distance between the third ink stain and the first hovering coordinate is less than the distance between the fourth ink stain and the first hovering coordinate. The droplet size of the third ink stain is greater than the droplet size of the fourth ink stain, and / or the droplet density of the third ink stain is greater than the droplet density of the fourth ink stain, and / or the ink droplet density of the third ink stain is greater than the ink droplet density of the fourth ink stain.

[0047] In one possible design, the target operation is a tapping operation, and the second parameter of the ink is related to the pen tip orientation when the stylus receives the tapping operation.

[0048] In one possible design, the ink marks include a fifth ink mark and a sixth ink mark. The fifth ink mark is displayed on the display screen in a display area facing the same direction as the pen tip, and the sixth ink mark is displayed on the display screen in a display area facing a different direction than the pen tip. The ink mark range of the fifth ink mark is larger than that of the sixth ink mark, and / or the ink droplet concentration of the fifth ink mark is greater than that of the sixth ink mark, and / or the ink droplet size of the fifth ink mark is greater than that of the sixth ink mark.

[0049] Fourthly, an interaction method is provided for a system comprising an electronic device and a stylus, wherein the electronic device is equipped with a display screen, and the electronic device and the stylus are connected. The method includes: moving the stylus above the display screen, wherein the distance between the stylus and the display screen is greater than a preset distance; and, in response to the movement of the stylus, displaying ink marks on the display screen by the electronic device. This achieves the effect of suspended drawing, resulting in a better interactive experience.

[0050] In one possible design, the electronic device displaying ink marks on the display screen in response to movement of the stylus includes: in response to movement of the stylus, the electronic device acquiring at least one hover coordinate, the hover coordinate being the coordinates on the display screen corresponding to the stylus moving above the display screen; and the electronic device displaying ink marks on the display screen based on the at least one hover coordinate.

[0051] In one possible design, the electronic device acquires at least one hover coordinate by: the electronic device acquiring the at least one hover coordinate based on a signal emitted by the stylus electrode.

[0052] In one possible design, the ink mark is composed of multiple ink droplets, and the first parameter of the ink mark is related to the style of the brush used by the stylus. The first parameter includes one or more of the following: ink mark color, ink droplet size, and ink droplet density.

[0053] In one possible design, the ink mark is composed of multiple ink droplets, and a third parameter of the ink mark is related to the distance between the stylus and the display screen. The third parameter includes one or more of the following: droplet size, droplet density, and droplet concentration.

[0054] In one possible design, one or more of the ink droplet size, droplet density, and droplet intensity are negatively correlated with the distance between the stylus and the display screen.

[0055] Fifthly, an interaction method is provided for use on a display screen containing an electronic device, the electronic device being connected to a stylus, the method comprising: acquiring at least one hover coordinate, the hover coordinate being the coordinates on the display screen corresponding to the stylus as it moves above the display screen; and displaying ink marks on the display screen in response to the at least one hover coordinate.

[0056] For other design aspects in the fifth aspect, please refer to the corresponding design in the fourth aspect.

[0057] Sixthly, an apparatus is provided that has the function of implementing the method performed by an electronic device or a stylus as described in any of the designs of any of the preceding aspects. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described function. In one possible example, the apparatus includes a communication unit (or communication module) and a processing unit (or processing module); the communication unit is used to perform communication operations in the method described in any of the preceding aspects; the processing unit is used to perform processing operations in the method described in any of the preceding aspects.

[0058] A seventh aspect provides an electronic device including a processor, a memory, a communication interface, and a display screen, wherein the memory, the communication interface, and the display screen are coupled to the processor, the communication interface is used for communicating with other devices, the memory is used for storing computer program code including computer instructions, and the processor reads the computer instructions from the memory to cause the electronic device to perform a method performed by the electronic device as described in any of the preceding aspects.

[0059] Eighthly, a stylus is provided, including a processor, a memory, and a communication interface, wherein the memory and the communication interface are coupled to the processor, the communication interface is used to communicate with other devices, the memory is used to store computer program code including computer instructions, and the processor reads the computer instructions from the memory to cause the stylus to perform a method performed by the stylus as described in any of the preceding aspects.

[0060] In one possible design, the stylus may also include a sensor that can be used to collect one or more of the following information to characterize the striking force, squeezing force, flicking force, flicking amplitude, and flicking direction.

[0061] Optionally, in the seventh or eighth aspect above, the memory may be coupled to the processor, or it may be independent of the processor. For example, the communication interface may be a transceiver, an input / output interface, an interface circuit, an output circuit, an input circuit, pins, or related circuits, etc.

[0062] A ninth aspect provides a computer-readable storage medium comprising a computer program or instructions that, when executed on an electronic device, cause the electronic device to perform a method as described in any of the preceding aspects. Alternatively, when executed on a stylus pen, cause the stylus pen to perform a method as described in any of the preceding aspects.

[0063] In a tenth aspect, a computer program product is provided that, when the computer program product is run on a computer, enables the computer to perform the method performed by the electronic device or stylus as designed in any of the preceding aspects.

[0064] Eleventhly, a chip system is provided, including at least one processor and at least one interface circuit, the at least one interface circuit being used to perform transceiver functions and send instructions to at least one processor, wherein when at least one processor executes instructions, at least one processor performs a method performed by an electronic device or stylus as described in any of the designs of any of the preceding aspects.

[0065] In a twelfth aspect, an interactive system is provided, comprising an electronic device and a stylus, wherein the electronic device is configured to perform the method described in any of the designs of the second aspect above, and the stylus is configured to perform the method described in any of the designs of the third aspect above. Alternatively, the electronic device and the stylus cooperate to implement the method described in any of the designs of any of the above aspects.

[0066] It should be noted that the technical effects of any of the designs in the second to twelfth aspects mentioned above can be found in the technical effects of the corresponding designs in the first aspect, and will not be repeated here. Attached Figure Description

[0067] Figure 1 A schematic diagram of a painting scene provided in an embodiment of this application;

[0068] Figure 2 This application provides a schematic diagram of the architecture of a communication system.

[0069] Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0070] Figure 4 This is a schematic diagram of the structure of a stylus provided in an embodiment of this application;

[0071] Figure 5 This is a schematic diagram of the structure of another electronic device provided in an embodiment of this application;

[0072] Figure 6 Interface illustration provided for embodiments of this application Figure 1 ;

[0073] Figure 7 Interface illustration provided for embodiments of this application Figure 2 ;

[0074] Figure 8 Interface illustration provided for embodiments of this application Figure 3 ;

[0075] Figure 9 A schematic diagram illustrating a scenario of stylus usage provided in an embodiment of this application;

[0076] Figure 10 Interface illustration provided for embodiments of this application Figure 4 ;

[0077] Figures 11 to 19G Interface illustration provided for embodiments of this application Figures 5 to 10 Nine;

[0078] Figure 20AA flowchart illustrating an interaction method provided in an embodiment of this application;

[0079] Figure 20B A flowchart illustrating another interaction method provided in an embodiment of this application;

[0080] Figure 21 This is a schematic diagram of the structure of another electronic device provided in an embodiment of this application;

[0081] Figure 22 This is a schematic diagram of the structure of another stylus provided in an embodiment of this application;

[0082] Figure 23 This is a schematic diagram of a chip system provided in an embodiment of this application. Detailed Implementation

[0083] The technical solutions provided by the embodiments of this application will be described in detail below with reference to the accompanying drawings. The terms "comprising" and "having," and any variations thereof, mentioned in the description of this application, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or devices.

[0084] It should be noted that in the embodiments of this application, the words "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the words "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0085] In the description of this application, unless otherwise stated, "multiple" means two or more. "And / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone.

[0086] To facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and the terms "first" and "second" are not necessarily different.

[0087] Currently, solutions for drawing on electronic devices using a stylus rely on the coordinates of the stylus's contact with the screen, and utilize parameters such as pressure sensitivity and tilt angle to draw lines with different textures. For example... Figure 1 As shown, based on the coordinates of the stylus 20 on the screen of the electronic device 10, the pressure sensitivity, tilt angle, and other parameters of the stylus 20 can draw lines 30. In this solution, the interaction between the stylus and the electronic device is limited and cannot simulate certain painting techniques in specific painting scenarios, such as the ink splashing technique in traditional Chinese painting.

[0088] Based on this, this application provides an interaction method that enriches the interaction between the stylus and the electronic device, and can simulate painting techniques in certain specific scenarios, such as ink splashing techniques, thereby improving the user experience.

[0089] For example, Figure 2 This illustration shows a schematic diagram of the architecture of a communication system applying an interaction method according to an embodiment of this application. Figure 2 As shown, the communication system 200 includes an electronic device 201 and a stylus 202.

[0090] The electronic device 201 can be any electronic device with a display screen. For example, electronic device 201 can include, but is not limited to, smartphones, netbooks, tablets, writing tablets, smartwatches, smart bracelets, phone watches, smart cameras, PDAs, in-vehicle computers, personal computers (PCs), personal digital assistants (PDAs), portable multimedia players (PMPs), augmented reality (AR) / virtual reality (VR) devices, smart TVs, projection devices, or motion-sensing game consoles in human-computer interaction scenarios. Alternatively, electronic device 201 can also be other types or structures of electronic devices with a display screen; this application is not limited to these categories.

[0091] The stylus 202 can be used to perform various writing operations on the electronic device 201, such as including but not limited to doodling, drawing, annotation, and signing. Optionally, the stylus 202 can be a resistive stylus, an electromagnetic stylus, or a capacitive stylus; this application embodiment does not impose any limitations on this.

[0092] Optionally, the operating system installed on the aforementioned electronic device 201 and / or stylus 202 includes, but is not limited to, Alternatively, other operating systems may be used. Of course, the electronic device 201 and / or the stylus 202 may not have an operating system installed. This application does not limit the specific type of the electronic device 201 and / or the stylus 202, whether or not an operating system is installed, or the operating system installed if one is installed. Optionally, for different types or different software system versions of the electronic device 201, the same or different versions of the stylus 202 can be adapted.

[0093] Optionally, the electronic device 201 and the stylus 202 can establish a connection via wired or wireless communication. For example, wireless communication methods may include, but are not limited to, Bluetooth (BT) (e.g., classic Bluetooth or Bluetooth Low Energy (BLE) Bluetooth), wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), etc.

[0094] Understandable. Figure 2 The simplified diagram is provided for ease of understanding. In practical applications, the system described above may include other devices, which are not shown in the diagram.

[0095] For example, Figure 3 A schematic diagram of the structure of an electronic device 201 provided in an embodiment of this application is shown.

[0096] like Figure 3 As shown, the electronic device 201 may include a processor 110, a memory 120, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna, a communication module 150, a sensor module 160, a display screen 170, etc.

[0097] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0098] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0099] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0100] USB interface 130 is an interface that conforms to the USB standard specification. USB interface 130 can be used to connect a charger to charge electronic device 201, and can also be used for data transfer between electronic device 201 and peripheral devices.

[0101] The charging management module 140 is used to receive charging input from the charger.

[0102] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, memory 120, and communication module 150, etc.

[0103] The communication function of electronic device 201 can be achieved through an antenna, communication module 150, etc.

[0104] The antenna is used to transmit and receive electromagnetic wave signals. The communication module 150 can provide solutions for wireless communication applications on the electronic device 201, including wireless local area networks (WLANs) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), frequency modulation (FM), near-field communication (NFC), and infrared (IR) technologies. The communication module 150 can be one or more devices integrating at least one communication processing module.

[0105] In some embodiments, the antenna of the electronic device 201 is coupled to the communication module 150, enabling the electronic device 201 to communicate with networks and other devices via wireless communication technologies. The wireless communication technologies may include Long Term Evolution (LTE), BitTorrent, GNSS, WLAN, NFC, FM, and / or IR technologies, etc.

[0106] In some embodiments of this application, the communication module 150 can be used to establish a connection with a stylus, and the electronic device 201 can interact with the stylus through the established connection.

[0107] The memory 120 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 201 by running the instructions stored in the memory 120 and / or the instructions stored in the memory disposed in the processor.

[0108] Optionally, the sensor module 160 includes one or more of a pressure sensor 160A, a magnetic sensor 160B, and a touch sensor 160C.

[0109] Pressure sensor 160A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 160A may be disposed on display screen 170. There are many types of pressure sensors 160A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When a force is applied to pressure sensor 160A, the capacitance between the electrodes changes. Electronic device 201 determines the pressure intensity based on the change in capacitance.

[0110] The magnetic sensor 160B includes a Hall sensor. The electronic device 201 can use the magnetic sensor 160B to detect the opening and closing of the flip cover. In some embodiments of this application, the electronic device 201 can use the magnetic sensor 160B to attract a stylus, thereby attaching the stylus to a fixed position on the electronic device 201.

[0111] Touch sensor 180C, also known as a "touch device," can be located on display screen 170. The touch sensor 180C and display screen 170 together form a touchscreen, also known as a "touchscreen." Touch sensor 180C is used to detect touch operations applied to or near it.

[0112] Electronic device 201 implements display functions through GPU, display screen 170, and application processor.

[0113] The display screen 170 is used to display images, videos, etc. The display screen 170 includes a display panel.

[0114] In some embodiments of this application, the display screen 170 can be used to display lines, patterns, or written text drawn by a user using a stylus. In still other embodiments of this application, the display screen 170 can also be used to receive signals emitted by the electrodes of the stylus.

[0115] For example, Figure 4 A schematic diagram of the structure of a stylus 202 provided in an embodiment of this application is shown.

[0116] like Figure 4 As shown, the stylus 202 may include electrodes 410, a sensor 420, a communication module 430, etc. The electrodes 410 can be used to transmit signals to components such as... Figure 3 The display screen 170 shown transmits signals. Accordingly, the electronic device 201 can determine the hovering coordinates of the stylus 202 on the display screen 170 based on the signals received by the display screen 170. In some embodiments, the electrode 410 can be integrated at the tip of the stylus 202. Of course, in other embodiments, the electrode 410 can also be integrated at other locations on the stylus 202, such as the cap, etc., and this application embodiment does not impose specific limitations on this.

[0117] In some embodiments, sensor 420 can be used to detect user operations applied to the stylus 202, such as, but not limited to, one or more of tapping, flicking, touching, and squeezing operations. When the user operation is a tapping, flicking, or squeezing operation, sensor 420 can be specifically implemented as a film sensor or an accelerometer. For example, a film sensor can identify tapping operations by recognizing touch events, and squeezing operations by detecting pressure data. An accelerometer can be used to detect the magnitude of the acceleration of the stylus 202 in various directions (generally three axes), such as identifying flicking operations by detecting acceleration data. When the user operation is a touch operation, sensor 420 can be specifically implemented as a touch sensor or a pressure sensor.

[0118] In some embodiments, the sensor 420 can also be used to attach the stylus 202 to a fixed position on the electronic device. In this embodiment, the sensor 420 can also be specifically implemented as a magnetic sensor.

[0119] It is understood that the number of sensors included in sensor 420 can be one or more, and this application embodiment does not limit this. At the same time, this application embodiment does not specifically limit the installation position of the sensor in stylus 202.

[0120] The communication module 430 can be used to enable information exchange between the stylus 202 and other devices (such as electronic device 201). For a detailed description of the communication module 430, please refer to [reference needed]. Figure 3 The following is a description of the communication module shown.

[0121] Optionally, in other embodiments, the electronic device and / or stylus may include a larger... Figure 3 , Figure 4 The diagram shows more or fewer components, or combinations of components, or splitting of components, or replacement of components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of both.

[0122] In some embodiments, the software system of an electronic device may adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses a layered architecture as an example to exemplify the software structure of the electronic device 201.

[0123] Figure 5 This is a schematic diagram of the software structure of an electronic device 201 provided in an embodiment of this application.

[0124] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the software system of an electronic device may include four layers: an application layer, an application framework layer, a system layer, and a kernel layer.

[0125] The application layer may include a series of application packages, such as, but not limited to, applications for drawing, Bluetooth, and WLAN. In some embodiments of this application, the drawing application can be used to implement various drawing operations.

[0126] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer can include some predefined functions.

[0127] The system layer can be used to provide various system services. In some embodiments, the system layer may include an input subsystem and an Aptouch daemon. The input subsystem is used to manage input. It manages input transactions, and the driver for the input device can register with the kernel through the interface provided by the input subsystem, using the functionality provided by the input subsystem to interact with user space. For example, in some embodiments of this application, the input subsystem can be used to manage touch events, flicking events, etc., of a stylus.

[0128] APtouch Daemon is a process related to display touch control. This process can run in the background of the electronic device 201, providing continuously running services and functions.

[0129] The kernel layer is the layer between hardware and software. In some embodiments, the kernel layer may include one or more of the following: touchpad (TP) driver, Bluetooth driver, and sensor driver.

[0130] Understandable. Figure 5 The software structure of the electronic device 201 shown is for illustrative purposes only. In practical applications, it may include more or fewer layers and / or more or fewer modules. The layers to which each module belongs may also be different. For example, the input subsystem of the system layer may also belong to the application framework layer. This application embodiment does not limit this.

[0131] The following example, using a stylus to draw on an electronic device, illustrates the workflow of electronic device software and hardware.

[0132] In some scenarios, the stylus can hover over the screen of an electronic device. When the stylus receives a tap, its electrodes emit a signal to the screen. The screen receives this signal, obtains the stylus's hover coordinates, and identifies the tap event. Then, the kernel-level TP driver is launched, reporting the data to the APtouch Daemon. Next, the APtouch Daemon packages the stylus's hover coordinates and other data and sends it back to the TP driver. Further, the TP driver receives the packaged data and passes it through the input subsystem and framework layer before uploading it to the application layer's drawing application. Finally, the drawing application executes the ink drawing process based on the packaged data, displaying the completed ink drawing on the electronic device's screen.

[0133] The technical solutions involved in the following embodiments can all be applied to applications with, for example, Figure 3 , Figure 4 , Figure 5 The device with the structure shown, and as Figure 2 The system implementation of the architecture shown.

[0134] It is understood that in the following embodiments, electronic device 201 is described as an electronic device and stylus 202 is described as a stylus. The electronic device and / or stylus can perform some or all of the steps in the embodiments of this application. These steps or operations are merely examples, and the embodiments of this application can also perform other operations or variations of various operations. Furthermore, the steps can be performed in different orders as presented in the embodiments of this application, and it is not necessary to perform all the operations in the embodiments of this application.

[0135] In some scenarios, a connection needs to be established between the stylus and the electronic device before drawing on the device using a stylus. For example, Figure 6 This illustration shows a scenario where a stylus is connected to an electronic device, as provided in an embodiment of this application. Figure 6 As shown in Figure (1), the user can attach the stylus to the side frame of the electronic device (such as a designated position on the long frame). In response to this attachment operation, the connection process between the stylus and the electronic device can be triggered. Optionally, the electronic device can display various interfaces before receiving the stylus attachment operation, such as, but not limited to, the main interface, the lock screen interface, and the running interfaces of various applications. That is to say, regardless of what interface is displayed on the electronic device, the connection process between the stylus and the electronic device can be triggered when the stylus is attached to the designated position on the electronic device. This embodiment of the application does not limit this.

[0136] Next, as Figure 6As shown in (2), the electronic device can pop up a connection interface 700, which can be used to remind the user whether they are sure they want to establish a connection between the stylus and the electronic device. If the electronic device detects an operation such as a click on the connection control 701 by the user, the stylus establishes a connection with the electronic device in response to the operation. Optionally, the electronic device may also display other interfaces such as... Figure 6 The reminder interface 710 shown in (3) reminds the user that the stylus has successfully established a connection with the electronic device.

[0137] It is understood that the above is merely an example illustrating one way in which an electronic device establishes a connection with a stylus. In other embodiments, the electronic device may also establish a connection with the stylus in other ways, such as through tapping, Bluetooth pairing, or other methods. This application does not impose specific limitations on these methods.

[0138] Furthermore, after the electronic device and the stylus are connected, the user can use the stylus to perform various drawing operations on the electronic device. The following, with reference to the accompanying diagrams, describes the process of drawing on an electronic device using a stylus.

[0139] In some embodiments, an electronic device may have a drawing application installed. Users can use a stylus to perform drawing operations on the interface of the drawing application. The drawing application on the electronic device can then respond to the drawing operations performed by the user and draw corresponding ink marks to generate a picture.

[0140] Optionally, the aforementioned drawing application can be a dedicated drawing application or other applications capable of performing drawing functions, such as, but not limited to, various applications like memos, sticky notes, and text applications. Optionally, the drawing application can be a system application or a downloaded third-party application; this application embodiment does not impose any restrictions on this.

[0141] For example, such as Figure 7 As shown in Figure (1), the electronic device displays a main interface 800 (or desktop 800), which includes icons for one or more applications, such as the icon for a calendar application, the icon for a settings application, etc., which will not be listed here. The icons of different applications can be used to open the running interface of the corresponding application and realize the functions of the corresponding application. Among the icons of these one or more applications is the icon 801 of a drawing application.

[0142] If the electronic device detects a click action, such as a user tapping the icon 801 of a drawing application, optionally, this click action can be performed by the user's finger or a stylus. In response to this action, such as... Figure 7As shown in Figure (2), the electronic device can display the running interface 810 of the drawing application, and the user can use a stylus to perform various drawing operations on the running interface 810. Optionally, in response to the user's click operation on the icon 801 of the drawing application, the electronic device can also first display the interface for creating a new layer (not shown in the figure) before displaying the running interface 810, so as to perform various drawing operations on the layer created by the user. This embodiment of the application does not limit this.

[0143] In some embodiments, a user can draw on the operating interface 810 by tapping a stylus. For example... Figure 8 As shown in Figure (1), the user performs a tapping operation on the stylus. Optionally, the user can use one hand to hold the stylus and the other hand to tap it. Alternatively, the user can hold and tap the stylus simultaneously with the same hand. This embodiment does not impose any restrictions on the tapping method used by the user. In response to this operation, the stylus can recognize the tapping event and then send the tapping event to the electronic device. Accordingly, when the electronic device recognizes the tapping event, it displays ink marks within a preset area based on the tapping event, such as... Figure 8 The ink mark 900 shown in (2) is an example. Optionally, in this embodiment, the ink mark 900 can be a sheet-like ink mark (such as, but not limited to, circular, fan-shaped, rectangular, irregular polygonal, etc.). It is understood that this embodiment takes the recognition of a tapping event by a stylus as an example. In other embodiments, the recognition of tapping events can also be performed by an electronic device. This application embodiment does not limit this. In this way, the user can draw ink marks on the electronic device by tapping the stylus, making the interaction between the stylus and the electronic device more diverse. This interaction method can simulate the painting techniques in certain specific painting scenarios and improve the user experience.

[0144] It is understood that the ink marks described in the embodiments of this application can refer to the drawing trajectory or handwriting presented by the electronic device based on a series of operations performed by the stylus. This article uses ink marks to describe it.

[0145] It is understood that the tapping operation can be a single tap or multiple taps, and this application embodiment does not impose a specific limitation on the number of taps included in the tapping operation. Optionally, when the stylus receives a tapping operation performed by the user, the stylus may be in a state such as Figure 9 The vertical usage state shown in (1) may also be in the following state: Figure 9 The horizontal usage state shown in (2) may also be in the following state: Figure 9 As shown in the tilted usage state in (3), this embodiment of the application does not impose any restrictions on the usage state of the stylus at this time.

[0146] In some embodiments, when the stylus receives a tapping operation, the stylus may not be hovering above the display screen of the electronic device. In this embodiment, as one possible implementation, the preset area can be the entire display area of ​​the electronic device's screen. For example, in this implementation, the ink marks presented in the preset area can be as follows: Figure 10 The ink mark 1100 is shown. Of course, in other implementations, the preset area can also be a display area on the screen of an electronic device (such as the upper left area, the upper right display area, etc.), and this application embodiment does not limit this.

[0147] In other embodiments, when the stylus receives a tap, it may hover above the display screen of the electronic device. In this embodiment, as a possible implementation, if the electronic device cannot recognize (or acquire) the hovering coordinates of the stylus on the display screen—for example, if the stylus's electrodes are not above the display screen, or if the stylus hovers above the display screen at a distance exceeding a preset distance—the display screen may not receive the signal emitted by the stylus's electrodes, and thus cannot recognize the coordinates of the stylus hovering above the display screen. In this case, the preset area may be the entire display area of ​​the electronic device's screen, or it may be a specific display area on the screen.

[0148] In this embodiment, as another possible implementation, when the electronic device can recognize the hovering coordinates of the stylus on the display screen—for example, when the stylus's electrodes are above the display screen and the stylus is hovering within a preset distance above the display screen—the display screen can receive the signal emitted by the stylus's electrodes, thereby recognizing the stylus's hovering coordinates above the display screen. In this case, the preset area can be determined based on the stylus's hovering coordinates. In other words, the preset area is related to the stylus's hovering coordinates on the electronic device's display screen.

[0149] In this implementation, as a specific embodiment, the preset area can be a display area of ​​a preset size based on the hovering coordinates of the stylus on the electronic device's screen. Optionally, the hovering coordinates can be the center point, corner point, or edge point of the preset area, etc. The preset area can be a circular, rectangular, sector-shaped, or other shaped area, such as a circle with the hovering coordinates as its center. This application embodiment does not impose any limitations on the size or shape of the preset area. For example, as shown... Figure 11 As shown, taking the hover coordinate of the stylus as Z as an example, the preset area can be the display area corresponding to the circle 1200.

[0150] It is understood that in the embodiments of this application, the ink stain appearing in the preset area does not mean that the ink stain must fill the preset area. The ink stain may occupy part or all of the preset area to be displayed. Optionally, the position of the ink droplets contained in the ink stain displayed in the preset area may be random, and the position of the ink droplets displayed at different times may be the same or different.

[0151] In some embodiments, the style of the ink blots presented in the preset area (or the parameters of the ink blots, such as, but not limited to, one or more of ink color, ink droplet size, and ink droplet density) can be determined according to the style of the brush selected by the user. In other words, the style of the ink blots presented in the preset area is related to the style of the brush selected by the user. Optionally, brushes can be classified based on different granularities, such as: according to the shape of the brush tip, they can be classified as: round-tipped brushes, square-tipped brushes, etc. According to the usage scenario, they can be classified as scene brushes, material brushes, pattern brushes, etc. This application embodiment does not impose any restrictions on the classification of brushes. It is understood that different brushes may have different styles.

[0152] For example, such as Figure 12 As shown in Figure (1), the electronic device can display a brush selection interface 1300 for a drawing application. Optionally, the user can perform operations such as clicking on the controls 811 included on the running interface 810, and in response to such operations, the electronic device presents the brush selection interface 1300. Of course, the user can also open the brush selection interface 1300 in other ways, and this embodiment of the application does not impose any restrictions on this.

[0153] The brush selection interface 1300 can contain one or more brush categories, such as but not limited to outlining, watercolor, flat wash, sketching, and texture, which will not be described in detail here. Each brush category can contain one or more different styles of brushes. Taking watercolor as an example, it can include wet brush 1301, wet edge rendering brush 1302, clear brush 1303, etc., which will also not be described in detail here. Users can select the brushes according to their actual needs for painting.

[0154] For example, if the user selects a wet brush, then, as described above, after the stylus receives a tap from the user, in response to that tap, the electronic device, combined with the user-selected brush, can display ink marks within a preset area as follows: Figure 12 The ink mark 1310 shown in (2) has the same style as the wet brush.

[0155] In some embodiments, the brush style is also related to one or more brush parameters. For example, these parameters may include, but are not limited to, one or more of color, size (or dimensions), and transparency. In some implementations, the brush parameters may be set to default or fixed settings. In other implementations, the user can also choose to change the brush parameter settings to change the brush style, thereby changing the style of the ink blots displayed within a preset area. For example, taking a wet brush as an example, the user can change the wet brush parameter settings, such as... Figure 12 As shown in (1), the user can perform operations such as clicking on the wet brush 1301, and in response to the operation, such as Figure 12 As shown in (3), the electronic device can present a parameter setting interface 1320, which includes one or more parameter setting options for a wet brush, such as color option 1321, size option 1322, opacity option 1323, etc. The user can set the corresponding parameter through each parameter setting option. It is understood that different parameters of the brush can be set through the same interface or through different interfaces, and this application embodiment does not limit this.

[0156] In this way, users can adjust the brush parameters to customize their ink effects, better meeting their specific needs and requirements in different drawing scenarios. For example, if a user sets the wet brush color to black and randomly varies its size and transparency, the ink effect will be as follows: If the stylus detects a tap, it recognizes the tap and sends it to the electronic device. Upon recognizing the tap, the electronic device launches the drawing application, which then displays the ink effect based on the user-selected brush and its parameter settings. Figure 12 The ink mark 1330 shown in (4) is an example. Optionally, in this example, since the user sets the brush size and transparency to vary randomly, for... Figure 12 The ink stain 1330 shown in (4) contains ink droplets whose size and transparency vary randomly. That is to say, for... Figure 12 The ink stain 1330 shown in (4) may contain ink droplets of the same or different size and / or transparency. For example, the size and transparency of ink droplet 1331 are different from those of ink droplet 1332.

[0157] It is understood that the ink stains described in the embodiments of this application may be composed of one or more ink droplets (or ink dots).

[0158] Of course, in other examples, if the user sets the brush size, opacity, etc., to a fixed value, then for displays such as... Figure 12 The ink stain shown in (4) contains a fixed size and transparency of each ink droplet. That is to say, the size and transparency of different ink droplets are the same.

[0159] In other embodiments, the style of the ink blot presented in the preset area can be determined by one or more parameters of the ink blot. In other words, the style of the ink blot presented in the preset area can be related to one or more parameters of the ink blot. For example, the parameters of the ink blot can include, but are not limited to, one or more of the following: ink droplet size, ink droplet density, ink droplet intensity (or opacity, or color depth, or transparency, etc.), and range. In this embodiment, as a possible implementation, the parameters of the ink blot presented in the preset area can also be defaulted or fixed. As another possible implementation, similar to the method of setting brush parameters described above, the user can also set and / or change one or more parameters of the ink blot through the running interface of the painting application. Of course, the user can also set and / or change one or more parameters of the ink droplet in other ways, and this application embodiment does not limit this.

[0160] As another possible implementation, one or more parameters of the ink can also be determined based on the tapping force of the tapping operation. That is, one or more parameters of the ink are related to the tapping force. This allows users to apply different tapping forces to the stylus, making the interaction between the user and the stylus more diverse and enriching the ink's presentation. As a specific embodiment, when a user taps the stylus, the stylus can detect the tapping force. For example, the stylus can detect the tapping force using an installed sensor; for instance, an accelerometer can detect the tapping force by sensing the stylus's acceleration. This application does not specifically limit the method by which the stylus detects the tapping force. Next, the stylus can send the detected tapping force to an electronic device, which can then determine the ink parameters based on the tapping force.

[0161] It is understood that in the embodiments of this application, the striking force can be directly represented by the sensor's sensing data (such as the sensor's acceleration), or it can be represented by other data calculated from the sensor's sensing data. The embodiments of this application do not limit this.

[0162] In one specific embodiment, one or more parameters of the ink droplet are positively correlated with the tapping force. For example, a greater tapping force results in a larger ink droplet size, and / or a greater ink droplet density, and / or a denser ink droplet (i.e., greater opacity, lower transparency, and darker color), and / or a larger area (i.e., a larger display area occupied by the ink droplet on the screen). For example, such as... Figure 13 As shown, when the striking force of the stylus is A, the ink marks appearing in the preset area can be as follows: Figure 13 As shown in Figure (1), when the striking force of the stylus is B, B must be less than A, and the ink mark in the preset area can be as follows: Figure 13 The ink stain 1410 is shown in (2). It can be seen that compared with ink stain 1410, ink stain 1400 has a larger ink droplet size, a higher density, and a larger ink stain area. In this way, by setting the ink stain parameters to be positively correlated with the tapping force, it conforms to the user's conventional thinking and makes it easier for the user to operate.

[0163] Of course, in other embodiments, one or more parameters of the ink stain can also be negatively correlated with the tapping force. For example, the greater the tapping force, the smaller the ink droplet size, and / or the lower the ink droplet density, and / or the paler the ink droplet (i.e., lower opacity, higher transparency, lighter color), and / or the smaller the range (i.e., the less display area the ink stain occupies on the display screen), etc. Alternatively, one or more parameters of the ink stain can satisfy a preset mapping relationship with the tapping force. For example, the mapping relationship can be: when the tapping force is at a certain value or range, one or more parameters of the ink stain are set to a certain value or range, respectively. This application embodiment does not specifically limit the mapping relationship, nor does it specifically limit the specific relationship between one or more parameters of the ink stain and the tapping force.

[0164] In some embodiments, the style (or parameters) of the ink stains presented in the preset area can also be determined based on the orientation of the stylus tip, the hovering coordinates of the stylus, etc. In other words, the style of the ink stains presented in the preset area can be related to one or more of the stylus orientation, the stylus hovering coordinates, etc. In actual ink splatter techniques, the splattered ink stains are related to the direction and position of the splattering, etc. The orientation of the stylus tip can simulate the direction of the splattering, and the hovering coordinates of the stylus can simulate the position of the splattering. In this way, the ink stain effect can be made more consistent with the ink stain effect in actual ink splattering scenarios. For example, when the user performs a tapping operation on the stylus, the electrodes of the stylus tip can transmit a signal to the display screen of the electronic device. Accordingly, after the electronic device receives the signal on the display screen, it can determine the orientation of the stylus tip (e.g., east, south, west, north, left, right, southeast, northeast, southwest, northwest, etc.) and also determine the hovering coordinates of the stylus. The ink pattern is then determined based on one or more of the following: the orientation of the stylus tip, the hover coordinates of the stylus, etc. Optionally, in this embodiment, since the signal is transmitted from the electrode of the stylus tip to the display screen of the electronic device, the hover coordinates of the stylus are also the hover coordinates of the stylus tip.

[0165] It is understood that the methods for determining ink parameters (or patterns) described in the embodiments of this application can be used individually or in combination. For example, when used individually, the ink parameters can be determined based on any one of the methods, and the types of ink parameters determined by different methods can be the same or different. When used in combination, a portion of the ink parameters can be determined based on one method, and then another portion of the ink parameters can be determined based on another method. The embodiments of this application do not limit this.

[0166] As a specific embodiment, in the same direction as the pen tip, more ink is presented, such as a larger ink area, and / or a higher ink droplet density, and / or a denser ink droplet. And / or, the closer to the pen's hover coordinates, the greater the ink droplet density, and / or the larger the ink droplet size, and / or the denser the ink droplet; conversely, the farther away from the pen's hover coordinates, the smaller the ink droplet density, and / or the smaller the ink droplet size, and / or the lighter the ink droplet. And / or the ink also spreads in one or more other directions along with the pen tip's direction. This allows the presented ink to conform to the patterns of ink presentation in real ink splashing techniques, resulting in a better simulation effect. Optionally, since the ink is presented in a preset area, in this embodiment, the position of the preset area can also be related to the pen tip's direction, or the position of the preset area can also be determined based on the pen tip's direction. In this embodiment, the ink presented in the preset area can be as follows: Figure 14 The ink mark shown is 1500. (As shown...) Figure 14As shown, when the pen tip is pointed to the left, the density of ink droplets on the left side is greater, and the area of ​​the ink mark is larger. Near the pen's hover coordinate B (shown as dot B in the figure), the larger the ink droplet size, the greater the ink droplet density.

[0167] In some embodiments, the tapping operation can be a tapping action applied to any position of the stylus; that is, regardless of where the user taps the stylus, the tapping action is considered the same. In other embodiments, tapping actions applied to different positions of the stylus, such as tapping the stylus body, tapping the stylus tip, and tapping the stylus tail, can be considered different tapping operations. In this embodiment, the style of the ink stain and the preset area (or the position where the ink stain is displayed) can also be determined based on different tapping actions. For example, the determined preset area and ink stain style can be different for different tapping operations.

[0168] The above describes the process of drawing ink marks by tapping the stylus. In some other embodiments, the user can also draw ink marks by flicking the stylus; this process is described below.

[0169] In some embodiments, such as Figure 15 As shown in Figure (1), the user can perform a flicking operation on the stylus. In response to the flicking operation, the stylus changes from state M to state N. Simultaneously, the stylus can recognize the flicking event (e.g., the stylus can recognize the flicking event through various sensors) and then send the flicking event to the electronic device. Correspondingly, when the electronic device recognizes the flicking event, it displays ink based on the flicking event, such as... Figure 15 The ink mark 1600 shown in (2) is an example. Optionally, the ink mark presented in this embodiment can be a strip-shaped ink mark. In this way, the user can draw ink marks on the electronic device by flicking the stylus, making the interaction between the stylus and the electronic device more diverse. Moreover, this interaction method is similar to the ink splashing technique, which can simulate painting techniques in certain specific scenarios and improve the user experience.

[0170] Of course, in other embodiments, the electronic device can also recognize the shaking event. For example, when a user shakes the stylus, the electrodes of the stylus will emit signals to the display screen of the electronic device in real time or periodically during the shaking process. Accordingly, after receiving the signal through the display screen, the electronic device can identify multiple hover coordinates of the stylus, and then combine these hover coordinates to identify the shaking event. Of course, the electronic device can also recognize the shaking event in other ways, and this application embodiment does not impose specific limitations on this.

[0171] In some embodiments, when the stylus receives a flicking operation, the stylus may not be flicked above the display screen of the electronic device. Optionally, in this embodiment, the ink mark may be displayed on any display area or the default display area of ​​the electronic device's display screen.

[0172] In other embodiments, when the stylus receives a flicking operation, the stylus may be flicked above the display screen of the electronic device. Optionally, in this embodiment, as a possible implementation, if the electronic device cannot obtain the hovering coordinates of the stylus during the flicking process above the display screen (i.e., one or more hovering coordinates included in the flicking event), such as if the distance between the stylus and the display screen exceeds a certain distance when the stylus is flicked above the display screen of the electronic device, the electronic device may not be able to obtain the hovering coordinates during the flicking process. Optionally, in this implementation, the ink mark can also be displayed on any display area or the default display area on the display screen of the electronic device.

[0173] As another possible implementation, the electronic device can obtain the hovering coordinates of the stylus during its swing above the display screen. If the distance between the stylus and the display screen does not exceed a certain distance during the swing, the electronic device can obtain the hovering coordinates of the stylus during the swing. Optionally, in this implementation, the display area presented by the ink can be determined based on one or more hovering coordinates included in the stylus swing (i.e., one or more hovering coordinates included in the swing event). In other words, the display area presented by the ink is related to one or more hovering coordinates included in the stylus swing.

[0174] In this implementation, as a specific example, the ink trace can be related to or correspond to the trajectory of the stylus being flicked above the display screen, such as being the same. Optionally, the trajectory of the stylus being flicked above the display screen can be determined based on the trajectory formed by one or more hovering coordinates included in the flicking process of the stylus, such as the trajectory of the stylus being flicked above the display screen can be the trajectory formed by one or more hovering coordinates included in the flicking process of the stylus. For example, as shown... Figure 16 As shown, taking trajectory 1700 as an example, which is formed by one or more hovering coordinates during the flicking of the stylus, the ink mark presented by the electronic device can be as ink mark 1710.

[0175] In some embodiments, similar to the tapping operation scheme described above, the ink style can also be determined based on the brush style selected by the user. For details on this implementation, please refer to the relevant implementations described above.

[0176] In some embodiments, the style of the ink blot can also be determined by one or more parameters of the ink blot. In other words, the style of the ink blot can also be related to one or more parameters of the ink blot. For example, the style of the ink blot can include, but is not limited to, one or more of the following: ink droplet size, ink droplet density, ink droplet intensity, ink blot length, ink blot direction, etc. In this embodiment, as one possible implementation, the parameters of the ink blot can also be defaulted or fixed. As another possible implementation, similar to the method of setting brush parameters described above, the user can also change the settings of one or more parameters of the ink blot through the running interface of the painting application.

[0177] In some embodiments, one or more parameters of the ink smudge can be determined based on one or more of the direction, amplitude, speed, and acceleration of the stylus flick, wherein the flick speed or acceleration can also be described as the force of the flick. In other words, the ink smudge pattern is related to one or more of the direction, amplitude, speed, and acceleration of the stylus flick. This allows users to perform different flick directions, and / or flick forces, and / or flick amplitudes with the stylus, enriching the user's interaction with the stylus. Furthermore, it can make the presented ink smudge effects richer and more consistent with the effects of real ink splatter techniques, i.e., a more realistic simulation. Optionally, the amplitude of the stylus flick can be determined based on the distance of the stylus flick, which can be determined based on the hovering coordinates included during the flick, such as the difference between the starting and ending hovering coordinates. The speed of the stylus flick can be determined based on the distance and duration of the flick. The acceleration of the stylus flick can be detected by a sensor of the stylus (such as an accelerometer). It is understood that the amplitude and speed of the stylus swing can be determined by the stylus or by the electronic device, and this application embodiment does not impose any restrictions on this.

[0178] As a specific embodiment, one or more parameters of the ink (such as ink direction, droplet size, droplet density, ink length) can be positively correlated with one or more of the amplitude, speed, and acceleration of the stylus flick, and the direction of the ink is consistent with the direction of the stylus flick. For example, the greater one or more of the amplitude, speed, and acceleration of the stylus flick, the larger the ink droplet size, and / or the greater the ink droplet density, and / or the thicker the ink droplet, and / or the longer the ink trail, etc. For example, such as... Figure 17 As shown in (1), when the stylus receives a flicking operation, and changes from state P1 to state P2 based on this flicking operation, the ink mark presented is as shown in ink mark 1800. Figure 17 As shown in (2), when the stylus receives a flicking operation and changes from state P3 to state P4, the ink stain presented is as shown in ink stain 1810. Among them, Figure 17In (1), the amplitude of the flicking operation received by the stylus is less than Figure 17 In the middle (2), the amplitude of the flicking operation received by the stylus is shown. It can be seen that compared with the ink 1800, the ink droplet size of the ink 1810 is larger, the ink droplet density is greater, and the ink is longer.

[0179] Of course, in other embodiments, one or more parameters of the ink mark may be negatively correlated with one or more of the amplitude, speed, acceleration, etc., of the stylus flick, or there may be a mapping relationship. For example, the length of the ink mark may also have a fixed proportional relationship with the amplitude of the stylus flick. For details on this implementation, please refer to the relevant implementations described above.

[0180] In some other embodiments, one or more parameters of the ink can also be determined based on the hovering coordinates during the pen flicking process. In other words, one or more parameters of the ink can also be related to the hovering coordinates during the pen flicking process.

[0181] In one specific embodiment, the hovering coordinates during the stylus flicking process include a starting hovering coordinate and an ending hovering coordinate. The starting hovering coordinate can refer to the hovering coordinate corresponding to the start of the stylus flick, and the ending hovering coordinate can refer to the hovering coordinate corresponding to the end of the stylus flick. The closer to the starting hovering coordinate, the greater the ink droplet density, and / or the larger the ink droplet size, and / or the denser the ink droplet, etc.; the closer to the ending hovering coordinate, the smaller the ink droplet density, and / or the smaller the ink droplet size, and / or the lighter the ink droplet, etc. For example, as... Figure 18 As shown, taking point B as the starting hover coordinate during the pen flicking process and point C as the ending hover coordinate, the resulting ink stain can be as shown in ink stain 1900. It can be seen that the closer to point B, the greater the ink droplet density and the larger the ink droplet size. The closer to point C, the smaller the ink droplet density and the smaller the ink droplet size, and so on. Thus, the closer to the starting hover coordinate, the greater the ink droplet density and / or the larger the ink droplet size and / or the denser the ink, making the ink stain effect closer to the effect of flicking a drawing pen in a real ink splatter scene, resulting in a better simulation effect.

[0182] Of course, in other embodiments, the closer to the end hover coordinates, the greater the ink droplet density, and / or the larger the ink droplet size, and / or the denser the ink droplets, etc.; and the closer to the start hover coordinates, the smaller the ink droplet density, and / or the smaller the ink droplet size, and / or the fainter the ink droplets, etc.

[0183] The above describes the process of drawing ink marks by performing tapping or flicking operations on the stylus. In some embodiments, the user can also perform a squeezing operation (also known as a pinching operation) on the stylus to draw ink marks, and this process is described below.

[0184] In some embodiments, such as Figure 19A As shown in Figure (1), the user performs a squeezing operation on the stylus. Optionally, the squeezing operation can be a single squeeze or multiple squeezes. This embodiment does not specifically limit the number of squeezes included in the squeezing operation. For example, the user can squeeze the stylus with multiple fingers to perform a squeezing operation on the stylus. In response to this operation, the stylus can recognize the squeezing event and then send the squeezing event to the electronic device. Similarly, the stylus can also recognize the squeezing event through various sensors (such as film sensors). Accordingly, when the electronic device recognizes the squeezing event, it displays ink marks in a preset area based on the squeezing event, such as... Figure 19A The ink mark 19a shown in (2) is an example. Optionally, the ink mark presented in this embodiment can be either a sheet-like ink mark or a strip-like ink mark. For the introduction of the preset area and the implementation of the preset area when the electronic device cannot recognize the hovering coordinates of the stylus on the display screen, please refer to the relevant implementation under the tapping operation above.

[0185] In this way, users can draw ink marks on electronic devices by squeezing the stylus, enriching the interaction between the stylus and the device. Furthermore, this squeezing action can simulate the interaction of an airbrush, enhancing the user experience.

[0186] In some embodiments, when the electronic device can obtain the hover coordinates of the stylus on the display screen, the display area presented by the ink, i.e., the preset area, can also be determined based on the hover coordinates of the stylus. In other words, the display area presented by the ink is related to the hover coordinates of the stylus above the display screen of the electronic device. Similarly, in this embodiment, the preset area can also be a display area of ​​a preset size based on the hover coordinates. For other implementations of this embodiment, please refer to the corresponding implementation under the tapping operation described above.

[0187] In some embodiments, similar to the tapping operation scheme described above, the ink style can also be determined based on the brush style selected by the user. For details on this implementation, please refer to the relevant implementations described above.

[0188] In some embodiments, the style of the ink blot can also be determined based on one or more parameters of the ink blot. For example, the parameters of the ink blot may include, but are not limited to, one or more of ink droplet size, ink droplet density, ink droplet intensity, and range. Similarly, in this embodiment, in some implementations, the parameters of the ink blot can be defaulted, or similar to the method of setting brush parameters described above, the user can also change the settings of one or more parameters of the ink blot through the interface of the drawing application.

[0189] In other implementations, one or more parameters of the ink can be determined based on the pressure applied during the squeezing operation. This allows users to apply different pressures to the stylus, diversifying the interaction between the user and the stylus and enriching the ink's presentation. Similarly, the stylus can detect the pressure applied via sensors (such as film sensors, pressure sensors, etc.) and then send the detected pressure to the electronic device. This application does not limit the method used to detect the pressure applied.

[0190] As a specific embodiment, one or more parameters of the ink droplet can be positively correlated with the pressure applied; for example, the greater the pressure, the larger the ink droplet size, and / or the greater the ink droplet density, and / or the denser the ink droplet, and / or the larger its range. For instance, when the pressure applied to the stylus is 'a', the ink droplet displayed on the screen can be as follows: Figure 19A As shown in Figure (2), the ink mark 19a is as follows. When the pressure applied to the stylus is b, which is greater than a, the ink mark displayed on the screen can be as shown. Figure 19B As shown in ink stain 19b, compared to ink stain 19a, ink stain 19b has a larger ink droplet size, a higher density, and a larger area.

[0191] Similarly, in other embodiments, one or more parameters of the ink may be negatively correlated with the pressure applied. For example, the greater the pressure applied, the smaller the ink droplet size, and / or the lower the ink droplet density, and / or the lighter the ink droplets, and / or the smaller their range. Alternatively, one or more parameters of the ink may have a pre-defined mapping relationship with the tapping force, similar to the tapping operation scenario described above.

[0192] In some implementations, similar to the tapping operation described above, the ink parameters can also be determined based on the stylus tip orientation, stylus hover coordinates, etc. For specific implementations, please refer to the related implementations described above. It is understandable that the relationship between the stylus tip orientation, stylus hover coordinates, and ink parameters under a squeeze operation can be the same as or different from the relationship between the stylus tip orientation, stylus hover coordinates, etc., and ink parameters under a tapping operation.

[0193] In some embodiments, when a user performs a squeeze operation on the stylus, the stylus's hovering position on the electronic device's display screen may not change. For example, the user may hold the stylus at a fixed position on the electronic device's display screen and perform one or more squeeze operations. In this embodiment, when the stylus receives a squeeze operation, the electronic device may obtain a fixed coordinate for the stylus's hovering position. For each squeeze operation, the electronic device can present the corresponding ink mark based on the scheme described above. It is understood that the force of each squeeze operation may be the same or different. Optionally, the position of the ink droplets contained in the ink mark presented for each squeeze operation can be random, that is, the position of the ink droplets contained in the ink mark presented for different squeeze operations may be different. For example, Figure 19C Figures (1) to (3) show schematic diagrams of the ink effects corresponding to one, two, and three squeezing operations, respectively. Optionally, in this embodiment, the ink can be sheet-like ink.

[0194] Similarly, when a user holds the stylus at a fixed position on the screen of an electronic device and performs one or more taps, the position of the ink droplets in the ink stain produced by each tap can also be random, meaning that the position of the ink droplets in the ink stain produced by different taps can be different.

[0195] In other embodiments, the hovering position of the stylus on the electronic device's display screen may change when the user performs a squeeze operation on the stylus. For example, the user may move the squeezed stylus on the electronic device's display screen while squeezing it. In this embodiment, when the stylus receives a squeeze operation, the electronic device may obtain multiple hovering coordinates of the stylus. In this embodiment, the parameters of the ink trace can be presented based on the multiple hovering coordinates corresponding to the squeeze operation. Optionally, in this embodiment, the ink trace can follow the trajectory formed by these multiple hovering coordinates. For example, as shown... Figure 19D As shown in Figure (1), when the user squeezes the stylus and moves it from the hovering position corresponding to hovering coordinate 1 to the hovering position corresponding to hovering coordinate 2, the ink mark displayed by the electronic device can be as follows: Figure 19D The ink mark 19d shown in (2) is an example. Optionally, in this embodiment, the ink mark can be a strip of ink. This can present an interactive effect similar to ink dripping, making the interactive effect richer.

[0196] In some embodiments, the above-described squeezing operation can be applied to any position of the stylus, such as the tip, body, tail, or different positions of the body. This application embodiment does not specifically limit the position of the stylus to which the squeezing operation is applied. Regardless of where the user squeezes the stylus, the squeezing operation is considered the same. In other embodiments, squeezing operations applied to different positions of the stylus can be considered different squeezing operations. Similarly, in this embodiment, the style of the ink mark, preset area, etc., can also be determined based on the squeezing operation.

[0197] It is understood that the above examples use tapping, flicking, and squeezing operations as examples. In other embodiments, touch operations can be substituted. Optionally, when the above tapping, flicking, and squeezing operations are received by the stylus while it is suspended a certain distance above the electronic device's display screen, the stylus and the electronic device's display screen do not need to be in contact. In other words, the interaction is achieved through a certain distance between the stylus and the electronic device's display screen, which can improve the interaction effect.

[0198] In some embodiments, before responding to the aforementioned tapping, flicking, and / or squeezing events, the drawing application in the electronic device needs to enable the function of responding to the tapping, flicking, and / or squeezing events of the stylus. After enabling this function, the application will only respond to the corresponding event and execute the drawing of the corresponding ink mark when the tapping, flicking, and / or squeezing events of the stylus are detected.

[0199] In some implementations, this feature may be enabled by default. In others, it may be enabled by the user. For example, the electronic device may include a feature activation control, which the user can use to enable the aforementioned feature. For instance, Figure 19E A schematic diagram of an interface provided in an embodiment of this application is shown. For example... Figure 19E As shown, the electronic device can display a drawing application's operating interface 810. This interface 810 includes a function activation control 2000. Users can perform operations such as activation on this control 2000. In response to these operations, the electronic device can enable the drawing application's functions in response to stylus tapping, flicking, and / or squeezing events. Of course, in other embodiments, this function activation control can also be located on other operating interfaces of the drawing application or other display interfaces of the electronic device, such as the operating interface of a settings application. This application embodiment does not impose specific limitations on this.

[0200] In some embodiments, users can also hold a stylus to draw in the air on electronic devices. In this embodiment, the user can move the stylus across the screen of the electronic device, and during this movement, the electrodes in the stylus continuously transmit signals to the screen. Correspondingly, after receiving these signals, the screen can identify the hovering coordinates of the stylus on the screen, and then draw ink marks based on these sequentially appearing hovering coordinates, thereby generating a picture, such as... Figure 19F The flower shown is 19f.

[0201] In some embodiments, similar to the above scheme, the ink style can also be determined based on the style of the brush selected by the user. For example, Figure 19G Figures (1) and (2) show schematic diagrams of drawings under different brush styles. This application does not limit the way users set brush styles. For example, users can set the brush style through the application interface shown above, or users can set the brush style by adjusting the distance between the stylus and the display screen.

[0202] In some embodiments, the ink pattern can also be determined based on one or more parameters of the ink. For example, the parameters of the ink may include, but are not limited to, one or more of ink droplet size, ink droplet density, and ink droplet intensity. Similarly, in this embodiment, the parameters of the ink can be default, or the user can change these parameters through an application interface, etc. Alternatively, the parameters of the ink can also be determined based on one or more of the following: the distance between the stylus and the display screen, the speed at which the stylus moves across the display screen.

[0203] In some implementations, one or more parameters of the ink droplet can be negatively correlated with the overhang distance. For example, a closer overhang distance results in a larger ink droplet size, and / or a higher ink droplet density, and / or a denser ink droplet. Conversely, in other implementations, one or more parameters of the ink droplet can be positively correlated with the overhang distance. For example, a greater overhang distance results in a larger ink droplet size, and / or a higher ink droplet density, and / or a denser ink droplet.

[0204] In some implementations, one or more parameters of the ink droplet can be negatively correlated with the speed at which the stylus moves across the display screen. For example, a slower movement speed results in larger ink droplet size and / or higher ink droplet density and / or denser ink. Alternatively, in other implementations, one or more parameters of the ink droplet can be positively correlated with the hovering distance. For example, a faster movement speed results in larger ink droplet size and / or higher ink droplet density and / or denser ink.

[0205] Similarly, in this embodiment, the user can also use methods such as Figure 19EOnce the electronic device is enabled to respond to air drawing, it will only respond to the user's action and perform air drawing when the user moves the stylus above the screen.

[0206] For example, Figure 20A The following is a flowchart illustrating an interaction method provided in an embodiment of this application, such as... Figure 20A As shown, the method includes the following steps:

[0207] S2101, The stylus receives the target operation.

[0208] The target operation includes one of the following: tapping, swinging, or squeezing.

[0209] S2102. In response to the target operation, the stylus sends target information to the electronic device. Accordingly, the electronic device receives the target information from the stylus.

[0210] The target information is generated based on the target operation. In some embodiments, taking a tapping operation as an example, the target information may include information representing at least one of the tapping event and tapping force corresponding to the tapping operation. In other embodiments, taking a swinging operation as an example, the target information may include information representing at least one of the swinging event, swinging force, swinging amplitude, and swinging direction corresponding to the swinging operation. In still other embodiments, taking a squeezing operation as an example, the target information includes information representing at least one of the squeezing event and squeezing force corresponding to the squeezing operation.

[0211] S2103. In response to the target information, the electronic device displays ink marks based on the position of the stylus on the display screen.

[0212] In some embodiments, when the electronic device obtains the hover coordinates of the stylus based on its position on the display screen, it can display the ink mark in a target display area in response to the target information. This target display area may be related to the hover coordinates of the stylus. For an explanation of the hover coordinates of the stylus, please refer to the above description.

[0213] In other embodiments, if the electronic device does not obtain hover coordinates based on the position of the stylus on the display screen, in response to target information, the electronic device may randomly display ink marks on the display screen.

[0214] In some implementations, the style of the ink blot can be determined by parameters of the ink blot. In some embodiments, a first parameter of the ink blot (such as one or more of ink color, droplet size, and droplet density) can be related to the style of the brush used by the stylus. In other embodiments, a second parameter of the ink blot (such as one or more of ink blot area, ink blot length, ink blot direction, droplet size, droplet density, and droplet density) can be related to a target operation received by the stylus. It is understood that the foregoing embodiments are examples where the first and second parameters are different; in other implementations, the first and second parameters can also be the same.

[0215] For example, Figure 20B This document illustrates a flowchart of another interaction method provided in an embodiment of this application, as shown below. Figure 20B As shown, the method includes the following steps:

[0216] S2201, The stylus moves above the display screen of the electronic device.

[0217] The stylus establishes a connection with the electronic device; the implementation of this connection can be found above. The distance between the stylus and the electronic device's display screen is greater than a preset distance. This means the stylus moves hovering above the display screen without contact. This preset distance may differ from the one described above. The specific value of the preset distance can be set by the developers according to actual needs. Optionally, the stylus can move hovering above the electronic device's display screen based on user input.

[0218] S2202, In response to the movement of the stylus, the electronic device displays ink marks on the display screen.

[0219] In some embodiments, in response to the movement of the stylus, the electronic device can acquire at least one hover coordinate, which is the coordinate on the display screen corresponding to the stylus's movement above the display screen; the electronic device can display ink on the display screen based on at least one hover coordinate. That is, the ink displayed by the electronic device is related to the hover coordinate of the stylus. Optionally, the trajectory of the stylus's hovering movement determines the stylus's hover coordinate, so the ink displayed by the electronic device can also be related to the trajectory of the stylus's hovering movement.

[0220] Optionally, the electronic device can obtain at least one hover coordinate based on the signal emitted by the stylus electrodes. Optionally, since the display screen of the electronic device may only receive the signal emitted by the stylus electrodes when the distance between the stylus and the display screen is within a certain range, the distance between the stylus and the display screen when the stylus moves above the electronic device's display screen can be greater than a preset distance but less than a preset distance 'a'. The preset distance 'a' must be greater than the preset distance.

[0221] In some implementations, the style of the ink blot can also be determined by parameters of the ink blot. In some embodiments, a first parameter of the ink blot (such as one or more of ink color, droplet size, and droplet density) can be related to the style of the brush used by the stylus. In other embodiments, a third parameter of the ink blot (such as one or more of droplet size, droplet density, and droplet density) can be related to the distance between the stylus and the display screen of the electronic device. It is understood that the foregoing embodiments are examples where the first and third parameters are different; in other implementations, the first and third parameters can also be the same.

[0222] The above primarily describes the solutions provided by the embodiments of this application from a methodological perspective. It is understood that electronic devices and / or styluses, in order to achieve the aforementioned functions, include corresponding hardware structures and / or software modules for executing each function. By combining the units and algorithm steps of the various examples described in the embodiments disclosed in this application, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by a computer driving the hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solutions of the embodiments of this application.

[0223] This application provides embodiments that can divide electronic devices and / or styluses into functional modules based on the above method examples. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing unit. The integrated unit can be implemented in hardware or as a software functional module. It should be noted that the unit division in this application embodiment is illustrative and only represents one logical functional division; in actual implementation, there may be other division methods.

[0224] like Figure 21The diagram shown is a structural schematic of an electronic device 2200 provided in an embodiment of this application. This electronic device 2200 can be used to implement the methods executed by the electronic devices described in the above method embodiments. For example, the electronic device 2200 may specifically include: a processing unit 2201, a display unit 2202, and a communication unit 2203. The processing unit 2201 is used to support the electronic device 2200 in executing... Figures 1-20B The processing functions of the electronic device described in any of the above. Display unit 2202, for supporting the electronic device 2200 in performing... Figures 1-20B The display function of the electronic device described in any of the above. Communication unit 2203 is used to support the electronic device 2200 in performing... Figures 1-20B The communication function of the electronic device described in any of the above.

[0225] Optional, Figure 21 The illustrated electronic device 2200 may also include a storage unit ( Figure 21 (not shown in the image), this storage unit stores a program or instruction. When the processing unit 2201 executes the program or instruction, it causes... Figure 21 The electronic device 2200 shown can perform the methods shown in the above method embodiments.

[0226] like Figure 22 The diagram shown is a structural schematic of a stylus 2300 provided in an embodiment of this application. The stylus 2300 can be used to implement the methods executed by the stylus described in the above method embodiments. For example, the stylus 2300 may specifically include: a processing unit 2301 and a communication unit 2302. The processing unit 2301 is used to support the stylus 2300 in executing... Figures 1-20B The processing functions of the stylus described in any of the above. Communication unit 2302 is used to support the stylus 2300 in performing... Figures 1-20B The communication function of the stylus as described in any of the above.

[0227] Optional, Figure 22 The stylus 2300 shown may also include a storage unit ( Figure 22 (not shown in the image), this storage unit stores a program or instruction. When the processing unit 2301 executes the program or instruction, it causes... Figure 22 The stylus 2300 shown can perform the methods described in the above method embodiments.

[0228] Figure 21 , Figure 22 The technical effects of the device shown can be referred to the technical effects described in the above method embodiments, and will not be repeated here. Figure 21 and / or Figure 22The processing unit involved can be implemented by a processor or processor-related circuit components, and can be a processor or processing module. The communication unit can be implemented by a transceiver or transceiver-related circuit components, and can be a transceiver or transceiver module. The display unit can be implemented by display screen-related components.

[0229] This application also provides a chip system, such as... Figure 23 As shown, the chip system includes at least one processor 2401 and at least one interface circuit 2402. The processor 2401 and the interface circuit 2402 are interconnected via lines. For example, the interface circuit 2402 can be used to receive signals from other devices. As another example, the interface circuit 2402 can be used to send signals to other devices (e.g., the processor 2401). Exemplarily, the interface circuit 2402 can read instructions stored in memory and send those instructions to the processor 2401. When the instructions are executed by the processor 2401, the device can perform the various steps performed by the electronic device or stylus in the above embodiments. Of course, the chip system may also include other discrete components, which are not specifically limited in this application embodiment.

[0230] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0231] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application does not specifically limit the type of memory or the arrangement of the memory and processor.

[0232] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0233] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor.

[0234] This application also provides a computer storage medium storing computer instructions, which, when executed on a device, cause the device to perform the methods described in the above-described method embodiments.

[0235] This application provides a computer program product, which includes a computer program or instructions that, when run on a computer, cause the computer to perform the methods described in the above-described method embodiments.

[0236] In addition, this application also provides an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory. The memory is used to store computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to cause the apparatus to perform the methods in the above-described method embodiments.

[0237] In this embodiment, the device, computer storage medium, computer program product or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0238] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An interaction method, characterized in that, Applied to a system comprising an electronic device and a stylus, wherein the electronic device and the stylus are connected, the stylus includes a sensor, and the electronic device is configured with a display screen, the method comprising: The electronic device displays a first interface, which includes a first brush style. In response to user input, the electronic device sets the brush style of the stylus to the first brush style; The stylus receives tapping operations from the user via the sensor. The tapping operations include single tapping or multiple tapping operations. When the tapping operation is received, the stylus hovers within a preset distance range above the display screen. In response to receiving the tapping operation, the stylus sends first information to the electronic device, the first information including information for characterizing at least one of the tapping event and tapping force corresponding to the tapping operation; The electronic device obtains the first hover coordinates of the stylus on the display screen based on the signal emitted by the electrodes of the stylus; In response to the first information, the electronic device displays an ink mark corresponding to the first brush style in the display area corresponding to the first hover coordinate. The ink mark is composed of multiple ink droplets, and the display area is a preset size display area based on the first hover coordinate. During the execution of the method, the stylus does not come into contact with the display screen of the electronic device.

2. The method according to claim 1, characterized in that, The tapping operation refers to the operation on the body, tip, or tail of the stylus.

3. The method according to claim 1 or 2, characterized in that, The first interface is a brush selection interface, which includes multiple brush categories. Each brush category contains one or more different brush styles, and the first brush style is one of the one or more different brush styles.

4. The method according to claim 3, characterized in that, The brush categories include one or more of the following: outlining, watercolor, flat wash, sketching, and texture.

5. The method according to claim 3, characterized in that, The one or more different brush styles include one or more of the following: wet brush, wet edge rendering brush, and clear brush.

6. The method according to claim 1 or 2, characterized in that, The ink stains are in the form of sheets.

7. The method according to claim 1 or 2, characterized in that, The first parameter of the ink mark is related to the style of the brush of the stylus, and the first parameter includes one or more of the following: ink mark color, ink droplet size, and ink droplet density.

8. The method according to claim 1 or 2, characterized in that, The second parameter of the ink mark is related to the tapping operation. The second parameter includes one or more of the following: ink mark range, ink mark length, ink mark direction, ink droplet size, ink droplet density, and ink droplet concentration.

9. The method according to claim 8, characterized in that, The parameters of the tapping operation include the tapping force, and at least one of the following is positively correlated with the tapping force: the range of the ink stain, the size of the ink droplet, the density of the ink droplet, and the intensity of the ink droplet.

10. The method according to claim 8, characterized in that, The length of the ink mark, the size of the ink droplet, the density of the ink droplet, and the intensity of the ink droplet are all related to the first hover coordinates. The first hover coordinates refer to the coordinates on the display screen when the stylus hovers over the display screen to receive the tapping operation.

11. The method according to claim 10, characterized in that, The ink mark includes a first ink mark and a second ink mark. The distance between the first ink mark and the first hover coordinate is less than the distance between the second ink mark and the first hover coordinate. The droplet size of the first ink mark is greater than the droplet size of the second ink mark, and / or the droplet density of the first ink mark is greater than the droplet density of the second ink mark, and / or the ink droplet density of the first ink mark is greater than the ink droplet density of the second ink mark.

12. The method according to claim 1 or 2, characterized in that, Before the stylus receives a tapping operation from the user via the sensor, the method further includes: The electronic device displays the interface of a first application, which is a drawing application; The electronic device displays ink marks based on the first hovering coordinates, including: The electronic device displays ink marks on the running interface of the first application based on the first hover coordinates.

13. An interaction method, characterized in that, Applied to an electronic device including a display screen, the electronic device being connected to a stylus, the method includes: Display a first interface, which includes a first brush style; In response to user input, the brush style of the stylus is set to the first brush style. The system receives first information sent by the stylus. The first information is sent by the stylus after it receives a tapping operation from the user through a sensor. The tapping operation includes a single tapping operation or multiple tapping operations. The tapping operation is received when the stylus is hovering above the display screen within a preset distance range. The first information includes information for characterizing at least one of the tapping event and tapping force corresponding to the tapping operation. The first hovering coordinates of the stylus on the display screen are obtained based on the signals emitted by the electrodes of the stylus; In response to the first information, an ink mark corresponding to the first brush style is displayed in the display area corresponding to the first hover coordinate; the ink mark is composed of multiple ink droplets, and the display area is a preset size display area based on the first hover coordinate; During the execution of the method, the stylus does not come into contact with the display screen of the electronic device.

14. The method according to claim 13, characterized in that, The tapping operation refers to the operation on the body, tip, or tail of the stylus.

15. The method according to claim 13 or 14, characterized in that, The first interface is a brush selection interface, which includes multiple brush categories. Each brush category contains one or more different brush styles, and the first brush style is one of the one or more different brush styles.

16. The method according to claim 15, characterized in that, The brush categories include one or more of the following: outlining, watercolor, flat wash, sketching, and texture.

17. The method according to claim 15, characterized in that, The one or more different brush styles include one or more of the following: wet brush, wet edge rendering brush, and clear brush.

18. The method according to claim 13 or 14, characterized in that, Before receiving the first information sent by the stylus, the method further includes: Display the running interface of the first application, which is a drawing application; The ink traces displayed based on the first hovering coordinates include: The ink effect is displayed on the running interface of the first application based on the first hover coordinates.

19. An interaction method, characterized in that, The method, which involves a stylus pen connected to an electronic device equipped with a display screen, includes the following steps: The system receives a tapping operation from the user on the stylus, which may include a single tap or multiple taps. The tapping operation is received when the stylus is hovering over the display screen at a preset distance. In response to receiving the tapping operation, the electronic device sends first information, wherein the first information includes information characterizing at least one of the tapping event and tapping force corresponding to the tapping operation, so that the electronic device obtains a first hover coordinate based on the signal emitted by the electrodes of the stylus, and displays ink marks corresponding to a first brush style in the display area corresponding to the first hover coordinate. The first hover coordinate is the hover coordinate of the stylus on the display screen of the electronic device, and the display area is a display area of ​​a preset size based on the first hover coordinate. During the execution of the method, the stylus does not come into contact with the display screen of the electronic device.

20. The method according to claim 19, characterized in that, The tapping operation refers to the operation on the body, tip, or tail of the stylus.

21. An electronic device, characterized in that, The device includes a processor, a memory, a communication interface, and a display screen. The memory, the communication interface, and the display screen are coupled to the processor. The communication interface is used to communicate with other devices. The memory is used to store computer program code, which includes computer instructions. The processor reads the computer instructions from the memory, causing the electronic device to perform the method as described in any one of claims 13-18.

22. A stylus, characterized in that, The device includes a processor, a memory, and a communication interface, wherein the memory and the communication interface are coupled to the processor, the communication interface is used to communicate with other devices, the memory is used to store computer program code, the computer program code including computer instructions, and the processor reads the computer instructions from the memory to cause the stylus to perform the method as described in any one of claims 19-20.

23. An interactive system, characterized in that, The device includes an electronic device and a stylus, the electronic device being used to perform the method performed by the electronic device as claimed in any one of claims 1-12, and the stylus being used to perform the method performed by the stylus as claimed in any one of claims 1-12.

Images