Interaction method, stylus, and electronic device
Through the stylus receiving operation and generating information, the electronic device displays ink marks, solving the problem of single interaction mode of the stylus, achieving rich simulation effects of painting techniques and improving user experience.
Patent Information
- Application Number
- PCT/CN2024/116104
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-08-05
- Filing Date
- 2024-08-30
- Publication Date
- 2025-08-14
AI Technical Summary
The interaction between existing stylus and electronic devices is single, and it is impossible to simulate painting techniques in certain specific painting scenes, such as ink splashing techniques.
The stylus receives tapping, swing or squeezing operations to generate corresponding target information. The electronic device displays ink marks according to the position of the stylus, simulating different painting techniques.
It realizes that the interaction between the stylus and electronic devices is richer, and can simulate painting techniques in specific painting scenes and improve user experience.
Smart Images

Figure CN2024116104_14082025_PF_FP_ABST
Abstract
Description
Interaction method, stylus pen and electronic device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on February 5, 2024, with application number 202410171798.X and application name “Interactive method, stylus and electronic device”, and claims priority to the Chinese patent application filed with the State Intellectual Property Office on August 5, 2024, with application number 202411075024.3 and application name “Interactive method, stylus and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminal technology, and in particular to an interaction method, a stylus pen, and an electronic device. Background Art
[0003] Currently, after a stylus is connected to an electronic device, a user can use it to draw on the device. During the drawing process, the stylus can draw lines of varying textures by contacting the screen of the electronic device. However, this interaction method is relatively limited and cannot simulate the painting techniques used in certain specific drawing scenarios.
[0004] Summary of the Invention
[0005] The present application provides an interaction method, a stylus pen, and an electronic device, which can enrich the interaction between the stylus pen and the electronic device and simulate painting techniques in certain specific scenarios, such as ink splashing techniques.
[0006] To achieve the above objectives, this application adopts the following technical solutions:
[0007] In a first aspect, an interaction method is provided, which is applied to a system including an electronic device and a stylus, wherein the electronic device is equipped with a display screen, and a connection is established between the electronic device and the stylus, the method comprising: the stylus receiving a target operation, wherein the target operation comprises one of a tapping operation, a swinging operation, and a squeezing operation; in response to the target operation, the stylus sending target information to the electronic device, wherein the target information is generated based on the target operation; and in response to the target information, the electronic device displays ink according to the position of the stylus on the display screen.
[0008] Based on the above technical solution, when the stylus receives a tap, swing, or squeeze operation, the stylus can respond to the operation by sending target information generated based on the tap or swing operation to the electronic device. The electronic device can then display ink based on the position of the stylus on the electronic device's display screen in response to the target information. In this way, the user can draw ink on the electronic device by tapping, swinging, or squeezing the stylus. This enriches the interaction between the stylus and the electronic device. This interaction can simulate painting techniques in certain specific painting scenarios, improving the user experience.
[0009] In one possible design, the target operation is a tapping operation, and the target information includes information representing at least one of a tapping event and a tapping force corresponding to the tapping operation; or, the target operation is a squeezing operation, and the target information includes information representing at least one of a squeezing event and a squeezing force corresponding to the squeezing operation; or, the target operation is a swinging operation, and the target information includes information representing at least one of a swinging event, a swinging force, a swinging amplitude, and a swinging direction corresponding to the swinging operation. Based on this design, when a tapping operation is performed on the stylus, the stylus can send information representing at least one of the tapping event and the tapping force corresponding to the tapping operation to the electronic device; when a squeezing operation is performed on the stylus, the stylus can send information representing at least one of the squeezing event and the squeezing force corresponding to the squeezing operation to the electronic device; and when a swinging operation is performed on the stylus, the stylus can send information representing at least one of the swinging event, a swinging force, a swinging amplitude, and a swinging direction corresponding to the swinging operation to the electronic device, so that the electronic device can display ink based on the aforementioned information. This allows different ink effects to be displayed when different operations are performed on the stylus, and also allows the displayed ink to be more consistent with the ink effect in an actual ink splashing scene.
[0010] In one possible design, the target operation is a tap or squeeze operation, and the ink is a sheet of ink; or, the target operation is a swing operation, and the ink is a strip of ink. Based on this design, when the operation received by the stylus is a tap or squeeze operation, the electronic device presents a sheet of ink, and when the operation received by the stylus is a swing operation, the electronic device presents a strip of ink. This way, different ink effects are presented under different interaction modes, that is, the ink corresponds to the interaction mode, which is more in line with the rules of real ink-splashing techniques and can achieve a better simulation effect.
[0011] In one possible design, the electronic device displays ink based on the position of the stylus on the display screen in response to the target information, including: when the electronic device obtains hovering coordinates based on the position of the stylus on the display screen, the electronic device displays the ink in a target display area in response to the target information, wherein the target display area is associated with the hovering coordinates, and the hovering coordinates refer to the coordinates on the display screen corresponding to when the stylus is hovering on the display screen to receive the target operation. Based on this design, when the electronic device is able to obtain the coordinates on the display screen corresponding to when the stylus is hovering on the electronic device display screen, the electronic device displays the ink in response to the target information in the display area associated with the coordinates, that is, displays the ink based on the coordinates. This allows the displayed ink to be associated with the coordinates. In actual ink-splashing techniques, the splashed ink is associated with the splashing location, and the aforementioned coordinates can simulate the splashing location, thereby making the ink effect more consistent with the ink effect in a real ink-splashing scene, resulting in a better simulation effect.
[0012] In one possible design, the electronic device displays ink based on the position of the stylus on the display screen in response to the target information, including: if the electronic device fails to obtain hovering coordinates based on the position of the stylus on the display screen, the electronic device randomly displays the ink on the display screen in response to the target information, wherein the hovering coordinates refer to the coordinates on the display screen corresponding to when the stylus was hovering over the display screen to receive the target operation. In some scenarios, the electronic device may be unable to obtain the coordinates corresponding to when the stylus was hovering over the display screen of the electronic device due to factors such as the stylus being too far from the electronic device. This scenario is similar to the actual ink splashing technique where the ink is splashed too far from the drawing paper. In this ink splashing scenario, ink can appear anywhere on the drawing paper. Thus, when the electronic device fails to obtain the coordinates corresponding to when the stylus was hovering over the display screen of the electronic device, the electronic device randomly displays ink on the display screen in response to the target information. This can also simulate the ink splashing technique in actual painting scenarios.
[0013] In one possible design, the ink is composed of multiple ink droplets, and a first parameter of the ink is related to the style of the brush used by the stylus. The first parameter includes one or more of ink color, ink drop size, and ink drop thickness. Based on this design, the ink color, ink drop size, ink drop thickness, etc. of the ink are related to the style of the brush used by the stylus, and these parameters of the ink determine the style of the ink. In other words, the style of the ink can be determined based on the style of the brush. In this way, when the user uses different brushes, the style of the ink presented by the electronic device may be different. This can meet the needs of users in different painting scenarios and also achieve better simulation effects.
[0014] In one possible design, the ink is composed of multiple ink droplets, and the second parameter of the ink is related to the target operation, and the second parameter includes one or more of the ink range, ink length, ink direction, ink drop size, ink drop density, and ink drop thickness. Based on this design, the ink range, ink length, ink direction, ink drop size, ink drop density, ink drop thickness, etc. of the ink are related to the operation received by the stylus, and these parameters of the ink determine the style of the ink, that is, the style of the ink can be determined according to the style of the brush. In this way, when the user uses different brushes, the style of the ink presented by the electronic device may be different. This can meet the needs of users in different painting scenarios, and in actual painting scenarios, the effect of the ink is also related to the style of the brush used (such as a brush, pen, etc.), which can also make the simulation effect better.
[0015] In one possible design, the target operation is a tapping operation, the parameters of the tapping operation include the tapping force, and at least one of the ink range, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with the tapping force; or, the target operation is a squeezing operation, the parameters of the squeezing operation include the squeezing force, and at least one of the ink range, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with the squeezing force; or, the target operation is a swinging operation, the parameters of the swinging operation include at least one of the swinging amplitude and the swinging force, and at least one of the ink length, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with at least one of the swinging amplitude and the swinging force. Based on this design, at least one of the ink range, ink droplet size, ink droplet density, and ink droplet thickness is positively correlated with the tapping force or squeezing force, or at least one of the ink length, ink droplet size, ink droplet density, and ink droplet thickness is positively correlated with at least one of the swing amplitude and swing force. In other words, the ink parameters are set to be positively correlated with the tapping force, squeezing force, swing amplitude, and swing force, which conforms to the user's conventional thinking and can make the user easier to use. Furthermore, it is more in line with the rules of real ink-splashing techniques, which can achieve a better simulation effect.
[0016] In one possible design, the target operation is a flick, and the direction of the ink is the same as the direction of the flick. With this design, when the stylus receives a flick, the direction of the ink displayed by the electronic device is the same as the direction of the flick, which better aligns with the presentation of ink using a realistic ink-splashing technique and results in a better ink effect.
[0017] In one possible design, one or more of the ink length, droplet size, droplet density, and droplet thickness are associated with hover coordinates. These hover coordinates refer to the coordinates on the display screen corresponding to when the stylus is hovering over the display screen to receive the target action. In actual ink-splashing techniques, the style of the splashed ink is related to the location where it was splashed. Based on this design, one or more of the ink length, droplet size, droplet density, and droplet thickness are associated with hover coordinates. These parameters determine the effect of the ink, and the hover coordinates can simulate the location of the splash, thereby making the ink effect more consistent with the ink splashing effect in a real-life ink-splashing scene, resulting in a better simulation effect.
[0018] In one possible design, the target operation is a tap operation or a squeeze operation, the ink mark includes a first ink mark and a second ink mark, the distance between the first ink mark and the hovering coordinate is smaller than the distance between the second ink mark and the hovering coordinate, the ink droplet size of the first ink mark is larger than the ink droplet size of the second ink mark, and / or the ink droplet density of the first ink mark is greater than the ink droplet density of the second ink mark, and / or the ink droplet density of the first ink mark is greater than the ink droplet density of the second ink mark. Based on this design, when the stylus receives a tap operation or a squeeze operation, the ink mark presented by the electronic device includes the first ink mark and the second ink mark, the distance between the first ink mark and the hovering coordinate is smaller than the distance between the second ink mark and the hovering coordinate, and the ink droplet size of the first ink mark is larger than the ink droplet size of the second ink mark, and / or the ink droplet density of the first ink mark is greater than the ink droplet density of the second ink mark, and / or the ink droplet density of the first ink mark is greater than the ink droplet density of the second ink mark. That is to say, the closer the ink is to the hovering coordinate, the greater the density of the ink droplets, and / or the larger the ink droplet size, and / or the thicker the ink droplets, etc. In this way, the presented ink can conform to the rules of ink presentation under the real ink splashing technique, or conform to the rules of ink dripping, so that the simulation effect is better.
[0019] In one possible design, the target operation is a swing operation, the hovering coordinates include a first hovering coordinate, the first hovering coordinate being the hovering coordinate when the stylus receives the swing operation and starts to swing, the ink includes a third ink mark and a fourth ink mark, the distance between the third ink mark and the first hovering coordinate is smaller than the distance between the fourth ink mark and the first hovering coordinate, the ink droplet size of the third ink mark is larger than the ink droplet size of the fourth ink mark, and / or the ink droplet density of the third ink mark is larger than the ink droplet density of the fourth ink mark, and / or the ink droplet thickness of the third ink mark is greater than the ink droplet thickness of the fourth ink mark. Based on this design, when the stylus receives a swing operation, the ink displayed by the electronic device includes the third ink mark and the fourth ink mark, the distance between the third ink mark and the starting hovering coordinate is smaller than the distance between the fourth ink mark and the starting hovering coordinate, that is, the closer the third ink mark is to the starting hovering coordinate. The third ink droplet size is larger than the fourth ink droplet size, and / or the third ink droplet density is greater than the fourth ink droplet density, and / or the third ink droplet thickness is greater than the fourth ink droplet thickness. In other words, the closer to the starting hovering coordinate, the greater the density of the ink droplets, and / or the larger the ink droplet size, and / or the thicker the ink droplets. This ensures that the rendered ink conforms to the patterns of ink presentation in real ink-splashing techniques, resulting in a better simulation effect.
[0020] In one possible design, before the stylus sends target information to the electronic device in response to the target operation, the method further includes: the electronic device displays the running interface of the first application, and the stylus is used to draw on the running interface. Exemplarily, the first application can be a painting application, etc. Based on this design, when the electronic device presents the running interface of the first application, the stylus receives a tapping operation, a swinging operation, or a squeezing operation, and the electronic device will then present ink to simulate painting techniques in certain specific scenarios. This can avoid the situation where the user is normally using the stylus to touch the electronic device, that is, when the stylus receives a tapping operation, a swinging operation, or a squeezing operation, the electronic device also presents ink, which affects the user's normal operation and reduces the user experience.
[0021] In one possible design, the target operation is a tapping operation, and the second parameter of the ink is related to the direction of the stylus tip when the tapping operation is received. In actual ink-splashing techniques, the splashed ink is related to the direction of splashing, and the direction of the stylus tip can simulate the direction of splashing. In this way, when the stylus receives a tapping operation, the second parameter of the ink presented by the electronic device is related to the direction of the stylus tip when the tapping operation is received. In other words, the style of the ink presented by the electronic device is related to the direction of the stylus tip when the tapping operation is received. In this way, the ink effect can be made more consistent with the ink effect in an actual ink-splashing scene.
[0022] In one possible design, the ink includes a fifth ink mark and a sixth ink mark. The fifth ink mark is displayed on the display screen in a display area facing the same direction as the pen tip, and the sixth ink mark is displayed on the display screen in a display area facing a different direction than the pen tip. The ink range of the fifth ink mark is larger than the ink range of the sixth ink mark, and / or the ink droplet concentration of the fifth ink mark is greater than the ink droplet concentration of the sixth ink mark, and / or the ink droplet size of the fifth ink mark is larger than the ink droplet size of the sixth ink mark. Based on this design, the ink mark presented in the same direction as the stylus tip has a larger range, and / or the ink droplet density is greater, and / or the ink droplets are thicker, etc. In this way, the presented ink can conform to the rules of ink presentation under the real ink-splashing technique, so that the simulation effect is better.
[0023] In a second aspect, an interaction method is provided, which is applied to an electronic device including a display screen, wherein the electronic device is connected to a stylus, and the method comprises: receiving target information from the stylus, wherein the target information is generated based on a target operation of the stylus, wherein the target operation comprises one of a tapping operation, a swinging operation, and a squeezing operation; and displaying ink according to the position of the stylus on the display screen in response to the target information.
[0024] In one possible design, the target operation is a tapping operation, and the target information includes information for representing at least one of a tapping event and a tapping force corresponding to the tapping operation; or, the target operation is a squeezing operation, and the target information includes information for representing at least one of a squeezing event and a squeezing force corresponding to the squeezing operation; or, the target operation is a swinging operation, and the target information includes information for representing at least one of a swinging event, a swinging force, a swinging amplitude, and a swinging direction corresponding to the swinging operation.
[0025] In one possible design, the target operation is a tapping operation or a squeezing operation, and the ink mark is a sheet of ink mark; or, the target operation is a swinging operation, and the ink mark is a strip of ink mark.
[0026] In one possible design, the display of ink according to the position of the stylus on the display screen in response to the target information includes: when hovering coordinates are obtained based on the position of the stylus on the display screen, the display of ink in a target display area in response to the target information, the target display area is related to the hovering coordinates, and the hovering coordinates refer to the corresponding coordinates on the display screen when the stylus hovers on the display screen to receive the target operation.
[0027] In one possible design, the ink is displayed according to the position of the stylus on the display screen in response to the target information, including: when the hovering coordinates are not obtained based on the position of the stylus on the display screen, the ink is randomly displayed on the display screen in response to the target information, and the hovering coordinates refer to the coordinates on the display screen corresponding to when the stylus is hovered on the display screen to receive the target operation.
[0028] In one possible design, the ink is composed of multiple ink droplets, and a first parameter of the ink is related to the style of the brush used by the stylus, and the first parameter includes one or more of ink color, ink droplet size, and ink droplet thickness.
[0029] In one possible design, the ink is composed of multiple ink droplets, and the second parameter of the ink is related to the target operation, and the second parameter includes one or more of ink range, ink length, ink direction, ink droplet size, ink droplet density, and ink droplet thickness.
[0030] In one possible design, the target operation is a tapping operation, the parameters of the tapping operation include the tapping force, and at least one of the ink range, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with the tapping force; or, the target operation is a squeezing operation, the parameters of the squeezing operation include the squeezing force, and at least one of the ink range, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with the squeezing force; or, the target operation is a swinging operation, the parameters of the swinging operation include at least one of the swinging amplitude and the swinging force, and at least one of the ink length, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with at least one of the swinging amplitude and the swinging force.
[0031] In a possible design, the target operation is a swinging operation, and the ink direction of the ink is the same as the swinging direction of the swinging operation.
[0032] In one possible design, one or more of the ink length, ink drop size, ink drop density, and ink drop thickness are related to the hovering coordinates, and the hovering coordinates refer to the corresponding coordinates on the display screen when the stylus hovers on the display screen to receive the target operation.
[0033] In one possible design, the target operation is a tapping operation or a squeezing operation, the ink includes a first ink mark and a second ink mark, the distance between the first ink mark and the hovering coordinate is smaller than the distance between the second ink mark and the hovering coordinate, the ink droplet size of the first ink mark is larger than the ink droplet size of the second ink mark, and / or the ink droplet density of the first ink mark is greater than the ink droplet density of the second ink mark, and / or the ink droplet thickness of the first ink mark is greater than the ink droplet thickness of the second ink mark.
[0034] In one possible design, the target operation is a swing operation, the hovering coordinates include a first hovering coordinate, the first hovering coordinate is the hovering coordinate when the stylus receives the swing operation and starts to swing, the ink includes a third ink and a fourth ink, the distance between the third ink and the first hovering coordinate is smaller than the distance between the fourth ink and the first hovering coordinate, the ink droplet size of the third ink is larger than the ink droplet size of the fourth ink, and / or the ink droplet density of the third ink is greater than the ink droplet density of the fourth ink, and / or the ink droplet thickness of the third ink is greater than the ink droplet thickness of the fourth ink.
[0035] In one possible design, before receiving target information from the stylus, the method further includes: the electronic device displays a running interface of a first application, and the stylus is used to draw on the running interface.
[0036] In one possible design, the target operation is a tapping operation, and the second parameter of the ink is related to the direction of the pen tip when the stylus receives the tapping operation.
[0037] In one possible design, the ink includes a fifth ink and a sixth ink, the fifth ink is displayed in a display area on the display screen facing the same direction as the pen tip, and the sixth ink is displayed in a display area on the display screen facing a different direction than the pen tip, the ink range of the fifth ink is larger than the ink range of the sixth ink, and / or the ink droplet concentration of the fifth ink is greater than the ink droplet concentration of the sixth ink, and / or the ink droplet size of the fifth ink is larger than the ink droplet size of the sixth ink.
[0038] In a third aspect, an interaction method is provided, which is applied to a stylus, wherein the stylus is connected to an electronic device, and the method includes: receiving a target operation, wherein the target operation includes one of a tapping operation, a swinging operation, and a squeezing operation; and in response to the target operation, sending target information to the electronic device, wherein the target information is used by the electronic device to display ink according to the position of the stylus on the display screen of the electronic device.
[0039] In one possible design, the target operation is a tapping operation, and the target information includes information for representing at least one of a tapping event and a tapping force corresponding to the tapping operation; or, the target operation is a squeezing operation, and the target information includes information for representing at least one of a squeezing event and a squeezing force corresponding to the squeezing operation; or, the target operation is a swinging operation, and the target information includes information for representing at least one of a swinging event, a swinging force, a swinging amplitude, and a swinging direction corresponding to the swinging operation.
[0040] In one possible design, the target operation is a tapping operation or a squeezing operation, and the ink mark is a sheet of ink mark; or, the target operation is a swinging operation, and the ink mark is a strip of ink mark.
[0041] In one possible design, the ink is composed of multiple ink droplets, and a first parameter of the ink is related to the style of the brush used by the stylus, and the first parameter includes one or more of ink color, ink droplet size, and ink droplet thickness.
[0042] In one possible design, the ink is composed of multiple ink droplets, and the second parameter of the ink is related to the target operation, and the second parameter includes one or more of ink range, ink length, ink direction, ink droplet size, ink droplet density, and ink droplet thickness.
[0043] In one possible design, the target operation is a tapping operation, the parameters of the tapping operation include the tapping force, and at least one of the ink range, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with the tapping force; or, the target operation is a squeezing operation, the parameters of the squeezing operation include the squeezing force, and at least one of the ink range, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with the squeezing force; or, the target operation is a swinging operation, the parameters of the swinging operation include at least one of the swinging amplitude and the swinging force, and at least one of the ink length, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with at least one of the swinging amplitude and the swinging force.
[0044] In a possible design, the target operation is a swinging operation, and the ink direction of the ink is the same as the swinging direction of the swinging operation.
[0045] In one possible design, one or more of the ink length, ink drop size, ink drop density, and ink drop thickness are related to the hovering coordinates, and the hovering coordinates refer to the corresponding coordinates on the display screen when the stylus hovers on the display screen to receive the target operation.
[0046] In one possible design, the target operation is a tapping operation or a squeezing operation, the ink includes a first ink mark and a second ink mark, the distance between the first ink mark and the hovering coordinate is smaller than the distance between the second ink mark and the hovering coordinate, the ink droplet size of the first ink mark is larger than the ink droplet size of the second ink mark, and / or the ink droplet density of the first ink mark is greater than the ink droplet density of the second ink mark, and / or the ink droplet thickness of the first ink mark is greater than the ink droplet thickness of the second ink mark.
[0047] In one possible design, the target operation is a swing operation, the hovering coordinates include a first hovering coordinate, the first hovering coordinate is the hovering coordinate when the stylus receives the swing operation and starts to swing, the ink includes a third ink and a fourth ink, the distance between the third ink and the first hovering coordinate is smaller than the distance between the fourth ink and the first hovering coordinate, the ink droplet size of the third ink is larger than the ink droplet size of the fourth ink, and / or the ink droplet density of the third ink is greater than the ink droplet density of the fourth ink, and / or the ink droplet thickness of the third ink is greater than the ink droplet thickness of the fourth ink.
[0048] In one possible design, the target operation is a tapping operation, and the second parameter of the ink is related to the direction of the pen tip when the stylus receives the tapping operation.
[0049] In one possible design, the ink includes a fifth ink and a sixth ink, the fifth ink is displayed in a display area on the display screen facing the same direction as the pen tip, and the sixth ink is displayed in a display area on the display screen facing a different direction than the pen tip, the ink range of the fifth ink is larger than the ink range of the sixth ink, and / or the ink droplet concentration of the fifth ink is greater than the ink droplet concentration of the sixth ink, and / or the ink droplet size of the fifth ink is larger than the ink droplet size of the sixth ink.
[0050] A fourth aspect provides an interactive method for a system comprising an electronic device and a stylus, wherein the electronic device is equipped with a display screen and a connection is established between the electronic device and the stylus. The method comprises: moving the stylus above the display screen, with the distance between the stylus and the display screen being greater than a preset distance; and displaying ink on the display screen in response to the movement of the stylus. This method achieves a suspended drawing effect, enhancing the interactive experience.
[0051] In one possible design, in response to the movement of the stylus, the electronic device displays ink on the display screen, including: in response to the movement of the stylus, the electronic device obtains at least one hovering coordinate, the hovering coordinate being the coordinates corresponding to the stylus on the display screen during the movement of the stylus above the display screen; and the electronic device displays ink on the display screen based on the at least one hovering coordinate.
[0052] In one possible design, the electronic device obtains at least one hovering coordinate, including: the electronic device obtains the at least one hovering coordinate based on a signal emitted by the stylus electrode.
[0053] In one possible design, the ink is composed of multiple ink droplets, and a first parameter of the ink is related to the style of the brush used by the stylus, and the first parameter includes one or more of ink color, ink droplet size, and ink droplet thickness.
[0054] In one possible design, the ink mark is composed of multiple ink droplets, and a third parameter of the ink mark is related to the distance between the stylus and the display screen. The third parameter includes one or more of ink droplet size, ink droplet density, and ink droplet thickness.
[0055] In one possible design, one or more of the ink droplet size, ink droplet density, and ink droplet thickness of the ink is negatively correlated with the distance between the stylus and the display screen.
[0056] In a fifth aspect, an interaction method is provided, which is applied to a display screen including an electronic device, wherein the electronic device is connected to a stylus pen, and the method comprises: obtaining at least one hovering coordinate, wherein the hovering coordinate is the corresponding coordinate on the display screen during the movement of the stylus pen above the display screen; and displaying ink on the display screen in response to the at least one hovering coordinate.
[0057] For other designs of the fifth aspect, please refer to the corresponding designs of the fourth aspect.
[0058] In a sixth aspect, a device is provided, which has the function of implementing the method performed by the electronic device or the method performed by the stylus as described in any design of any of the above aspects. The function can be implemented by hardware, or the corresponding software can be implemented by hardware. The hardware or software includes one or more modules corresponding to the above functions. In a possible example, the device includes a communication unit (or communication module) and a processing unit (or processing module); the communication unit is used to perform the communication operation in the method described in any design of any of the above aspects. The processing unit is used to perform the processing operation in the method described in any design of any of the above aspects.
[0059] In the seventh aspect, an electronic device is provided, comprising a processor, a memory, a communication interface and a display screen, wherein the memory, the communication interface and the display screen are coupled to the processor, the communication interface is used to communicate with other devices, the memory is used to store computer program code, and the computer program code includes computer instructions. The processor reads the computer instructions from the memory so that the electronic device executes the method executed by the electronic device as described in any design of any of the above aspects.
[0060] In an eighth aspect, a stylus is provided, comprising a processor, a memory and a communication interface, wherein the memory and the communication interface are coupled to the processor, the communication interface is used to communicate with other devices, the memory is used to store computer program code, and the computer program code includes computer instructions, and the processor reads the computer instructions from the memory so that the stylus executes the method of the stylus execution as described in any of the designs in any of the above aspects.
[0061] In one possible design, the stylus may further include a sensor, which may be used to collect information representing one or more of the following: tapping force, squeezing force, swinging force, swinging amplitude, and swinging direction.
[0062] Optionally, in the seventh or eighth aspect, the memory may be coupled to the processor, or may be independent of the processor. Exemplarily, the communication interface may be a transceiver, an input / output interface, an interface circuit, an output circuit, an input circuit, a pin, or a related circuit.
[0063] In a ninth aspect, a computer-readable storage medium is provided, the computer-readable storage medium including a computer program or instructions. When the computer program or instructions are executed on an electronic device, the electronic device executes the method as described in any one of the above aspects. Alternatively, when the computer program or instructions are executed on a stylus pen, the stylus pen executes the method as described in any one of the above aspects.
[0064] In a tenth aspect, a computer program product is provided, which, when executed on a computer, enables the computer to execute any of the methods designed for the electronic device or stylus to execute in any of the above aspects.
[0065] In the eleventh aspect, a chip system is provided, comprising at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor. When the at least one processor executes the instructions, the at least one processor executes the method executed by the electronic device or stylus as described in any design in any of the above aspects.
[0066] In a twelfth aspect, an interactive system is provided, comprising an electronic device and a stylus, wherein the electronic device is configured to execute the method described in any one of the designs of the second aspect, and the stylus is configured to execute the method described in any one of the designs of the third aspect. Alternatively, the electronic device and the stylus cooperate to implement the method described in any one of the designs of any one of the above aspects.
[0067] It should be noted that the technical effects brought about by any design in the above-mentioned second to twelfth aspects can refer to the technical effects brought about by the corresponding design in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0068] FIG1 is a schematic diagram of a painting scene provided in an embodiment of the present application;
[0069] FIG2 is a schematic diagram of the architecture of a communication system provided in an embodiment of the present application;
[0070] FIG3 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0071] FIG4 is a schematic structural diagram of a stylus provided in an embodiment of the present application;
[0072] FIG5 is a schematic structural diagram of another electronic device provided in an embodiment of the present application;
[0073] FIG6 is a first schematic diagram of an interface provided in an embodiment of the present application;
[0074] FIG7 is a second schematic diagram of an interface provided in an embodiment of the present application;
[0075] FIG8 is a third schematic diagram of an interface provided in an embodiment of the present application;
[0076] FIG9 is a schematic diagram of a scenario of a stylus in use provided by an embodiment of the present application;
[0077] FIG10 is a fourth schematic diagram of an interface provided in an embodiment of the present application;
[0078] Figures 11 to 19G are interface diagrams 5 to 19 provided in embodiments of the present application;
[0079] FIG20A is a schematic diagram of a flow chart of an interaction method provided in an embodiment of the present application;
[0080] FIG20B is a schematic diagram of a flow chart of another interaction method provided in an embodiment of the present application;
[0081] FIG21 is a schematic structural diagram of another electronic device provided in an embodiment of the present application;
[0082] FIG22 is a schematic structural diagram of another stylus provided in an embodiment of the present application;
[0083] Figure 23 is a structural diagram of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION
[0084] The technical solutions provided by the embodiments of the present application are described in detail below in conjunction with the accompanying drawings. The terms "including" and "having" and any variations thereof mentioned in the description of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.
[0085] It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being more preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0086] In this application, unless otherwise specified, "plurality" means two or more. "And / or" in this document is simply a description of an association between related objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone.
[0087] To facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art will understand that the words "first" and "second" do not limit the quantity or execution order, and the words "first" and "second" do not necessarily mean different.
[0088] Currently, stylus-based drawing on electronic devices uses the coordinates of the stylus's contact with the electronic device's screen as the basis for drawing lines of varying textures based on parameters such as the stylus's pressure sensitivity and tilt angle. As shown in Figure 1, electronic device 10 draws line 30 based on the coordinates of stylus 20 on the screen of electronic device 10, the pressure sensitivity of stylus 20, and other parameters such as the tilt angle. This approach uses a limited interaction method between the stylus and the electronic device and cannot simulate certain painting techniques used in specific scenarios, such as the splash-ink technique used in traditional Chinese painting.
[0089] Based on this, an embodiment of the present application provides an interaction method that can enrich the interaction between a stylus pen and an electronic device, and can simulate painting techniques in certain specific scenarios, such as ink splashing techniques, to enhance the user experience.
[0090] For example, Figure 2 shows a schematic diagram of the architecture of a communication system for applying an interactive method provided in an embodiment of the present application. As shown in Figure 2 , the communication system 200 includes an electronic device 201 and a stylus 202 .
[0091] The electronic device 201 may be any electronic device with a display screen. For example, the electronic device 201 may include, but is not limited to, a smartphone, a netbook, a tablet computer, a handwriting tablet, a smartwatch, a smart bracelet, a phone watch, a smart camera, a PDA, a car computer, a personal computer (PC), a personal digital assistant (PDA), a portable multimedia player (PMP), an augmented reality (AR) / virtual reality (VR) device, a smart TV, a projection device, or a somatosensory game console in a human-computer interaction scenario. Alternatively, the electronic device 201 may be an electronic device with a display screen of other types or structures, which is not limited in this application.
[0092] The stylus 202 can be used to perform various writing operations on the electronic device 201, including but not limited to graffiti, drawing, annotation, signature, etc. Optionally, the stylus 202 can be a resistive stylus, an electromagnetic stylus, or a capacitive stylus, which is not limited in this embodiment of the present application.
[0093] Optionally, the operating system installed on the electronic device 201 and / or the stylus pen 202 includes but is not limited to Or other operating systems. Of course, the electronic device 201 and / or the stylus 202 may not have an operating system installed. This application does not limit the specific type of the electronic device 201 and / or the stylus 202, whether an operating system is installed, or the operating system installed under an installed operating system. Optionally, electronic devices 201 of different types or with different software system versions can be adapted to the same or different versions of the stylus 202.
[0094] Optionally, the electronic device 201 and the stylus 202 may be connected via a wired communication method or a wireless communication method. For example, the wireless communication method may include, but is not limited to, Bluetooth (e.g., traditional Bluetooth or Bluetooth low energy (BLE)), wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) networks), and the like.
[0095] It can be understood that FIG2 is a simplified schematic diagram for ease of understanding. In actual applications, the above system may further include other devices that are not shown in the figure.
[0096] For example, FIG3 shows a schematic structural diagram of an electronic device 201 provided in an embodiment of the present application.
[0097] As shown in Figure 3, the electronic device 201 may include a processor 110, a memory 120, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna, a communication module 150, a sensor module 160, a display screen 170, etc.
[0098] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0099] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0100] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0101] The USB interface 130 is an interface that complies with the USB standard. The USB interface 130 can be used to connect a charger to charge the electronic device 201, and can also be used to transmit data between the electronic device 201 and peripheral devices.
[0102] The charging management module 140 is configured to receive charging input from a charger.
[0103] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to provide power to the processor 110, the memory 120, and the communication module 150.
[0104] The communication function of the electronic device 201 can be implemented through an antenna, a communication module 150 , and the like.
[0105] The antenna is used to transmit and receive electromagnetic wave signals. The communication module 150 can provide wireless communication solutions for the electronic device 201, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The communication module 150 can be one or more devices that integrate at least one communication processing module.
[0106] In some embodiments, the antenna of the electronic device 201 is coupled to the communication module 150, so that the electronic device 201 can communicate with a network and other devices via wireless communication technology. The wireless communication technology may include long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology.
[0107] In some embodiments of the present application, the communication module 150 may be used to establish a connection with the stylus, and the electronic device 201 may exchange information with the stylus through the established connection.
[0108] The memory 120 may be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 201 by running the instructions stored in the memory 120 and / or instructions stored in a memory provided in the processor.
[0109] Optionally, the sensor module 160 includes one or more of a pressure sensor 160A, a magnetic sensor 160B, and a touch sensor 160C.
[0110] Pressure sensor 160A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 160A can be located on display screen 170. There are many types of pressure sensors 160A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates made of conductive material. When a force acts on pressure sensor 160A, the capacitance between the electrodes changes. Electronic device 201 determines the intensity of the pressure based on this change in capacitance.
[0111] The magnetic sensor 160B includes a Hall sensor. The electronic device 201 can use the magnetic sensor 160B to detect the opening and closing of the flip cover. In some embodiments of the present application, the electronic device 201 can use the magnetic sensor 160B to attract the stylus, thereby adsorbing the stylus to a fixed position on the electronic device 201.
[0112] Touch sensor 180C, also known as a "touch device," can be provided on display screen 170. Touch sensor 180C and display screen 170 form a touch screen, also known as a "touch screen." Touch sensor 180C is used to detect touch operations applied to or near it.
[0113] The electronic device 201 implements the display function through the GPU, the display screen 170, and the application processor.
[0114] The display screen 170 is used to display images, videos, etc. The display screen 170 includes a display panel.
[0115] In some embodiments of the present application, the display screen 170 may be used to display lines, patterns, texts, etc. drawn by a user through handwriting. In still other embodiments of the present application, the display screen 170 may also be used to receive signals sent by electrodes of a stylus.
[0116] For example, FIG4 shows a schematic structural diagram of a stylus 202 provided in an embodiment of the present application.
[0117] As shown in Figure 4 , stylus 202 may include electrodes 410, sensors 420, a communication module 430, and the like. Electrodes 410 may be used to transmit signals to display screen 170, such as that shown in Figure 3 . Accordingly, electronic device 201 may determine the hovering coordinates of stylus 202 on display screen 170 based on the signals received by display screen 170. In some embodiments, electrodes 410 may be integrated into the tip of stylus 202. Of course, in other embodiments, electrodes 410 may also be integrated into other locations on stylus 202, such as the cap, and this is not specifically limited in this embodiment of the present application.
[0118] In some embodiments, the sensor 420 can be used to detect user operations acting on the stylus 202, such as including but not limited to one or more of a tapping operation, a swinging operation, a touch operation, and a squeeze operation. When the user operation is implemented as a tapping operation, a swinging operation, or a squeeze operation, the sensor 420 can be specifically implemented as a film sensor or an acceleration sensor. For example, the film sensor can identify a tapping operation by identifying a touch event, and identify a squeeze operation by detecting pressure data. The acceleration sensor can be used to detect the magnitude of the acceleration of the stylus 202 in various directions (generally three axes). For example, the acceleration sensor can identify a swinging operation by detecting acceleration data. When the user operation is a touch operation, the sensor 420 can be specifically implemented as a touch sensor, a pressure sensor, etc.
[0119] In some embodiments, the sensor 420 can also be used to attach the stylus 202 to a fixed position on the electronic device. In this embodiment, the sensor 420 can also be specifically implemented as a magnetic sensor.
[0120] It is understandable that the number of sensors included in the sensor 420 may be one or more, and the embodiment of the present application does not impose any limitation on this. At the same time, the embodiment of the present application does not impose any specific limitation on the installation position of the sensor in the stylus 202.
[0121] The communication module 430 can be used to implement information exchange between the stylus 202 and other devices (such as the electronic device 201). For a detailed introduction to the communication module 430, please refer to the relevant introduction to the communication module shown in Figure 3.
[0122] Alternatively, in other embodiments, the electronic device and / or stylus may include more or fewer components than those shown in FIG3 and FIG4 , or some components may be combined, separated, replaced, or arranged differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0123] In some embodiments, the software system of the electronic device may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In this embodiment of the present invention, the software structure of the electronic device 201 is exemplified by taking the layered architecture as an example.
[0124] FIG5 is a schematic diagram of the software structure of an electronic device 201 provided in an embodiment of the present application.
[0125] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other via software interfaces. In some embodiments, the software system of an electronic device may include four layers: an application layer, an application framework layer, a system layer, and a kernel layer.
[0126] The application layer may include a series of application packages, such as but not limited to drawing, Bluetooth, WLAN, and other applications. In some embodiments of the present application, the drawing application may be used to implement various drawing operations.
[0127] The application framework layer can provide an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer can include some predefined functions.
[0128] The system layer can be used to provide various system services. In some embodiments, the system layer can include an input subsystem and a touch process (Aptouch Daemon). Among them, the input subsystem is a subsystem for managing input. The input subsystem can be used to manage input transactions. The driver of the input device can be registered with the kernel through the interface provided by the input subsystem and use the functions provided by the input subsystem to interact with user space. For example, in some embodiments of the present application, the input subsystem can be used to manage tap events, swing events, etc. of the stylus.
[0129] APtouch Daemon is a process related to display screen touch control. This process can run in the background of electronic device 201 and provide continuous running services and functions.
[0130] The kernel layer is a layer between hardware and software. In some embodiments, the kernel layer may include one or more of a touch screen (touch pad, TP) driver, a Bluetooth driver, and a sensor driver.
[0131] It can be understood that the software structure of the electronic device 201 shown in Figure 5 is only an example. In actual applications, it can also include more or fewer levels, and / or more or fewer modules, and the levels to which each module belongs can also be different. For example, the input subsystem of the system layer can also belong to the application framework layer. This embodiment of the present application does not limit this.
[0132] The following describes the workflow of electronic device software and hardware by way of example, using a scenario where a stylus is used to draw on an electronic device.
[0133] In some scenarios, the stylus can hover on the display screen of an electronic device. When the stylus receives a tapping operation, the electrodes in the stylus transmit a signal to the display screen. Correspondingly, after the display screen receives the signal, it obtains the hovering coordinates of the stylus on the display screen based on the signal, and can obtain the tapping event of the stylus. Then the TP driver of the kernel layer is started, and the data is reported to APtouch Daemon through the TP driver. Then, APtouch Daemon packages the data such as the hovering coordinates of the stylus and returns it to the TP driver. Furthermore, after receiving the packaged data, the TP driver uploads the packaged data to the painting application of the application layer through the input subsystem and the framework layer. Finally, the painting application executes the ink drawing process based on the packaged data, and finally presents the completed ink on the display screen of the electronic device.
[0134] The technical solutions involved in the following embodiments can all be implemented in devices having the structures shown in Figures 3, 4, and 5, and in a system having the architecture shown in Figure 2.
[0135] It is understood that in the following embodiments, the electronic device 201 is used as an electronic device and the stylus 202 is used as a stylus. The electronic device and / or the stylus can perform some or all of the steps in the embodiments of the present application. These steps or operations are merely examples, and the embodiments of the present application can also perform other operations or variations of various operations. In addition, the various steps can be performed in a different order than those presented in the embodiments of the present application, and it is possible that not all operations in the embodiments of the present application need to be performed.
[0136] In some scenarios, before using a stylus to draw on an electronic device, it is necessary to first establish a connection between the stylus and the electronic device. For example, FIG6 shows a schematic diagram of a scenario in which a stylus is connected to an electronic device provided in an embodiment of the present application. As shown in (1) in FIG6 , the user can adsorb the stylus on the side frame of the electronic device (such as a designated position on the long frame), and in response to the adsorption operation, the connection process between the stylus and the electronic device can be triggered. Optionally, before receiving the stylus adsorption operation, the electronic device can present various interfaces, such as but not limited to the main interface, the lock screen interface, the running interface of various applications, etc. In other words, no matter what interface is presented on the electronic device, when the stylus is adsorbed to the designated position on the electronic device, the connection process between the stylus and the electronic device can be triggered, and the embodiment of the present application does not limit this.
[0137] Then, as shown in FIG6 (2), the electronic device may pop up a connection interface 700, which may be used to remind the user whether to confirm the connection between the stylus pen and the electronic device. If the electronic device detects an operation such as a click of the user on the connection control 701, the stylus pen and the electronic device are connected in response to the operation. Optionally, the electronic device may also present a reminder interface 710 such as shown in FIG6 (3) to remind the user that the connection between the stylus pen and the electronic device is successfully established.
[0138] It is understood that the above is only an example of an implementation method for establishing a connection between an electronic device and a stylus. In other embodiments, the electronic device can also establish a connection with the stylus in other ways, such as: through a touch, Bluetooth pairing, etc., and the present embodiment does not impose specific limitations on this.
[0139] Furthermore, after the electronic device and the stylus are connected, the user can use the stylus to perform various drawing operations on the electronic device. The following describes the process of a user using the stylus to draw on an electronic device with reference to the accompanying drawings.
[0140] In some embodiments, a drawing application may be installed in the electronic device, and the user may use a stylus to perform drawing operations in the running interface of the drawing application. The drawing application in the electronic device may draw corresponding ink in response to the drawing operations performed by the user, thereby generating a picture.
[0141] Optionally, the drawing application can be an application dedicated to drawing, or other applications that can realize drawing functions, such as: including but not limited to various applications such as memos, notes, and text applications. Optionally, the drawing application can be a system application or a downloaded third-party application, which is not limited in this embodiment of the application.
[0142] For example, as shown in FIG7 (1), the electronic device displays a main interface 800 (or desktop 800), which includes one or more application icons, such as an icon for a calendar application, an icon for a settings application, etc., which are not described one by one here. The icons of different applications can be used to open the running interface of the corresponding application and implement the functions of the corresponding application. The one or more application icons include an icon 801 for a drawing application.
[0143] If the electronic device detects a user clicking on the icon 801 of the drawing application, the clicking operation can be performed by the user's finger or by a stylus. In response to the operation, as shown in (2) of FIG7 , the electronic device can display the running interface 810 of the drawing application, and the user can use the stylus to perform various drawing operations on the running interface 810. Optionally, in response to the user clicking on the icon 801 of the drawing application, the electronic device can also first present a new layer interface (not shown in the figure) before presenting the running interface 810, so as to perform various drawing operations on the layer newly created by the user. This embodiment of the present application does not limit this.
[0144] In some embodiments, the user can draw on the operation interface 810 by tapping the stylus. As shown in (1) in Figure 8, the user performs a tapping operation on the stylus. Optionally, the user can use one hand to hold the stylus and the other hand to tap the stylus. The same hand can also hold the stylus and tap the stylus at the same time. The embodiment of the present application does not impose any restrictions on the tapping method adopted by the user. In response to the operation, the stylus can recognize the tapping event and then send the tapping event to the electronic device. Accordingly, when the electronic device recognizes the tapping event, it presents ink in a preset area based on the tapping event, such as the ink 900 shown in (2) in Figure 8. Optionally, in this embodiment, the ink 900 can be a sheet-shaped ink (such as but not limited to a circle, a sector, a rectangle, an irregular polygon, etc.). It can be understood that in this embodiment, the stylus recognizes the tapping event as an example. In other embodiments, the electronic device can also recognize the tapping event. The embodiment of the present application does not limit this. In this way, users can draw ink on electronic devices by tapping the stylus, enriching the interaction between the stylus and electronic devices. This interaction method can simulate painting techniques in certain specific painting scenarios and improve the user experience.
[0145] It can be understood that the ink described in the embodiment of the present application may refer to a drawing track or handwriting presented by the electronic device based on a series of operations after the stylus performs a series of operations. The term "ink" is used to describe it in this article.
[0146] It is understood that the tapping operation can be a single tap or multiple taps, and the embodiment of the present application does not impose any specific restrictions on the number of taps included in the tapping operation. Optionally, when the stylus receives the tapping operation performed by the user, the stylus may be in a vertical use state as shown in Figure 9 (1), or in a horizontal use state as shown in Figure 9 (2), or in a tilted use state as shown in Figure 9 (3). The embodiment of the present application does not impose any restrictions on the use state of the stylus at this time.
[0147] In some embodiments, when the stylus receives a tapping operation, the stylus may not be hovering above the display screen of the electronic device. In this embodiment, as a possible implementation, the preset area can be the entire display area of the electronic device display screen. Exemplarily, in this implementation, the ink presented in the preset area can be ink 1100 as shown in Figure 10. Of course, in other implementations, the preset area can also be a certain display area on the electronic device display screen (such as the upper left area, the upper right display area, etc.), and the embodiments of the present application are not limited to this.
[0148] In other embodiments, when the stylus receives a tapping operation, the stylus may hover above the display screen of the electronic device. In this embodiment, as a possible implementation, when the electronic device cannot identify (or obtain) the hovering coordinates of the stylus on the display screen, such as when the electrodes of the stylus are not above the display screen of the electronic device, or when the distance at which the stylus hovers above the display screen of the electronic device exceeds a preset distance, the display screen of the electronic device may not be able to receive the signal emitted by the electrodes of the stylus, and thus cannot identify the coordinates at which the stylus hovers above the display screen of the electronic device. At this time, the preset area may also be the entire display area of the display screen of the electronic device, or the preset area may also be a certain display area on the display screen of the electronic device.
[0149] In this embodiment, as another possible implementation, when the electronic device can identify the coordinates of the stylus pen hovering on the display screen, such as when the stylus pen's electrodes are above the electronic device's display screen and when the stylus pen hovers within a preset distance above the electronic device's display screen, the electronic device's display screen can receive the signal emitted by the stylus pen's electrodes and thereby identify the coordinates of the stylus pen hovering above the electronic device's display screen. In this case, the preset area can be determined based on the stylus pen's hovering coordinates. In other words, the preset area is related to the stylus pen's hovering coordinates on the electronic device's display screen.
[0150] In this implementation, as a specific embodiment, the preset area can be a display area of a preset size based on the hovering coordinates of the stylus on the display screen of the electronic device. Optionally, the hovering coordinates can be used as the center point, corner point, or edge point of the preset area. The preset area can be a circular, rectangular, sector-shaped, or other shaped area, such as a circle with the hovering coordinates as the center. The embodiment of the present application does not impose any restrictions on the size and shape of the preset area. For example, as shown in Figure 11, taking the hovering coordinates of the stylus as Z as an example, the preset area can be the display area corresponding to the circle 1200.
[0151] It should be understood that in the embodiments of the present application, the ink being presented in a predetermined area does not necessarily fill the predetermined area. The ink may occupy part or all of the predetermined area. Optionally, the positions of the ink droplets within the ink presented in the predetermined area may be random, and the positions of the ink droplets presented at different times may be the same or different.
[0152] In some embodiments, the style of the ink presented in the preset area (or the parameters of the ink, such as one or more of the ink color, ink drop size, and ink drop thickness) can be determined according to the style of the brush selected by the user. In other words, the style of the ink presented in the preset area is related to the style of the brush selected by the user. Optionally, the brushes can be classified based on different division granularities, for example: according to the shape of the pen tip, they can be divided into: round-headed brushes, square-headed brushes, etc. According to the usage scenario, they can be divided into scene brushes, material brushes, pattern brushes, etc. The embodiments of the present application do not impose any restrictions on the classification of brushes. It is understandable that for different brushes, their styles may be different.
[0153] For example, as shown in (1) of FIG12 , the electronic device may display a brush selection interface 1300 of a drawing application. Optionally, the user may perform an operation such as clicking on a control 811 included in the running interface 810. In response to the operation, the electronic device presents the brush selection interface 1300. Of course, the user may also open the brush selection interface 1300 in other ways, and the present embodiment of the application does not impose any limitation on this.
[0154] The brush selection interface 1300 may include one or more brush categories, including but not limited to outline, watercolor, flat painting, sketching, and textures, which are not described here. Each brush category may include one or more brushes of different styles. For example, watercolor may include a wet brush 1301, a wet edge rendering brush 1302, and a clearing brush 1303. These are not described here, and users can select a brush based on their needs.
[0155] For example, if the brush selected by the user is wet, then in combination with the above description, after the stylus receives the user's tapping operation, in response to the operation, the electronic device combines the brush selected by the user and presents ink 1310 in the preset area as shown in (2) of Figure 12. The style of the ink 1310 is the same as that of the wet brush.
[0156] In some embodiments, the style of the brush is also related to one or more parameters of the brush. For example, the parameters of the brush may include but are not limited to one or more of color, size (or dimension), transparency, etc. In some implementations, the setting of the brush parameters may be a default or fixed setting. In other implementations, the user may also choose to change the setting of the brush parameters to change the style of the brush, thereby changing the style of the ink presented in the preset area. For example, taking the wet brush as an example, the user may change the parameter setting of the wet brush. As shown in (1) of FIG12 , the user may perform an operation such as clicking on the wet brush 1301. In response to the operation, as shown in (3) of FIG12 , the electronic device may present a parameter setting interface 1320. The parameter setting interface 1320 includes one or more parameter setting options for the wet brush, such as a color option 1321, a size option 1322, an opacity option 1323, etc. The user may set the corresponding parameter through each parameter setting option. It is understandable that different parameters of the brush can be set through the same interface or through different interfaces, and the embodiments of the present application are not limited to this.
[0157] In this way, the user can set the parameters he needs by changing the parameters of the brush, so that the effect of the ink can better meet the actual needs and meet the needs of users, such as the needs in different painting scenes. For example, take the example of the user setting the color of the wet brush to black and the size and transparency to change randomly, and then the setting is completed. If the stylus detects that the user performs a tapping operation, in response to the operation, the stylus can recognize the tapping event and then send the tapping event to the electronic device. Accordingly, after recognizing the tapping event, the electronic device starts the drawing application, and the ink presented by the drawing application based on the brush selected by the user and the parameter setting of the brush can be the ink 1330 shown in (4) of Figure 12. Optionally, in this example, since the user sets the size and transparency of the brush to change randomly, for the ink 1330 shown in (4) of Figure 12, the size and transparency of each ink drop contained therein also change randomly. That is, for the ink mark 1330 shown in (4) in FIG12 , the size and / or transparency of each ink droplet contained therein may be the same or different, such as the size and transparency of ink droplet 1331 may be different from the size and transparency of ink droplet 1332 .
[0158] It is understandable that the ink traces described in the embodiments of the present application may be composed of one or more ink droplets (or ink dots).
[0159] Of course, in other examples, if the user sets the brush size, transparency, etc. to be fixed, then the size, transparency, etc. of each ink droplet contained in the ink trace shown in (4) of Figure 12 is also fixed. In other words, the size, transparency, etc. of different ink drops are the same.
[0160] In other embodiments, the style of the ink presented in the preset area can be determined by one or more parameters of the ink. In other words, the style of the ink presented in the preset area can be related to one or more parameters of the ink. Exemplarily, the parameters of the ink may include, but are not limited to, one or more of ink drop size, ink drop density, ink drop thickness (or opacity, or color depth, or transparency, etc.), range, etc. In this embodiment, as a possible implementation, the parameters of the ink presented in the preset area can also be default or fixed. As another possible implementation, similar to the above-mentioned method of setting brush parameters, the user can also set and / or change the settings of one or more parameters of the ink through the running interface of the painting application, etc. Of course, the user can also set and / or change one or more parameters of the ink drop in other ways, and the embodiments of the present application are not limited to this.
[0161] As another possible implementation, one or more parameters of the ink can also be determined based on the tapping force of the tapping operation. That is, one or more parameters of the ink are related to the tapping force of the tapping operation. In this way, the user can perform different tapping forces on the stylus, making the user's interaction with the stylus more diverse, and also making the ink presentation effect richer. As a specific embodiment, when the user performs a tapping operation on the stylus, the stylus can detect the tapping force of the tapping operation. For example, the stylus can detect the tapping force through an installed sensor. For example, taking an acceleration sensor as an example, the stylus can detect the tapping force through the acceleration of the stylus sensed by the acceleration sensor. The embodiment of the present application does not specifically limit the way the stylus detects the tapping force. Then, the stylus can also send the detected tapping force to the electronic device, and the electronic device can then determine the parameters of the ink based on the tapping force.
[0162] It can be understood that in the embodiment of the present application, the tapping force can be directly represented by the sensor's perception data (such as: sensor acceleration, etc.), or it can be represented by other data calculated from the sensor's perception data. The embodiment of the present application does not limit this.
[0163] As a specific embodiment, one or more parameters of the ink mark are positively correlated with the tapping force. For example, the greater the tapping force, the larger the ink droplet size, and / or the greater the ink droplet density, and / or the thicker the ink droplet (i.e., the greater the opacity, the lower the transparency, the darker the color), and / or the larger the range (i.e., the more display area the ink mark occupies on the display screen), etc. For example, as shown in FIG13 , when the tapping force of the stylus is A, the ink mark presented in the preset area may be ink mark 1400 as shown in FIG13 (1), and when the tapping force of the stylus is B, B is less than A, and the ink mark presented in the preset area may be ink mark 1410 as shown in FIG13 (2). It can be seen that compared with ink mark 1410, ink mark 1400 has a larger ink droplet size, a greater density, and a larger range. In this way, by setting the parameters of the ink mark to be positively correlated with the tapping force, it conforms to the user's conventional thinking and can make it easier for the user to operate.
[0164] Of course, in other embodiments, one or more parameters of the ink mark may be negatively correlated with the tapping force. For example: the greater the tapping force, the smaller the size of the ink dot, and / or the smaller the density of the ink droplets, and / or the lighter the ink droplets (i.e., the smaller the opacity, the greater the transparency, the lighter the color), and / or the smaller the range (i.e., the smaller the display area occupied by the ink mark on the display screen), etc. Alternatively, a preset mapping relationship may be satisfied between one or more parameters of the ink mark and the tapping force. For example: the mapping relationship may be: when the tapping force is in which value or which range, one or more parameters of the ink mark are set to which value or which range respectively. The embodiment of the present application does not impose any specific restrictions on the mapping relationship, nor does it impose any specific restrictions on the specific relationship between one or more parameters of the ink mark and the tapping force.
[0165] In some other embodiments, the style (or parameters) of the ink displayed in the preset area can also be determined based on the orientation of the stylus tip, the hovering coordinates of the stylus, etc. In other words, the style of the ink displayed in the preset area can be related to one or more of the orientation of the stylus, the hovering coordinates of the stylus, etc. In actual ink-splashing techniques, the splashed ink is related to the direction and location of the splashing. The orientation of the stylus tip can simulate the direction of the splashing, and the hovering coordinates of the stylus can simulate the location of the splashing. In this way, the ink effect can be made more consistent with the ink effect in actual ink-splashing scenarios. For example, when a user performs a tapping operation with the stylus, the electrode of the stylus tip can transmit a signal to the display screen of the electronic device. Accordingly, after the electronic device receives the signal based on the display screen, it can determine the orientation of the stylus tip (for example, east, south, west, north, left, right, southeast, northeast, southwest, northwest, etc.) and the hovering coordinates of the stylus. The ink pattern is then determined based on one or more of the direction of the stylus tip, the hovering coordinates of the stylus, etc. Optionally, in this embodiment, since the signal is transmitted to the display screen of the electronic device by the electrodes of the stylus tip, the hovering coordinates of the stylus are also the hovering coordinates of the stylus tip.
[0166] It is understood that the schemes for determining ink parameters (or styles) described in the various embodiments of the present application can be used individually or in combination. For example, when used individually, the ink parameters can be determined based on any one of the methods, and the types of ink parameters determined by different methods can be the same or different. When used in combination, a portion of the ink parameters can be determined based on one method, and then another portion of the ink parameters can be determined based on another method. The embodiments of the present application do not limit this.
[0167] As a specific embodiment, in the same direction as the pen tip is facing, more ink is presented, such as a larger ink range, and / or a greater ink droplet density, and / or thicker ink droplets. And / or, the closer to the hovering coordinates of the stylus, the greater the density of the ink droplets presented, and / or the larger the ink droplet size, and / or the thicker the ink droplets, etc., that is, the farther away from the hovering coordinates of the stylus, the smaller the density of the ink droplets presented, and / or the smaller the ink droplet size, and / or the lighter the ink droplets, etc. And / or the ink also spreads in one or more other directions along the direction of the pen tip. In this way, the presented ink can be made to conform to the rules of ink presentation under the real ink splashing technique, so that the simulation effect is better. Optionally, since the ink is presented in a preset area, in this embodiment, the position of the preset area can also be related to the pen tip direction, or in other words, the position of the preset area can also be determined based on the pen tip direction. In this embodiment, the ink presented in the preset area can be the ink 1500 shown in Figure 14. As shown in Figure 14, when the pen tip is facing left, the ink drop density on the left side is greater and the ink range is larger. Closer to the hovering coordinate B of the stylus (indicated by dot B in the figure), the ink drop size is larger and the ink drop density is greater.
[0168] In some embodiments, the tapping operation can be a tapping action acting on any position of the stylus, that is, no matter where the user taps the stylus, the tapping action is considered to be the same tapping operation. In other embodiments, tapping actions acting on different positions of the stylus, such as tapping actions acting on the body of the stylus, tapping actions acting on the tip of the stylus, tapping actions acting on the tail of the stylus, etc., can be considered to be different tapping operations. In this embodiment, the style of the above-mentioned ink, the preset area (or the location where the ink is presented), etc. can also be determined based on different tapping actions. For example: for different tapping operations, the determined preset area and ink style can be different.
[0169] The above describes the process of drawing ink by tapping the stylus pen. In other embodiments, the user can also perform a swinging operation on the stylus pen to draw ink, which is described below.
[0170] In some embodiments, as shown in (1) in FIG15 , the user can perform a swinging operation on the stylus. In response to the swinging operation, the stylus changes from state M to state N. At the same time, the stylus can recognize the swinging event (such as the stylus can recognize the swinging event through various sensors), and then send the swinging event to the electronic device. Accordingly, when the electronic device recognizes the swinging event, it presents ink based on the swinging event, such as the ink 1600 shown in (2) in FIG15 . Optionally, the ink presented in this embodiment can be a strip of ink. In this way, the user can draw ink on the electronic device by swinging the stylus, making the interaction between the stylus and the electronic device richer. Moreover, this interaction method is similar to the ink splashing technique, which can simulate the painting techniques in certain specific scenarios and improve the user experience.
[0171] Of course, in other embodiments, the electronic device may also identify a swing event. For example, when a user swings a stylus, the stylus' electrodes may transmit signals to the electronic device's display screen in real time or periodically during the swinging process. Accordingly, after the electronic device receives the signal via the display screen, it may identify multiple hovering coordinates of the stylus and, in combination with these hovering coordinates, identify a swing event. Of course, the electronic device may also identify a swing event in other ways, and this embodiment of the present application does not impose any specific limitations on this.
[0172] In some embodiments, when the stylus receives a swing operation, the stylus may not be swung over the display screen of the electronic device. Optionally, in this embodiment, the ink can be presented in any display area or a default display area on the display screen of the electronic device.
[0173] In other embodiments, when the stylus receives a swing operation, the stylus may be swung above the display screen of the electronic device. Optionally, in this embodiment, as a possible implementation, when the electronic device cannot obtain the hovering coordinates of the stylus during the swing process above the display screen (i.e., one or more hovering coordinates contained in the swing event), if the stylus exceeds a certain distance from the display screen when it is swung above the electronic device, the electronic device may not be able to obtain the hovering coordinates of the stylus during the swing process. Optionally, in this implementation, the ink can also be presented in any display area or default display area on the display screen of the electronic device.
[0174] As another possible implementation, when the electronic device can obtain the hovering coordinates of the stylus when it is swung above the display screen, if the distance between the stylus and the display screen does not exceed a certain distance when the stylus is swung above the display screen of the electronic device, the electronic device can obtain the hovering coordinates of the stylus during the swinging process. Optionally, in this implementation, the display area where the ink is presented can be determined based on one or more hovering coordinates included in the swinging process of the stylus (that is, one or more hovering coordinates included in the swinging event). In other words, the display area where the ink is presented is related to the one or more hovering coordinates included in the swinging process of the stylus.
[0175] In this implementation, as a specific embodiment, the ink can be related to or correspond to the trajectory of the stylus pen swung above the display screen, such as the same. Optionally, the trajectory of the stylus pen swung above the display screen can be determined based on the trajectory composed of one or more hovering coordinates contained in the stylus pen swinging process, such as the trajectory of the stylus pen swung above the display screen can be the trajectory composed of one or more hovering coordinates contained in the stylus pen swinging process. Exemplarily, as shown in FIG16 , taking the trajectory composed of one or more hovering coordinates contained in the stylus pen swinging process, such as trajectory 1700, the ink presented by the electronic device can be such as ink 1710.
[0176] In some embodiments, similar to the tapping operation scheme described above, the style of the ink mark can also be determined according to the style of the brush selected by the user. For the specific implementation, reference can be made to the relevant implementation described above.
[0177] In some embodiments, the style of the ink may also be determined by one or more parameters of the ink. In other words, the style of the ink may also be related to one or more parameters of the ink. Exemplarily, the style of the ink may include but is not limited to one or more of ink drop size, ink drop density, ink drop thickness, ink length, ink direction, etc. In this embodiment, as a possible implementation, the parameters of the ink may also be default or fixed. As another possible implementation, similar to the above-mentioned method of setting brush parameters, the user may also change the settings of one or more parameters of the ink through the running interface of the painting application.
[0178] In some embodiments, one or more parameters of the ink mark can also be determined based on one or more of the direction, amplitude, speed, and acceleration of the stylus swing, where the speed or acceleration of the swing can also be described as the force of the swing. In other words, the pattern of the ink mark is related to one or more of the direction, amplitude, speed, and acceleration of the stylus swing. This allows the user to swing the stylus in different directions, and / or forces, and / or amplitudes, enriching the user's interaction with the stylus. Furthermore, the rendered ink mark can be more diverse and more consistent with the effect of ink marks created using realistic ink-splashing techniques, i.e., the simulation effect is more realistic. Optionally, the amplitude of the stylus swing can be determined based on the distance the stylus is swung. The distance of the stylus swing can be determined based on the hovering coordinates included in the stylus swing process, such as the difference between the starting hovering coordinates and the ending hovering coordinates. The speed of the stylus swing can be determined based on the distance and duration of the stylus swing. The acceleration of the stylus swing can be detected by a sensor of the stylus (such as an accelerometer). It is understandable that the amplitude and speed of the swing of the stylus pen may be determined by the stylus pen or by an electronic device, and the embodiment of the present application does not impose any limitation on this.
[0179] As a specific embodiment, one or more parameters of the ink (such as the direction of the ink, the size of the ink droplets, the density of the ink droplets, the length (or length) of the ink mark, etc.) can be positively correlated with one or more of the amplitude, speed, acceleration, etc. of the swing of the stylus, and the direction of the ink mark is consistent with the swing direction of the stylus. For example: the larger the amplitude, speed, acceleration, etc. of the swing of the stylus, the larger the size of the ink droplets, and / or the greater the density of the ink droplets, and / or the thicker the ink droplets, and / or the longer the ink mark, etc. For example, as shown in (1) of Figure 17, when the stylus receives a swing operation and changes from state P1 to state P2 based on the swing operation, the ink mark presented is shown as ink mark 1800. As shown in (2) of Figure 17, when the stylus receives a swing operation and changes from state P3 to state P4, the ink mark presented is shown as ink mark 1810. Among them, in Figure 17 (1), the swing amplitude of the swing operation received by the stylus is smaller than the swing amplitude of the swing operation received by the stylus in Figure 17 (2). It can be seen that compared with ink 1800, the ink droplet size of ink 1810 is larger, the ink droplet density is greater, and the ink is longer.
[0180] Of course, in other embodiments, one or more parameters of the ink trace may be negatively correlated with one or more of the amplitude, speed, acceleration, etc. of the stylus swing, or may have a mapping relationship. For example, the length of the ink trace may have a fixed proportional relationship with the amplitude of the stylus swing. For this implementation, please refer to the relevant implementation described above.
[0181] In some other embodiments, one or more parameters of the ink trace may also be determined based on the hovering coordinates of the stylus during the swinging process. In other words, one or more parameters of the ink trace may also be related to the hovering coordinates of the stylus during the swinging process.
[0182] As a specific embodiment, the hovering coordinates during the swinging of the stylus pen include the starting hovering coordinates and the ending hovering coordinates. The starting hovering coordinates may refer to the hovering coordinates corresponding to when the stylus pen starts to swing, and the ending hovering coordinates may refer to the hovering coordinates corresponding to when the stylus pen ends to swing. The closer to the starting hovering coordinates, the greater the density of the ink droplets, and / or the larger the ink droplet size, and / or the thicker the ink droplets, etc. The closer to the ending hovering coordinates, the smaller the density of the ink droplets, and / or the smaller the ink droplet size, and / or the lighter the ink droplets, etc. For example, as shown in FIG18 , taking the starting hovering coordinates during the swinging of the stylus pen as point B and the ending hovering coordinates as point C as an example, the ink trace presented may be as shown in ink trace 1900. It can be seen that the closer to point B, the greater the density of the ink droplets, and the larger the ink droplet size. The closer to point C, the smaller the density of the ink droplets, and the smaller the ink droplet size, etc. In this way, the closer to the starting hovering coordinates, the greater the density of the ink droplets, and / or the larger the ink droplet size, and / or the thicker the ink droplets, so that the ink effect is closer to the effect of swinging a painting brush in a real ink-splashing scene, and the simulation effect is better.
[0183] Of course, in other embodiments, the closer to the end hovering coordinate, the greater the density of the ink droplets, and / or the larger the size of the ink droplets, and / or the thicker the ink droplets, etc., and the closer to the start hovering coordinate, the smaller the density of the ink droplets, and / or the smaller the size of the ink droplets, and / or the lighter the ink droplets, etc.
[0184] The above describes the process of drawing ink by tapping or swinging the stylus. In some other embodiments, the user can also perform a squeeze operation (also known as a pinch operation) on the stylus to draw ink, which is described below.
[0185] In some embodiments, as shown in (1) in FIG19A , the user performs a squeezing operation on the stylus. Optionally, the squeezing operation can be a single squeeze or multiple squeezes, and the embodiment of the present application does not impose any specific restrictions on the number of squeezes included in the squeezing operation. For example, the user can squeeze the pen shaft with multiple fingers to perform a squeezing operation on the stylus. In response to this operation, the stylus can recognize the squeezing event and then send the squeezing event to the electronic device. Similarly, the stylus can also recognize the squeezing event through various sensors (such as film sensors, etc.). Accordingly, when the electronic device recognizes the squeezing event, it presents ink in a preset area based on the squeezing event, such as the ink 19a shown in (2) in FIG19A . Optionally, the ink presented in this embodiment can also be a sheet of ink or a strip of ink. Regarding the introduction of the preset area and the implementation of the preset area when the electronic device cannot recognize the hovering coordinates of the stylus on the display screen, please refer to the relevant implementation under the tapping operation above.
[0186] In this way, the user can draw ink on the electronic device by squeezing the stylus, making the interaction between the stylus and the electronic device more diverse. In addition, the squeezing operation can simulate the interaction of a spray gun, improving the user experience.
[0187] In some embodiments, when the electronic device can obtain the hovering coordinates of the stylus on the display screen, the display area where the ink is presented, that is, the preset area, can also be determined based on the hovering coordinates of the stylus. In other words, the display area where the ink is presented is related to the hovering coordinates of the stylus above the electronic device display screen. Similarly, in this embodiment, the preset area can also be a display area of a preset size based on the hovering coordinates. For other implementations of this embodiment, please refer to the corresponding implementation under the tapping operation above.
[0188] In some embodiments, similar to the tapping operation scheme described above, the style of the ink mark can also be determined according to the style of the brush selected by the user. For the specific implementation, reference can be made to the relevant implementation described above.
[0189] In some embodiments, the ink pattern can also be determined based on one or more ink parameters. For example, the ink parameters may include, but are not limited to, one or more of ink drop size, ink drop density, ink drop thickness, and range. Similarly, in some implementations of this embodiment, the ink parameters can be default, or similar to the method for setting brush parameters described above, the user can also modify the settings of one or more ink parameters through the running interface of the painting application.
[0190] In other implementations, one or more parameters of the ink can also be determined based on the squeezing force of the squeezing operation. In this way, the user can perform different squeezing forces on the stylus, making the user's interaction with the stylus more diverse and the ink presentation effect richer. Similarly, the stylus can also detect the squeezing force through a sensor (such as a film sensor, a pressure sensor, etc.), and then send the detected squeezing force to the electronic device. The embodiments of the present application do not limit the method of detecting the squeezing force.
[0191] As a specific embodiment, one or more parameters of the ink mark may be positively correlated with the squeezing force, for example, the greater the squeezing force, the larger the ink droplet size, and / or the greater the ink droplet density, and / or the thicker the ink droplet, and / or the larger the range, etc. For example, when the squeezing force of the stylus is a, the ink mark displayed on the display screen may be as shown in ink mark 19a shown in (2) of FIG19A , and when the squeezing force of the stylus is b, b is greater than a, the ink mark displayed on the display screen may be as shown in ink mark 19b shown in FIG19B . It can be seen that compared with ink mark 19a, ink mark 19b has a larger ink droplet size, a higher density, and a larger range.
[0192] Similarly, in other embodiments, one or more parameters of the ink mark may be negatively correlated with the squeeze force. For example, the greater the squeeze force, the smaller the ink dot size, and / or the smaller the ink drop density, and / or the lighter the ink droplets, and / or the smaller the range, etc. Alternatively, the relationship between one or more parameters of the ink mark and the tapping force may satisfy a similar pre-set mapping relationship as described above in the tapping operation scenario.
[0193] In some other implementations, similar to the implementation of the tapping operation described above, the parameters of the ink trace can also be determined based on the orientation of the stylus tip, the hovering coordinates of the stylus, etc. For details on this specific implementation, please refer to the relevant implementations described above. It is understood that the relationship between the orientation of the stylus tip, the hovering coordinates of the stylus, and the parameters of the ink trace in the squeeze operation can be the same as or different from the relationship between the orientation of the stylus tip, the hovering coordinates of the stylus, etc. and the parameters of the ink trace in the tapping operation.
[0194] In some embodiments, when the user performs a squeeze operation on the stylus, the hovering position of the stylus on the electronic device display may not change, for example: the user fixes the stylus at a certain position on the electronic device display and performs one or more squeeze operations. In this embodiment, when the stylus receives a squeeze operation, the hovering coordinates of the stylus obtained by the electronic device may be fixed to one coordinate. For each squeeze operation, the electronic device can present the corresponding ink based on the scheme described above. It can be understood that the force of each squeeze operation may be the same or different. Optionally, the position of the ink droplets contained in the ink presented by each squeeze operation can be random, that is, the position of the ink droplets contained in the ink presented by different squeeze operations can be different. For example, (1) to (3) in Figure 19C respectively show schematic diagrams of the ink effects corresponding to one squeeze operation, two squeeze operations, and three squeeze operations. Optionally, in this embodiment, the ink can be a sheet of ink.
[0195] Similarly, when the user fixes the stylus pen at a certain position on the display screen of the electronic device and performs one or more tapping operations, the positions of the ink droplets contained in the ink presented for each tapping operation can also be random, that is, the positions of the ink droplets contained in the ink presented by different tapping operations can be different.
[0196] In other embodiments, when the user performs a squeezing operation on the stylus, the hovering position of the stylus on the electronic device display may change. For example, the user squeezes the stylus and moves the squeezed stylus on the electronic device display. In this embodiment, when the stylus receives the squeezing operation, the electronic device may obtain multiple coordinates of the hovering coordinates of the stylus. In this embodiment, the parameters of the ink can be presented based on the multiple hovering coordinates corresponding to the squeezing operation. Optionally, in this embodiment, the ink can follow the trajectory formed by these multiple hovering coordinates. For example, as shown in (1) in Figure 19D, when the user squeezes the stylus and moves the squeezed stylus from the hovering position corresponding to hovering coordinate 1 to the hovering position corresponding to hovering coordinate 2, the ink presented by the electronic device may be ink 19d as shown in (2) in Figure 19D. Optionally, in this embodiment, the ink can be a strip of ink. In this way, an interactive effect similar to dripping ink can be presented, making the interactive effect richer.
[0197] In some embodiments, the squeezing operation can also be applied to any position of the stylus, such as the tip, body, tail, or different positions of the body. The embodiments of the present application do not impose any specific restrictions on the position of the stylus on which the squeezing operation is applied. Regardless of where the user squeezes the stylus, the squeezing operation is considered to be the same squeezing operation. In other embodiments, squeezing operations applied to different positions of the stylus can be considered to be different squeezing operations. Similarly, in this embodiment, the style of the ink, the preset area, etc. can also be determined based on the squeezing operation.
[0198] It is understood that the above examples use tapping, swinging, and squeezing operations, which can be replaced by touch operations in other embodiments. Optionally, when the tapping, swinging, and squeezing operations are received while the stylus is suspended a certain distance above the electronic device display, the stylus and the electronic device display may not be in contact. In other words, the interaction is achieved through air with a certain distance between the stylus and the electronic device display, which can achieve a better interaction effect.
[0199] In some embodiments, before responding to the above-mentioned tap events, and / or swing events, and / or squeeze events, the drawing application in the electronic device needs to enable the function of responding to the tap events, and / or swing events, and / or squeeze events of the stylus. After enabling this function, when the tap events, and / or swing events, and / or squeeze events of the stylus are recognized, the drawing application will respond to the corresponding events and execute the corresponding ink drawing.
[0200] In some implementations, the function may be enabled by default. In other implementations, the function may be enabled by the user. For example, the electronic device may include a function enable control, and the user may enable the aforementioned function through the function enable control. For example, FIG19E shows an interface schematic diagram provided by an embodiment of the present application. As shown in FIG19E , the electronic device may display a running interface 810 of a drawing application, wherein the running interface 810 includes a function enable control 2000, and the user may perform operations such as enabling the function enable control 2000. In response to the user's operation, the electronic device may enable the drawing application to respond to tap events, and / or swing events, and / or squeeze events of the stylus. Of course, in other embodiments, the function enable control may also be located in other running interfaces of the drawing application, or other display interfaces of the electronic device, such as the running interface of the settings application. The embodiment of the present application does not impose specific limitations on this.
[0201] In some embodiments, a user can also use a handheld stylus to draw on an electronic device. In this embodiment, the user can move the stylus across the electronic device's display. During this movement, the electrodes in the stylus continuously transmit signals to the electronic device's display. Upon receiving the signals, the display identifies the coordinates of the stylus's hovering position on the display and, based on these sequentially occurring hovering coordinates, creates an ink trace, thereby generating a picture, such as the flower 19f shown in FIG19F .
[0202] In some embodiments, similar to the above scheme, the style of the ink can also be determined according to the style of the brush selected by the user. For example, (1) and (2) in Figure 19G respectively show schematic diagrams of drawings under different brush styles. The embodiment of the present application does not limit the way in which the user sets the brush style. For example, the user can set the brush style through the application interface shown above, or the user can set the brush style by adjusting the suspension distance between the stylus and the display screen.
[0203] In some embodiments, the ink pattern can also be determined based on one or more parameters of the ink. For example, the ink parameters can include, but are not limited to, one or more of ink droplet size, ink droplet density, and ink droplet thickness. Similarly, in this embodiment, the ink parameters can be default, or the user can modify these ink parameter settings through the application interface. Alternatively, the ink parameters can be determined based on one or more of the distance between the stylus and the display screen, the speed at which the stylus is moved while suspended on the display screen, and so on.
[0204] In some implementations, one or more parameters of the ink mark may be negatively correlated with the hovering distance. For example, the closer the hovering distance, the larger the ink droplet size, and / or the greater the ink droplet density, and / or the thicker the ink droplet. Of course, in other implementations, one or more parameters of the ink mark may be positively correlated with the hovering distance. For example, the farther the hovering distance, the larger the ink droplet size, and / or the greater the ink droplet density, and / or the thicker the ink droplet.
[0205] In some implementations, one or more parameters of the ink mark may be negatively correlated with the speed at which the stylus is moved while suspended on the display screen. For example, slower movement results in larger ink droplet size, greater ink droplet density, and / or thicker ink droplets. Alternatively, in other implementations, one or more parameters of the ink mark may be positively correlated with the distance from the display screen. For example, faster movement results in larger ink droplet size, greater ink droplet density, and / or thicker ink droplets.
[0206] Similarly, in this embodiment, the user can also enable the electronic device to respond to air drawing by means of a method such as that shown in FIG19E . When the user holds the stylus and moves it in the air above the display screen, the electronic device will respond to the user's operation and perform air drawing.
[0207] For example, FIG20A shows a flow chart of an interaction method provided in an embodiment of the present application. As shown in FIG20A , the method includes the following steps:
[0208] S2101: The stylus receives a target operation.
[0209] The target operation includes one of a tapping operation, a swinging operation, and a squeezing operation.
[0210] S2102: In response to the target operation, the stylus pen sends target information to the electronic device. Correspondingly, the electronic device receives the target information from the stylus pen.
[0211] The target information is generated based on the target operation. In some embodiments, taking the target operation as a tapping operation as an example, the target information may include information for characterizing at least one of a tapping event and a tapping force corresponding to the tapping operation. In other embodiments, taking the target operation as a swinging operation as an example, the target information may include information for characterizing at least one of a swinging event, a swinging force, a swinging amplitude, and a swinging direction corresponding to the swinging operation. In still other embodiments, taking the target operation as a squeezing operation as an example, the target information includes information for characterizing at least one of a squeezing event and a squeezing force corresponding to the squeezing operation.
[0212] S2103. In response to the target information, the electronic device displays ink according to the position of the stylus on the display screen.
[0213] In some embodiments, when the electronic device obtains the hovering coordinates of the stylus based on the position of the stylus on the display screen, the electronic device may display the ink in a target display area in response to the target information. The target display area may be related to the hovering coordinates of the stylus. For an introduction to the hovering coordinates of the stylus, please refer to the above description.
[0214] In other embodiments, when the electronic device fails to obtain the hovering coordinates based on the position of the stylus on the display screen, the electronic device may randomly present ink on the display screen in response to the target information.
[0215] In some implementations, the style of the ink can be determined by the parameters of the ink. In some embodiments, the first parameter of the ink (such as one or more of the ink color, ink drop size, and ink drop thickness) can be related to the style of the brush used by the stylus. In other embodiments, the second parameter of the ink (such as one or more of the ink range, ink length, ink direction, ink drop size, ink drop density, and ink drop thickness) can be related to the target operation received by the stylus. It will be understood that the aforementioned embodiment uses the example of the first parameter and the second parameter being different. In other implementations, the first parameter and the second parameter can also be the same.
[0216] For example, FIG20B shows a flow chart of another interaction method provided in an embodiment of the present application. As shown in FIG20B , the method includes the following steps:
[0217] S2201. Move the stylus pen above the display screen of the electronic device.
[0218] In which, a connection is established between the stylus pen and the electronic device. For the implementation of establishing the connection, please refer to the above description. In which, the distance between the stylus pen and the electronic device display screen is greater than the preset distance. It can be understood that the distance between the stylus pen and the electronic device display screen is greater than the preset distance, that is, the stylus pen is suspended and moved above the display screen, and there is no contact between the stylus pen and the electronic device display screen. The preset distance here may be different from the preset distance described above. The specific value of the preset distance can be set by the developer according to actual needs. Optionally, the stylus pen can be suspended and moved above the electronic device display screen based on user operation.
[0219] S2202. In response to the movement of the stylus pen, the electronic device displays ink on the display screen.
[0220] In some embodiments, in response to the movement of a stylus, the electronic device may obtain at least one hovering coordinate, which is the coordinate on the display screen corresponding to the stylus's movement above the display screen. The electronic device may then display ink on the display screen based on the at least one hovering coordinate. In other words, the ink displayed by the electronic device is correlated with the stylus's hovering coordinate. Alternatively, the trajectory of the stylus's hovering movement determines the stylus's hovering coordinate, so the ink displayed by the electronic device may also be correlated with the trajectory of the handwritten hovering movement.
[0221] Optionally, the electronic device may obtain at least one hovering coordinate based on the signal emitted by the stylus electrode. Optionally, because the electronic device's display screen may only receive the signal emitted by the stylus electrode when the distance between the stylus and the display screen is within a certain range, when the stylus moves above the electronic device's display screen, the distance between the stylus and the display screen may be greater than a preset distance and less than a preset distance a. The preset distance a is greater than the preset distance.
[0222] In some implementations, the style of the ink can also be determined by the parameters of the ink. In some embodiments, the first parameter of the ink (such as one or more of the ink color, ink drop size, and ink drop thickness) can be related to the style of the brush used by the stylus. In other embodiments, the third parameter of the ink (such as one or more of the ink drop size, ink drop density, and ink drop thickness) can be related to the distance between the stylus and the electronic device display. It will be understood that the aforementioned embodiments use the example of the first parameter and the third parameter being different. In other implementations, the first parameter and the third parameter can also be the same.
[0223] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of method. It is understandable that, in order to realize the above functions, the electronic device and / or stylus includes hardware structures and / or software modules corresponding to the execution of each function. In combination with the units and algorithm steps of each example described in the embodiments disclosed in this application, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer-driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present application.
[0224] The present application is an embodiment that can divide the functional modules of the electronic device and / or stylus according to the above method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.
[0225] As shown in Figure 21, it is a structural diagram of an electronic device 2200 provided in an embodiment of the present application. The electronic device 2200 can be used to implement the methods performed by the electronic devices recorded in the above various method embodiments. Exemplarily, the electronic device 2200 may specifically include: a processing unit 2201, a display unit 2202, and a communication unit 2203. Among them, the processing unit 2201 is used to support the electronic device 2200 to perform the processing function of the electronic device described in any one of Figures 1 to 20B. The display unit 2202 is used to support the electronic device 2200 to perform the display function of the electronic device described in any one of Figures 1 to 20B. The communication unit 2203 is used to support the electronic device 2200 to perform the communication function of the electronic device described in any one of Figures 1 to 20B.
[0226] Optionally, the electronic device 2200 shown in Figure 21 may further include a storage unit (not shown in Figure 21) that stores a program or instruction. When the processing unit 2201 executes the program or instruction, the electronic device 2200 shown in Figure 21 may perform the method shown in the above method embodiment.
[0227] As shown in Figure 22, a schematic diagram of the structure of a stylus 2300 provided in an embodiment of the present application is provided. The stylus 2300 can be used to implement the methods performed by the stylus as described in the above various method embodiments. For example, the stylus 2300 may specifically include: a processing unit 2301 and a communication unit 2302. The processing unit 2301 is used to support the stylus 2300 in performing the processing functions of the stylus described in any of Figures 1-20B. The communication unit 2302 is used to support the stylus 2300 in performing the communication functions of the stylus described in any of Figures 1-20B.
[0228] Optionally, the stylus pen 2300 shown in FIG22 may further include a storage unit (not shown in FIG22 ) storing a program or instruction. When the processing unit 2301 executes the program or instruction, the stylus pen 2300 shown in FIG22 may execute the method in the above method embodiment.
[0229] The technical effects of the devices shown in Figures 21 and 22 can refer to the technical effects described in the above method embodiments and will not be repeated here. The processing unit involved in Figures 21 and / or 22 can be implemented by a processor or processor-related circuit components, which can be a processor or processing module. The communication unit can be implemented by a transceiver or transceiver-related circuit components, which can be a transceiver or transceiver module. The display unit can be implemented by display-related components.
[0230] An embodiment of the present application also provides a chip system, as shown in Figure 23, which includes at least one processor 2401 and at least one interface circuit 2402. The processor 2401 and the interface circuit 2402 can be interconnected via lines. For example, the interface circuit 2402 can be used to receive signals from other devices. For another example, the interface circuit 2402 can be used to send signals to other devices (such as the processor 2401). Exemplarily, the interface circuit 2402 can read instructions stored in the memory and send the instructions to the processor 2401. When the instructions are executed by the processor 2401, the device can execute the various steps performed by the electronic device or stylus in the above embodiments. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiments of the present application.
[0231] Optionally, there may be one or more processors in the chip system. The processor may be implemented in hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.
[0232] Optionally, the memory in the chip system may be one or more memories. The memory may be integrated with the processor or may be provided separately from the processor, which is not limited in this application. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or provided on different chips. This application does not specifically limit the type of memory or the configuration of the memory and the processor.
[0233] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.
[0234] It should be understood that each step in the above method embodiment can be completed by hardware integrated logic circuits in a processor or by software instructions. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.
[0235] An embodiment of the present application further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on a device, the device executes the method described in the above method embodiment.
[0236] An embodiment of the present application provides a computer program product, which includes: a computer program or instructions, which, when executed on a computer, causes the computer to execute the method described in the above method embodiment.
[0237] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the device to execute the methods in the above-mentioned method embodiments.
[0238] Among them, the equipment, computer storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0239] The above content is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.
Claims
1. An interactive method, characterized in that: Applied to a system including an electronic device and a stylus, the electronic device being configured with a display screen, the electronic device and the stylus being connected, the method comprising: The stylus receives a target operation, where the target operation includes one of a tapping operation, a swinging operation, and a squeezing operation; In response to the target operation, the stylus sends target information to the electronic device, where the target information is generated based on the target operation; In response to the target information, the electronic device displays ink according to the position of the stylus on the display screen.
2. The method according to claim 1, characterized in that The target operation is a tapping operation, and the target information includes information for representing at least one of a tapping event and a tapping force corresponding to the tapping operation; Alternatively, the target operation is a squeeze operation, and the target information includes information for representing at least one of a squeeze event and a squeeze force corresponding to the squeeze operation; Alternatively, the target operation is a swing operation, and the target information includes information for representing at least one of a swing event, a swing force, a swing amplitude, and a swing direction corresponding to the swing operation.
3. The method according to claim 1 or 2, characterized in that The target operation is a tapping operation or a squeezing operation, and the ink mark is a sheet-shaped ink mark; or the target operation is a swinging operation, and the ink mark is a strip-shaped ink mark.
4. The method according to any one of claims 1 to 3, characterized in that In response to the target information, the electronic device displays ink according to the position of the stylus on the display screen, including: When the electronic device obtains the hovering coordinates based on the position of the stylus on the display screen, the electronic device displays the ink in a target display area in response to the target information. The target display area is related to the hovering coordinates. The hovering coordinates refer to the coordinates on the display screen corresponding to when the stylus hovers on the display screen to receive the target operation.
5. The method according to any one of claims 1 to 3, characterized in that In response to the target information, the electronic device displays ink according to the position of the stylus on the display screen, including: When the electronic device fails to obtain the hovering coordinates based on the position of the stylus on the display screen, the electronic device randomly displays the ink on the display screen in response to the target information, where the hovering coordinates refer to the coordinates on the display screen corresponding to when the stylus is hovered on the display screen to receive the target operation.
6. The method according to any one of claims 1 to 5, characterized in that The ink is composed of multiple ink drops. The first parameter of the ink is related to the style of the brush used by the stylus pen. The first parameter includes one or more of ink color, ink drop size, and ink drop thickness.
7. The method according to any one of claims 1 to 5, characterized in that The ink is composed of multiple ink drops, and the second parameter of the ink is related to the target operation. The second parameter includes one or more of ink range, ink length, ink direction, ink drop size, ink drop density, and ink drop thickness.
8. The method according to claim 7, characterized in that The target operation is a tapping operation, the parameters of the tapping operation include a tapping force, and at least one of an ink range, an ink droplet size, an ink droplet density, and an ink droplet thickness of the ink is positively correlated with the tapping force; Alternatively, the target operation is a squeeze operation, the parameters of the squeeze operation include squeeze force, and at least one of the ink range, ink drop size, ink drop density, and ink drop thickness of the ink is positively correlated with the squeeze force; Alternatively, the target operation is a swinging operation, the parameters of the swinging operation include at least one of the swinging amplitude and the swinging force, and at least one of the ink length, ink droplet size, ink droplet density, and ink droplet thickness of the ink is positively correlated with at least one of the swinging amplitude and the swinging force.
9. The method according to claim 7 or 8, characterized in that The target operation is a swing operation, and the ink direction of the ink is the same as the swing direction of the swing operation.
10. The method according to any one of claims 7 to 9, characterized in that One or more of the ink length, ink drop size, ink drop density, and ink drop thickness of the ink is related to the hovering coordinates, and the hovering coordinates refer to the coordinates on the display screen corresponding to when the stylus hovers on the display screen to receive the target operation.
11. The method according to claim 10, characterized in that The target operation is a tap operation or a squeeze operation, the ink includes a first ink mark and a second ink mark, the distance between the first ink mark and the hovering coordinate is smaller than the distance between the second ink mark and the hovering coordinate, the ink droplet size of the first ink mark is larger than the ink droplet size of the second ink mark, and / or the ink droplet density of the first ink mark is greater than the ink droplet density of the second ink mark, and / or the ink droplet thickness of the first ink mark is greater than the ink droplet thickness of the second ink mark.
12. The method according to claim 10, characterized in that The target operation is a swing operation, the hovering coordinates include a first hovering coordinate, the first hovering coordinate is the hovering coordinate when the stylus receives the swing operation and starts to swing, the ink includes a third ink mark and a fourth ink mark, the distance between the third ink mark and the first hovering coordinate is smaller than the distance between the fourth ink mark and the first hovering coordinate, the ink droplet size of the third ink mark is larger than the ink droplet size of the fourth ink mark, and / or the ink droplet density of the third ink mark is greater than the ink droplet density of the fourth ink mark, and / or the ink droplet thickness of the third ink mark is greater than the ink droplet thickness of the fourth ink mark.
13. The method according to any one of claims 1 to 12, characterized in that Before the stylus sends target information to the electronic device in response to the target operation, the method further includes: The electronic device displays a running interface of a first application, and the stylus is used for drawing on the running interface.
14. An interactive method, characterized in that: Applied to an electronic device including a display screen, the electronic device being connected to a stylus, the method comprising: receiving target information from the stylus, where the target information is generated based on a target operation on the stylus, the target operation comprising one of a tapping operation, a swinging operation, and a squeezing operation; In response to the target information, ink is displayed according to the position of the stylus on the display screen.
15. The method according to claim 14, characterized in that The target operation is a tapping operation, and the target information includes information for representing at least one of a tapping event and a tapping force corresponding to the tapping operation; Alternatively, the target operation is a squeeze operation, and the target information includes information for representing at least one of a squeeze event and a squeeze force corresponding to the squeeze operation; Alternatively, the target operation is a swing operation, and the target information includes information for representing at least one of a swing event, a swing force, a swing amplitude, and a swing direction corresponding to the swing operation.
16. An interactive method, characterized in that: Applied to a stylus pen, the stylus pen is connected to an electronic device, and the method includes: receiving a target operation, wherein the target operation includes one of a tapping operation, a swinging operation, and a squeezing operation; In response to the target operation, target information is sent to the electronic device, where the target information is used by the electronic device to display ink according to the position of the stylus on the display screen of the electronic device.
17. The method according to claim 16, characterized in that The target operation is a tapping operation, and the target information includes information for representing at least one of a tapping event and a tapping force corresponding to the tapping operation; Alternatively, the target operation is a squeeze operation, and the target information includes information for representing at least one of a squeeze event and a squeeze force corresponding to the squeeze operation; Alternatively, the target operation is a swing operation, and the target information includes information for representing at least one of a swing event, a swing force, a swing amplitude, and a swing direction corresponding to the swing operation.
18. An interactive method, characterized in that: Applied to a system including an electronic device and a stylus, the electronic device being configured with a display screen, the electronic device and the stylus being connected, the method comprising: The stylus moves above the display screen, and the distance between the stylus and the display screen is greater than a preset distance; In response to movement of the stylus, the electronic device displays ink on the display screen.
19. The method according to claim 18, characterized in that The electronic device displaying ink on the display screen in response to the movement of the stylus pen comprises: In response to the movement of the stylus, the electronic device acquires at least one hovering coordinate, where the hovering coordinate is a coordinate on the display screen corresponding to the movement of the stylus above the display screen; The electronic device displays ink on the display screen based on the at least one hovering coordinate.
20. The method according to claim 19, characterized in that The electronic device acquires at least one hovering coordinate, including: The electronic device obtains the at least one hovering coordinate based on the signal emitted by the stylus electrode.
21. The method according to any one of claims 18 to 20, characterized in that The ink is composed of multiple ink drops. The first parameter of the ink is related to the style of the brush used by the stylus pen. The first parameter includes one or more of ink color, ink drop size, and ink drop thickness.
22. The method according to any one of claims 18 to 21, characterized in that The ink mark is composed of multiple ink droplets. The third parameter of the ink mark is related to the distance between the stylus and the display screen. The third parameter includes one or more of ink droplet size, ink droplet density, and ink droplet thickness.
23. The method according to claim 22, characterized in that One or more of the ink drop size, ink drop density, and ink drop thickness of the ink is negatively correlated with the distance between the stylus and the display screen.
24. An interactive method, characterized in that: Applied to a display screen comprising an electronic device, wherein the electronic device is connected to a stylus pen, the method comprises: Acquire at least one hovering coordinate, where the hovering coordinate is a coordinate on the display screen corresponding to the stylus pen moving above the display screen; In response to the at least one hover coordinate, ink is displayed on the display screen.
25. An electronic device, characterized in that: The electronic device comprises a processor, a memory, a communication interface and a display screen, wherein the memory, the communication interface and the display screen are coupled to the processor, the communication interface is used to communicate with other devices, the memory is used to store computer program code, and the computer program code includes computer instructions. The processor reads the computer instructions from the memory to enable the electronic device to execute the method executed by the electronic device as described in any one of claims 1 to 13, or to execute the method as described in any one of claims 14 to 15, or to execute the method executed by the electronic device as described in any one of claims 18 to 23, or to execute the method as described in claim 24.
26. A stylus pen, characterized in that: The present invention comprises a processor, a memory and a communication interface, wherein the memory and the communication interface are coupled to the processor, the communication interface is used to communicate with other devices, the memory is used to store computer program code, and the computer program code includes computer instructions. The processor reads the computer instructions from the memory to enable the stylus to execute the method executed by the stylus according to any one of claims 1 to 13, or the method executed by the stylus according to any one of claims 16 to 17, or the method executed by the stylus according to any one of claims 18 to 23.
27. A computer-readable storage medium, characterized in that The computer-readable storage medium includes a computer program or instructions, which, when the computer program or instructions are run on an electronic device, causes the electronic device to execute the method executed by the electronic device as described in any one of claims 1-13, or the method as described in any one of claims 14-15, or the method executed by the electronic device as described in any one of claims 18-23, or the method as described in claim 24; or, when the computer program or instructions are run on a stylus, causes the stylus to execute the method executed by the stylus as described in any one of claims 1-13, or the method as described in any one of claims 16-17, or the method executed by the stylus as described in any one of claims 18-23.
28. A computer program product, characterized in that When the computer program product is run on a computer, the computer can execute the method performed by the electronic device as described in any one of claims 1-13, or the method as described in any one of claims 14-15, or the method performed by the electronic device as described in any one of claims 18-23, or the method as described in claim 24, or the computer can execute the method performed by the stylus as described in any one of claims 1-13, or the method as described in any one of claims 16-17, or the method performed by the stylus as described in any one of claims 18-23.
29. An interactive system, characterized in that The invention comprises an electronic device and a stylus, wherein the electronic device is used to execute the method executed by the electronic device as described in any one of claims 1-13, and the stylus is used to execute the method executed by the stylus as described in any one of claims 1-13, or the electronic device is used to execute the method executed by the electronic device as described in any one of claims 18-23, and the stylus is used to execute the method executed by the stylus as described in any one of claims 18-23.
Citation Information
Patent Citations
Interaction method, handwriting pen and electronic equipment
CN119002758A
Input method and device for handwriting pen
CN102799286A
Mobile terminal, input operation method thereof and computer storage medium
CN111459343A
Display method and device, electronic equipment and storage medium
CN113360031A
Handwriting input device
CN219958189U