Data processing method and electronic equipment

Abstract

The invention discloses a data processing method and electronic equipment, and the method comprises the steps: carrying out the splitting and conversion processing of target three-dimensional motion data generated by target input equipment in response to a target triggering event, and obtaining a plurality of two-dimensional coordinate sets; generating the plurality of two-dimensional coordinate sets to obtain a plurality of two-dimensional track data; the two-dimensional trajectory data is identified to generate target input data corresponding to the target three-dimensional motion data.

Description

Technical Field

[0001] The present application relates to the field of data processing, and in particular to a data processing method and electronic equipment. Background Art

[0002] Some electronic devices can support writing input operations. The device can obtain the movement trajectory of relevant objects (such as fingers, styluses, etc.) moving on the device surface through relevant detection modules, identify the obtained movement trajectory to obtain corresponding input data, for example, identify the movement trajectory to obtain the corresponding character.

[0003] The movement trajectories of objects on the device surface may overlap. When the movement trajectories overlap, current devices cannot correctly identify the obtained movement trajectories and thus cannot obtain correct input data. Summary of the Invention

[0004] To this end, this application discloses the following technical solutions:

[0005] The first aspect of the present application provides a data processing method, comprising:

[0006] In response to a target triggering event, the target three-dimensional motion data generated by the target input device is split and converted to obtain a plurality of two-dimensional coordinate sets;

[0007] Performing generation processing on the plurality of two-dimensional coordinate sets to obtain a plurality of two-dimensional trajectory data;

[0008] The two-dimensional trajectory data is identified to generate target input data corresponding to the target three-dimensional motion data.

[0009] Optionally, the step of splitting and converting the target three-dimensional motion data generated by the target input device includes:

[0010] splitting the target three-dimensional motion data based on the operation behavior data of the operator of the target input device to obtain a plurality of three-dimensional coordinate sets;

[0011] The three-dimensional coordinate sets are converted into corresponding two-dimensional coordinate sets based on the posture data of the operating body.

[0012] Optionally, the step of splitting and converting the target three-dimensional motion data generated by the target input device includes:

[0013] Converting the target three-dimensional motion data based on the pose data of the operating body of the target input device to obtain a target two-dimensional coordinate set;

[0014] The target two-dimensional coordinate set is split based on the operation behavior data of the operating body to obtain a plurality of two-dimensional coordinate sets.

[0015] Optionally, the splitting of the target three-dimensional motion data based on the operation behavior data of the operating object of the target input device includes:

[0016] Determine a movement start position, a movement end position, and a movement interval duration of the target input device based on the operation behavior data;

[0017] Splitting the target three-dimensional motion data into a plurality of three-dimensional coordinate sets based on a target splitting condition, wherein the target splitting condition includes that the target input device returns from a motion end position to a motion start position and the resulting motion interval duration is greater than a first threshold;

[0018] and / or,

[0019] The converting of the plurality of three-dimensional coordinate sets into corresponding two-dimensional coordinate sets based on the posture data of the operating body includes:

[0020] Determining relative position information between a motion plane of the target input device and an input surface of the electronic device based on the posture data;

[0021] The three-dimensional coordinate sets are transformed using the direction cosine matrix corresponding to the relative position information to obtain corresponding two-dimensional coordinate sets.

[0022] Optionally, the step of splitting the target three-dimensional motion data generated by the target input device includes:

[0023] Analyzing target characteristic parameters of the trajectory generated by the target three-dimensional motion data;

[0024] Determining split points of the trajectory based on the target feature parameters;

[0025] The target three-dimensional motion data is split into a plurality of three-dimensional coordinate sets based on the splitting points.

[0026] Optionally, at least one of the following is also included:

[0027] encapsulating data units obtained by splitting the target three-dimensional motion data to obtain the three-dimensional coordinate set;

[0028] Deleting the three-dimensional motion data generated when the target input device returns from the motion end position to the motion start position;

[0029] The target three-dimensional motion data is split and processed based on the target operation of the operating body acting on the target input device, and the target operation includes at least one of operating the target input device to input a target symbol, changing the input parameters of the target input device, and changing the display parameters or operating parameters of the electronic device.

[0030] Optionally, the generating process of the plurality of two-dimensional coordinate sets includes at least one of the following:

[0031] Obtaining attribute information of the target input device, and performing trajectory smoothing processing and path connection processing on the plurality of two-dimensional coordinate sets using a processing model corresponding to the attribute information to obtain corresponding two-dimensional trajectory data;

[0032] Obtaining application information of a target application running on the electronic device, and performing trajectory smoothing processing and path connection processing on the plurality of two-dimensional coordinate sets using a target processing model to obtain two-dimensional trajectory data matching the application information;

[0033] Font information specified by the operating body is obtained, and the plurality of two-dimensional coordinate sets are generated based on the font information to obtain a plurality of two-dimensional trajectory data matching the font information.

[0034] Optionally, the identifying the two-dimensional trajectory data to generate target input data corresponding to the target three-dimensional motion data includes at least one of the following:

[0035] Inputting the two-dimensional trajectory data into a first processing model for generation processing to generate at least one of target character string data, target graphic data, and target expression data;

[0036] The two-dimensional trajectory data is input into a second processing model associated with a target application running on the electronic device for generation processing to generate target control instruction data. The target application is an application configured to respond to input data generated by the target input device.

[0037] Optionally, the target triggering event is generated from at least one of the following:

[0038] The sensor of the target input device obtains three-dimensional motion data;

[0039] Establishing a communication connection with the target input device and running a target application corresponding to the target input device;

[0040] There is overlap between character data and / or image data generated by the target input device.

[0041] A second aspect of the present application provides an electronic device, comprising at least one processor and at least one processing model capable of running on the processor, wherein the processing model can be called by a target application to perform at least one of the following:

[0042] In response to a target triggering event, the target three-dimensional motion data generated by the target pen device is split and converted to obtain a plurality of two-dimensional coordinate sets;

[0043] Performing generation processing on the plurality of two-dimensional coordinate sets to obtain a plurality of two-dimensional handwriting data;

[0044] The two-dimensional handwriting data is recognized to generate at least one of target character string data, target graphic data, target expression data, and target control instruction data corresponding to the target three-dimensional motion data. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without any creative work.

[0046] Figure 1 This is a flow chart of a data processing method provided by an embodiment of the present application;

[0047] Figure 2 is a schematic diagram of a two-dimensional coordinate set provided in an embodiment of the present application;

[0048] Figure 3 is a schematic diagram of a posture of a target input device provided in an embodiment of the present application;

[0049] Figure 4 is a schematic diagram of another posture of a target input device provided in an embodiment of the present application;

[0050] Figure 5 is a schematic diagram of a posture of another target input device provided in an embodiment of the present application;

[0051] Figure 6 Schematic diagram of a movement starting position and a movement ending position provided in an embodiment of the present application;

[0052] Figure 7 is a schematic diagram of a trajectory range provided in an embodiment of the present application;

[0053] Figure 8 This is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0055] This embodiment provides a data processing method, see Figure 1 , is a flowchart of the method, which may include the following steps.

[0056] S101 , in response to a target triggering event, splitting and converting target three-dimensional motion data generated by a target input device to obtain a plurality of two-dimensional coordinate sets.

[0057] The execution subject of the data processing method of this embodiment can be any electronic device that supports writing operations, including but not limited to mobile phones, computers, tablet computers and other electronic devices.

[0058] A target trigger event may be an event generated by an electronic device when certain conditions are met, and is used to trigger the execution of the method of this embodiment. The conditions for generating a target trigger event may be pre-set and may include one or more conditions. The electronic device may generate a target trigger event when any of these conditions is met.

[0059] The target input device is an input device that is communicatively connected to the electronic device and can be used to perform writing operations. The target input device can be a wearable device, such as a ring-like device that can be worn on a user's finger, or a handheld device, such as a writing pen, stylus, mouse, or controller.

[0060] The three-dimensional motion data of the target input device can represent the coordinate changes of the target input device in three-dimensional space. For example, the three-dimensional motion data can be the three-dimensional coordinate change data of the target input device. The target input device can have a sensor capable of detecting three-dimensional motion data, such as a six-axis sensor. The six-axis sensor can detect the linear acceleration and angular velocity of the target input device in three-dimensional space, and the target input device can obtain three-dimensional motion data based on this data.

[0061] When the target input device moves, the target input device can use the above sensors to detect its own three-dimensional motion data, and transmit the three-dimensional motion data to the electronic device through the communication connection between the target input device and the electronic device.

[0062] The communication connection between the target input device and the electronic device can be a wireless connection, such as a Bluetooth connection between a writing pen and a tablet computer, or a wired connection, such as a data cable connection between a handle and a computer, and between a mouse and a computer.

[0063] The target three-dimensional motion data may include the three-dimensional motion data continuously generated by the target input device after the target trigger event is generated, or the three-dimensional motion data continuously generated by the target input device before the target trigger event is generated, or both.

[0064] In S101, the order of the splitting process and the conversion process is not limited, that is, the splitting process may be performed first and then the conversion process, or the conversion process may be performed first and then the splitting process.

[0065] After the splitting and conversion processes, one or more two-dimensional coordinate sets corresponding to the target three-dimensional motion data can be obtained. Each two-dimensional coordinate set can include multiple two-dimensional coordinate data. For each two-dimensional coordinate set, the multiple two-dimensional coordinate data contained in the set can represent a specific character or a specific graphic element.

[0066] As some examples, a set of two-dimensional coordinates may contain Figure 2 (1) shows a plurality of two-dimensional coordinate data representing a specific character, and each black circle in the figure represents a two-dimensional coordinate data.

[0067] S102 , generating and processing a plurality of two-dimensional coordinate sets to obtain a plurality of two-dimensional trajectory data.

[0068] In step S102 , a generation process may be performed on each two-dimensional coordinate set to obtain two-dimensional trajectory data corresponding to the two-dimensional coordinate set.

[0069] The two-dimensional trajectory data may be ink data used to encapsulate the two-dimensional trajectory and its shape in a standardized format, or data in other formats capable of representing the two-dimensional trajectory.

[0070] Generating a two-dimensional coordinate set may include performing trajectory smoothing and path connection processing on the two-dimensional coordinate set. Trajectory smoothing refers to smoothing the multiple two-dimensional coordinate data contained in the two-dimensional coordinate set, identifying and removing noisy and irregular two-dimensional coordinate data, and ensuring that the two-dimensional trajectory represented by the generated two-dimensional trajectory data has good smoothness. Path connection refers to connecting the remaining multiple two-dimensional coordinate data in the set based on a certain algorithm or model to form a curve representing the two-dimensional trajectory.

[0071] For each two-dimensional coordinate set, the two-dimensional trajectory data corresponding to the set can be stored in the form of Bezier curve data, or can be stored in other vector representation forms to ensure that the process of identifying the two-dimensional trajectory data can be carried out efficiently.

[0072] As some examples, Figure 2 After the two-dimensional coordinate set shown in (1) is generated, we can obtain Figure 2 The two-dimensional trajectory shown in (2).

[0073] S103 , identifying the two-dimensional trajectory data to generate target input data corresponding to the target three-dimensional motion data.

[0074] In step S103 , each two-dimensional trajectory data may be identified to obtain target input data corresponding to the target three-dimensional motion data.

[0075] The target input data may be a single character or a string of multiple characters. In this case, the target input data may be generated by the electronic device comparing the two-dimensional trajectory data with pre-stored trajectories of each character, determining the character corresponding to each two-dimensional trajectory data, and obtaining the string corresponding to the target three-dimensional motion data.

[0076] The target input data may also include multiple expressions, with each two-dimensional trajectory data corresponding to one expression. In this case, the target input data may be generated by the electronic device comparing the two-dimensional trajectory data with the expression pattern to determine the expression corresponding to each two-dimensional trajectory data.

[0077] The target input data may also include graphic data, and the shape represented by the graphic data may be consistent with the shape of the two-dimensional trajectory corresponding to the two-dimensional trajectory data.

[0078] The target input data may also be a control instruction for controlling the electronic device to perform a specific operation. In this case, the target input data may be generated by configuring a trigger pattern for triggering a number of control instructions based on user operations. After obtaining the two-dimensional trajectory data, the electronic device compares the two-dimensional trajectory data with the pre-configured trigger pattern and determines the control instruction corresponding to the successfully matched trigger pattern as the target input data.

[0079] The beneficial effects of this embodiment are:

[0080] On the one hand, the method of this embodiment can obtain corresponding target input data based on the target three-dimensional motion data of the target input device, so that the operator performing the writing operation can perform the writing operation without moving the target input device on the surface of a specific device, thereby improving the convenience of the writing operation;

[0081] On the other hand, by splitting the target three-dimensional motion data, this embodiment can divide the overlapping two-dimensional trajectories into several parts, so that even when the two-dimensional trajectories overlap, accurate target input data can be identified.

[0082] Optionally, the target triggering event is generated from at least one of the following:

[0083] The sensor of the target input device obtains three-dimensional motion data;

[0084] Establishing a communication connection with the target input device and running a target application corresponding to the target input device;

[0085] There is overlap between character data and / or image data generated by the target input device.

[0086] In the first case of generating a target trigger event, the sensor can start outputting three-dimensional motion data when the target input device is moved. When the electronic device obtains the three-dimensional motion data output by the sensor, it can be determined that the user is using the target input device to perform a writing operation at this time. Therefore, a target trigger event can be obtained, so as to obtain the target input data corresponding to the target three-dimensional motion data according to the method of the aforementioned embodiment.

[0087] In this case, the target 3D motion data may include all 3D motion data output by the sensor after the target trigger event is obtained and until the target input device stops moving. The cessation of movement of the target input device can be determined by the sensor stopping outputting 3D motion data.

[0088] In the second case of generating a target trigger event, the target application may be any application pre-installed on the electronic device that is capable of processing target input data, such as a drawing application, a text editing application, an instant messaging application, and the like.

[0089] If the electronic device establishes a communication connection with the target input device while running these target applications, or starts running these target applications after establishing a communication connection with the target input device, the electronic device can obtain a target trigger event so as to process the target three-dimensional motion data according to the method of the aforementioned embodiment to obtain corresponding target input data.

[0090] In this case, the target three-dimensional motion data may include all three-dimensional motion data output by the sensor during a period from when the target trigger event is obtained to when the target input device stops moving.

[0091] In the third scenario where a target trigger event is generated, when a target input device moves on a specific surface of an electronic device (e.g., a screen), the electronic device can obtain a certain amount of two-dimensional coordinate data generated by the target input device's movement. After the target input device begins to move, the electronic device can determine whether the currently obtained two-dimensional coordinate data overlaps with the two-dimensional coordinate data previously obtained after the target input device began moving. If, at a certain moment after the target input device has moved for a certain period of time, the electronic device determines that the currently obtained two-dimensional coordinate data is the same as the two-dimensional coordinate data previously obtained, then the currently obtained two-dimensional coordinate data can be determined to overlap with the previously obtained two-dimensional coordinate data, and a target trigger event can be generated.

[0092] Alternatively, the electronic device may also determine that the three-dimensional motion data of the target input device overlap when the distance between two three-dimensional motion data is less than or equal to a set distance threshold during the movement of the target input device, that is, when the following formula (1) is satisfied, thereby obtaining a target trigger event.

[0093]

[0094] Among them, (X1, Y1, Z1) and (X2, Y2, Z2) represent two three-dimensional motion data, d() represents the distance between the two, D threshold Indicates the distance threshold.

[0095] In this case, the target three-dimensional motion data may only include the part of the three-dimensional motion data that may be covered by the corresponding two-dimensional trajectory, that is, only include the three-dimensional motion data of the target input device obtained during the period from the start of the target input device moving to the acquisition of the target trigger event; it may also include the three-dimensional motion data before and after the acquisition of the target trigger event, that is, include all three-dimensional motion data during the period from the start of the target input device moving to the stop of moving.

[0096] Based on the above multiple ways of generating target trigger events, electronic devices can apply the data processing method of the aforementioned embodiment to process target three-dimensional motion data in various scenarios where target input devices are used to perform writing operations, so as to meet the user's needs for writing operations in various usage scenarios.

[0097] Optionally, the target three-dimensional motion data generated by the target input device is split and converted, including:

[0098] The target three-dimensional motion data is split based on the operation behavior data of the operator of the target input device to obtain a plurality of three-dimensional coordinate sets;

[0099] Based on the pose data of the operating body, several three-dimensional coordinate sets are converted into corresponding two-dimensional coordinate sets.

[0100] The operator of the target input device can be regarded as a user who currently uses the target input device to perform a writing operation.

[0101] The operation behavior data may include one or more types of data that can represent the operation behavior of the operating body on the target input device.

[0102] As some examples, the operation behavior data may include any one or more of pause duration data, movement acceleration change data, movement speed change data, movement direction change data, and plane change data.

[0103] The pause duration data indicates the duration that the target input device stays at the same position. The electronic device can determine the pause duration data based on the obtained three-dimensional motion data and the corresponding timestamp. For example, if the three-dimensional motion data obtained by the electronic device from time T0 to time T1 corresponds to the same three-dimensional space coordinate, it can be determined that the target input device paused at this three-dimensional space coordinate for a duration of T1-T0.

[0104] The mobile acceleration change data represents the acceleration change amplitude of the target input device within a certain period of time. The sensor of the target input device can output the mobile acceleration data of the target input device. The electronic device can obtain the mobile acceleration change data of the target input device based on the mobile acceleration data at different times.

[0105] The movement direction change data indicates whether the movement direction of the target input device has changed. The sensor of the target input device can output the movement acceleration data of the target input device in different directions. Therefore, the electronic device can determine the movement direction of the target input device at the corresponding moment based on the direction of the movement acceleration data output by the sensor at any moment, thereby determining whether the movement direction of the target input device has changed.

[0106] The plane change data may indicate whether the plane of the target input device has changed and the magnitude of the change. For example, if the target input device is a writing pen, the plane change data may indicate whether the plane of the pen tip has changed and the magnitude of the change.

[0107] The plane where the target input device is located can be determined based on the three-dimensional motion data. For example, the electronic device can obtain the three-dimensional motion data generated by the target input device over a period of time, and determine the plane formed by these three-dimensional motion data in the three-dimensional space as the plane where the target input device is located during this period of time.

[0108] When splitting, the electronic device can determine several three-dimensional motion data as three-dimensional splitting points from the multiple three-dimensional motion data contained in the target three-dimensional motion data based on the operation behavior data, and split the target three-dimensional motion data into several parts based on these three-dimensional splitting points, each of which can be used as a three-dimensional coordinate set.

[0109] Exemplarily, the target three-dimensional motion data includes 100 three-dimensional motion data obtained in chronological order. Assuming that two three-dimensional splitting points are determined, the electronic device can treat the three-dimensional motion data from the first three-dimensional motion data to the first three-dimensional splitting point and the three-dimensional motion data in between as a three-dimensional coordinate set, the three-dimensional motion data from the first three-dimensional splitting point to the second three-dimensional splitting point and the three-dimensional motion data in between as a three-dimensional coordinate set, and the three-dimensional motion data from the second three-dimensional splitting point to the last three-dimensional motion data and the three-dimensional motion data in between as a three-dimensional coordinate set.

[0110] The posture data of the operating body can be represented by the posture data of the target input device. The posture data of the target input device can be detected by a sensor built into the target input device for detecting the posture of the device, such as an accelerometer or a gyroscope. As some examples, when the target input device is used to perform a writing operation, the target input device can be in Figure 3 The posture shown, or in Figure 4 The posture shown, or in Figure 5 The posture shown.

[0111] The posture of the target input device can be related to the current posture of the operator. For example, when the operator is in a standing posture or a squatting posture, the target input device can generally be in a Figure 3 When the operator is in a sitting or prone position, the target input device can generally be in Figure 4 When the operator is in a supine position, the target input device can generally be in Figure 5 The posture shown.

[0112] When performing the conversion, the electronic device can determine the appropriate input surface of the electronic device based on the above-mentioned posture data, and then, for each three-dimensional coordinate set, convert each three-dimensional motion data contained in the three-dimensional coordinate set into two-dimensional coordinate data on the input surface, thereby obtaining a two-dimensional coordinate set.

[0113] Optionally, splitting and converting the target three-dimensional motion data generated by the target input device may also include:

[0114] The target three-dimensional motion data is converted based on the pose data of the operating body of the target input device to obtain a target two-dimensional coordinate set;

[0115] The target two-dimensional coordinate set is split based on the operation behavior data of the operator to obtain several two-dimensional coordinate sets.

[0116] During the conversion process, the input surface of the electronic device can be determined based on the posture data, and then each three-dimensional motion data in the target three-dimensional motion data can be converted into two-dimensional coordinate data on the input surface, thereby obtaining a two-dimensional coordinate set composed of two-dimensional coordinate data.

[0117] When performing splitting processing, the electronic device can determine several two-dimensional coordinate data as two-dimensional splitting points from the multiple two-dimensional coordinate data contained in the target two-dimensional coordinate set based on the operation behavior data, and split the target two-dimensional coordinate set into several two-dimensional coordinate sets based on these two-dimensional splitting points.

[0118] Exemplarily, the target three-dimensional motion data includes 100 three-dimensional motion data obtained in chronological order, and 100 two-dimensional coordinate data arranged in chronological order can be obtained through conversion processing, wherein two two-dimensional splitting points are determined, and the electronic device can treat the first two-dimensional coordinate data to the first two-dimensional splitting point and the two-dimensional coordinate data in between as a two-dimensional coordinate set, the first two-dimensional splitting point to the second two-dimensional splitting point and the two-dimensional coordinate data in between as a two-dimensional coordinate set, and the second two-dimensional splitting point to the last two-dimensional coordinate data and the two-dimensional coordinate data in between as a two-dimensional coordinate set.

[0119] Optionally, splitting the target three-dimensional motion data based on the operation behavior data of the operator of the target input device includes:

[0120] Determine a movement start position, a movement end position, and a movement interval duration of a target input device based on the operation behavior data;

[0121] Splitting the target three-dimensional motion data into a plurality of three-dimensional coordinate sets based on a target splitting condition, wherein the target splitting condition includes that the target input device returns from a motion end position to a motion start position and the resulting motion interval duration is greater than a first threshold;

[0122] As some examples, the operation behavior data may include any one or more of pause duration data, movement acceleration change data, movement speed change data, movement direction change data, and plane change data.

[0123] In some embodiments, the movement start position and the movement end position may be determined based on movement acceleration change data or movement speed change data.

[0124] Generally, the target input device usually pauses at a certain position for a period of time before starting to write a character, and moves after starting to write. After writing a character, the target input device pauses for a period of time again.

[0125] Therefore, the method of determining the starting position and the ending position of the movement based on the movement acceleration change data can be to obtain the movement acceleration change data corresponding to the target input device at each three-dimensional motion data. If the movement acceleration of the target input device increases from 0 to greater than a specific acceleration threshold at a certain three-dimensional motion data, then the three-dimensional motion data can be determined to be the first three-dimensional motion data, and the area within a certain range around the first three-dimensional motion data is defined as the starting position of the movement. If the movement acceleration of the target input device decreases to 0 or a value close to 0 at a certain three-dimensional motion data, then the three-dimensional motion data can be determined to be the second three-dimensional motion data, and the area within a certain range around the second three-dimensional motion data is defined as the ending position of the movement.

[0126] Similarly, the movement speed change data corresponding to the target input device at each three-dimensional motion data can be obtained. If the movement speed of the target input device increases from 0 to greater than a specific speed threshold at a certain three-dimensional motion data, the three-dimensional motion data can be determined to be the first three-dimensional motion data, and the area within a certain range around the first three-dimensional motion data is defined as the starting position of the motion. If the movement speed of the target input device decreases to 0 or a value close to 0 at a certain three-dimensional motion data, the three-dimensional motion data can be determined to be the second three-dimensional motion data, and the area within a certain range around the second three-dimensional motion data is defined as the ending position of the motion.

[0127] In some embodiments, the movement start position and the movement end position may be determined based on the movement direction change data.

[0128] Generally, when writing multiple characters continuously, the target input device usually pauses at a certain position for a period of time before starting to write the first character. After each character is written, the target input device usually returns to the position where the character was started.

[0129] Therefore, the method of determining the starting position and the ending position of the movement based on the movement direction change data can be that if, at a certain three-dimensional motion data, the movement direction change data indicates that the target input device has changed from never moving in any direction to moving in any specific direction, then the three-dimensional motion data can be determined to be the first three-dimensional motion data, and the area within a certain range around the first three-dimensional motion data is defined as the starting position of the movement; if, at a certain three-dimensional motion data, the movement direction change data indicates that the moving direction of the target input device before reaching the three-dimensional motion data is opposite to the moving direction after reaching the three-dimensional motion data, then the three-dimensional motion data can be determined to be the second three-dimensional motion data, and the area within a certain range around the second three-dimensional motion data is defined as the ending position of the movement.

[0130] In some embodiments, the movement start position and the movement end position may be determined based on the plane change data.

[0131] Generally, when using a target input device to write a character, the target input device usually moves within a specific plane. Before starting to write a character, the target input device will move from other planes to the specific plane. After writing a character, the target input device will leave the plane.

[0132] Therefore, the method of determining the starting position and the ending position of the motion based on the plane change data can be that, for a three-dimensional motion data, if this three-dimensional motion data and the subsequent multiple three-dimensional motion data belong to the same plane, and this three-dimensional motion data and the multiple three-dimensional motion data obtained before do not belong to the same plane, then the three-dimensional motion data can be determined to be the first three-dimensional motion data, and the area within a certain range around the first three-dimensional motion data is the starting position of the motion; for a three-dimensional motion data, if this three-dimensional motion data and the subsequent multiple three-dimensional motion data do not belong to the same plane, and this three-dimensional motion data and the multiple three-dimensional motion data obtained before belong to the same plane, then the three-dimensional motion data can be determined to be the second three-dimensional motion data, and the area within a certain range around the second three-dimensional motion data is the ending position of the motion.

[0133] The duration of a movement interval can be defined as the time elapsed from the moment the target input device moves into the end position of a movement to the moment it moves into the start position of the movement. The duration of a movement interval can be determined based on the pause duration data of the target input device at each 3D movement data point during this period. For example, the 3D movement data of the target input device from the moment it moves into the end position of a movement to the moment it moves into the start position of a movement can be accumulated, along with the corresponding pause duration data of the target input device at these 3D movement data points. The result is used as the movement interval duration.

[0134] See Figure 6 , Figure 6 Each black circle in the figure represents a three-dimensional motion data. The method of determining the motion start position according to the first three-dimensional motion data and determining the motion end position according to the second three-dimensional motion data can be:

[0135] The three-dimensional motion data between the first three-dimensional motion data and the first second three-dimensional motion data obtained are determined as a set, and the area where this set is located is determined as the writing area; a dividing line that can divide the first three-dimensional motion data and this set is determined in the upper left corner of this area, and the area above the left of the dividing line is determined as the starting position of the movement; a dividing line that can divide the second three-dimensional motion data and this set is determined in the lower right corner of this area, and the area below the right of the dividing line is determined as the ending position of the movement.

[0136] When splitting based on the target splitting conditions, the movement process that meets the target splitting conditions can be determined in the target three-dimensional motion data, and the first three-dimensional motion data in these movement processes can be determined as the three-dimensional splitting point, and then the target three-dimensional motion data can be split into several three-dimensional coordinate sets based on these three-dimensional splitting points.

[0137] For example, the target input device moves into the motion end position at a certain moment, stays in the area for a certain period of time, then moves to the motion starting position, and moves into the motion starting position after a certain period of time, and the motion interval time of the target input device from entering the motion end position to returning to the motion starting position is greater than a first threshold value, then it can be determined that the movement process from entering the motion end position to returning to the motion starting position meets the target splitting condition, and the first three-dimensional motion data obtained when the target input device enters the motion end position is determined as a three-dimensional splitting point.

[0138] The target three-dimensional motion data is split into several three-dimensional coordinate sets based on the target splitting condition, wherein the target splitting condition includes that the target input device returns from the motion end position to the motion start position and the resulting motion interval duration is greater than a first threshold.

[0139] The first threshold can be set according to the user's usage habits, for example, it can be set to 0.5 seconds, or set to other values ​​without limitation.

[0140] When splitting the target two-dimensional coordinate set, the three-dimensional splitting points can be determined according to the above method, and the two-dimensional coordinates corresponding to the three-dimensional splitting points are determined as two-dimensional splitting points, thereby splitting the target two-dimensional coordinate set into several two-dimensional coordinate sets.

[0141] Optionally, the method of converting a plurality of three-dimensional coordinate sets into corresponding two-dimensional coordinate sets based on the posture data of the operating body may include:

[0142] Determining relative position information between a motion plane of the target input device and an input surface of the electronic device based on the posture data;

[0143] The direction cosine matrix corresponding to the relative position information is used to transform a number of three-dimensional coordinate sets to obtain a number of corresponding two-dimensional coordinate sets.

[0144] For a three-dimensional coordinate set, the plane where all or most of the three-dimensional motion data in the three-dimensional coordinate set are located can be determined as the motion plane of the target input device corresponding to the three-dimensional coordinate set.

[0145] The input surface of an electronic device can be determined based on the posture data. For example, the orientation of a specific axis of the target input device in three-dimensional space can be determined based on the posture data, and a plane perpendicular to the axis, or a plane forming a specific angle with the axis, can be determined as the input surface of the electronic device.

[0146] As an example, when the target input device is a writing pen, the axis may be an axis formed by a line connecting the pen tip and the pen tail.

[0147] As an example, when the gesture data indicates that the target input device is in Figure 3In the posture shown, the input surface can be a plane parallel to the direction of gravity and close to perpendicular to the axis. When the posture data indicates that the target input device is in Figure 4 or Figure 5 When the posture is correct, the input surface can be a horizontal surface perpendicular to the direction of gravity.

[0148] The relative position information between the moving plane and the input surface of the electronic device may include the angle between the moving plane and the input surface, or the cosine value of the angle.

[0149] After obtaining the relative position information, the direction cosine matrix R of the target input device can be calculated by analyzing the posture data detected by the accelerometer and / or gyroscope, combining the relative position information, and using sensor fusion technology. The calculation method can be found in the relevant technology and will not be repeated here.

[0150] The direction cosine matrix R is a matrix used to convert three-dimensional spatial coordinates into two-dimensional coordinates. The direction cosine matrix R is a 3x3 matrix whose elements are the cosine values ​​of the angles between the device coordinate system of the target input device and the reference coordinate system. This matrix describes the orientation of the device coordinate system relative to the reference coordinate system. Each column (or row) of the matrix represents the projection direction of an axis in the reference coordinate system into the device coordinate system. The device coordinate system can be a coordinate system fixed to the target input device, for example, a coordinate system determined based on a specific axis on the target input device. The reference coordinate system can be a coordinate system determined based on the direction of gravity.

[0151] For any three-dimensional motion data, the three-dimensional motion data can be projected onto the corresponding input surface based on the following formula (2), thereby converting it into corresponding two-dimensional coordinate data.

[0152]

[0153] Among them, (x, y, z) T represents three-dimensional motion data, and (x', y') represents the converted two-dimensional coordinate data.

[0154] Based on this, for any three-dimensional coordinate set, after obtaining the cosine matrix R corresponding to the three-dimensional coordinate set, all three-dimensional motion data of the set can be converted into corresponding two-dimensional coordinates according to formula (2). These two-dimensional coordinates constitute the two-dimensional coordinate set corresponding to the three-dimensional coordinate set.

[0155] The above method of converting three-dimensional motion data into two-dimensional coordinate data can be applied to the conversion processing step in any of the aforementioned embodiments.

[0156] Optionally, the step of splitting the target three-dimensional motion data generated by the target input device includes:

[0157] Analyze target characteristic parameters of the trajectory generated by the target's three-dimensional motion data;

[0158] Determine the splitting points of the trajectory based on the target feature parameters;

[0159] The target three-dimensional motion data is split into several three-dimensional coordinate sets based on the splitting points.

[0160] Among them, target characteristic parameters may include fluency, deflection direction, smoothness, trajectory range, etc.

[0161] The fluency corresponding to the three-dimensional motion data can be represented by the pause duration data of the target input device at the three-dimensional motion data.

[0162] The deflection direction corresponding to the three-dimensional motion data can be identified by the angle between the first moving direction and the second moving direction corresponding to the three-dimensional motion data. The first moving direction indicates the moving direction of the target input device before it moves to the three-dimensional motion data, and the second moving direction indicates the moving direction of the target input device when it moves from the three-dimensional motion data to the next three-dimensional motion data.

[0163] The smoothness corresponding to the three-dimensional motion data can be obtained by connecting the three-dimensional motion data and multiple three-dimensional motion data before and after it into a curve, and then determining the curvature of the curve at the three-dimensional motion data, and using the curvature to represent the smoothness of the three-dimensional motion data.

[0164] The trajectory range can be defined as a range that just contains the trajectory generated by the target three-dimensional motion data. The trajectory range can be determined by determining the bottommost three-dimensional motion data within the plane where the target three-dimensional motion data resides, using this three-dimensional motion data to determine the lower boundary of the trajectory range, determining the topmost three-dimensional motion data, using this three-dimensional motion data to determine the upper boundary of the trajectory range, determining the leftmost three-dimensional motion data, using this three-dimensional motion data to determine the left boundary of the trajectory range, determining the rightmost three-dimensional motion data, and using this three-dimensional motion data to determine the right boundary of the trajectory range. Thus, a rectangular trajectory range consisting of the lower boundary, upper boundary, left boundary, and right boundary of the trajectory range can be obtained.

[0165] The method for determining the trajectory range may also be to determine an upper left boundary and a lower right boundary within the plane where the target three-dimensional motion data resides, and determine the range between the two boundaries as the trajectory range. The upper left boundary may be a straight line having an angle of 45° with the horizontal direction, passing through at least one of the target three-dimensional motion data, and with all other three-dimensional motion data except the one that passed through located to its lower right; the lower right boundary may be a straight line having an angle of 45° with the horizontal direction, passing through at least one of the target three-dimensional motion data, and with all other three-dimensional motion data except the one that passed through located to its upper left.

[0166] For some examples, see Figure 7 , is a schematic diagram of a trajectory range, where the black solid line represents the boundary of the trajectory range and the black circle represents the target three-dimensional motion data.

[0167] When determining the split point based on fluency, the corresponding pause duration data greater than a certain threshold, for example, three-dimensional motion data greater than 0.5 seconds, can be determined as a three-dimensional split point, and then the target three-dimensional motion data can be split into several three-dimensional coordinate sets based on the three-dimensional split point.

[0168] When determining split points based on deflection direction, 3D motion data with a deflection direction greater than a certain deflection threshold can be identified as 3D split points. For example, when a target input device returns from its end position to its start position, its movement direction is essentially reversed. Therefore, a deflection threshold close to 180° can be set. For example, if the deflection threshold is set to 160°, 3D motion data with a deflection direction greater than 160° can be identified as 3D split points.

[0169] When determining split points based on smoothness, consider that the trajectory formed when writing a character or drawing a specific shape is generally smooth and has little curvature. However, when the target input device returns from the end position of movement to the starting position, the trajectory changes direction significantly and has greater curvature. Therefore, 3D motion data with a smoothness greater than a certain curvature threshold can be determined as 3D split points.

[0170] When determining the split point based on the trajectory range, since the target input device generally stays near the boundary of the trajectory range after writing a character or drawing a specific graphic, the three-dimensional motion data whose distance to the boundary of the trajectory range is less than a certain threshold can be determined as the three-dimensional split point.

[0171] Optionally, at least one of the following is also included:

[0172] Encapsulating the data units obtained by splitting the target three-dimensional motion data to obtain a three-dimensional coordinate set;

[0173] Deleting the three-dimensional motion data generated by the target input device returning from the motion end position to the motion start position;

[0174] The target three-dimensional motion data is split and processed based on the target operation of the operating body acting on the target input device, and the target operation includes at least one of the operations of operating the target input device to input a target symbol, changing the input parameters of the target input device, and changing the display parameters or operating parameters of the electronic device.

[0175] The data units obtained by splitting the target three-dimensional motion data may include the target three-dimensional motion data of each part obtained by dividing based on the three-dimensional splitting points.

[0176] Exemplarily, the target three-dimensional motion data includes 100 three-dimensional motion data obtained in chronological order. Assume that two three-dimensional splitting points are determined, wherein the three-dimensional motion data from the first three-dimensional motion data to the first three-dimensional splitting point and the three-dimensional motion data in between are regarded as a data unit, the three-dimensional motion data from the first three-dimensional splitting point to the second three-dimensional splitting point and the three-dimensional motion data in between are regarded as a data unit, and the three-dimensional motion data from the second three-dimensional splitting point to the last three-dimensional motion data and the three-dimensional motion data in between are regarded as a data unit.

[0177] After obtaining the data units, each data unit may be encapsulated based on a predetermined data format to obtain an encapsulated unit of a corresponding format, and the encapsulated unit is used as a three-dimensional coordinate set.

[0178] The data format can be determined based on the currently running application. For example, if the currently running application needs to obtain string data as input, the data format can be a character format, and the obtained encapsulation unit can be a character unit. If the currently running application needs to obtain graphic data as input, the data format can be a graphic format, and the obtained encapsulation unit can be a graphic unit.

[0179] After obtaining the target three-dimensional motion data, the three-dimensional motion data generated each time the target input device moves to the starting position can be determined from the target three-dimensional motion data, and recorded as the third three-dimensional motion data (X R , Y R , Z R ), for each third three-dimensional motion data, the fourth three-dimensional motion data (X) generated when the target input device last entered the motion termination position before the third three-dimensional motion data can be further determined. L , Y L , Z L), if the movement interval duration of the target input device moving from the fourth three-dimensional motion data to the third three-dimensional motion data is greater than the first threshold, it can be determined that the three-dimensional motion data generated by the target input device during the period from the fourth three-dimensional motion data to the third three-dimensional motion data belongs to the three-dimensional motion data generated by the target input device returning from the end position of the motion to the starting position of the motion, so this part of the three-dimensional motion data can be deleted, and then the steps of splitting processing and conversion processing in the aforementioned embodiment are performed.

[0180] The advantage of deleting the 3D motion data in the above manner is that when repeatedly writing in the same area using a target input device, the user often moves the target input device, which is located at the end position of the motion, back to the start position after writing a character to write the next character. Moving from the end position back to the start position generates redundant 3D motion data that does not belong to the character. If this 3D motion data is retained, it will affect the accuracy of subsequent recognition of the target input data. By deleting this redundant 3D motion data in the above method, it is beneficial to obtain more accurate target input data.

[0181] Optionally, in some embodiments, the target three-dimensional motion data may be split and processed based on the target operation performed by the operating body on the target input device.

[0182] The splitting method can be that if the target input device or electronic device detects a target operation of an operating body acting on the target input device at a certain moment, the three-dimensional motion data generated by the target input device at that moment can be determined as a three-dimensional splitting point, or the two-dimensional coordinate data converted from the three-dimensional motion data generated by the target input device at that moment can be determined as a two-dimensional splitting point, and based on the determined three-dimensional splitting point or two-dimensional splitting point, the target three-dimensional motion data or the target two-dimensional coordinate set can be split.

[0183] The target operation includes at least one of operating a target input device to input a target symbol, changing an input parameter of the target input device, and changing a display parameter or an operating parameter of the electronic device.

[0184] The target symbol can be a punctuation mark required in the text, a paragraph configuration symbol used to configure the paragraph format, an emoticon, or other symbols that may be used when editing text.

[0185] The input parameters of the target input device may be parameters for specifying font information, image parameters of the two-dimensional trajectory image (such as thickness parameters and line type parameters of the two-dimensional trajectory), and the two-dimensional trajectory parameters may be displayed on the screen by the electronic device based on the obtained two-dimensional trajectory data.

[0186] The display parameters of an electronic device may include parameters for controlling the display mode, for example, the display parameters may control the electronic device to display text in page mode, outline mode or web page mode; may also include display brightness parameters of the electronic device; may also include parameters for controlling the size of text displayed by the electronic device.

[0187] The operating parameters of the electronic device may include volume parameters of the electronic device, and may include parameters for controlling the electronic device to start or close an application, start or close a specific window or page.

[0188] The target input device can obtain target operations in various forms, such as obtaining the target operation when a specific key of the target input device is triggered, obtaining the target operation when the operating body touches a specific touch area, and obtaining the target operation when a specific voice command is collected, without limitation.

[0189] In some embodiments, the generation processing of the two-dimensional coordinate set can be performed using a pre-built processing model capable of generating two-dimensional trajectory data. The processing model used to generate the two-dimensional trajectory data can be a neural network model of any architecture.

[0190] The method of using the processing model to generate processing may include any one or more of the following:

[0191] Obtaining attribute information of a target input device, and performing trajectory smoothing and path connection processing on a plurality of two-dimensional coordinate sets using a processing model corresponding to the attribute information to obtain corresponding two-dimensional trajectory data;

[0192] Obtaining application information of a target application running on the electronic device, and performing trajectory smoothing and path connection processing on a plurality of two-dimensional coordinate sets using a target processing model to obtain two-dimensional trajectory data matching the application information;

[0193] Font information specified by the operating body is obtained, and a plurality of two-dimensional coordinate sets are generated and processed based on the font information to obtain a plurality of two-dimensional trajectory data matching the font information.

[0194] In the first generation processing method, the attribute information of the target input device can represent the type of the target input device, for example, whether the target input device is a writing pen, a mouse, a ring, or a handle, and can also represent the model, brand and other attributes of the target input device.

[0195] Taking the type of target input device as an example, different processing models corresponding to different types of input devices can be pre-configured in the electronic device, such as a writing pen corresponding to a writing pen processing model and a mouse corresponding to a mouse processing model. After obtaining the attribute information, the processing model corresponding to the type of target input device can be called to perform trajectory smoothing and path connection processing on the obtained two-dimensional coordinate set to obtain the corresponding two-dimensional trajectory data.

[0196] The advantage of generating two-dimensional trajectory data in this way is that, when the actual movement path is the same, the three-dimensional motion data generated by different target input devices may differ due to the influence of the device characteristics. Applying the processing model corresponding to the target input device to generate two-dimensional trajectory data is beneficial for correcting the influence of the device characteristics for the current target input device through the corresponding processing model, obtaining two-dimensional trajectory data that is more consistent with the actual operation intention of the operator, and thus obtaining more accurate target input data.

[0197] In the second generation processing method, the target application refers to the application that needs to use the target input data after the electronic device obtains the target input data. For example, when the target input data is string data, the target application can be an instant messaging application that needs to send the string data as an instant message; when the target input data is graphic data, the target application can be a drawing application that needs to display the graphic data on the screen of the electronic device.

[0198] The application information of the target application may include the application type of the target application and may also include the application name of the target application.

[0199] Based on the application information, the electronic device can determine the processing model that is suitable for the application type of the target application from multiple pre-built processing models, use the processing model as the target processing model, and use the target processing model to perform trajectory smoothing and path connection processing on several two-dimensional coordinate sets.

[0200] The advantage of generating two-dimensional trajectory data in this way is that different types of applications may require different target input data, and the two-dimensional trajectory data required to generate different target input data may also be different. Therefore, calling the target processing model corresponding to the application information to generate two-dimensional trajectory data can make the generated two-dimensional trajectory data more consistent with subsequent recognition requirements, which is conducive to obtaining more accurate target input data.

[0201] In the third generation processing method, the electronic device can pre-determine the font information according to the operation instructions of the operating body, for example, determine the font information as Kaiti, Roman, etc., and then input the font information and the two-dimensional coordinate set into the processing model together to perform generation processing based on the font information, or, call the processing model corresponding to the font information in multiple processing models, and perform generation processing on the two-dimensional coordinate set based on the corresponding processing model.

[0202] The advantage of generating two-dimensional trajectory data in this way is that two-dimensional trajectory data matching the specified font information can be directly generated, and then when the two-dimensional trajectory data is subsequently recognized, character string data matching the specified font information can be directly identified, thereby improving recognition efficiency and accuracy.

[0203] Optionally, identifying the two-dimensional trajectory data to generate target input data corresponding to the target three-dimensional motion data includes at least one of the following:

[0204] Inputting the two-dimensional trajectory data into a first processing model for generation processing to generate at least one of target character string data, target graphic data, and target expression data;

[0205] The two-dimensional trajectory data is input into a second processing model associated with a target application running on the electronic device for generation processing to generate target control instruction data. The target application is an application configured to respond to input data generated by a target input device.

[0206] The first processing model can be a pre-built processing model that can generate any one or more of string data, graphic data, and expression data. The second processing model can be a pre-built processing model that can generate control instructions corresponding to the target application. Both the first processing model and the second processing model can be convolutional neural network models, large language models, or other processing models with corresponding processing capabilities. The method of constructing the above processing models can be referred to the relevant technology and will not be repeated here.

[0207] In the above embodiment, multiple second processing models can be pre-configured on the electronic device, and each second processing model is associated with one or more applications installed on the electronic device; if when obtaining the target three-dimensional motion data, the target application currently running on the electronic device is associated with a certain second processing model, then the associated second processing model can be called to process the obtained two-dimensional trajectory data to obtain the target control instruction data corresponding to the target application; if when obtaining the target three-dimensional motion data, the target application currently running on the electronic device is not associated with each second processing model, then the first processing model can be called to process the obtained two-dimensional trajectory data to generate at least one of the target character string data, target graphic data, and target expression data.

[0208] When the first processing model generates target string data, it can extract geometric features of each 2D trajectory data, including but not limited to the curvature, start and end points, and direction of trajectory extension. These features are then matched with the existing geometric features of individual characters to determine the character corresponding to each 2D trajectory data, ultimately outputting target string data consisting of multiple characters. Specific recognition methods can be found in related art and are not detailed here.

[0209] This embodiment also provides an electronic device, see Figure 8 The electronic device may include at least one processor 801 and at least one processing model 802 capable of running on the processor, where the processing model can be called by a target application to perform at least one of the following:

[0210] In response to a target triggering event, the target three-dimensional motion data generated by the target pen device is split and converted to obtain a plurality of two-dimensional coordinate sets;

[0211] Generate and process a plurality of two-dimensional coordinate sets to obtain a plurality of two-dimensional handwriting data;

[0212] Recognize two-dimensional handwriting data to generate target input data corresponding to target three-dimensional motion data. The target input data may include at least one of target character string data, target graphic data, target expression data, and target control instruction data.

[0213] Optionally, the processor 801 performs splitting and conversion processing on the target three-dimensional motion data generated by the target input device, including:

[0214] The target three-dimensional motion data is split based on the operation behavior data of the operator of the target input device to obtain a plurality of three-dimensional coordinate sets;

[0215] Based on the pose data of the operating body, several three-dimensional coordinate sets are converted into corresponding two-dimensional coordinate sets.

[0216] Optionally, the processor 801 performs splitting and conversion processing on the target three-dimensional motion data generated by the target input device, including:

[0217] The target three-dimensional motion data is converted based on the pose data of the operating body of the target input device to obtain a target two-dimensional coordinate set;

[0218] The target two-dimensional coordinate set is split based on the operation behavior data of the operator to obtain several two-dimensional coordinate sets.

[0219] Optionally, the processor 801 splits the target three-dimensional motion data based on the operation behavior data of the operator of the target input device, including:

[0220] Determine a movement start position, a movement end position, and a movement interval duration of a target input device based on the operation behavior data;

[0221] Splitting the target three-dimensional motion data into a plurality of three-dimensional coordinate sets based on a target splitting condition, wherein the target splitting condition includes that the target input device returns from a motion end position to a motion start position and the resulting motion interval duration is greater than a first threshold;

[0222] and / or,

[0223] The processor 801 converts a plurality of three-dimensional coordinate sets into corresponding two-dimensional coordinate sets based on the posture data of the operating body, including:

[0224] Determining relative position information between a motion plane of the target input device and an input surface of the electronic device based on the posture data;

[0225] The direction cosine matrix corresponding to the relative position information is used to transform a number of three-dimensional coordinate sets to obtain a number of corresponding two-dimensional coordinate sets.

[0226] Optionally, the processor 801 splits the target three-dimensional motion data generated by the target input device, including:

[0227] Analyze target characteristic parameters of the trajectory generated by the target's three-dimensional motion data;

[0228] Determine the splitting points of the trajectory based on the target feature parameters;

[0229] The target three-dimensional motion data is split into several three-dimensional coordinate sets based on the splitting points.

[0230] Optionally, the processor 801 may further perform at least one of the following:

[0231] Encapsulating the data units obtained by splitting the target three-dimensional motion data to obtain a three-dimensional coordinate set;

[0232] Deleting the three-dimensional motion data generated by the target input device returning from the motion end position to the motion start position;

[0233] The target three-dimensional motion data is split and processed based on the target operation of the operating body acting on the target input device, and the target operation includes at least one of the operations of operating the target input device to input a target symbol, changing the input parameters of the target input device, and changing the display parameters or operating parameters of the electronic device.

[0234] Optionally, the processor 801 generates a plurality of two-dimensional coordinate sets, including at least one of the following:

[0235] Obtaining attribute information of a target input device, and performing trajectory smoothing and path connection processing on a plurality of two-dimensional coordinate sets using a processing model corresponding to the attribute information to obtain corresponding two-dimensional trajectory data;

[0236] Obtaining application information of a target application running on the electronic device, and performing trajectory smoothing and path connection processing on a plurality of two-dimensional coordinate sets using a target processing model to obtain two-dimensional trajectory data matching the application information;

[0237] Font information specified by the operating body is obtained, and a plurality of two-dimensional coordinate sets are generated and processed based on the font information to obtain a plurality of two-dimensional trajectory data matching the font information.

[0238] Optionally, the processor 801 identifies the two-dimensional trajectory data to generate target input data corresponding to the target three-dimensional motion data, including at least one of the following:

[0239] Inputting the two-dimensional trajectory data into a first processing model for generation processing to generate at least one of target character string data, target graphic data, and target expression data;

[0240] The two-dimensional trajectory data is input into a second processing model associated with a target application running on the electronic device for generation processing to generate target control instruction data. The target application is an application configured to respond to input data generated by a target input device.

[0241] Optionally, the target triggering event is generated from at least one of the following:

[0242] The sensor of the target input device obtains three-dimensional motion data;

[0243] Establishing a communication connection with the target input device and running a target application corresponding to the target input device;

[0244] There is overlap between character data and / or image data generated by the target input device.

[0245] The working principle of the electronic device of this embodiment can be found in the relevant steps of the data processing method of the aforementioned embodiment, and will not be described in detail.

[0246] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the various embodiments can be referenced to each other.

[0247] For the convenience of description, the above systems or devices are described as being divided into various modules or units according to their functions. Of course, when implementing the present application, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0248] Through the description of the above embodiments, it can be seen that those skilled in the art can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present application or certain parts of the embodiments.

[0249] Finally, it should be noted that, in this document, relational terms such as first, second, third, and fourth are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

[0250] The above is only a preferred embodiment of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A data processing method, comprising: In response to a target triggering event, the target three-dimensional motion data generated by the target input device is split and converted to obtain a plurality of two-dimensional coordinate sets; Performing generation processing on the plurality of two-dimensional coordinate sets to obtain a plurality of two-dimensional trajectory data; The two-dimensional trajectory data is identified to generate target input data corresponding to the target three-dimensional motion data.

2. The method according to claim 1, wherein The target three-dimensional motion data generated by the target input device is split and converted, including: splitting the target three-dimensional motion data based on the operation behavior data of the operator of the target input device to obtain a plurality of three-dimensional coordinate sets; The three-dimensional coordinate sets are converted into corresponding two-dimensional coordinate sets based on the posture data of the operating body.

3. The method according to claim 1, wherein The target three-dimensional motion data generated by the target input device is split and converted, including: Converting the target three-dimensional motion data based on the pose data of the operating body of the target input device to obtain a target two-dimensional coordinate set; The target two-dimensional coordinate set is split based on the operation behavior data of the operating body to obtain a plurality of two-dimensional coordinate sets.

4. The method according to claim 2, wherein the step of segmenting the target three-dimensional motion data based on the operation behavior data of the operator of the target input device comprises: Determine a movement start position, a movement end position, and a movement interval duration of the target input device based on the operation behavior data; Splitting the target three-dimensional motion data into a plurality of three-dimensional coordinate sets based on a target splitting condition, wherein the target splitting condition includes that the target input device returns from a motion end position to a motion start position and the resulting motion interval duration is greater than a first threshold; and / or, The converting of the plurality of three-dimensional coordinate sets into corresponding two-dimensional coordinate sets based on the posture data of the operating body includes: Determining relative position information between a motion plane of the target input device and an input surface of the electronic device based on the posture data; The three-dimensional coordinate sets are transformed using the direction cosine matrix corresponding to the relative position information to obtain corresponding two-dimensional coordinate sets.

5. The method according to claim 1, wherein The target three-dimensional motion data generated by the target input device is split, including: Analyzing target characteristic parameters of the trajectory generated by the target three-dimensional motion data; Determining split points of the trajectory based on the target feature parameters; The target three-dimensional motion data is split into a plurality of three-dimensional coordinate sets based on the splitting points.

6. The method according to any one of claims 1 to 5, further comprising at least one of the following: encapsulating data units obtained by splitting the target three-dimensional motion data to obtain the three-dimensional coordinate set; Deleting the three-dimensional motion data generated when the target input device returns from the motion end position to the motion start position; The target three-dimensional motion data is split and processed based on the target operation of the operating body acting on the target input device, and the target operation includes at least one of operating the target input device to input a target symbol, changing the input parameters of the target input device, and changing the display parameters or operating parameters of the electronic device.

7. The method according to claim 1, wherein generating the plurality of two-dimensional coordinate sets comprises at least one of the following: Obtaining attribute information of the target input device, and performing trajectory smoothing processing and path connection processing on the plurality of two-dimensional coordinate sets using a processing model corresponding to the attribute information to obtain corresponding two-dimensional trajectory data; Obtaining application information of a target application running on the electronic device, and performing trajectory smoothing processing and path connection processing on the plurality of two-dimensional coordinate sets using a target processing model to obtain two-dimensional trajectory data matching the application information; Font information specified by the operating body is obtained, and the plurality of two-dimensional coordinate sets are generated based on the font information to obtain a plurality of two-dimensional trajectory data matching the font information.

8. The method according to claim 1, wherein identifying the two-dimensional trajectory data to generate target input data corresponding to the target three-dimensional motion data comprises at least one of the following: Inputting the two-dimensional trajectory data into a first processing model for generation processing to generate at least one of target character string data, target graphic data, and target expression data; The two-dimensional trajectory data is input into a second processing model associated with a target application running on the electronic device for generation processing to generate target control instruction data. The target application is an application configured to respond to input data generated by the target input device.

9. The method according to claim 1, wherein: The target trigger event is generated by at least one of the following: The sensor of the target input device obtains three-dimensional motion data; Establishing a communication connection with the target input device and running a target application corresponding to the target input device; There is overlap between character data and / or image data generated by the target input device.

10. An electronic device comprising at least one processor and at least one processing model capable of running on the processor, wherein the processing model can be called by a target application to perform at least one of the following: In response to a target triggering event, the target three-dimensional motion data generated by the target pen device is split and converted to obtain a plurality of two-dimensional coordinate sets; Performing generation processing on the plurality of two-dimensional coordinate sets to obtain a plurality of two-dimensional handwriting data; The two-dimensional handwriting data is recognized to generate at least one of target character string data, target graphic data, target expression data, and target control instruction data corresponding to the target three-dimensional motion data.

Images