Data processing method and electronic equipment

Abstract

The invention provides a data processing method and electronic equipment. The method comprises the steps of determining a target to-be-responded event capable of being triggered by a target operation in response to the obtained target operation executed by pen equipment on a touch display screen of the electronic equipment; displaying an execution result of executing the target event to be responded by the electronic equipment in a target area of the touch display screen; wherein the target area comprises at least one of a display area of the touch display screen, an action area of the target operation, a blank area in the touch display screen or an area where a target display object is located, and the target display object is an object determined based on the target operation; different target to-be-responded events triggered by different target operations are related to or unrelated to the target display object; the presentation parameter of the execution result is different from the initial display parameter of the target area.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data processing method and an electronic device. Background Technology

[0002] With the increasing popularity of mobile office devices, users' demand for portable electronic devices is growing. In some office scenarios without keyboard and mouse support, pen devices have become the primary tool for input and operation. However, in current technologies, the efficiency of users interacting with electronic devices through pen devices is relatively low, affecting users' work efficiency. Summary of the Invention

[0003] This application provides a data processing method and an electronic device.

[0004] The technical solution of this application embodiment is implemented as follows: This application provides a data processing method, including: in response to obtaining a target operation performed by a pen device on a touch screen of an electronic device, determining a target event to be responded to that can be triggered by the target operation; presenting the execution result of the electronic device performing the target event to be responded to in a target area of ​​the touch screen; wherein, the target area includes at least one of the following: the display area of ​​the touch screen, the area where the target operation is active, a blank area in the touch screen, or the area where the target display object is located, and the target display object is an object determined based on the target operation; different target events to be responded to by different target operations may or may not be related to the target display object; the presentation parameters of the execution result are different from the initial display parameters of the target area.

[0005] This application provides an electronic device, including: a first body and a second body rotatably connected, a touch display screen disposed on the first body and / or the second body, a processor, and a target application process or target processing model capable of running on the processor, wherein the target application process or the target processing model runs on the processor to perform the following operations: in response to obtaining a target operation performed by a pen device on the touch display screen, determining a target event to be responded to that can be triggered by the target operation; presenting the execution result of the electronic device executing the target event to be responded to in a target area of ​​the touch display screen; wherein the target area includes at least one of the display area of ​​the touch display screen, the area of ​​action of the target operation, a blank area in the touch display screen, or an area where a target display object is located, and the target display object is an object determined based on the target operation; different target events to be responded to by different target operations are related to or unrelated to the target display object; the presentation parameters of the execution result are different from the initial display parameters of the target area; the target event to be responded to depends on the target application process or target processing model.

[0006] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of this application. Attached Figure Description

[0007] Figure 1 This is a schematic diagram illustrating the implementation flow of a data processing method provided in an embodiment of this application; Figure 2 This is a schematic diagram of the correspondence between a target operation and its execution result provided in an embodiment of this application. Figure 1 ; Figure 3 This is a schematic diagram of the correspondence between a target operation and its execution result provided in an embodiment of this application. Figure 2 ; Figure 4 This is a schematic diagram of the correspondence between a target operation and its execution result provided in an embodiment of this application. Figure 3 ; Figure 5 This is a schematic diagram of the execution result of a target event to be responded to, provided in an embodiment of this application. Figure 1 ; Figure 6 This is a schematic diagram of the execution result of a target event to be responded to, provided in an embodiment of this application. Figure 2 .

[0008] It should be noted that the terms "first" and "second" mentioned above are only used to distinguish between different options and do not represent the degree of superiority or inferiority of the options or their priority in the implementation process. Detailed Implementation

[0009] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0010] This application provides a data processing method, such as... Figure 1 As shown, the method includes steps S100 and S110: Step S100: In response to the target operation performed by the pen device on the touch screen of the electronic device, determine the target event to be responded to that can be triggered by the target operation; Here, a pen device can refer to a device capable of inputting data onto a touchscreen display via physical contact or capacitive sensing. In some implementations, the pen device can be a stylus; for example, a pen device can be either an active pen or a passive pen.

[0011] In some implementations, a target operation can refer to an operation performed by a user on a touchscreen display using a pen device, such as a selection operation, a writing operation, a pressing operation, a clicking operation, or a drawing trajectory operation. A target operation can also refer to an operation performed by a user within a preset distance of the touchscreen display using a pen device, such as a pen hovering operation. Understandably, in this scenario, the preset distance can refer to the touchscreen display's sensing distance for the pen, for example, this sensing distance could be 1 centimeter (cm). A target operation can also refer to an operation performed by the user on the pen device itself, such as a touch operation, a voice input operation, or a spatial writing operation.

[0012] A target pending event refers to a series of functional operations triggered by a target operation and executed by an electronic device.

[0013] In some implementations, the target event to be responded to can be the identification and editing of displayed content, such as adding, deleting, modifying, or modifying the display attributes of displayed content. Specifically, modifying the display attributes of displayed content can involve changing the display content from a dynamic display mode to a static display mode, or vice versa.

[0014] In some implementations, the target event to be responded to may be an adjustment of display parameters, such as an adjustment of the display theme, an adjustment of the display layout, an adjustment of the display font size, an adjustment of the display font, an adjustment of the display color, etc.

[0015] In some implementations, the target event to be responded to can be an operation performed using an artificial intelligence model, such as performing image manipulation or text manipulation using an artificial intelligence model.

[0016] In some implementations, the target event to be responded to may be an adjustment operation on the operating configuration parameters of the touch display screen, such as adjusting the area display state, adjusting the brightness, adjusting the display mode, etc.

[0017] In some implementations, the target event to be responded to can be a zoom operation on the selected area, or it can be the generation of display content. The generation of display content can refer to generating the target input content obtained by the target operation.

[0018] In some implementations, the target event to be responded to is determined based on the area of ​​effect of the target operation and / or operation parameters. Here, taking a selection operation as an example, the area of ​​effect can refer to the selection region corresponding to the selection operation, and the operation parameters can be trajectory point data generated by the user when performing the selection operation using a pen device.

[0019] Step S110: Display the execution result of the electronic device executing the target pending event on the target area of ​​the touch screen; The target area includes at least one of the following: the display area of ​​the touch screen, the area where the target operation is performed, a blank area in the touch screen, or the area where the target display object is located. The target display object is an object determined based on the target operation. Different target events triggered by different target operations may or may not be related to the target display object. The presentation parameters of the execution result are different from the initial display parameters of the target area.

[0020] In some implementations, the target area may refer to the full-screen area of ​​the touch display, the operation area of ​​the target operation, a blank area in the touch display, or the area where the associated content is located, etc.

[0021] The execution result refers to the content generated by the electronic device after executing the target event to be responded to. For example: In some implementations, when the target event to be responded to is the identification and editing of the displayed content, the execution result is the edited displayed content, such as the displayed content obtained after deleting some content, the displayed content obtained after adding some content, or the displayed content obtained after modifying some content.

[0022] In some implementations, when the target event to be responded to is an adjustment of display parameters, the execution result is displayed with the adjusted display parameters, such as with the adjusted display layout, the adjusted display font, or the adjusted display font size.

[0023] In some implementations, when the target event to be responded to is an operation performed using an artificial intelligence model, the execution result can be the output of the artificial intelligence model, such as a generated image or generated text.

[0024] In some implementations, when the target event to be responded to is an adjustment of the operating configuration parameters of the touch display, the execution result is that the touch display operates with the adjusted operating parameters, such as the touch display operating with the adjusted display mode or the touch display operating with the adjusted brightness.

[0025] In some implementations, when the target event to be responded to is a scaling operation on the selected area, the result can be the display content obtained after the scaling operation, such as the enlarged display content or the reduced display content.

[0026] In some implementations, the display area can refer to a full-screen area, a half-screen area, or a split-screen area. A full-screen area refers to the entire display range of the touchscreen display; a half-screen area refers to half of the display range, such as one of the upper, lower, left, or right halves; and a split-screen area is where, in multi-window mode, the touchscreen display is divided into two or more independent display areas.

[0027] The effective area refers to the actual area on the touchscreen display affected by a user's target operation. In some implementations, the effective area can be a selected area, a hovering area, or the area the operation is pointing at. For example, when a user makes a selection operation on the touchscreen display using a pen device, the area enclosed by the trajectory points of the pen device on the touchscreen display is the selected area. When the pen device hovers above the touchscreen display, the circle generated with the projection of the pen tip as the center and a preset distance as the radius is the hovering area. When the pen device operates on an image, the area occupied by the image is the effective area.

[0028] In some implementations, a blank area may refer to an area where no content is displayed.

[0029] In some implementations, the target display object can refer to specific display content, such as images, audio, or specific text.

[0030] For example, when controlling the switching between static and dynamic modes of an image through a target operation, the target display object is the image. Similarly, when controlling the playback state of audio through a target operation, the target display object is the audio. When converting audio to text through a target operation, the target display object is the audio. Furthermore, when controlling changes in text display parameters through a target operation, the target display object is the specific text.

[0031] like Figure 2 As shown, when deleting content from text using a target operation, the specific text can be the text identified for deletion. When adding content to text using a target operation, the specific text can be the text identified for addition. When highlighting content in text using a target operation, the specific text can be the text to be highlighted. When bolding content in text using a target operation, the specific text can be the text to be bolded.

[0032] In some implementations, the target display object is an object determined based on a target operation. This object can be an object directly pointed to by the target operation, such as an object selected by a circle, an object pointed to by an arrow, an object hovered over, or an object input via voice. Alternatively, the object can be determined based on the operation input; for example, after a user performs voice input using a pen device, the input voice can determine the content associated with that input on the touchscreen display. The object can also be determined by the input trajectory of the target operation, such as an object indicated by a line (e.g., ...). Figure 2 The text includes specific characters corresponding to straight lines and wavy lines, as well as text content determined by the input trajectory.

[0033] In this application, different target operations trigger different target response events, which may or may not be related to the target display object determined by the target operation. For example, when an artificial intelligence model is invoked to generate the target input content corresponding to the target operation, the generated content may be unrelated to the target display object. Similarly, when deleting content from text through a target operation, the resulting text is related to the text content to be deleted.

[0034] In this application, when the target event to be responded to involves a global adjustment, the target event to be responded to is not associated with the target display object. In this scenario, the target operation can be adjusting the operating parameters of the display screen, or it can be adjusting the display parameters of the displayed content, such as adjusting the font or size of the entire text. When the target event to be responded to involves an adjustment to the target display object, the target event to be responded to is associated with the target display object. In this scenario, the target operation can be partially deleting the displayed content, partially highlighting the displayed content, or partially selecting the displayed content.

[0035] In some implementations, the presentation parameters differ from the initial display parameters of the target area. These parameters can refer to changes in the displayed content, changes in the display parameters of the displayed content, changes in the operating parameters of the touch screen, or changes in the display layout, etc.

[0036] In some implementations, after obtaining the execution result, user feedback information on the execution result can also be obtained. This feedback information indicates whether the user is satisfied with the execution result, and if the user is satisfied with the execution result, the target pending response event is determined to have been completed.

[0037] In one example, image information of the user is acquired through an image acquisition component; based on the analysis results of body language and / or facial expression information in the image information acquired by the first processing model, feedback information is determined; for example, if the body language represents a nod, it is determined that the user is satisfied with the execution result; if the body language represents a shake of the head, it is determined that the user is dissatisfied with the execution result. For example, if the facial expression represents a smile, it is determined that the user is satisfied with the execution result; if the body language represents anger or pouting, it is determined that the user is dissatisfied with the execution result.

[0038] In one example, the user's voice information is acquired through a voice acquisition component; based on the analysis results of the user's voice information by a second processing model, feedback information is determined; for example, if the voice information confirms the modification, it is determined that the user is satisfied with the execution result.

[0039] In one example, the movement trajectory information triggered by the pen device on the touch screen is acquired; if the movement trajectory information represents an evaluation of the execution result, it is determined as feedback information. This movement trajectory information can be OK, a checkmark, an error mark, etc. For example, if the voice information is an error mark, it is determined that the user is dissatisfied with the execution result.

[0040] In this embodiment, firstly, by performing a target operation on the touch screen of an electronic device using a pen device, the user's operation intention can be obtained. Then, the target event to be responded to corresponding to the operation intention is determined, and the execution result of the target event to be responded to is presented in the target area of ​​the display screen. Through this method, intelligent human-computer interaction is realized, enabling the electronic device to respond to the target operation efficiently and accurately, which significantly improves the user's office efficiency.

[0041] In some embodiments, step S100 may further include steps S101 and S102: Step S101: Obtain the area of ​​action of the target operation on the touch screen and / or the operation parameters of the target operation, wherein the operation parameters can characterize the relative position information between the pen device and the touch screen; In some implementations, it is determined whether the area of ​​action is a blank area; the target event to be responded to is determined based on whether the area of ​​action is a blank area.

[0042] For example, if the area to be responded to is not a blank area, the target event to be responded to is determined based on the content attributes of the displayed content in the area to be responded to. The target event to be responded to can be a modification of the display attributes of the displayed content, an adjustment of the display layout, an adjustment of the displayed content, or a scaling of the displayed content, etc.

[0043] For example, if the area of ​​action is determined to be a blank area, the target event to be responded to can be an operation performed using an artificial intelligence model, or an operation to adjust the operating parameters of the touch screen.

[0044] In some implementations, operation parameters can refer to operation behavior parameters, such as operation trajectory, hovering distance and duration, click frequency and intensity, and rate and intensity variation information. It is understood that different operation parameters can trigger different events to be responded to.

[0045] In one example, when the operation parameter is an operation trajectory, different operation trajectories can correspond to different events to be responded to, for example, Figure 3 He Ru Figure 4 As shown, selecting the trajectory can trigger scaling of the displayed content; as Figure 2 As shown, wavy lines can trigger bolding of displayed content, while horizontal lines can trigger highlighting. In some implementations, different selection trajectories correspond to different scaling windows, such as... Figure 3 As shown, the selected trajectory is an ellipse ( Figure 3 In the case of the left image, the corresponding scaling window is an ellipse ( Figure 3 (See right image) Figure 4 As shown, the selected trajectory is a rectangle ( Figure 4 In the case of the left image, the corresponding scaling window is a rectangle ( Figure 4 (Right image).

[0046] In one example, when the operation parameter is the hover distance and duration, different combinations of hover height and duration can correspond to different events to be responded to. For instance, hovering at a first height for a first duration can trigger a brightness adjustment of the touchscreen display, while hovering at a second height for a first duration can trigger an adjustment of the display mode. Furthermore, if the electronic device enters a scenario where the brightness of the touchscreen display needs to be adjusted, the brightness can be increased or decreased by moving the pen device up and down.

[0047] In one example, when the operation parameters are click frequency and intensity, different combinations of frequency and intensity can correspond to different events to be responded to. For example, when the user applies the first frequency and first intensity to the touch screen, the refresh rate of the touch screen can be adjusted; when the user applies the second frequency and first intensity to the touch screen, the resolution of the touch screen can be adjusted.

[0048] In some implementations, the relative position information between the pen device and the touch display screen can refer to a static relative distance, which may be the distance between the pen device and the touch display screen, or the distance between the pen device and a relevant reference point on the touch display screen. The relative position information between the pen device and the touch display screen can also refer to dynamic relative position change information, such as the movement trajectory of the pen device relative to the touch display screen when writing or moving.

[0049] Step S102: Determine the target response event that the target operation can trigger based on the object information and / or operation parameters within the scope of action. The target response event depends on the target process or target processing model of the electronic device.

[0050] In some implementations, object information may refer to whether the active area is a blank area. When the active area is not blank, the object information also includes object information of the displayed content. Further, the object information of the displayed object may include object type, object display parameters, etc. When the active area is blank, the object information also includes application information corresponding to that area. This allows the electronic device to determine a target event to be responded to that application information. For example, if the application information indicates that the blank area is on the system desktop, the target event to be responded to may be adjusting the operating configuration parameters (i.e., working parameters) of the touch screen. If the application information indicates that the blank area is a non-desktop application under the operating system, the target event to be responded to may be a call to an artificial intelligence model.

[0051] In some implementations, when the target event to be responded to involves the invocation of an artificial intelligence model, the corresponding artificial intelligence model can be directly invoked to generate the target content. The output of the artificial intelligence model can be an image or text. The artificial intelligence model can process content currently displayed on the touchscreen, process user input, or process both user input and content displayed on the touchscreen simultaneously.

[0052] In some implementations, when the target event to be responded to does not involve model invocation, the relevant application process can be invoked to scale the displayed content, redraw or adjust the content in office software (e.g., Word / PPT), or adjust the operating parameters of the touch screen.

[0053] In this embodiment of the application, by acquiring the effective area and / or operation parameters, the electronic device can accurately identify the user's interactive behavior with the touch screen through the pen device, intelligently understand the user's operation intention, and accurately trigger the corresponding processing flow, so as to significantly improve the user's operation efficiency in the office scenario.

[0054] In some embodiments, step S102 may include steps S1021 to S1024: Step S1021: Determine whether the target operation's effective area is a blank area; In some implementations, the electronic device determines whether the area under its control is a blank area by detecting whether there are interface elements, text, image content, audio content, etc. within the area under its control.

[0055] Step S1022: When the effective area is a blank area in the first application interface, determine that the target operation can trigger a first pending event that adjusts the operating configuration parameters of the touch screen, and the first application interface belongs to the desktop application of the electronic device; or, Here, the blank area of ​​the first application interface can refer to the blank area on the system desktop of the electronic device.

[0056] In some implementations, the running configuration parameters may include, but are not limited to, one or more of the following: resolution, refresh rate, brightness, color mode, display model, and regional display status.

[0057] In this application, when a user performs a target operation in a blank area of ​​the first application (system desktop application) interface, the system can identify the target operation as a request to modify the operating configuration parameters of the touch screen. This method allows users to quickly adjust the operating configuration parameters of the touch screen without opening the settings menu, improving the user's operational efficiency with electronic devices.

[0058] Step S1023: If the effective area is a blank area in the second application interface, determine that the target operation can trigger a second event to be responded to, which calls the target artificial intelligence model. The target artificial intelligence model is determined at least based on the target application to which the second application interface belongs; or, In some implementations, the second application interface may refer to the interface of a non-desktop application under the operating system or pre-operating system, wherein the non-desktop application may include, but is not limited to, the following applications: for example, Office applications, browser applications, communication applications (such as WeChat), drawing applications, UEFI applications, BIOS applications, etc.

[0059] In some implementations, the target AI model is a specific AI model selected based on the type of the target application. For example, for image-related applications, an AI model with image processing or raw image generation capabilities can be invoked, while for text editing-related applications, an AI model with text generation or raw text processing capabilities can be invoked. In this application, when a user performs a target operation in a blank area of ​​the second application interface, the system automatically loads and runs the corresponding target AI model based on the type of the current target application.

[0060] Step S1024: When the scope is a non-blank area, determine the target event to be responded to based on the object information of the displayed object within the scope. The object information includes the object attribute information and / or semantic content information of the displayed object.

[0061] In some implementations, object attribute information may include, but is not limited to, object type, object display parameters, and object shape. Object type may include image type, text type, video type, and audio type. Object display parameters may include, but are not limited to, whether to highlight, whether to bold, font type, font size, and whether to italicize. The semantic content information of the displayed object includes the intent or control commands represented by the semantics.

[0062] In this embodiment, by distinguishing between blank and non-blank areas and making response event decisions in conjunction with specific application interface types, a multi-dimensional understanding of user intent is achieved, thereby enabling accurate matching of corresponding processing logic and further improving the user's operational efficiency and interactive experience when using electronic devices.

[0063] In some embodiments, the method further includes step S1025: Step S1025: When the area of ​​action is a blank area, determine the target event to be triggered based on the operation parameters of the target operation; In some implementations, the operation parameters may include parameters such as operation trajectory, hovering distance and duration, click frequency and intensity, and rate and intensity variation information. Thus, different combinations of these parameters can correspond to different events to be responded to.

[0064] In this application, different actions can correspond to different operation parameters, and different operation parameters can correspond to different events to be responded to. These events can include, but are not limited to, adjusting the operating configuration parameters of the touchscreen display, calling a manual processing model, and adjusting the display mode. Thus, after obtaining the operation parameters of the target action, the event to be responded to that operation parameter can be identified as the target event to be responded to.

[0065] Specifically, step S1025 may include steps S200 and S201: Step S200: When the effective area is a blank area in the first application interface, determine the type and / or value of the adjustable touch display screen operation configuration parameters based on the operation parameters of the target operation; or, In some implementations, adjusting operational configuration parameters can include adjusting the display status of a region, adjusting the display mode, adjusting the split-screen mode, adjusting the HDR mode, adjusting brightness, and adjusting the refresh rate. Different combinations of parameter information can correspond to different types of adjustments to operational configuration parameters.

[0066] In one example, if the operation trajectory is identified as a rectangle, it is determined to adjust the screen brightness. Then, the brightness is determined to decrease or increase based on the speed at which the user draws the rectangle. For example, if the user draws the rectangle at a high speed, the brightness is increased, and if the user draws the rectangle at a low speed, the brightness is decreased.

[0067] In one example, the operation trajectory was identified as a circular frame, indicating an adjustment to split-screen mode.

[0068] In some implementations, adjusting the values ​​of operational configuration parameters may include adjusting the refresh rate, brightness, etc. Different combinations of parameter information can correspond to adjustments of different operational configuration parameter values.

[0069] In one example, if the operation trajectory is identified as a numerical value, it is determined to be an adjustment to the running configuration parameter. Then, the corresponding parameter type is determined based on the speed at which the user draws the value. For example, if the speed is the first speed, the brightness is adjusted to that value; if the speed is the second speed, the refresh rate is adjusted to that value.

[0070] Step S201: When the area of ​​operation is a blank area in the second application interface, determine the artificial intelligence model or its functional service that can be called based on the operation parameters of the target operation.

[0071] In some implementations, different combinations of parameter information can correspond to different artificial intelligence models or functional services.

[0072] In some implementations, different functional services can be determined based on different operation trajectories.

[0073] For example, if the system recognizes that the user's drawn operation trajectory is a rectangle, it determines that a raw image service is needed. In this scenario, the system calls an AI model capable of providing raw image services. If the system recognizes that the user's drawn operation trajectory is a triangle, it determines that a raw text service is needed. In this scenario, the system calls an AI model capable of providing raw text services.

[0074] In some implementations, the AI ​​model can be determined based on the drawing speed. For example, if the drawing speed is a first speed, the AI ​​model is determined to be a model with image generation capabilities. If the drawing speed is a second speed, the AI ​​model is determined to be a model with text generation capabilities.

[0075] In this embodiment, by introducing judgment logic based on operation parameters in the blank area, the processing methods under different application scenarios can be distinguished, thereby reducing redundant interactions such as menu clicks and improving office efficiency.

[0076] In some embodiments, step S1024 may include steps S210 to S212: Step S210: Based on the object attribute information of the display object, determine at least one of the following to trigger the electronic device to perform a scaling operation on the active area, adjust the display parameters of the display object, adjust the display object, or call the target artificial intelligence model; In some implementations, adjusting the display parameters of the display object may include one or more of the following: adjusting the display theme of the display object, adjusting the display layout of the display object, adjusting the display font size of the display object, etc.

[0077] For example, if the object's display attribute indicates it's text, the font size can be adjusted. If the object's display attribute indicates it's an image, the target AI model can be invoked to analyze the image content and generate a corresponding text description. If the object's display attribute indicates it's speech, the speech can be converted into text and inserted into the corresponding area of ​​the touchscreen display.

[0078] In some implementations, adjusting a display object can refer to adding content to the display object, deleting content from the display object, or changing the display attributes of the display object. For example, if the display attribute of the object indicates that the display object is a video, the video can be switched from a static display to a dynamic display, that is, the video can be played.

[0079] Step S211: Determine the functional services of the artificial intelligence model that can be invoked based on the semantic content information of the displayed object; Here, semantic content information refers to the actual meaning and contextual information of the content contained in the displayed object.

[0080] In some implementations, the corresponding artificial intelligence model's functional services can be directly invoked to process the displayed object based on semantic content information.

[0081] For example, the displayed content can be summarized by calling an artificial intelligence model and inserted into the corresponding area of ​​the touch screen. Alternatively, an AI model can be used to generate an image of the displayed content, which can then be inserted into the corresponding area of ​​the touch screen. Finally, AI can be used to refine and supplement the displayed content, and the refined content can be displayed back in the corresponding area of ​​the touch screen.

[0082] Step S212: Obtain the positional relationship between the display object and the operation trajectory of the target operation, and determine the type of event to be triggered based on the positional relationship and the object information of the display object.

[0083] Here, the operation trajectory refers to the path information left by the user when drawing graphics or making pen gestures on the interface, which usually consists of a series of coordinate points.

[0084] In some implementations, the relationship between the displayed object and the operation trajectory can be a selection relationship, where the operation trajectory corresponding to the selection relationship is a closed shape. In this scenario, the event to be responded to can be a scaling operation on the displayed object.

[0085] In some implementations, when the relationship between the display object and the operation trajectory is the deletion of content in the display object, the content indicated by the operation trajectory is deleted from the display object.

[0086] In some implementations, when the relationship between the display object and the operation trajectory is a marker of the content in the display object, the content indicated by the operation trajectory in the display object is highlighted or bolded.

[0087] In some implementations, when the relationship between the display object and the operation trajectory is a modification of the content in the display object, the content to be modified indicated by the operation trajectory is replaced with the corresponding content in the display object.

[0088] In some implementations, when the relationship between the display object and the operation trajectory is to supplement the content in the display object, the content indicated by the operation trajectory in the display object is added to the corresponding content in the display object.

[0089] In this embodiment, by combining object attributes, semantic content, and operation trajectories, the event triggering conditions are further enriched, improving the accuracy and flexibility of the system response, thereby significantly enhancing the user's work efficiency.

[0090] In some embodiments, step S102 may further include steps S1026 and S1027: Step S1026: While the relative position between the pen device and the touch screen remains unchanged, determine the event to be triggered based on the duration of the operation parameter characterization at the target relative position; In some implementations, ensuring that the relative position between the pen device and the touch display remains unchanged can be achieved by the pen device being in a hover state or in a click state, where a click state refers to the user clicking a specific location on the touch display using the pen device.

[0091] In some implementations, when the pen device is in a hovering state, different height ranges can correspond to different events to be responded to. For example, the event to be responded to in the first height range could be an adjustment of display parameters, the event to be responded to in the second height range could be an adjustment of the operating parameters of the touch screen, and the event to be responded to in the third height range could be an operation performed using an artificial intelligence model. Furthermore, after triggering an adjustment of display parameters through the first height range, different types of parameter adjustments can be set for each height value in the first height range. For example, the first height corresponds to an adjustment of the display theme, the second height corresponds to an adjustment of the display layout, and the third height corresponds to an adjustment of the display font size.

[0092] In some implementations, when the pen device is in a click state, different pressure ranges applied to the touchscreen by the user can correspond to different events to be responded to. For example, the event to be responded to by the first pressure range could be an adjustment of display parameters, the event to be responded to by the second pressure range could be an adjustment of the touchscreen's operating configuration parameters, and the event to be responded to by the third pressure range could be an operation performed using an artificial intelligence model. Furthermore, after triggering an adjustment of display parameters through the first pressure range, different types of parameter adjustments can be set for each pressure value within the first pressure range. For example, the first pressure could correspond to an adjustment of the display theme, the second pressure to an adjustment of the display layout, and the third pressure to an adjustment of the display font size.

[0093] In some implementations, when the pen device is in a hover state, different hover duration intervals can correspond to different pending events. For example, the pending event corresponding to the first hover duration interval could be an adjustment of display parameters, the pending event corresponding to the second hover duration interval could be an adjustment of the operating configuration parameters of the touch screen, and the pending event corresponding to the third hover duration interval could be an operation performed using an artificial intelligence model. Furthermore, after triggering the adjustment of display parameters through the first hover duration interval, different types of parameter adjustments can be set for each hover duration value in the first hover duration interval. For example, the first hover duration corresponds to the adjustment of the display theme, the second hover duration corresponds to the adjustment of the display layout, and the third hover duration corresponds to the adjustment of the display font size.

[0094] In some implementations, when the pen device is in a single-click state, different press duration intervals on the touch screen via the pen device can correspond to different pending events. For example, the pending event corresponding to the first press duration interval could be an adjustment of display parameters, the pending event corresponding to the second press duration interval could be an adjustment of the touch screen's operating configuration parameters, and the pending event corresponding to the third press duration interval could be an operation performed using an artificial intelligence model. Furthermore, after triggering an adjustment of display parameters through the first press duration interval, different types of parameter adjustments can be set for each press duration value within the first press duration interval. For example, the first press duration could correspond to an adjustment of the display theme, the second press duration to an adjustment of the display layout, and the third press duration to an adjustment of the display font size.

[0095] In some implementations, when the pen device is in a single-click state, different combinations of pressing durations and pressure levels on the touchscreen can correspond to different events to be responded to. For example, the event to be responded to by the first pressure level could be an adjustment of display parameters, the event to be responded to by the second pressure level could be an adjustment of the touchscreen's operating configuration parameters, and the event to be responded to by the third pressure level could be an operation performed using an artificial intelligence model. Furthermore, after the adjustment of display parameters is triggered by the first pressure level, different types of parameter adjustments can be set for different pressing durations under the first pressure level. For example, pressing with the first pressure level for the first pressing duration corresponds to adjusting the display theme, pressing with the first pressure level for the second pressing duration corresponds to adjusting the display layout, and pressing with the first pressure level for the third pressing duration corresponds to adjusting the display font size. After adjusting the operating configuration parameters of the touch screen by triggering the second pressure, different types of parameters can be adjusted for different pressing durations under the second pressure. For example, pressing with the second pressure for the first pressing duration corresponds to adjusting the brightness, pressing with the second pressure for the second pressing duration corresponds to adjusting the display mode, and pressing with the second pressure for the third pressing duration corresponds to adjusting the refresh rate, etc. In some implementations, when the pen device is in a hovering state, different combinations of hover durations and hover heights can correspond to different events to be responded to. For example, the event to be responded to at the first height could be an adjustment of display parameters, the event to be responded to at the second height could be an adjustment of the operating configuration parameters of the touch screen, and the event to be responded to at the third height could be an operation performed using an artificial intelligence model. Furthermore, after triggering an adjustment of display parameters at the first height, different types of parameter adjustments can be set for different hover durations at the first height. For example, hovering at the first height for the first hover duration corresponds to adjusting the display theme, hovering at the first height for the second hover duration corresponds to adjusting the display layout, and hovering at the first height for the third hover duration corresponds to adjusting the display font size. Hovering at the second height for the first hover duration corresponds to adjusting brightness, hovering at the second height for the second hover duration corresponds to adjusting the display mode, and hovering at the second height for the third hover duration corresponds to adjusting the refresh rate.

[0096] Step S1027: When the operation parameters characterize the relative position change between the pen device and the touch display screen, determine the event to be triggered based on the relative position change parameters. The change parameters include at least one of the change amount, variable type, and change acceleration.

[0097] In some implementations, the event to be triggered is determined based on the change in the relative position of the pen device with respect to the touch screen. The change in relative position may be a change in hovering height, a change in pressure, a change in touch trajectory, etc.

[0098] In some implementations, the variable type may include, but is not limited to, one or more of the following: height, force, trajectory, direction, etc.

[0099] In some implementations, different variable types can correspond to different events to be responded to. For example, height can correspond to the adjustment of display parameters, force can correspond to the operating configuration parameters of the touch screen, trajectory can correspond to the operation of the displayed content, and direction can correspond to the invocation of artificial intelligence models. Furthermore, different heights can correspond to the adjustment of different types of display parameters, different trajectories can correspond to different operations on the displayed content, different force can correspond to the adjustment of operating configuration parameters of different touch screens, and different directions can correspond to the invocation of different types of artificial intelligence models.

[0100] In some implementations, different changes can correspond to different events to be responded to.

[0101] In one example, different height changes can correspond to adjustments of different types of display parameters. For instance, a first height change can correspond to an adjustment of the display layout, a second height change can correspond to an adjustment of the display font size, a third height change can correspond to an adjustment of the display font, and so on. It should be noted that the height change can refer to the difference between two adjacent different heights, or it can refer to the frequency of height changes within a preset time period.

[0102] In one example, different trajectories can correspond to different operations on the displayed content. For example, when the trajectory is a closed shape (e.g., a circle, a triangle, etc.), the display content corresponding to the closed shape can be scaled; when the trajectory is a diagonal line on part of the displayed content, the deletion of that part of the content can be achieved.

[0103] In some implementations, different changes in acceleration can correspond to different events to be responded to. These changes in acceleration can refer to the acceleration due to changes in height between different hovering heights when the user hovers the pen device; it can also refer to the acceleration due to movement of the trajectory generated during the user's movement using the pen device; or it can refer to the acceleration due to changes in force between different pressure levels when the user presses the pen device.

[0104] In one example, different height change accelerations can correspond to adjustments of different types of display parameters. For instance, the first height change acceleration can correspond to adjustments of the display layout, the second height change acceleration to adjustments of the display font size, and the third height change acceleration to adjustments of the display font itself. In another example, different movement accelerations can correspond to different operations on the displayed content. For instance, the first movement acceleration can scale the displayed content corresponding to the closed shape; the second movement acceleration can delete the content corresponding to the trajectory.

[0105] In this embodiment of the application, by determining different events to be responded to based on different states of operation parameters, more refined recognition of user operation intentions can be achieved, thereby improving operation efficiency and interactive experience in office scenarios.

[0106] In some embodiments, step 110 above may include steps S111 to S113: Step S111: Control the target component of the electronic device to execute the target event to be responded to. The target component includes at least one of the hardware component, software component, and processing model of the electronic device. Here, the target component refers to a specific functional module or system component used to execute the target response event. The target component can be a hardware component (e.g., a touch screen controller, a sensor, etc.), a software component (e.g., an operating system kernel, an application programming interface, etc.), or a processing model (e.g., an artificial intelligence model, an image recognition engine, etc.).

[0107] In this application, the execution of the target pending event can be achieved by a single component or by multiple components working together.

[0108] For example, if the target operation is an operation performed by the user within a preset distance of the touch screen using a pen device, the hovering height between the pen device and the touch screen can be obtained by calling the sensor in the hardware component, and then the corresponding application programming interface in the software component can be used to determine the adjustment of the operating parameters of the touch screen corresponding to the hovering height.

[0109] For example, if the target operation is to delete part of the displayed content, the trajectory data of the pen device can be collected, and the software component can determine the content information corresponding to the trajectory data and delete it from the displayed content.

[0110] Step S112: Determine the target region based on the type of the target event to be responded to; and, In some implementations, the target area may include at least one of the following: the display area of ​​the touch screen, the area where the target operation is performed, a blank area in the touch screen, or the area where the target display object is located.

[0111] In some implementations, different target events correspond to different target areas. For example, if the target event is an adjustment operation on the operating parameters of the touch display screen, the target area can be the entire screen area of ​​the touch display screen. If the target event is an operation performed using an artificial intelligence model, the target area can be a blank area in the touch display screen.

[0112] When the target event to be responded to is the identification and editing of the displayed content, the target area can be the area of ​​effect of the target operation.

[0113] When the target event to be responded to is a modification of the display properties of the target display object, the target area can be the area where the target display object is located.

[0114] Step S113: Present the execution result corresponding to the target event to be responded to in the target area, wherein the display parameters of the target input content obtained based on the target operation in the execution result are different from the display parameters of the target display object.

[0115] In some implementations, the display parameters may include a main color, which allows the execution result and the target display object to be displayed in different colors, enabling the user to distinguish the subsequent input or generated content from the original content.

[0116] In some implementations, the display parameters may include identifier parameters, which can highlight the execution results for user differentiation. For example, the execution results can be highlighted, underlined, or bolded.

[0117] Understandably, setting the display parameters of the execution result to be different from those of the target display object allows users to distinguish between the execution result and the target display object via the touch screen. This differentiated display method helps users more intuitively distinguish between the execution result and the original display content, enhancing the user experience and improving the accuracy and friendliness of the human-computer interaction process.

[0118] In this embodiment, on the one hand, the execution of the target response event is achieved by using at least one of the hardware components, software components, and processing models as the target components, thus satisfying diverse user needs through diverse processing components. On the other hand, by presenting the execution results in a differentiated manner in the target area, users can quickly identify the scope of the operation's impact, improving the user-friendliness of the human-computer interaction process.

[0119] In some embodiments, step S111 above includes steps S1111 to S1113: Step S1111: Obtain the target input content by the relative positional change between the pen device and the touch screen, as represented by the operation parameters of the target operation; In some implementations, the target input content can be obtained based on the operation trajectory in the operation parameters. The operation trajectory can be obtained by capturing the trajectory points of the pen device on the touch screen using trajectory acquisition technology, and then using gesture recognition technology to identify the operation trajectory and determine the target input content.

[0120] Step S1112: When the target display object and the target input content are associated, control the first target component to perform a first type of processing on the target display object based on the target input content. The first target component includes the processing model and / or software component of the electronic device. In some implementations, the target display object and the target input content are associated. In this scenario, the target input content is a processing instruction for the target display object, or a processing prompt for the target display object. Thus, the target input content can trigger the processing model and / or software components to process the target display object. This processing of the target display object can include error correction, summary processing, image processing, or illustration processing.

[0121] In some implementations, the target display object is associated with the target input content. The target input content can be an explanation of the target display object, supplementary content, or extended content. In this way, the target input content can trigger the processing model and / or software components to further enrich and improve the content of the target display object.

[0122] In some implementations, determining that there is an association between the target input content and the target display object can be achieved by the target input content containing content that explicitly indicates the target display object. For example, the target input content can be an error correction command for the target display content.

[0123] In some implementations, determining the association between the target input content and the target display object can be achieved by the target input content's corresponding area indicating the target display object. For example, Figure 2 As shown in the left-hand image, the target input content is entered based on the target display object. Or, as... Figure 3 As shown, the target input content is the selection trajectory of the target display object.

[0124] In some implementations, determining the association between the target input content and the target display object can be achieved by setting the target input content's corresponding area to a blank area. In this scenario, the content of the target display object can be summarized.

[0125] Step S1113: When the target display object and the target input content are not associated, control the second target component to perform the second type of processing on the target input content or refer to the target display object to perform the second type of processing on the target input content. The second target component includes the processing model of the electronic device.

[0126] In some implementations, the target display object and the target input content are not associated; that is, the text content corresponding to the target input content is not associated with the target display object.

[0127] In some implementations, performing a second type of processing on the target input content may involve calling an artificial intelligence model to directly generate the target input content.

[0128] In some implementations, performing a second type of processing on the target input content with reference to the target display object may involve calling an artificial intelligence model to generate the target input content in the display style of the target display object, or calling an artificial intelligence model to generate the target input content in the display format of the target display object.

[0129] In this embodiment, firstly, the user's intent is identified through operation parameters and target input content is generated; secondly, based on the relationship between the target input content and the target display object, it is determined whether to perform a first type of processing or a second type of processing; finally, the first target component or the second target component is invoked to complete the corresponding type of processing task. This hierarchical processing structure enables efficient text and image editing and content creation in office scenarios, improving user operational efficiency in such environments.

[0130] In some embodiments, step S113 may further include steps S1131 and S1132: Step S1131: Determine the display status of the target input content obtained from the target operation based on the type of the target event to be responded to; In some implementations, when the target event to be responded to is an adjustment of display parameters, the target input content can be an instruction used to trigger the adjustment of display parameters. In this scenario, the display state of the target input content indicates that the target input content does not need to be displayed.

[0131] In some implementations, when the target event to be responded to is the editing of the target display object, the target input content includes content to be added to the target display object. In this scenario, the display state of the target input content indicates that the target input content needs to be displayed.

[0132] In some implementations, when the target event to be responded to is an adjustment of display parameters, the target input content may be an instruction to trigger an adjustment of the display font. In this scenario, the display state of the target input content indicates that the target input content does not need to be displayed.

[0133] In some implementations, when the target event to be responded to is the generation of target input content, the target input content can be the content to be generated. In this scenario, the display status of the target input content indicates that the target input content needs to be displayed.

[0134] Step S1132: When the display state indicates that the target input content needs to be displayed, determine the second display parameters of the target input content based on the first display parameters of the target display object after responding to the target pending event. The second display parameters are different from the first display parameters.

[0135] Here, the first display parameter refers to the display attributes of the target object before responding to the target event, including but not limited to position, size, color, transparency, and font style. The second display parameter refers to the new display attributes set for the target input content when it needs to be displayed. By setting the second display parameter to be different from the first display parameter, changes can be highlighted and readability enhanced.

[0136] In some implementations, the display parameters may include the main color, so that when the first display parameter represents the first color, the second display parameter can be set to any color different from the first color. For example, when the first color is green, the second display parameter can be set to red, yellow, black, blue, etc.

[0137] In some implementations, the display parameters may include identification parameters. In this way, when the first display parameter represents the first display mode, the second display parameter can be set to any display mode different from the first display mode. For example, when the first display mode is a highlighted display, the second display mode may be a bold display or a tilted display, etc.

[0138] In this embodiment of the application, when it is determined that the target input content needs to be displayed, the second display parameter of the target input content is set to be different from the first display parameter of the target display object. This differentiated presentation method enables users to quickly identify the scope of influence of the target event to be responded to, and improves the user-friendliness of the human-computer interaction process.

[0139] The following describes the application of the embodiments of this application in a real-world scenario.

[0140] To address the issue that users often need to rely on pen devices to perform basic office tasks when using electronic devices due to the lack of keyboard and mouse support, this application proposes a pen gesture processing method, aiming to enable document editing and image generation functions quickly and efficiently through pen devices.

[0141] In this application, when a user opens an office document such as PPT or Word and performs an operation on a certain page, the user can use a pen device to draw on the display area of ​​the display component of the electronic device, and achieve different operations through different drawing trajectories.

[0142] In some embodiments, the drawing trajectory can be a closed graphic trajectory (e.g., rectangle, triangle, ellipse, circle, etc.). In this scenario, different processing logic can be executed depending on whether the first area circled by the image trajectory is a blank area.

[0143] In some embodiments, when the first region is not a blank region, that is, when there is any content such as text or images in the region, the first region is identified and automatically focused and enlarged to display the content in the first region on the whole screen so that the user can edit the content in the first region.

[0144] In some implementations, the shape of the region obtained by drawing the trajectory can be magnified and displayed. For example, as... Figure 3 As shown, when the drawn trajectory is an ellipse, the area selected by the ellipse is magnified for display. For example... Figure 4 As shown, when the drawn trajectory is a rectangle, the area selected by the rectangle is enlarged for display.

[0145] In some implementations, the processing logic for the case where the first region is not a blank region is described, and may include steps S1 to S4: Step S1: Global stroke recognition section.

[0146] First, the trajectory acquisition module obtains a set of data for all trajectory points in the drawing trajectory by the pen device. The handwriting acquisition module records this trajectory point data based on the screen resolution. Then, the gesture recognition module analyzes the set of trajectory point data, identifies the trajectory as a closed shape, and outputs the image range information corresponding to the closed shape.

[0147] Step S2: Obtain the contents of the closed shape.

[0148] Based on the identified image range information using the relevant interfaces of the office software, determine whether there are text and / or image elements within the first region represented by the image range information. If they are found to exist, extract the text and / or image elements from the first region.

[0149] Step S3: Integrate the extracted content into the canvas and make modifications.

[0150] The text and / or image elements extracted in step S2 are rendered into the canvas component of the electronic device, allowing the user to further edit the content in the first area.

[0151] During the user's editing of the content in the first area, the trajectory point data drawn by the user on the canvas is input into the stroke recognition module for recognition, and corresponding operations are performed. For example, if the trajectory point data represents a deletion stroke, the rectangular range of the deletion stroke is obtained, and the positional relationship between the rectangular range of the deletion stroke and the rectangular ranges corresponding to each element in the first area is determined based on the rectangular range of the deletion stroke. If the rectangular range of an element coincides with the rectangular range of the deletion stroke, the element is removed from the canvas.

[0152] Step S4: Update the modified content into the original office document.

[0153] After completing step S3, extract the text and / or image elements from the canvas and use the relevant interfaces of the office software to update the content of the canvas to the original office document.

[0154] In some embodiments, when the first area is a blank area, that is, when there is no text or image content in the area, the relevant artificial intelligence model can be invoked to perform image generation or text generation operations.

[0155] In some implementations, the content of the generated image or text corresponding to the generated image operation can be determined by prompts entered by the user, or it can be determined based on the content of the office document.

[0156] In some implementations, the shape and area of ​​the raw image are related to the drawing trajectory. For example, as... Figure 5 As shown, when the drawn trajectory is an ellipse, the image output by the AI ​​model is also elliptical. Figure 6 As shown, when the drawn trajectory is a rectangle, the image output by the artificial intelligence model is rectangular.

[0157] In some implementations, the processing logic for the case where the first region is a blank region is described, and may include steps S11 to S13: Step S11: Global stroke recognition section.

[0158] First, the trajectory acquisition module obtains a set of data for all trajectory points in the drawing trajectory by the pen device. The handwriting acquisition module records this trajectory point data based on the screen resolution. Then, the gesture recognition module analyzes the set of trajectory point data, identifies the trajectory as a closed shape, and outputs the image range information corresponding to the closed shape.

[0159] Step S12: Create an input window in the office document.

[0160] An input window is created based on the relevant interfaces of the office software, allowing users to input prompts in this window.

[0161] Step S13: Perform the raw image operation.

[0162] If content exists in step S12, the user-inputted prompts can be used as input to the AI ​​model, enabling the AI ​​model to perform image generation based on the input. If no content exists in step S12, the content of a text document can be used as input to the AI ​​model, enabling the AI ​​model to perform image generation based on the content of the text document.

[0163] It should be noted that for image and text operations, it is necessary to analyze the currently displayed content on the screen or select the content before performing the operation. For example, image and text operations can be performed based on the following dimensions: ① Keyword matching: The output text and image content needs to take into account the keywords contained in the input content and context. For example, "artificial intelligence" and "AI", proper nouns such as "PPT" or domain terms such as "quantum computing", etc.

[0164] ② Thematic Consistency: The output text and images should revolve around the core theme displayed on the current interface. For example, if the context discusses "project management processes," the output content should be generated and associated with this theme.

[0165] ③ User Intent Continuation: The output text and image content needs to match the user's current task scenario. For example, if a user is writing a report and enters a request for "supplementary data examples," the output content needs to be intent-matched.

[0166] In some embodiments, the drawing trajectory may include strokes used to edit the content of the document, such as... Figure 2 As shown, adding a wavy line under the text content will make it bold; adding a horizontal line under the text content will make it highlight; inserting content in the middle of the text content will add the content to the text content; and deleting content in the text content will delete the content corresponding to the deleted stroke.

[0167] In some embodiments, after the corresponding processing function is triggered, multimodal interaction methods, such as pen gestures, voice, gestures, eye movements, etc., can be used to confirm whether the obtained output content should be displayed or whether the output content should be further modified.

[0168] For example, if a user is satisfied with the images and text output by the AI ​​model, they can perform a first action to confirm that the content is displayed on the screen. This first action could be a checkmark made with a pen gesture, a voice input of "confirm," an "OK" gesture, or eye contact for a preset duration to indicate tacit approval.

[0169] Alternatively, if the user is not satisfied with the images and text output by the AI ​​model, the user can use the gestures defined in this solution to make further modifications, or use voice input to input new keywords or commands to interact with the AI ​​model and modify the generated content.

[0170] This application provides an electronic device, including: a first body and a second body rotatably connected, a touch display screen disposed on the first body and / or the second body, a processor, and a target application process or target processing model capable of running on the processor, wherein the target application process or the target processing model runs on the processor to perform the following operations: In response to obtaining a target operation performed by a pen device on a touch screen, a target event to be responded to that can be triggered by the target operation is determined; the execution result of the electronic device executing the target event to be responded to is presented in a target area of ​​the touch screen; wherein, the target area includes at least one of the following: the display area of ​​the touch screen, the area where the target operation is active, a blank area in the touch screen, or the area where the target display object is located, and the target display object is an object determined based on the target operation; different target events to be responded to that triggered by different target operations may or may not be related to the target display object; the presentation parameters of the execution result are different from the initial display parameters of the target area; the target event to be responded to depends on the target application process or the target processing model. In some implementations, a model may refer to a model used to implement a data processing method.

[0171] In some implementations, the electronic device may refer to a laptop computer. In this scenario, if the touch screen is located on the first body, the first body may refer to the casing on the screen side of the laptop computer, and the second body may refer to the casing on the keyboard side of the laptop computer.

[0172] In some embodiments, the target application process or the target processing model described above may also execute any step in the data processing method of the electronic device described above.

[0173] This application also proposes a computer program including computer-readable code. When the computer-readable code is run in an electronic device, the processor in the electronic device executes a data processing method provided in this application.

[0174] This application provides a computer program product, including a computer program or computer executable instructions. When the computer program or computer executable instructions are executed by a processor, they implement the data processing method provided in this application.

[0175] This application provides a computer-readable storage medium storing a computer program or computer-executable instructions for implementing the data processing method provided in this application when executed by a processor.

[0176] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. A data processing method, comprising: In response to obtaining a target operation performed by the pen device on the touch screen of the electronic device, a target event to be responded to is determined that the target operation can trigger. The execution result of the electronic device performing the target event to be responded to is displayed in the target area of ​​the touch screen; The target area includes at least one of the following: the display area of ​​the touch screen, the area where the target operation is performed, a blank area in the touch screen, or the area where the target display object is located. The target display object is an object determined based on the target operation. Different target operations trigger different target-response events, which may or may not be related to the target display object; The presentation parameters of the execution result are different from the initial display parameters of the target area.

2. The method according to claim 1, wherein determining a target event that the target operation can trigger is in response to obtaining a target operation performed by the pen device on the touch screen of the electronic device, comprising: The target operation is obtained by measuring the area of ​​action of the target operation on the touch screen and / or the operation parameters of the target operation, wherein the operation parameters can characterize the relative position information between the pen device and the touch screen. Based on the object information within the scope of action and / or the operation parameters, a target event to be responded to is determined that the target operation can trigger. The target event to be responded to depends on the target process or target processing model of the electronic device.

3. The method according to claim 2, wherein, Based on object information within the defined area of ​​effect, the target operation can trigger a target event to be responded to, including: Determine whether the area of ​​effect of the target operation is a blank area; If the area of ​​action is a blank area in the first application interface, it is determined that the target operation can trigger a first pending event that adjusts the operating configuration parameters of the touch screen, and the first application interface belongs to the desktop application of the electronic device; or, If the area of ​​action is a blank area in the second application interface, it is determined that the target operation can trigger a second pending event that invokes the target artificial intelligence model, wherein the target artificial intelligence model is determined at least based on the target application to which the second application interface belongs; or, When the effective area is a non-blank area, the target event to be responded to is determined based on the object information of the displayed object within the effective area. The object information includes the object attribute information and / or semantic content information of the displayed object.

4. The method according to claim 3, further comprising: When the area of ​​action is a blank area, the target event to be triggered is determined based on the operation parameters of the target operation; The determination of the target event to be triggered based on the operation parameters of the target operation includes: When the effective area is a blank area in the first application interface, the type and / or value of the adjustable operating configuration parameters of the touch display screen are determined based on the operating parameters of the target operation; or, When the area of ​​action is a blank area in the second application interface, the artificial intelligence model or its functional service that can be invoked is determined based on the operation parameters of the target operation.

5. The method according to claim 3, wherein, The determination of the target event to be responded to based on the object information of the displayed object within the effective area includes at least one of the following: Based on the object attribute information of the display object, determine at least one of the following: trigger the electronic device to perform a scaling operation on the active area, adjust the display parameters of the display object, adjust the display object, or call the target artificial intelligence model; The functional services of the artificial intelligence model that can be invoked are determined based on the semantic content information of the displayed object; Obtain the positional relationship between the display object and the operation trajectory of the target operation, and determine the type of event to be triggered based on the positional relationship and the object information of the display object.

6. The method according to claim 2, wherein, Determining the target response event that the target operation can trigger based on the operation parameters includes: When the operation parameters characterize the relative position between the pen device and the touch display screen as unchanged, the event to be triggered is determined based on the duration of the target relative position. When the operating parameters characterize the relative position change between the pen device and the touch display screen, a triggerable event is determined based on the relative position change parameters, wherein the change parameters include at least one of the change amount, variable type, and change acceleration.

7. The method according to claim 1, wherein presenting the execution result of the electronic device executing the target event to be responded to in the target area of ​​the touch display screen comprises: Controlling a target component of an electronic device to execute the target event to be responded to, wherein the target component includes at least one of the electronic device's hardware components, software components, and processing model; The target region is determined based on the type of the target event to be responded to; as well as, The execution result corresponding to the target event to be responded to is presented in the target area, wherein the display parameters of the target input content obtained based on the target operation in the execution result are different from the display parameters of the target display object.

8. The method according to claim 7, wherein, The target component of the control electronic device executes the target event to be responded to, including: The target input content is obtained by obtaining the relative positional change between the pen device and the touch screen as represented by the operation parameters of the target operation; When the target display object and the target input content are associated, the first target component is controlled to perform a first type of processing on the target display object based on the target input content. The first target component includes a processing model and / or software component of the electronic device. When the target display object and the target input content are not associated, the second target component is controlled to perform a second type of processing on the target input content or to perform a second type of processing on the target input content with reference to the target display object. The second target component includes the processing model of the electronic device.

9. The method according to claim 7 or 8, wherein presenting the execution result corresponding to the target event to be responded to in the target area includes: The display status of the target input content obtained from the target operation is determined based on the type of the target event to be responded to. When the display state indicates that the target input content needs to be displayed, a second display parameter of the target input content is determined based on the first display parameter of the target display object after responding to the target pending event. The second display parameter is different from the first display parameter.

10. An electronic device, comprising: A first body and a second body are rotatably connected, a touch display screen and a processor are disposed on the first body and / or the second body, and a target application process or a target processing model capable of running on the processor, wherein the target application process or the target processing model runs on the processor to perform the following operations: In response to obtaining a target operation performed by a pen device on the touch display screen, a target pending event that the target operation can trigger is determined; the execution result of the electronic device executing the target pending event is presented in a target area of ​​the touch display screen; wherein, the target area includes at least one of the display area of ​​the touch display screen, the area of ​​action of the target operation, a blank area in the touch display screen, or the area where the target display object is located, and the target display object is an object determined based on the target operation; different target pending events triggered by different target operations are related to or unrelated to the target display object; the presentation parameters of the execution result are different from the initial display parameters of the target area; the target pending event depends on the target application process or the target processing model.

Images