Data processing method and electronic equipment

Abstract

The invention discloses a data processing method and electronic equipment. The data processing method comprises the following steps: monitoring first interaction data input into a first application of the electronic equipment; outputting a target function service option in a target area of the electronic equipment in response to the fact that the first interaction data meets a target triggering condition; wherein the target function service option is an option which can be provided by the target processing model or a target application of the electronic equipment and is used for executing a target processing operation on the target data; the target data is from the first interaction data or second interaction data different from the first interaction data.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data processing method and electronic equipment. Background Art

[0002] With the continuous development of artificial intelligence technology, users often need to use artificial intelligence models such as large language models to process data.

[0003] However, if users want to use the artificial intelligence model, they need to first open a specific application configured with the artificial intelligence model and use the specific application to implement the corresponding data processing, which makes the data processing more complex. Summary of the invention

[0004] On the one hand, the present application provides a data processing method, comprising:

[0005] Monitoring first interaction data input to a first application of an electronic device;

[0006] In response to the first interaction data satisfying a target trigger condition, outputting a target function service option in a target area of ​​the electronic device;

[0007] The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data;

[0008] The target data comes from the first interaction data or second interaction data different from the first interaction data.

[0009] In a possible implementation manner, the first interaction data satisfies a target trigger condition, including at least one of the following:

[0010] In response to monitoring input of target character string data, determining that the first interaction data satisfies the target trigger condition;

[0011] In response to monitoring input of target voice segment data, determining that the first interaction data satisfies the target trigger condition;

[0012] In response to monitoring the input target trajectory data, determining that the first interaction data satisfies the target trigger condition;

[0013] In response to monitoring the target gesture action or the target posture change data, determining that the first interaction data satisfies the target trigger condition;

[0014] In response to a behavior parameter when the first interaction data is input satisfying a corresponding parameter threshold, it is determined that the first interaction data satisfies the target trigger condition.

[0015] In yet another possible implementation, outputting a target function service option in a target area of ​​the electronic device includes at least one of the following:

[0016] In response to the first interaction data satisfying a target trigger condition, determining target data, so as to output a target function service option for the target data in the target area;

[0017] In response to the first interaction data satisfying a target trigger condition, obtaining application information of the first application, and outputting a target function service option in the target area based on the application information;

[0018] In response to the first interaction data satisfying a target trigger condition, determining target data, and outputting a target function service option for the target data in the target area based on the application information of the first application;

[0019] In response to the first interaction data satisfying a target trigger condition, operation information of a target operation is obtained, and a target function service option for the target data is output in the target area based on the operation information, wherein the target operation is at least used to obtain the target data; wherein the target area is located or not located in the window area of ​​the first application.

[0020] In yet another possible implementation, determining the target data includes at least one of the following:

[0021] Obtaining a behavior parameter when the first interaction data is input, and determining the target data from the interaction data input to the first application based on the behavior parameter, wherein the target data is interaction data generated by an input operation having a target behavior parameter;

[0022] using the target sensitive word in the interaction data input into the first application as the target data;

[0023] determining the interaction data input into the first application after satisfying the target trigger condition as the target data;

[0024] determining data from a second application obtained after a target trigger condition is satisfied as the target data, the second application having a target communication connection with the first application;

[0025] The data determined by the target operation acting on the window display data of the first application is used as the target data, and the window display data includes the first interaction data and the application data of the first application.

[0026] In yet another possible implementation, outputting a target function service option for the target data in the target area includes at least one of the following:

[0027] Outputting at least one target function service option for the target data in a first area in the window area of ​​the first application, wherein a target position relationship exists between the first area and the area where the target data is located;

[0028] outputting at least one target function service option for the target data in a second area, where the second area is a pop-up window area covering a portion of the window area of ​​the first application;

[0029] Outputting the target data and at least one target function service option for the target data in a window area of ​​a second application, wherein the second application is an application capable of invoking a target processing model to provide a target function service;

[0030] Obtaining attribute information of the target data, and outputting at least one matching target function service option in the target area based on the attribute information;

[0031] Identifying a user intention represented by the target data, and outputting at least one matching target function service option in the target area based on the user intention;

[0032] Obtaining load resource information of the electronic device, and outputting at least one target function service option matching the target data in the target area based on the load resource information;

[0033] Obtaining user portrait information of a target user, and outputting at least one matching target function service option in the target area based on the user portrait information and attribute information of the target data;

[0034] The source information of the target data is obtained, and at least one matching target function service option is output in the target area based on the source information.

[0035] In yet another possible implementation, outputting a target function service option in the target area based on the application information of the first application includes at least one of the following:

[0036] Outputting at least one target function service option matching the application identification information of the first application in the target area;

[0037] outputting at least one target function service option different from the function service that can be provided by the first application in the target area based on the application configuration information of the first application;

[0038] Determine a user intention based on the application identification information of the first application and the target data, and output at least one matching target function service option in the target area based on the user intention;

[0039] At least one matching target function service option is output in the target area based on the running status information of the first application.

[0040] In yet another possible implementation, outputting a target function service option for the target data in the target area based on the operation information includes at least one of the following:

[0041] outputting at least one target function service option in the target area based on the content of the target data and the information of the operating device implementing the target operation, wherein at least one of the output target function service options is different under the action of different operating devices;

[0042] Outputting at least one matching target function service option in the target area based on the content of the target data and the user portrait information of the operating user of the target operation, wherein at least one of the output target function service options is different under the operation of different operating users;

[0043] Outputting at least one matching target function service option in the target area based on the content of the target data and the operating environment information of the target operation, wherein at least one of the output target function service options is different in different operating environments;

[0044] In the case where the target data includes text data, based on the operating device information and / or operating user information of the target operation, outputting in the target area a target function service option including or excluding a target function service option for changing the data amount or type of the text data and / or for acquiring associated data of the text data;

[0045] In the case where the target data includes image data, based on the operating device information and / or operating user information of the target operation, outputting in the target area a target function service option including or excluding a target function service option for changing the data amount or type of the image data and / or for acquiring associated data of the image data;

[0046] In the case where the target data includes an access address, outputting a target function service option including or not including a target function service option for changing an access mode or an output type of content corresponding to the access address in the target area based on the operating device information and / or the operating user information of the target operation;

[0047] In the case where the target data includes media playback data, outputting a target function service option including or not including a target function service option for changing playback parameters of the media playback data in the target area based on the operating device information and / or operating user information of the target operation;

[0048] In the case where the target data includes text data and image data, the target area output includes or does not include target function service options for layout design or content generation for the text data and image data based on the operating device information and / or operating user information of the target operation.

[0049] In yet another possible implementation, the method further includes:

[0050] If the first application outputs a first window in response to the first interaction data satisfying the target trigger condition, adjust the position relationship between the target area and the first window; if the first application outputs a first window in response to the first interaction data satisfying the target trigger condition, adjust the display parameters of the first window based on the target function service options output in the target area, or process the display content of the first window.

[0051] In another aspect, the present application further provides an electronic device, comprising at least one processor and at least one large model file capable of running on the processor, wherein the large model file can be called by at least one application running on the electronic device to perform at least one of the following:

[0052] Monitoring first interaction data input to a first application of an electronic device;

[0053] In response to the first interaction data satisfying a target trigger condition, outputting a target function service option in a target area of ​​the electronic device;

[0054] The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data;

[0055] The target data comes from the first interaction data or second interaction data different from the first interaction data.

[0056] In a possible implementation, the electronic device includes a first body and a second body that are rotatably connected, and at least one of the first body and the second body has a display screen to output the target function service option in a target area on the display screen; wherein outputting the target function service option in the target area includes at least one of the following:

[0057] In response to the first interaction data satisfying a target trigger condition, determining target data, so as to output a target function service option for the target data in the target area;

[0058] In response to the first interaction data satisfying a target trigger condition, obtaining application information of the first application, and outputting the target function service option in the target area based on the application information;

[0059] In response to the first interaction data satisfying a target trigger condition, determining target data, and outputting a target function service option for the target data in the target area based on the application information of the first application;

[0060] In response to the first interaction data satisfying a target trigger condition, obtaining operation information of a target operation, and outputting a target function service option for the target data in the target area based on the operation information, wherein the target operation is at least used to obtain the target data;

[0061] The target area is located in or not located in the window area of ​​the first application. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0063] Figure 1 A flow chart of a data processing method provided in this application;

[0064] Figure 2 A schematic diagram of another flow chart of the data processing method provided in this application;

[0065] Figure 3 A schematic diagram of the flow of the data processing method provided in this application in an application scenario;

[0066] Figure 4 A schematic diagram of another flow chart of the data processing method provided in this application;

[0067] Figure 5 A schematic diagram of another flow chart of the data processing method provided in this application;

[0068] Figure 6 A flowchart of the data processing method provided by the present application in another application scenario;

[0069] Figure 7 A schematic diagram of another flow chart of the data processing method provided in this application;

[0070] Figure 8 A schematic diagram of the structure of an electronic device provided in this application. DETAILED DESCRIPTION

[0071] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation mode of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application. It is known to those skilled in the art that with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0072] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0073] like Figure 1 , shows a flow chart of a data processing method provided by an embodiment of the present application. The method of this embodiment can be applied to an electronic device, which can be a laptop, a tablet computer, a mobile phone, or a desktop computer, etc., without limitation. The method of this embodiment may include:

[0074] S101, monitoring first interaction data of a first application input into an electronic device.

[0075] The first application may be an application currently being used by the user, or any application currently having input. The type of the first application may be various, such as a document application, a presentation application, a mailbox application providing mail services, an instant messaging application, an image editing application, a drawing application, an image generation application, a browser application, a social application, a conference application, or a live broadcast application for live video broadcasting, etc. Of course, the first application may also be at least one pre-specified application to be monitored.

[0076] In the present application, there are many possibilities for the specific implementation of monitoring whether the first interaction data input to the first application exists, which are described in several cases:

[0077] For example, the hook technology in the operating system can be used to monitor whether there is first interactive data input in the application in the electronic device. For example, taking the operating system of the electronic device as the Windows system, the Windows hook technology can be used to monitor each application in the electronic device to timely monitor the first interactive data input in the first application.

[0078] For another example, the application program interface of the first application may be called to monitor whether the first interaction data is input into the first application.

[0079] For another example, the first application having the first interactive data input is determined by monitoring identification information of an active driver.

[0080] Of course, there may be other monitoring methods, which are not specifically limited.

[0081] In the present application, the first interaction data refers to data input into the first application, and the specific data form of the first interaction data may be various, such as a string of characters, voice data, handwriting image data, input gesture data, sensing data, or motion image.

[0082] S102: In response to the first interaction data satisfying a target trigger condition, outputting a target function service option in a target area of ​​the electronic device.

[0083] Among them, the first interaction data meeting the target trigger condition indicates that the first application has the need to process data with the help of a processing model or provide AI function services. There may be many possibilities for the target trigger condition, which can be set according to actual needs. For example, the first interaction data meeting the target trigger condition may be: detecting a set target string, setting a gesture action, setting a voice signal, or setting handwriting content, such as including a set target string in the first interaction data, setting a gesture action, setting a voice signal, or setting handwriting content, or, after the first interaction data, there is a set target string, setting a gesture action, setting a voice signal, or setting handwriting content. Several possible situations will be used as examples in the following, and I will not go into details here.

[0084] The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data.

[0085] The target data comes from the first interaction data or from second interaction data different from the first interaction data.

[0086] For example, the target data may be at least part of the data in the first interaction data. For example, when the first interaction data includes a set target string, a set gesture action, a set voice signal, or a set handwriting content that makes the first interaction data meet the target trigger condition, the target data may be data input before the set target string, the set gesture action, the set voice signal, or the set handwriting content in the first interaction data (for example, the data may be the last sentence string, or a voice signal or gesture action input at the most recent set time, etc.).

[0087] For another example, the target data may come from second interactive data. The second interactive data may be data input into the first application before the first interactive data, or may be data obtained after the first interactive data and originating from other applications other than the first application.

[0088] Of course, there may be other possibilities for the target data, which will be described in detail in several cases later and will not be elaborated here.

[0089] In the present application, the target processing model can be a local model of the electronic device, or a model located in the cloud or edge device. The target processing model can be any type of artificial intelligence model, such as an image generation model, a large language model, or at least one of other machine learning models.

[0090] The target application may be an application that can call a target processing model, or an application that can provide a processing operation corresponding to a target functional service option.

[0091] There may be multiple possibilities for the target processing operations that the target processing model or the target application can perform on the target data, which may vary depending on the function of the target processing model or the data processing function configured by the target application.

[0092] For example, the target processing operations that can be performed by the target processing model or target application may include, but are not limited to, translation, search, semantic interpretation, image generation, writing, video generation, image editing, image redrawing, information search, content answers, and sentence reply operations with the help of artificial intelligence.

[0093] Accordingly, based on the type of target processing operation that the target processing model or target application can perform, the type of the target function service option may also have multiple possibilities. Based on this, the target function service option that can be output in the present application may be a list or set of target function service options, and at least one target function service option may be included in the list or set.

[0094] In the present application, the target area may be located in the window area of ​​the first application or may not be located in the window area of ​​the first application.

[0095] For example, the target area may be a partial area within the window area of ​​the first application. In this case, the target area may belong to the same layer as the window area of ​​the first application, for example, the target area may be an embedded window area or a segmented area within the window area. The target area may also be in a different layer from the window area of ​​the first application, for example, the target area may be a floating pop-up window area within the window coverage of the application.

[0096] For another example, the target area may be a pop-up window area that may be located outside the coverage of the window area of ​​the first application, or a window area of ​​another form.

[0097] The solution of the present application can be executed by a specific application (such as a target application) other than the first application to enable the specific application to monitor the first application and provide artificial intelligence services to the first application in a timely manner.

[0098] From the above content, it can be seen that after monitoring the first interactive data input into the first application of the electronic device, if the first interactive data meets the target trigger condition, the target function service option can be output in the target area of ​​the electronic device. Since the target function service option is an option corresponding to the target processing operation that can be provided by the target processing model or the target application, during the user's use of the first application, the user does not need to start other specific applications separately, and the relevant data in the first application can be processed with the help of the processing model or the target application, thereby improving the convenience of data processing.

[0099] It can be understood that after outputting the target function service option, in response to the target function service option being triggered, the present application can also detect that the target function service option is triggered, such as detecting that the user clicks or selects the target function option by other means, etc., and perform the target processing operation corresponding to the triggered target function service option on the target data through the target processing model or target application.

[0100] For example, if the target function service option is a translation option, then after the target function service option is triggered, the target data can be translated through the target processing model or the target application.

[0101] Furthermore, the present application can also display processing result data corresponding to the target data in an electronic device.

[0102] For example, the target data is displayed at the position of the cursor or other input point in the first application when the target trigger condition is met; or the target data is displayed at the current position of the cursor or other input point in the first application.

[0103] As another example, the target data is displayed in the window area of ​​the second application. The second application is the application to which the target trigger condition is jumped when the target trigger condition is met. For example, the second application is the target application. On this basis, after the second application processes the target data and obtains the processing result data, the processing result data can be displayed in the window area of ​​the second application. The second application can also be the application where the input point such as the cursor is currently located. For example, after the first interactive data meets the target trigger condition, the user moves the cursor from the first application to the second application, then the target processing model or the processing result data obtained by the target application can be displayed at the position of the input point in the second application.

[0104] Of course, after obtaining the processing result data corresponding to the target data, the present application may not display the processing result data of the target data, but directly store the processing result data corresponding to the target data, for example, storing the processing result data in a storage area corresponding to a storage address preset by the user.

[0105] Several possible situations in which the first interaction data meets the target trigger condition in this application are described below:

[0106] In a possible case, in response to monitoring input of target character string data, it may be determined that the first interaction data meets the target trigger condition.

[0107] Among them, the target string data can be a set string data for waking up the artificial intelligence function service. The length and specific content of the target string data can be set according to actual needs, without restriction. Moreover, the target string data can be a specific character or character combination, or a specific prompt word, etc. The target string data can be pre-configured by the electronic device, or can be flexibly set by the user according to his own needs, without restriction.

[0108] For example, the target string data may be "@AI", "@lenovo", "#AI#", or other prompt strings containing set characters such as "AI"; it may also be the name of the target application, or a string containing the name of the target application, etc., without limitation. The target string data may be located at the end of the first interactive data, or may be located at other positions in the first interactive data, without limitation.

[0109] In another possible scenario, the present application may determine that the first interaction data meets the target trigger condition in response to monitoring input target voice segment data.

[0110] The target voice segment data may also be set as needed. For example, the target voice segment data may be voice data that at least includes the name of the target processing model or the target application, or includes voice data that can indicate that artificial intelligence processing is required. For example, the target voice segment data may include voice information such as "use AI", "AI" or "target application name".

[0111] In yet another possible scenario, in response to monitoring input target trajectory data, it is determined that the first interaction data satisfies a target trigger condition.

[0112] The target trajectory data may be any set handwriting trajectory data, and the target trajectory data may indicate that the first application or the user of the first application has a need to call an artificial intelligence function service. For example, the target trajectory data may be handwriting or strokes in the shape of a character string "AI"; or may be handwriting or touch trajectory in the shape of "L", "artificial intelligence" or other set shapes.

[0113] In yet another possible scenario, in response to monitoring target gesture action or target posture change data, it is determined that the first interaction data satisfies the target trigger condition.

[0114] The target gesture action or target posture change data may also be set as needed, and the specific set data may be different depending on the specific implementation of the gesture action and posture detection.

[0115] For example, the target gesture action or target posture change data may be: a long press or sliding action of two fingers sensed by a touch screen, or a click action of a stylus; or a click action of specific keys of a mouse or keyboard; or a pre-set user gesture or action that can be recognized by a camera, the user's line of sight, the posture change of the electronic device, etc., wherein the posture change of the electronic device may be a change in the screen angle of the electronic device, a specific posture change or jitter, etc.

[0116] For another example, the target gesture action or target posture change data may also be: a screenshot operation, a circle selection operation, a drag operation, a hover operation, an eye tracking operation, or a word marking operation for marking at least one character, etc. For example, a screenshot operation may be an operation of taking a screenshot of at least part of the text or image displayed or input by the first application; a circle selection operation may be an operation of selecting at least part of the text or image content displayed or input by the first application; and a hover operation may be an operation of the user's finger resting on the application window of the first application or operating the floating window.

[0117] In yet another possible scenario, in response to a behavior parameter when the first interaction data is input satisfying a corresponding parameter threshold, it is determined that the first interaction data satisfies the target trigger condition.

[0118] The behavior parameters when inputting the first interaction data may include, but are not limited to, specific behavior data parameters when inputting the first interaction data, including, but not limited to, modification, erasure, deletion, input continuity, and whether there is repeated input, etc. Correspondingly, the behavior parameter meeting the corresponding parameter threshold may be that the freeze time during the input of the first interaction data exceeds a set time length; or there may be more than a set number of modifications, erasures, deletions, or repeated inputs, etc.

[0119] It can be understood that in the above possible situations, the target character string data, the target voice segment data and the target trajectory data may belong to the first interaction data, or may be regarded as data input after the first interaction data, without any specific limitation.

[0120] In the present application, in response to the first interaction data satisfying the target trigger condition, the specific implementation of outputting the target function service option in the target area of ​​the electronic device may also have multiple possibilities. The following introduces several possible implementations of determining and outputting the target function service option to introduce the data processing method of the present application.

[0121] Based on a possible implementation method of outputting target function service options in the target area of ​​the electronic device, the implementation process of the data processing method of the present application can be found in Figure 2 .like Figure 2 The data processing method shown may include the following steps S201 and S202:

[0122] S201, monitoring first interaction data of a first application input into an electronic device.

[0123] This step can be referred to the previous related introduction and will not be repeated here.

[0124] S202: In response to the first interaction data satisfying a target trigger condition, determine target data to output a target function service option for the target data in a target area of ​​the electronic device.

[0125] The target function service options are options that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data.

[0126] The specific time limit for the first interaction data to meet the target trigger condition may be at least one of the several possible situations mentioned above, and is not specifically limited.

[0127] The target data may be data determined from the first interaction data or data input into the first application before the first interaction data, or data input or transmitted to the first application after the first interaction data. The data format of the target data may also be various, such as text data, voice data, image data, or sensor signal data, etc., without limitation.

[0128] Several possible situations for determining target data are described below:

[0129] For example, in one possible case, a behavior parameter when the first interaction data is input can be obtained, and target data can be determined from the interaction data input to the first application based on the behavior parameter, wherein the target data is interaction data generated by an input operation with a target behavior parameter.

[0130] The interaction data input into the first application here may include the first interaction data, or the second interaction data, or may include both the first interaction data and the second interaction data. For example, the second interaction data may be data input before or after the first interaction data.

[0131] The target behavior parameter may include at least one of the following parameter information: number of modifications, whether there is a mark, input handwriting force, input error, spelling error, deletion frequency, and number of deletions. On this basis, the interactive data generated by the input operation with the target behavior parameter may be data marked by a focus identifier or other means, data with spelling errors or splicing errors exceeding a set number of times, data with handwriting traces or touch input force exceeding a set force, and data in a data area with repeated deletions exceeding a set number of times.

[0132] It is understandable that if the user modifies or deletes part of the data input or displayed in the first application many times, or marks it as important, it means that the user is unable to effectively edit the data, correctly understand the data, or correctly input the data. In order to accurately complete the processing of the data, it is possible to use processing models such as artificial intelligence models or target applications with processing model functions to provide at least one target function service option that can operate and process the data, so that the user can efficiently process the corresponding data with the help of the target application or target processing model.

[0133] In another possible situation, the present application may use the target sensitive word in the interaction data input into the first application as the target data.

[0134] In this possible manner, the interaction data input into the first application can refer to the above related introduction and will not be described in detail.

[0135] Among them, the target sensitive words can be pre-set, such as target sensitive words can include but are not limited to set names of people, places, buildings, animals, objects, files, or language characters of a set country (for example, if the user often uses Chinese, then English and other foreign characters can be used as target sensitive words), etc., so that these target sensitive words can be searched, information queried, translated, etc. in the future.

[0136] In yet another possible scenario, the interaction data input into the first application after the target trigger condition is satisfied may be determined as the target data.

[0137] For example, when a target string, target voice segment data, target trajectory data, or target gesture action is detected to be input and meets the target trigger condition, a segment or sentence of interaction data input after the target string, target voice segment data, target trajectory data, or target gesture action is input, or the interaction data input within a set time period is determined as the target data. For example, assuming that "@AI" is detected to confirm that the target trigger condition is met, a sentence of string input after "@AI" or a segment of data input continuously can be used as the target data.

[0138] In yet another possible situation, the interaction data input before the target trigger condition is satisfied and that meets the set requirements may be determined as the target data.

[0139] For example, the interaction data that meets the set requirements may be text or images input, selected or edited within a set time period before the target trigger condition is met; or the last sentence or last string input before the target trigger condition is met.

[0140] For another example, if the target trigger condition is detected when input of the target string data is satisfied, the target data may be interactive data that is input before the target string data that satisfies the target trigger condition is input and that has a set position relationship with the target string. For example, the set position relationship may be that the target string belongs to the same paragraph, the same sentence, or is a picture that is adjacent to the target string.

[0141] In yet another possible scenario, data from the second application obtained after the target trigger condition is satisfied may be determined as target data.

[0142] There is a target communication connection between the second application and the first application. In this application, the first application can have data interaction with the second application and can obtain data transmitted by the second application.

[0143] The second application may be an application on the electronic device. For example, the second application may be an application to which the electronic device jumps when the target trigger condition is confirmed to be met. In this case, the second application may be the target application mentioned above. The second application may also be an application that the user opens or controls to jump to after confirming that the trigger condition is met and transmits data to the first application.

[0144] For example, the first application is an instant messaging application, and the second application may be a shopping application, video playback application, audio playback application, email application, or document application, etc., in which the electronic device can share data with the first application. Correspondingly, the data from the second application may be a link address, video content, audio data, email link, email content, or document, etc.

[0145] The second application can also be an application running on other electronic devices. For example, if the first application is an instant messaging application, and the second application can be an instant messaging application on other electronic devices, then the target data is the image, text, or video data sent by the second application to the first application after confirming that the target trigger condition is met. For another example, if the first application is a remote conference application, and the second application is a remote conference application on other electronic devices, then the target data can be the conference image, text, or PPT data sent by the second application to the first application after confirming that the target trigger condition is met.

[0146] In yet another possible case, data determined by a target operation acting on the window display data of the first application may be used as target data.

[0147] The window display data includes the first interaction data and application data of the first application. The application data of the first application may include historical input data of the first application (i.e., data input to the first application before the first interaction data), user interface data, network push data, and response data generated by the first application in response to the first interaction data.

[0148] Among them, the target operation can be a word-marking operation, a screenshot operation, a circling operation, a dragging operation or a floating operation, etc., or it can be a voice input operation, a gesture operation or an eye tracking operation. Accordingly, the data targeted at or input by the word-marking operation, the circling operation, the dragging operation, the voice input operation, the gesture operation or the eye tracking operation can be determined as the target data.

[0149] For example, taking the first application as a document application, in response to the first interaction data satisfying the target trigger condition, the data selected by the circle selection operation in the document application may be used as the target data.

[0150] It is understandable that, in practical applications, the target data may be comprehensively determined by combining multiple of the above possible situations, without any specific limitation.

[0151] Of course, there may be other possibilities for determining the target data, and there is no limitation to this.

[0152] In this embodiment, the target function service options for the target data can be determined based on at least one of the content and data type of the target data, and the target function service options that can be provided by the target processing model or target application can be determined, such as determining the target function service options that can be achieved with the help of artificial intelligence.

[0153] As described above, a function service option list for the target data may be determined, and the function service option list includes at least one target function service option.

[0154] For example:

[0155] Assuming that the target data is text data, combined with this data type, it can be determined that the processing operations on the text data with the help of artificial intelligence include but are not limited to text editing, text expansion, text content reduction, text topic extraction, text translation, and text-generated graphics, etc., so that the target function service options corresponding to these processing operations can be determined.

[0156] For another example, if the target data is text data and the text data indicates the need for raw images, then the target function service options may include raw images and raw videos, etc., based on the content of the text data.

[0157] In this embodiment, in response to the first interaction data input into the first application satisfying the target trigger condition, the data content and type of the target data to be processed can be combined to reasonably output selectable target function service options in the target area of ​​the electronic device, so that the target processing model or target application can be used to perform corresponding processing operations on the target data through the output target function service options.

[0158] In this embodiment, when the target function service options for the target data are output in the target area, there may be multiple target areas. Based on this, outputting the target function service options for the target data in the target area may include at least one of the following possible situations:

[0159] In one possible scenario, at least one target function service option for the target data may be output in a first area in the window area of ​​the first application. In this possible scenario, the target area is the first area, and the first area belongs to the window area of ​​the first application. There is a target position relationship between the first area and the area where the target data is located. For example, the target position relationship is adjacent to the area where the target area is located, or is outside the area where the target data is located and at the edge of the window area of ​​the first application.

[0160] In another possible case, at least one target function service option for the target data can be output in the second area, and the second area is a pop-up window area covering part of the window area of ​​the first application. In other words, the second area and the window area of ​​the first application are in different layers, but the second area is a pop-up window area located above the window area of ​​the first application.

[0161] In another possible scenario, the target data and at least one target function service option for the target data can be output in the window area of ​​the second application. The second application is an application that can call the target processing model to provide the target function service, such as the second application is the application to which the first interaction data jumps in response to the first interaction data satisfying the target trigger condition. For example, the second application can be the target application mentioned above. In this possible scenario, the target data can be any of the ones mentioned above. In particular, the target data can be the target data input to the second application after the target trigger condition is satisfied.

[0162] For example, when it is monitored that the first interaction data input into the first application meets the target trigger condition, a jump to the second application can be triggered, and the target data input into the second application can be obtained, the target data can be output in the window area of ​​the second application, and at least one target function service option for the target data can be output in the window area of ​​the second application.

[0163] In this embodiment, there may be multiple possibilities for the specific implementation of determining and outputting the target function service options for the target data. Several possible implementations are described below as examples. In actual applications, outputting the target function service options for the target data may include at least one of the following possible implementations:

[0164] In a possible implementation manner, attribute information of the target data is obtained, and at least one matching target function service option is output in the target area based on the attribute information.

[0165] The attribute information of the target data may include the data type and the language type of the target data. For example, the data type of the target data may be at least one of words, long sentences, pictures, and graphic texts. The language type of the target data may be at least one of Chinese, English, Japanese, and French.

[0166] Among them, the determination of target data and target area can refer to the previous related introduction and will not be repeated here.

[0167] In this possible implementation, the target function service options that may need to be provided may be determined in combination with the specific type of the target data and the language to which it belongs.

[0168] In yet another possible implementation, the user intention represented by the target data is identified, and at least one matching target function service option is output in the target area based on the user intention.

[0169] The user intention represented by the target data may be identified by performing an intention analysis on the target data or the first interaction data to determine the user intention, and the user intention may represent the processing operation that the user wants to perform on the target data. For example, the user intention may be translation, image generation, topic extraction, or content search, etc., without limitation.

[0170] Each user intention is suitable for at least one functional service option, so that each target functional service option required to be output can be determined based on the user intention guaranteed by the target data.

[0171] In yet another possible implementation, load resource information of the electronic device is obtained, and at least one target function service option matching the target data is output in the target area based on the load resource information.

[0172] The load resource information of the electronic device may include at least one of the following information: the hardware configuration of the electronic device, the software configuration, the functional service configuration corresponding to the functional service that can be provided, and the current resource usage. The load resource information of the electronic device can reflect that the electronic device is currently suitable for processing the target data through the target application or target processing model, provided that there are no abnormal conditions such as insufficient resources or device downtime.

[0173] In yet another possible implementation, user portrait information of the target user is obtained, and at least one matching target function service option is output in the target area based on the user portrait information and attribute information of the target data.

[0174] The attribute information of the target data can be found in the previous introduction and will not be repeated here.

[0175] The target user is a user of the electronic device, a logged-in user of the first application, or a logged-in user of the target application. The user portrait information of the target user can at least reflect the user's processing habits or processing requirements for different types of target data. Based on this, the user portrait information of the target user can include the target user's historical operation behaviors for different types of data and the selected functional service options.

[0176] For example, user portrait information may include the operations or demands that users habitually initiate on vocabulary, the beautification or cropping that users habitually perform on images, and the processing operations that users frequently perform on articles, such as generating summaries or checking errors, etc.

[0177] In actual applications, at least one matching target function service option can be comprehensively determined based on the user portrait information and the attribute information of the target data; or at least one target function service option can be first determined based on the attribute information of the target data, and the at least one target function service option can be sorted in descending order according to the degree of match between the target function service option and the user portrait information, and the at least one target function service option can be output in the target area according to the sorting order.

[0178] Among them, if the display range of the target area is limited, the target function service options that have a lower degree of match with the user portrait information can be folded and displayed first, that is, cached in the cache area to be displayed, so that when the user drags or pulls down the target function service option list, the target function service options that have a lower degree of match with the user portrait information will be displayed.

[0179] In yet another possible implementation, source information of the target data is obtained, and at least one matching target function service option is output in the target area based on the source information.

[0180] The source information of the target data is at least used to characterize the application from which the target data comes and its application type. For example, the source information of the target data may indicate that the target data comes from a browser application, a document application, a PPT application, an album, or a social application. Based on this, combined with the source information of the target data, different target function service options can be recommended for data from different sources.

[0181] In practical applications, the present application may also combine the source information of the target data and the attribute information of the target attribute to output at least one matching target function service option in the target area.

[0182] For example, if the target data comes from the WeChat application and the target data is a picture, then functional service options such as picture beautification, raw picture, and asking questions about the image can be determined as target functional service options.

[0183] For another example, if the target data comes from a PPT or a document, and the target data is text, then the matching target function service options may include: retrieving related documents, translating, or generating questions for the target data.

[0184] It is understandable that the above-mentioned implementation methods of determining target function service options may be used in combination with each other without specific limitation.

[0185] For ease of understanding Figure 2 The relevant contents of the embodiment are described below by taking an application scenario as an example.

[0186] For ease of description, the first interactive data satisfies the target trigger condition of monitoring the input target string data, and the data determined by the target operation acting on the window display data of the first application is used as the target data. Considering that there are many possibilities for determining the target function service options, the target function service options are determined by combining the attribute information and source information of the target data and the user intention represented by the target data. Figure 3 , shows a schematic diagram of an implementation flow of a data processing method provided in an embodiment of the present application in an application scenario. This embodiment may include:

[0187] S301, detecting first interaction data input into a first application of an electronic device.

[0188] The first interactive data may be a picture, text, PPT, or data including text and pictures.

[0189] S302, monitoring input of target character string data, determining that the first interaction data meets a target trigger condition, and using data determined by a target operation acting on the first interaction data in the first application as target data.

[0190] For example, after inputting the first interaction data, the user inputs a target character string such as "@AI" or "AI+", and it is determined that the target trigger condition is met.

[0191] Of course, this embodiment takes the example of monitoring the input of the target character string to determine that the target trigger condition is met. The same applies to the present embodiment for monitoring the input of target voice segment data, target trajectory data, target gesture action or target posture change data, or the behavior parameters when inputting the first interaction data meet the parameter threshold, etc., and the details will not be repeated here.

[0192] The target operation can be a circle selection operation, a screenshot operation, or a floating operation, etc., and there is no restriction on this.

[0193] In this application, the window display data acting on the first application is taken as the first interactive data acting on the first application. In this case, after performing a target operation on the first interactive data, the application can determine the data targeted by the target operation in the first interactive data as the target data.

[0194] For example, taking the first interaction data as data that includes at least an image, if the user wants to process the image in the first interaction data, after the user enters a string such as "@AI", the user can select the image content to be processed from the first interaction data by circling or the like.

[0195] It is understandable that determining the target data based on the behavior parameters when inputting the first interaction data, and determining the interaction data input into the first application or the second application after monitoring the target character string as the target data, are also applicable to this embodiment and will not be described in detail.

[0196] S303, determining the attribute information and source information of the target data, and identifying the user intention represented by the target data.

[0197] It can be understood that in this embodiment, the target data is taken as a part of the first interactive data. In this case, the target data can be data sent to the first application by other applications. The target data can also be data obtained from other local applications of the electronic device. Therefore, the source information of the target data can have multiple possibilities. For example, if the first application is an instant messaging application, and the target data is a picture transmitted by the instant messaging application of other electronic devices, then the source information of the target data is the instant messaging application; if the target data is data uploaded from the album, then the data source of the target data is from the album; of course, if the target data is text data entered by the user, then the source of the target data is the user input from the first application.

[0198] The attribute information of the target data may represent information such as the data type, content type, format, and data size of the target data, and is limited to this. For example, in this embodiment, taking the target data as a picture as an example, the attribute information of the target data at least includes that the data type of the target data is a picture, and may also include information such as the picture format and the object category and object features of the objects in the picture.

[0199] Among them, the user intention represented by the target data can be the user intention determined by performing intent recognition on the target data. For example, if the target data is a picture, the user intention that may be represented by the picture content can be determined by performing intent recognition on the content of the picture. For example, if the target picture contains an image of a person, then the user intention may be to beautify the target picture, enlarge the image, or blur the background of the image.

[0200] The user intention represented by the target data may also be the user intention represented by the first interaction data where the target data is located, and details will not be repeated here.

[0201] S304: Based on the attribute information, source information and user intention corresponding to the target data, output at least one target function service option in the first area of ​​the window area of ​​the first application.

[0202] The target function service option is an option that can be provided by the target processing model or the target application of the electronic device for performing the target processing operation on the target data. For example, the target processing model is a large language model, and the target application is an application in the electronic device that can call the large language model or has the large language model function.

[0203] Taking the target data as text data as an example, and the attribute information, source information and user intention of the target data are text data, document and redundancy reduction respectively, then it can be determined that the target function service options suitable for being provided by the target processing model or target application may include: topic extraction, text simplification and article simplification.

[0204] The first area may be an area in the window area of ​​the first application that is adjacent to the target data.

[0205] Of course, if the at least one target function service option is displayed through a pop-up window area within the coverage of the window area of ​​the first application, it is also applicable to this embodiment. The specific process is similar and will not be repeated here.

[0206] It can be understood that after outputting the at least one target function service option, in response to the target function service option selected by the user, the target data is processed using a target processing model or a target application, and the processing operation is a processing operation that matches the target function service option selected by the user.

[0207] Furthermore, after processing the target data, the present application can also display the data processing result corresponding to the target data at the position of the input point such as the cursor when the target trigger condition is met in the first application. The latter is to display the data processing result at the position corresponding to the cursor in the first application or other applications of the cursor at the current moment in the electronic device. The details are as described above and will not be repeated here.

[0208] The data processing method of the present application is introduced below in conjunction with another possible implementation of outputting a target function service option in a target area of ​​an electronic device in response to the first interaction data satisfying a target trigger condition. Figure 4 , shows another implementation flow diagram of the data processing method provided by the present application. The method of this embodiment may include:

[0209] S401, monitoring first interaction data of a first application input into an electronic device.

[0210] This step can be referred to the previous related introduction and will not be repeated here.

[0211] S402: In response to the first interaction data satisfying a target trigger condition, obtaining application information of a first application, and outputting a target function service option in the target area based on the application information.

[0212] The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data. The target data comes from the first interaction data or second interaction data different from the first interaction data.

[0213] Among them, the specific possible implementation of determining the target data can be found in the previous related introduction, which will not be repeated here.

[0214] The application information of the first application may include, but is not limited to, the application identifier, application type, application configuration, and other information related to the first application. The application configuration may be used to indicate whether the first application has the ability to call the processing model, and may also indicate the functions that the first application can achieve.

[0215] It can be understood that the application information of the first application can characterize the type or capability of the first application, and combined with the type or capability of the first application, it can accurately determine the functional services that may need to be obtained with the help of processing models such as artificial intelligence models when the user uses the first application.

[0216] For example, if the first application is an image editing application, when the user uses the first application, he or she may need to use processing models such as artificial intelligence models to edit the images displayed in the first application or generate new images. Therefore, if the first application is an image editing application, the target function service options may include: image editing, image generation, high-definition image conversion and other function service options.

[0217] In this embodiment, there may be multiple possible situations for outputting the target function service option based on the application information of the first application. For example, outputting the target function service option based on the application information may include at least one of the following possible situations:

[0218] In one possible case, at least one target function service option matching the application identification information of the first application may be output in the target area.

[0219] The application identification information of the first application is used to uniquely identify the first application. For example, the application identification information of the first application may be the name or number of the first application.

[0220] The target function service options that match the application identification information of the first application can be determined based on the function service options that have been used historically by the first application. For example, if the first application is a game application, and the user searches for game strategies or records highlight moments during the game, then based on the application identification information of the first application, it can be determined that the matching target function service options may include searching for game strategies and generating highlight moments. For another example, if the first application is an image display or image editing application, then the user edits, crops, and refines the image during the use of the first application, or uses the functions of editing, cropping, or refining images using a processing model. Therefore, the matched target function service options may include: image refinement function, image editing function, and image cropping function.

[0221] In yet another possible scenario, at least one target function service option different from the function service that can be provided by the first application may be output in the target area based on the application configuration information of the first application.

[0222] The application configuration information of the first application may represent the functional services that the first application can provide, or the processing capabilities of the processing model that the application can call. Accordingly, based on the application configuration information of the first application, the first application may be recommended options for functional services other than the functional services that it can call or implement.

[0223] For example, if the first application is a document application, then the application configuration information of the first application can reflect that the first application can provide service functions such as text input and text editing. In this case, the present application can determine that the first application cannot provide functional services such as text topic extraction and content search. Therefore, options for target functional services such as text topic extraction and content search can be output.

[0224] In yet another possible scenario, the user intention may be determined based on the application identification information and target data of the first application, and at least one matching target function service option may be output in the target area based on the user intention.

[0225] There are many possibilities for the specific implementation of intent analysis based on the application identification information and target data of the first application. For example, in one possible implementation, the intent recognition model can be pre-trained based on the application identification information and target data samples of different application samples. Accordingly, based on the application identification information of the first application and the target data, the user intent is determined using the intent recognition model. The intent recognition model can be any artificial intelligence model, such as a large language model such as llama3, without limitation.

[0226] After determining the user intent, the specific implementation of matching at least one target function service option based on the user intent can be found in the previous related introduction and will not be repeated here.

[0227] In yet another possible scenario, at least one matching target function service option may be output in the target area based on the running state information of the first application.

[0228] The running state information of the first application is at least one kind of information related to the running state of the first application. For example, the running state information of the first application may be used to indicate whether the first application is stuck or in an abnormal state.

[0229] The target function service option output based on the running state information of the first application may be an option corresponding to a function service for repairing or improving the running state of the first application. For example, the target function service option may be an option corresponding to a function service for accelerating the application, improving the network state, improving the resource allocation of the first application, or improving hardware resource conditions such as memory usage.

[0230] In this embodiment, the target area may be located in or not located in the window area of ​​the first application. For details, see Figure 1 and Figure 2 The relevant introduction about the target area in the embodiment will not be repeated here.

[0231] The data processing method of the present application is introduced below in conjunction with another possible implementation of outputting a target function service option in a target area of ​​an electronic device in response to the first interaction data satisfying a target trigger condition. Figure 5 , shows another implementation flow diagram of the data processing method provided by the present application. The method of this embodiment may include:

[0232] S501, monitoring first interaction data of a first application input into an electronic device.

[0233] This step can be referred to the previous related introduction and will not be repeated here.

[0234] S502: In response to the first interaction data satisfying a target trigger condition, determine target data, and output a target function service option for the target data in a target area based on application information of the first application.

[0235] The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data.

[0236] Among them, the specific possible situations for determining the target data can be found in Figure 2 The relevant introduction about determining the target data in the embodiment will not be repeated here.

[0237] For the application information of the first application, please refer to the previous related introduction, which will not be repeated here.

[0238] In this embodiment, the target function service options for the target data are actually determined by combining the application information such as the type and capability of the first application. Figure 2 and Figure 4 The sum of the embodiments is realized.

[0239] For example, the present application can combine the application identification information, application configuration information and at least one of the user intentions corresponding to the application identification information and the target data of the first application, and combine at least one of the attribute information of the target data, the load resource information of the electronic device, the user portrait information and the source information of the target data, to output at least one matching target function service option.

[0240] For ease of understanding Figure 5 The embodiment of the present invention is introduced below in combination with another application scenario.

[0241] For ease of description, the example of detecting an input target string and determining that the first interaction data meets the target trigger condition is still taken. In addition, the example of outputting at least one target function service option is taken by combining the application identification information of the first application and the user intent determined by the target data.

[0242] like Figure 6 , shows a schematic diagram of an implementation flow of the data processing method provided in an embodiment of the present application in another application scenario. The method of this embodiment may include:

[0243] S601, detecting, through a hook function, first interaction data input into a first application of an electronic device.

[0244] S602: If it is determined through the hook function that the input target string data is monitored, the application identification information of the first application that inputs the target string data is obtained.

[0245] The present application can monitor the global keyboard messages or touch screen input messages of the electronic device through a hook function to obtain the interactive data input by the user, and when confirming that the user has input the target string data (such as "@AI"), obtain the application identification information corresponding to the first application (i.e., the application where the input point such as the cursor is located) that inputs the target string data.

[0246] It is understandable that the example of monitoring the data input in each application in the electronic device through the hook function is used for explanation, but obtaining the target string data input into the first application through other methods is also applicable to this embodiment.

[0247] In addition, as mentioned above, if the target character string data is replaced with target voice segment data or target gesture action, etc., only the implementation means of monitoring input needs to be adjusted, and the specific implementation can also be applied to this embodiment.

[0248] For example, the application identification information of the first application may at least include the application process name of the first application. Of course, it may also be other identification information mentioned above, and there is no limitation on this.

[0249] S603, determine target data.

[0250] The specific implementation of determining the target data may be any of the possible situations mentioned above.

[0251] For example, the most recent sentence, the last piece of data, or the last picture input before the target character string data in the first interactive data is determined as the target data.

[0252] For another example, data input into the first application after the target character string data is detected may be determined as the target data.

[0253] For another example, data input into a second application after the target string data is detected can be determined as target data. The second application can be an application to which the electronic device jumps in response to the detected target string data, such as a target application. The second application can also be any other application other than the first application, without limitation.

[0254] S604: Determine the user intent using a pre-trained intent recognition model based on the target data and the application identification information of the first application.

[0255] S605: Based on the user intention, output at least one matching target function service option in a target area of ​​the electronic device.

[0256] The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data.

[0257] For example, the target area may be a partial area of ​​the window area of ​​the first application, etc. Of course, it may also be any one of the several situations mentioned above, which will not be described in detail.

[0258] The data processing method of the present application is introduced below in conjunction with another possible implementation of outputting a target function service option in a target area of ​​an electronic device in response to the first interaction data satisfying a target trigger condition. Figure 7 , shows another implementation flow diagram of the data processing method provided by the present application. The method of this embodiment may include:

[0259] S701, monitoring first interaction data of a first application input into an electronic device.

[0260] This step can be referred to the previous related introduction and will not be repeated here.

[0261] S702: In response to the first interaction data satisfying a target trigger condition, operation information of a target operation is obtained, and a target function service option for the target data is output in a target area based on the operation information.

[0262] The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data.

[0263] The process of determining the target data can be found in the previous related introduction and will not be repeated here.

[0264] The target operation is at least used to obtain target data. For example, the target operation may be an operation of inputting target data, or may be an operation of dragging, moving, selecting, copying or pasting. Of course, other possibilities of the target operation mentioned above may also be included, and there is no limitation on this.

[0265] The operation information of the target operation may include at least one of: attribute information of the operation device used for the target operation, operation feature information of the operation user of the target operation, operation behavior information of the operation user, and operation environment information.

[0266] The operating device used for the target operation may be a stylus, a mouse, a keyboard, a touch screen or an input sensor, etc. The attribute information of the operating device may include the type of the operating device and the input functions that can be realized.

[0267] The operation characteristic information of the target operation user may be the operation habits, operation preferences or preferred functional services of the target operation user. The operation behavior information may include, but is not limited to, the operation speed, operation behavior track and operation frequency. Among them, the operation behavior track can be used to characterize the specific type or type of operation of the target operation. The operation frequency can reflect whether the historically recommended functional services meet the user's intention.

[0268] The operating environment information may be the external environment or scene in which the electronic device is located when the target operation is input. For example, the operating environment information includes, but is not limited to, a working environment, a home environment, an indoor environment, an outdoor environment, a noise environment, an audio and video playback environment, etc. When the operating environment information is different, the user's requirements for function options during the use of the first application will also be different.

[0269] In this embodiment, outputting the target function service option for the target data based on the operation information may include at least one of the following possible situations:

[0270] In one possible case, at least one target function service option is output in the target area based on the content of the target data and the operating device information for implementing the target operation.

[0271] The content of the target data may reflect the type and content characteristics of the target data. For example, if the target data is text, the target data is the specific content in the text. Similarly, the content of the target data may also be image content, audio content, and web page content.

[0272] The operating device information may represent the specific operating device used to implement the target operation and the model of the operating device. For example, the operating device information of the target operation may represent that the target operation is input by a finger, a touchpad, a mouse, a keyboard, a stylus, a handle or a wearable device, etc. If the operating device is a stylus, a handle or a mouse, etc., the operating device information may also include information such as the model of the stylus, the handle or the mouse.

[0273] Wherein, under the action of different operating devices, at least one of the outputted target function service options is different. That is, for different operating devices represented by the operating device information, the outputted target function service options may have one or more different target function service functions.

[0274] In this implementation, the content of the target data and the operating device information both affect the quantity and type of output target function service options.

[0275] In yet another possible scenario, at least one matching target function service option is output in the target area based on the content of the target data and the user portrait information of the operating user of the target operation.

[0276] The content of the target data may be text data, image data, or PPT data, etc., as described above.

[0277] Among them, the user portrait information of the operating user may be the user habits and operating preferences of the operating user, etc. For details, please refer to the previous related introduction and will not be repeated here.

[0278] Wherein, under the operation of different operating users, at least one of the output target function service options is different.

[0279] Similar to the above, when outputting at least one target function service option in combination with the content of the target data and the user portrait information of the operating user of the target operation, the at least one target function service option can be sorted in order from high to low according to the degree of match between the target function service option and the user portrait information, and the at least one target function service option can be output in the target area according to the sorting order.

[0280] In yet another possible scenario, at least one matching target function service option is output in the target area based on the content of the target data and the operating environment information of the target operation.

[0281] The content of the target data is as described above.

[0282] The operating environment information of the target operation may be the scene environment in which the electronic device is used when the target operation is applied, such as the aforementioned audio-visual entertainment environment, game scene, indoor environment or outdoor environment, etc., which will not be elaborated herein.

[0283] Wherein, under different operating environments, at least one of the output target function service options is different.

[0284] For example, when the target data content is an image and the operating environment information is an outdoor environment, the target functional service options may include a functional service option for generating a video and a functional service option for repairing, etc. When the target data content is an image and the operating environment information is a conference environment, the output target functional service options are not suitable for including a functional service option for generating a video, but may include functional service options such as beautifying an image and reducing an image.

[0285] In another possible scenario, when the target data includes text data, based on the operating device information and / or operating user information of the target operation, target function service options including or excluding those for changing the data amount or type of the text data and / or for obtaining associated data of the text data are output in the target area.

[0286] For example, the target function service option may include a function service option for changing the data volume or type of the text data, but not include a function service option for obtaining associated data of the text data; or, may not include a function service option for changing the data volume or type of the text data, but include a function service option for obtaining associated data of the text data; or may include both a function service option for changing the data volume or type of the text data and a function service option for obtaining associated data of the text data.

[0287] The text data may be in Chinese or a foreign language, without limitation.

[0288] The operating user information may include one or more of the operating user's identity and user portrait information.

[0289] Among them, changing the data volume of text data may be to summarize the content, extract the theme, and delete the content of text data (such as an article or a paragraph); or to expand, continue, or enrich the content of text data (a string of characters or a sentence). Accordingly, the target function service option for changing the data volume of text data may be an option for triggering content summarization, theme extraction, content deletion, content expansion, and content continuation.

[0290] The target functional service options for changing the type of text data may be functional service options such as Vincent image, Vincent video, and Vincent animation.

[0291] The target function service option for obtaining the associated data of the text data may be an option for triggering a search, question, search or translation of the text data.

[0292] In another possible scenario, when the target data includes image data, based on the operating device information and / or operating user information of the target operation, target function service options including or excluding those for changing the data amount or type of the image data and / or for acquiring associated data of the image data are output in the target area.

[0293] Changing the amount of image data may be achieved by changing image parameters of the image to reduce or increase the amount of image data. For example, changing the amount of image data may be achieved by retouching, adjusting exposure, adjusting clarity, adjusting saturation, changing the image theme, or adjusting background color, etc. Correspondingly, the target function service option may be an option for retouching, adjusting exposure, or adjusting saturation, etc.

[0294] Similarly, the target function service option for changing the image type may be an option for triggering the execution of image generation, image generation, video generation, or image generation, cartoon generation.

[0295] The associated data of the image data may be data obtained by asking questions based on the image, searching for similar images, or tracing the source of the image. Accordingly, the target function service option may be an option for triggering asking questions about the image, searching for similar images, or tracing the source of the image.

[0296] In another possible scenario, when the target data includes an access address, target function service options including or not including a target function service option for changing the access method or output type of the content corresponding to the access address are output in the target area based on the operating device information and / or operating user information of the target operation.

[0297] The access address may be a hyperlink or a Uniform Resource Locator (URL) address.

[0298] The access method of the content corresponding to the access address refers to the method of accessing the content corresponding to the access address. For example, the access method of the content corresponding to the access address may be to click the access address to access the content corresponding to the access address. Then the access method may be adjusted to obtain the summary or summary or key information corresponding to the content corresponding to the access address by positioning with a floating mouse and triggering with a specific control or physical button, so that the user can obtain the content pointed to by the access address without clicking the access address.

[0299] The output type of the content corresponding to the access address may be output in the form of a hyperlink, a graphic link, or a summary graphic. For example, the output type of the content corresponding to the access address is output in the form of a hyperlink, and the target function service option for changing the output type may be an option for changing the output type of the content corresponding to the access address to a graphic link.

[0300] In yet another possible case, when the target data includes media playback data, target function service options including or not including a target function service option for changing playback parameters of the media playback data are output in the target area based on the operating device information and / or operating user information of the target operation.

[0301] The media playback data may include at least one of media data such as audio data, video data, and animation data.

[0302] Changing the playback parameters of the media playback data may include changing the frame rate, playback speed, volume, and size (such as the size of an animation screen) of the media playback data.

[0303] In another possible scenario, when the target data includes text data and image data, the target area output includes or does not include target function service options for layout design or content generation for the text data and image data based on the operating device information and / or operating user information of the target operation.

[0304] The layout design of the text data and the image data may be at least one of designing the typesetting, proportional relationship and positional relationship of the text data and the image data.

[0305] Generating content from text data and image data may be generating documents, PPTs, images, or videos based on the text data and image data.

[0306] In this embodiment, the target area may be located in or not located in the window area of ​​the first application. For details, please refer to the above introduction and will not be described in detail.

[0307] It is understandable that in any of the above data processing method embodiments, the first interaction data satisfying the target trigger condition may also trigger the first application to output some windows such as menus or toolbars. For ease of distinction, the window output by the first application in response to the first interaction data satisfying the target trigger condition is called the first window.

[0308] On this basis, when outputting the target area, it is also necessary to avoid mutual occlusion between the target area and the first window output by the first application, so as to prevent the user from fully understanding the target function service options in the target area or from being unable to clearly see the content in the first window.

[0309] For example, in a possible implementation, if the first application outputs the first window in response to the first interaction data satisfying the target trigger condition, the positional relationship between the target area and the first window is adjusted. By adjusting the positional relationship between the target area and the first window, there is no overlap between the first window and the target area, and naturally there is no mutual occlusion. For example, based on the position of the first window in the display interface, the position of the target area is adjusted so that there is no overlap or mutual occlusion between the target area and the first window.

[0310] In another possible implementation, if the first application outputs a first window in response to the first interaction data satisfying the target trigger condition, the display parameters of the first window are adjusted based on the target function service options output in the target area, or the display content of the first window is processed.

[0311] Among them, adjusting the display unit of the first window can be adjusting the transparency of the first window so that the first window cannot block the target function service options displayed in the target area; merging the first window with the window area of ​​the first application, or adjusting the size of the first window to avoid overlap between the first window and the target area.

[0312] Processing the display content of the first window may be deleting part of the content in the first window, or adding part or all of the target function service options in the target area to the first window so that the target function service options are not blocked by the content of the first window.

[0313] In another aspect, the present application also provides an electronic device. Figure 8 , showing a schematic diagram of the composition structure of an electronic device provided in an embodiment of the present application.

[0314] The electronic device includes: at least one processor 801 and at least one large model file capable of running on the processor, wherein the large model file can be called by at least one application running on the electronic device to perform at least one of the following:

[0315] Monitoring first interaction data input to a first application of an electronic device;

[0316] In response to the first interaction data satisfying a target trigger condition, a target function service option is outputted in a target area of ​​the electronic device.

[0317] The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data;

[0318] The target data comes from the first interaction data or second interaction data different from the first interaction data.

[0319] For example, an application in an electronic device monitors first interaction data input into a first application of the electronic device and runs a large model file to perform the above processing operations.

[0320] As another example, the application executes the above processing operations by running a large language file.

[0321] The electronic device at least includes a memory 802 connected to the processor;

[0322] The memory 802 is used to store the large model file.

[0323] It is understandable that the electronic device may further include a display screen 803 and an input unit 804 .

[0324] Of course, the electronic device may also have Figure 8 There may be more or fewer components, without limitation.

[0325] In a possible implementation, the electronic device includes a first body and a second body that are rotatably connected, and at least one of the first body and the second body has a display screen to output a target function service option in a target area on the display screen; wherein outputting the target function service option in the target area includes at least one of the following:

[0326] In response to the first interaction data satisfying a target trigger condition, determining target data, so as to output a target function service option for the target data in the target area;

[0327] In response to the first interaction data satisfying a target trigger condition, obtaining application information of the first application, and outputting the target function service option in the target area based on the application information;

[0328] In response to the first interaction data satisfying a target trigger condition, determining target data, and outputting a target function service option for the target data in the target area based on the application information of the first application;

[0329] In response to the first interaction data satisfying a target trigger condition, obtaining operation information of a target operation, and outputting a target function service option for the target data in the target area based on the operation information, wherein the target operation is at least used to obtain the target data;

[0330] The target area is located in or not located in the window area of ​​the first application.

[0331] It can be understood that the related operations performed by the electronic device can refer to the related introduction of the previous embodiment, and will not be repeated here.

[0332] A computer program product is also provided in an embodiment of the present application, including computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements any data processing method provided in the embodiment of the present application.

[0333] A computer-readable storage medium is also provided in an embodiment of the present application. The storage medium carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any data processing method provided in the embodiment of the present application.

[0334] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.

[0335] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a training device, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0336] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0337] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a training device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.

Claims

1. A data processing method, comprising: Monitoring first interaction data input to a first application of an electronic device; In response to the first interaction data satisfying a target trigger condition, outputting a target function service option in a target area of ​​the electronic device; The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data; The target data comes from the first interaction data or second interaction data different from the first interaction data.

2. The data processing method according to claim 1, wherein: The first interaction data satisfies a target trigger condition, including at least one of the following: In response to monitoring input of target character string data, determining that the first interaction data satisfies the target trigger condition; In response to monitoring input of target voice segment data, determining that the first interaction data satisfies the target trigger condition; In response to monitoring the input target trajectory data, determining that the first interaction data satisfies the target trigger condition; In response to monitoring the target gesture action or the target posture change data, determining that the first interaction data satisfies the target trigger condition; In response to a behavior parameter when the first interaction data is input satisfying a corresponding parameter threshold, it is determined that the first interaction data satisfies the target trigger condition.

3. The data processing method according to claim 1 or 2, wherein: Outputting a target function service option in a target area of ​​the electronic device includes at least one of the following: In response to the first interaction data satisfying a target trigger condition, determining target data, so as to output a target function service option for the target data in the target area; In response to the first interaction data satisfying a target trigger condition, obtaining application information of the first application, and outputting a target function service option in the target area based on the application information; In response to the first interaction data satisfying a target trigger condition, determining target data, and outputting a target function service option for the target data in the target area based on the application information of the first application; In response to the first interaction data satisfying a target trigger condition, operation information of a target operation is obtained, and a target function service option for the target data is output in the target area based on the operation information, wherein the target operation is at least used to obtain the target data; wherein the target area is located or not located in the window area of ​​the first application.

4. The data processing method according to claim 3, wherein: Determine target data, including at least one of the following: Obtaining a behavior parameter when the first interaction data is input, and determining the target data from the interaction data input to the first application based on the behavior parameter, wherein the target data is interaction data generated by an input operation having a target behavior parameter; using the target sensitive word in the interaction data input into the first application as the target data; determining the interaction data input into the first application after satisfying the target trigger condition as the target data; determining data from a second application obtained after a target trigger condition is satisfied as the target data, the second application having a target communication connection with the first application; The data determined by the target operation acting on the window display data of the first application is used as the target data, and the window display data includes the first interaction data and the application data of the first application.

5. The data processing method according to claim 3, wherein: Outputting a target function service option for the target data in the target area includes at least one of the following: Outputting at least one target function service option for the target data in a first area in the window area of ​​the first application, wherein a target position relationship exists between the first area and the area where the target data is located; outputting at least one target function service option for the target data in a second area, where the second area is a pop-up window area covering a portion of the window area of ​​the first application; Outputting the target data and at least one target function service option for the target data in a window area of ​​a second application, wherein the second application is an application capable of invoking a target processing model to provide a target function service; Obtaining attribute information of the target data, and outputting at least one matching target function service option in the target area based on the attribute information; Identifying a user intention represented by the target data, and outputting at least one matching target function service option in the target area based on the user intention; Obtaining load resource information of the electronic device, and outputting at least one target function service option matching the target data in the target area based on the load resource information; Obtaining user portrait information of a target user, and outputting at least one matching target function service option in the target area based on the user portrait information and attribute information of the target data; The source information of the target data is obtained, and at least one matching target function service option is output in the target area based on the source information.

6. The data processing method according to claim 3, wherein: Outputting a target function service option in the target area based on the application information of the first application includes at least one of the following: Outputting at least one target function service option matching the application identification information of the first application in the target area; outputting at least one target function service option different from the function service that can be provided by the first application in the target area based on the application configuration information of the first application; Determine a user intention based on the application identification information of the first application and the target data, and output at least one matching target function service option in the target area based on the user intention; At least one matching target function service option is output in the target area based on the running status information of the first application.

7. The data processing method according to claim 3, wherein: Outputting a target function service option for the target data in the target area based on the operation information includes at least one of the following: outputting at least one target function service option in the target area based on the content of the target data and the information of the operating device implementing the target operation, wherein at least one of the output target function service options is different under the action of different operating devices; Outputting at least one matching target function service option in the target area based on the content of the target data and the user portrait information of the operating user of the target operation, wherein at least one of the output target function service options is different under the operation of different operating users; Outputting at least one matching target function service option in the target area based on the content of the target data and the operating environment information of the target operation, wherein at least one of the output target function service options is different in different operating environments; In the case where the target data includes text data, based on the operating device information and / or operating user information of the target operation, outputting in the target area a target function service option including or excluding a target function service option for changing the data amount or type of the text data and / or for acquiring associated data of the text data; In the case where the target data includes image data, based on the operating device information and / or operating user information of the target operation, outputting in the target area a target function service option including or excluding a target function service option for changing the data amount or type of the image data and / or for acquiring associated data of the image data; In the case where the target data includes an access address, outputting a target function service option including or not including a target function service option for changing an access mode or an output type of content corresponding to the access address in the target area based on the operating device information and / or the operating user information of the target operation; In the case where the target data includes media playback data, outputting a target function service option including or not including a target function service option for changing playback parameters of the media playback data in the target area based on the operating device information and / or operating user information of the target operation; In the case where the target data includes text data and image data, the target area output includes or does not include target function service options for layout design or content generation for the text data and image data based on the operating device information and / or operating user information of the target operation.

8. The data processing method according to claim 1, further comprising: If the first application outputs a first window in response to the first interaction data satisfying a target trigger condition, adjusting a positional relationship between the target area and the first window; If the first application outputs a first window in response to the first interaction data satisfying a target trigger condition, a display parameter of the first window is adjusted based on a target function service option output in the target area, or display content of the first window is processed.

9. An electronic device, comprising at least one processor and at least one large model file capable of running on the processor, wherein the large model file can be called by at least one application running on the electronic device to perform at least one of the following: Monitoring first interaction data input to a first application of an electronic device; In response to the first interaction data satisfying a target trigger condition, outputting a target function service option in a target area of ​​the electronic device; in, The target function service option is an option that can be provided by a target processing model or a target application of an electronic device for performing a target processing operation on target data; The target data comes from the first interaction data or second interaction data different from the first interaction data.

10. The electronic device according to claim 9, wherein: The electronic device comprises a first body and a second body which are rotatably connected, and at least one of the first body and the second body has a display screen, so as to output the target function service option in a target area on the display screen; wherein outputting the target function service option in the target area includes at least one of the following: In response to the first interaction data satisfying a target trigger condition, determining target data, so as to output a target function service option for the target data in the target area; In response to the first interaction data satisfying a target trigger condition, obtaining application information of the first application, and outputting the target function service option in the target area based on the application information; In response to the first interaction data satisfying a target trigger condition, determining target data, and outputting a target function service option for the target data in the target area based on the application information of the first application; In response to the first interaction data satisfying a target trigger condition, obtaining operation information of a target operation, and outputting a target function service option for the target data in the target area based on the operation information, wherein the target operation is at least used to obtain the target data; The target area is located in or not located in the window area of ​​the first application.

Images