Data processing method and electronic equipment

Abstract

The invention discloses a data processing method and electronic equipment. The data processing method comprises the steps that in response to a target trigger event, the electronic equipment is switched from a first operation mode to a second operation mode; wherein in the first operation mode, first input information is received and processed by utilizing a first application; in the second operation mode, receiving second input information by using a second application; inputting task information corresponding to the second input information into a target model; receiving processing result information corresponding to the task information from the target model; wherein the first input information and the second input information both represent input information related to an operation interface of the first application.

Description

Technical Field

[0001] The present application relates to, but is not limited to, the field of computer technology, and in particular to a data processing method and electronic device. Background Art

[0002] Currently, applications installed on electronic devices can provide various types of application information, including text, images, videos, or audio. Users expect to be able to process the application information they are interested in in a simple and quick way, such as saving the text, images, videos, or audio locally or beautifying images. Summary of the Invention

[0003] In view of this, the present application at least provides a data processing method and an electronic device.

[0004] The technical solution of this application is achieved as follows:

[0005] In one aspect, the present application provides a data processing method, the method comprising:

[0006] In response to the target trigger event, the electronic device switches from the first operating mode to the second operating mode; wherein, in the first operating mode, the first input information is received and processed by the first application;

[0007] In the second operating mode, using the second application, receiving second input information; inputting task information corresponding to the second input information into the target model; and receiving processing result information corresponding to the task information from the target model;

[0008] The first input information and the second input information both represent input information related to the running interface of the first application.

[0009] In some embodiments, the method further comprises:

[0010] Based on the target trigger event, determining a target processing window corresponding to the target trigger event;

[0011] Receiving second input information using the second application includes:

[0012] The second input information corresponding to the target processing window is received by using the second application.

[0013] In some embodiments, the method further comprises at least one of the following:

[0014] generating a target trigger event based on a first trigger operation on a first control displayed on a display screen of the electronic device;

[0015] generating a target trigger event based on the obtained first gesture operation on the touch device; and connecting the touch device to the electronic device for communication;

[0016] generating a target trigger event based on a second gesture operation on a display screen of the electronic device;

[0017] A target trigger event is generated based on a first gesture operation of touching a display screen of an electronic device using a designated area of the touch device.

[0018] In some implementations, a target triggering event may be generated based on different types of interaction modes, and determining a target processing window corresponding to the target triggering event may include one or more of the following:

[0019] If the target triggering event is generated based on the first category of interaction, determining the target processing window based on all display interfaces output by the electronic device;

[0020] If the target trigger event is generated based on the second category of interaction, identifying at least one object displayed and output by the electronic device; in response to a user selecting a first object among the at least one object, determining a target processing window based on the first object;

[0021] If the target trigger event is generated based on the third type of interaction mode, a second object corresponding to the third type of interaction mode is determined; and based on the second object, a target processing window is determined.

[0022] In some implementations, after determining the target processing window corresponding to the target triggering event, the method further includes at least one of the following:

[0023] configuring the boundaries of the target processing window to the specified first display parameter;

[0024] Display the specified animation effect in the target processing window;

[0025] updating display parameters of the target processing window and the running interface of the first application respectively, so that the display parameters of the target processing window are different from the display parameters of the running interface of the first application;

[0026] The display parameter of the second input information is configured as a specified second display parameter; the second display parameter is different from the third display parameter corresponding to the first input information.

[0027] In some embodiments, before inputting the task information corresponding to the second input information into the target model, the method further includes:

[0028] identifying at least one object within a target processing window;

[0029] Task information is generated based on the second input information and the at least one object.

[0030] In some embodiments, identifying at least one object within the target processing window includes at least one of the following:

[0031] Identifying at least one view control contained in a target processing window; acquiring at least one object based on the at least one view control; the object comprising at least one of a text object, a picture object, a video object, or a voice object;

[0032] Obtain a window screenshot corresponding to the target processing window; input the window screenshot into the target model; and receive at least one object corresponding to the window screenshot from the target model.

[0033] In some implementations, generating task information based on the second input information and the at least one object includes:

[0034] determining a third object from the at least one object based on the second input information;

[0035] Based on the object type of the third object, display and output at least one second control;

[0036] In response to a triggering operation on a target second control among the at least one second control, task information is generated based on the target second control and the third object.

[0037] In some embodiments, when the target processing window is determined based on the fourth object in the running interface of the first application, before inputting the task information corresponding to the second input information into the target model, the method further includes:

[0038] displaying and outputting at least one third control based on the object type of the fourth object;

[0039] In response to a triggering operation on a target third control among the at least one third control, task information is generated based on the target third control and a fourth object.

[0040] On the other hand, the present application also provides an electronic device, comprising:

[0041] a processor configured to switch the electronic device from a first operating mode to a second operating mode in response to a target trigger event; wherein, in the first operating mode, first input information is received and processed using a first application; in the second operating mode, second input information is received using a second application; task information corresponding to the second input information is input into a target model; and processing result information corresponding to the task information is received from the target model;

[0042] The display screen is used to display output processing result information.

[0043] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and do not limit the technical solutions of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and, together with the specification, are used to illustrate the technical solutions of the present application.

[0045] Figure 1 A schematic diagram of the implementation flow of a data processing method provided in this application;

[0046] Figure 2 A schematic diagram of an embodiment provided in this application;

[0047] Figure 3 A schematic diagram of an embodiment provided in this application;

[0048] Figure 4 A schematic diagram of an embodiment provided in this application;

[0049] Figure 5 A schematic diagram of the structure of a data processing device provided in this application;

[0050] Figure 6 A schematic diagram of the hardware entity of an electronic device provided in this application. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions of this application are further elaborated in detail below with reference to the accompanying drawings and embodiments. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0052] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0053] The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first / second / third" can be interchanged with a specific order or sequence where permitted so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0054] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing this application only and are not intended to limit this application.

[0055] As mentioned above, users may need to further process the application information presented by the application. However, some applications do not support local processing of application information, or the steps for local processing of application information are relatively complicated.

[0056] For example, if an app doesn't support saving images locally, users will first need to take a screenshot of their device and then use image editing software to extract the image of interest from the screenshot. This solution takes a long time to complete, and the image captured from the screenshot will have a lower resolution and may not be as high quality as the original image.

[0057] For example, if an app supports saving images locally and the user wishes to further edit the image of interest, the user must first save the image locally, then import the saved image into image editing software for editing, and finally save the edited image locally again. This solution also suffers from a long and cumbersome operation process; in addition, some image editing software requires payment, resulting in additional image editing fees for the user.

[0058] Based on this, an embodiment of the present application provides a data processing method, which can be executed by an electronic device, which can be various types of terminals such as laptops, tablet computers, desktop computers, set-top boxes, mobile devices (for example, mobile phones, portable music players, personal digital assistants, dedicated messaging devices, portable gaming devices), etc., and can also be implemented as a server. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0059] Below, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the drawings in the embodiments of the present application.

[0060] Figure 1 A schematic diagram of the implementation flow of a data processing method provided in this application, such as Figure 1 As shown, the method includes the following steps S11 to S12:

[0061] Step S11: In response to a target triggering event, the electronic device switches from a first operating mode to a second operating mode; wherein, in the first operating mode, the first input information is received and processed by a first application;

[0062] Step S12: In the second operating mode, using a second application, receiving second input information; inputting task information corresponding to the second input information into a target model; and receiving processing result information corresponding to the task information from the target model;

[0063] The first input information and the second input information both represent input information related to the running interface of the first application.

[0064] Here, the target trigger event can be any type of event that triggers the electronic device to switch from the first operating mode to the second operating mode. In some embodiments, the target trigger event can be a trigger event generated based on a user operation, for example, a target trigger event is generated in response to a user performing a specified operation. In some embodiments, the target trigger event can be a trigger event automatically determined by the electronic device based on interaction information related to the user during the user's interaction with the electronic device, for example, the electronic device obtains image processing information input by the user in an instant messaging application and generates a target trigger event based on the image processing information.

[0065] The first application refers to any type of application currently running in the electronic device. For example, the first application can be an operating system application, an office application, or a multimedia application.

[0066] The first application is an application currently running in the electronic device, that is, a running interface of the first application is displayed on the display screen of the electronic device.

[0067] In some embodiments, the first application may include multiple applications, that is, the first application may be multiple applications that are currently running in the electronic device and display corresponding running interfaces on the display screen.

[0068] In some implementations, when multiple applications in the electronic device are in a running state, the first application may be a foreground application among the multiple applications.

[0069] The first operating mode may refer to a normal operating mode of the electronic device, or a non-artificial intelligence (AI) mode.

[0070] The first input information refers to input information related to the running interface of the first application obtained in the first mode. Here, the first input information can be any type of information. In some embodiments, the first input information can be interactive information input by the user for the running interface of the first application. For example, the first input information can be click information, sliding track information, shortcut key information, etc. input by the user for the current running interface of the first application. In some embodiments, the first input information can be information transmitted to the first application by an application other than the first application.

[0071] The first input information is received and processed by the first application, that is, in the first operating mode, the input information for the first application is acquired by the first application, and the first application responds to the first input information.

[0072] The second operating mode may refer to an AI mode of the electronic device. Here, in the second operating mode, the electronic device processes input information using an AI algorithm or an AI model.

[0073] The second application refers to an application that receives user interaction information in the second operating mode. In some implementations, the second application is a system-level application running in the electronic device.

[0074] The second input information refers to input information related to the running interface of the first application obtained in the second running mode. In some embodiments, the second input information may be interactive information input by the user to the running interface of the first application in the second running mode. For example, the second input information may be click information, sliding track information, shortcut key information, image or text editing commands, etc. executed by the user related to the running interface of the first application. In some embodiments, the second input information may be information transmitted to the first application by an application other than the first application.

[0075] In some embodiments, in the second operating mode, the display parameters of the operating interface of the first application are updated, or the display parameters of the input information are updated, so that the user can visually and intuitively feel that the electronic device has entered the second operating mode from the first operating mode based on the change in the display parameters of the operating interface of the first application, or the change in the display parameters of the input information (i.e., the display parameters of the second input information are different from the display parameters of the first input information).

[0076] The second input information is received using the second application, that is, in the second operating mode, the input information related to the operating interface of the first application is no longer sent to the first application, but is sent to the second application, so that the second application responds to the second input information.

[0077] The task information corresponding to the second input information refers to the task information to be processed determined based on the second input information. In some embodiments, the task to be processed and the processing object corresponding to the task can be determined based on the second input information. For example, in the case where the second input information is a picture editing instruction, the task to be processed corresponding to the second input information is the picture editing task, and the processing object corresponding to the picture editing task is the picture object corresponding to the second input information; for another example, in the case where the second input information is a text translation instruction, the task to be processed corresponding to the second input information is the text translation task, and the processing object corresponding to the text translation task is the text object corresponding to the second input information.

[0078] The second application inputs the task information corresponding to the second input information into the target model, so as to use the target model to execute the to-be-processed task corresponding to the task information.

[0079] Here, the target model can be any model that can process the task to be processed. In some embodiments, the target model can be a model determined based on the task type of the task to be processed. For example, when the task to be processed is a text processing task (for example, a text translation task, a text expansion task, a summary generation task, etc.), the target model can be a large language model; for another example, when the task to be processed is a task for processing multimodal information, the target model can be a visual language model; and so on. In some embodiments, the target model can be a model determined based on the amount of computation corresponding to the task to be processed. For example, the second application can be used to estimate the amount of computation required to process the task to be processed, and based on the estimated amount of computation and the computing resources of the multiple working nodes running the model, the target working node can be determined from the multiple working nodes to use the model running on the target working node as the model.

[0080] The target model performs model inference on the task information corresponding to the second input information and feeds back the model inference result to the second application. The second application receives the model inference result from the target model and uses the model inference result as the processing result information corresponding to the task information.

[0081] In some embodiments, when the processing result corresponding to the task information is a visual result, the second application displays and outputs the processing result. In some embodiments, when the processing result corresponding to the task information is an audio result, the second application calls an audio output device of the electronic device to output the processing result.

[0082] In the data processing method provided by the present application, first, in response to a target trigger event, the electronic device switches from a first operating mode to a second operating mode, wherein, in the first operating mode, a first application is used to receive and process first input information; then, in the second operating mode, a second application is used to receive second input information, input task information corresponding to the second input information into a target model, and receive processing result information corresponding to the task information from the target model; wherein the first input information and the second input information both represent input information related to the operating interface of the first application. In this way, on the one hand, in the second operating mode, the second application can be used to receive the second input information related to the operating interface of the first application, and the target model can be called to process the task information corresponding to the second input information to obtain processing result information corresponding to the task information, thereby realizing rapid processing of application information displayed in the operating interface of the first application and shortening the user's operation path; on the other hand, different operating modes are set for the electronic device, and the electronic device can be switched from the first operating mode to the second operating mode by a target trigger event, so as to quickly process application information of the first application in the second operating mode, thereby improving the user's processing efficiency of application information.

[0083] In some embodiments, the data processing method further includes the following step S13:

[0084] Step S13: determining a target processing window corresponding to the target trigger event based on the target trigger event.

[0085] Here, the target processing window refers to a display window created by the second application in response to the target triggering event. In some embodiments, the target processing window corresponding to the target triggering event can be determined based on any appropriate method.

[0086] In some embodiments, the target processing window may be determined based on the active area of the target triggering event on the display screen of the electronic device. For example, when the active area of the target triggering event on the display screen contains a single object, the target processing window is determined based on the single object; correspondingly, when the active area of the target triggering event on the display screen contains multiple objects, the target processing window is determined based on the entire display interface currently displayed on the display screen.

[0087] In some embodiments, the target processing window can be determined based on the type of control corresponding to the target trigger event. For example, when the target trigger event corresponds to a first type of control, the target processing window is determined based on the current running interface of the foreground application of the electronic device; correspondingly, when the target trigger event corresponds to a second type of control, the target processing window is determined based on the entire display interface currently displayed on the display screen.

[0088] In some embodiments, when a target processing window is determined based on a partial display interface or the entire display interface in a display screen, the display position of the target processing window on the display screen corresponds to the display position of the partial display interface or the entire display interface corresponding to the target processing window on the display screen.

[0089] Thus, the receiving of the second input information by using the second application in the above step S12 can be implemented as the following step S121:

[0090] The second application is used to receive second input information corresponding to the target processing window.

[0091] Here, the input information related to the target processing window is used as the second input information, and the second application is used to receive the second input information.

[0092] In some embodiments, after determining the target processing window, the user may perform a zoom operation on the target processing window, so that the target processing window may be displayed using a partial display area or the entire display area of the display screen of the electronic device.

[0093] In some embodiments, when the target processing window is displayed using the entire display area of the electronic device's display screen, the user's interactive operations with the display interface of the electronic device are all interactive operations within the target processing window, and therefore are all sent to the second application as second input information; when the target processing window is displayed using a partial display area of the electronic device's display screen, the user's interactive operations within the target processing window are sent to the second application as second input information, and the interactive operations within the display area outside the target processing window are sent to the first application as first input information.

[0094] In some embodiments, after the target processing window is determined, the target processing window is placed at the top of the hierarchy, and the user can drag the target processing window. In this way, the user can drag the target processing window to a suitable position, thereby reducing the obstruction of the running interface of the first application and allowing the user to continue to operate the first application smoothly.

[0095] As can be seen from the above, in the above embodiments provided by the present application, on the one hand, by determining the target processing window corresponding to the target trigger event and using the target processing window to receive the second input information processed by the second application, the user can input interactive information in different display areas according to the purpose of the operation; at the same time, when the user uses the target processing window to process the application information in the running interface of the first application, he is still in the scenario of the first application. Therefore, there is no need for additional jump operations, which achieves the effect of on-site processing of application information and reducing user operation steps; on the other hand, while operating the target processing window, the user is allowed to continue to operate the first application under the target processing window, which can provide the user with a more flexible and rich interactive experience; on the other hand, since the display position of the target processing window on the display screen corresponds to the display position of the partial display interface or the entire display interface corresponding to the target processing window on the display screen, the user's visual jump can be avoided.

[0096] In some embodiments, the data processing method further includes at least one of the following steps S141 to S144:

[0097] Step S141: generating the target trigger event based on a first trigger operation on a first control displayed on a display screen of the electronic device.

[0098] Here, the first control refers to any type of control displayed on a display screen of an electronic device. In some embodiments, the first control can be an icon type control, an animation type control, or a floating window type control.

[0099] In some embodiments, the first trigger operation for the first control can be any type of operation preset for the first control. For example, the first trigger operation can be a click operation, a long press operation, a sliding operation, etc. for the first control; for another example, the first trigger operation can also be a voice control operation, a gesture control operation, etc. for the first control.

[0100] In this way, in response to receiving the first trigger operation for the first control, a target trigger event corresponding to the first trigger operation is generated.

[0101] Step S142: generating the target trigger event based on the obtained first gesture operation on the touch device; and establishing a communication connection between the touch device and the electronic device.

[0102] Here, the touch device can be any type of device that is communicatively connected to the electronic device. In some embodiments, the touch device can be a touch device that is connected to the electronic device via a physical communication line, such as an external touch panel of the electronic device. In some embodiments, the touch device can be a touch device that is connected to the electronic device via a wireless communication signal, such as a touch device that is connected to the electronic device via Bluetooth, a mobile hotspot (Wi-Fi), etc. In some embodiments, the touch device is a stylus that is communicatively connected to the electronic device.

[0103] In some embodiments, the first gesture operation on the touch device can be any type of gesture operation performed on the touch device. In some embodiments, the first gesture operation can be a gesture operation performed on a specified location on the touch device, such as a gesture operation performed on the end, body, or tip of a pen. In some embodiments, the first gesture operation can be a preset gesture operation performed on a specified location on the touch device, such as a finger tapping operation or a two-finger pinching operation on the pen body at a specified location on the touch device.

[0104] In some embodiments, when the first gesture operation is an operation of the user squeezing the pen body with two fingers, the electronic device enters a temporary second operating mode (i.e., a temporary AI mode) while the user squeezes the pen body with two fingers, and exits the temporary second operating mode in response to the user reducing the squeezing pressure on the pen body.

[0105] In this way, in response to the first gesture operation on the touch device, a target trigger event corresponding to the first gesture operation is generated.

[0106] Step S143: Generate the target trigger event based on the second gesture operation on the display screen of the electronic device.

[0107] Here, the second gesture operation refers to a gesture operation performed by a user on a display screen of an electronic device.

[0108] In some implementations, when multiple running interfaces corresponding to the first applications are displayed on the display screen, the second gesture operation refers to a gesture operation performed by the user on one of the first applications on the display screen.

[0109] In some embodiments, the second gesture operation refers to a gesture operation performed by the user on at least one display object on the display screen, wherein the display object may be a picture object, text object, video object, voice object, etc. displayed and output in the first application.

[0110] In some embodiments, the second gesture operation may be a gesture operation performed by the user on the display screen along a specified trajectory. For example, the second gesture operation may be a three-finger sliding operation, a rectangular trajectory operation, a circular trajectory operation, etc. performed by the user on the display screen.

[0111] In this way, in response to the second gesture operation, a target trigger event corresponding to the second gesture operation is generated.

[0112] Step S144 : generating the target trigger event based on a first gesture operation of touching the display screen of the electronic device using a designated area of the touch device.

[0113] Here, the first gesture operation may refer to any gesture operation in which the user touches the display screen of the electronic device using a designated area of the touch device.

[0114] In some embodiments, the first gesture operation may be a gesture operation performed by a user using a designated area of a touch device and following a preset trajectory on the display screen of the electronic device. For example, the first gesture operation may be a gesture operation performed by a user using the tip of a touch device and following a circular or rectangular trajectory on the display screen. For example, if the touch device is a stylus, a target trigger event is generated in response to the user touching the display screen of the electronic device with the tip of the stylus.

[0115] In this way, in response to the first gesture operation, a target trigger event corresponding to the first gesture operation is generated.

[0116] In some implementations, the target triggering event may be generated based on different types of interaction modes.

[0117] Here, interaction methods are divided into different categories based on the scope of the area to be processed corresponding to the interaction method; the area to be processed refers to the area where the user desires to perform AI processing on the application information displayed therein. For example, if the area to be processed is the entire display area of the electronic device's display screen, the corresponding interaction method is determined to be the first type of interaction method; if the area to be processed is only a portion of the display area of the electronic device's display screen, the corresponding interaction method is determined to be the second or third type of interaction method.

[0118] Thus, the determination of the target processing window corresponding to the target triggering event, that is, the above step S13, can be implemented as one or more of the following steps S131 to S133:

[0119] Step S131: If the target triggering event is generated based on the first type of interaction mode, the target processing window is determined based on all display interfaces output by the electronic device.

[0120] As mentioned above, the first category of interaction mode refers to an interaction mode in which the corresponding area to be processed is the entire area displayed on the display screen of the electronic device. Therefore, when the target trigger event is a trigger event generated based on the first category of interaction mode, the target processing window corresponding to the target trigger event is determined based on the entire display interface output by the electronic device.

[0121] In some embodiments, the first category of interaction may include the first trigger operation described above, that is, a trigger operation on a first control displayed on a display screen of the electronic device.

[0122] In some embodiments, the first category of interaction may include the first gesture operation for the touch device described above, for example, a two-finger squeeze operation or a two-finger tap operation on the body of the stylus.

[0123] In some embodiments, the first category of interaction may include the second gesture operation described above, in which a user applies a finger to a display screen of an electronic device, and the area to be processed corresponding to the second gesture operation is the entire display interface of the electronic device. For example, the second gesture operation may be a sliding operation on the display screen using two, three, or more fingers.

[0124] Step S133: If the target trigger event is generated based on the second category of interaction, identify at least one object displayed and output by the electronic device; in response to the user's selection operation of a first object among the at least one object, determine the target processing window based on the first object.

[0125] As mentioned above, the second type of interaction mode refers to an interaction mode in which the corresponding area to be processed is a partial display area in the display screen of the electronic device.

[0126] Here, in the case where the target trigger event is a trigger event generated based on the second category of interaction method, first, the objects displayed and output on the display screen of the electronic device are identified to determine at least one object; wherein each object can be a picture object, text object, video object or voice object, etc. in the running interface of the first application; then, based on the user's selection operation of the first object among the at least one object, the first object is regarded as the object of interest to the user, and a target processing window containing the first object is generated.

[0127] In some embodiments, the second category of interaction may include the first gesture operation on the touch device described above, such as a two-finger pinch operation or a two-finger tap operation on the pen body of the touch device. Thus, after determining the target trigger event based on the first gesture operation, at least one object displayed and outputted in all display interfaces of the electronic device is identified, and a first object is determined from the at least one object based on the user's selection operation, thereby determining a target processing window based on the first object.

[0128] Step S133: If the target triggering event is generated based on the third type of interaction mode, determine the second object corresponding to the third type of interaction mode; and determine the target processing window based on the second object.

[0129] As mentioned above, the third type of interaction mode refers to an interaction mode in which the corresponding area to be processed is a partial display area in the display screen of the electronic device.

[0130] Here, when the target trigger event is a trigger event generated based on the third type of interaction mode, the second object is determined based on the partial display area corresponding to the third type of interaction mode, and then the target processing window is generated based on the second object.

[0131] In some embodiments, the third category of interaction may include the second gesture operation on the display screen of the electronic device described above; wherein, the second gesture operation is a gesture operation on a partial display area in the display screen of the electronic device, for example, the second gesture operation may be an operation in which the user uses his finger to circle the area of interest on the display screen.

[0132] In some embodiments, the third category of interaction may include the above-mentioned first gesture operation of touching the display screen of the electronic device using a designated area of the touch device. For example, the first gesture operation may be an operation in which a user uses a stylus to circle an area of interest on the display screen.

[0133] In the above-mentioned embodiments provided in the present application, different target trigger events are determined using different interaction methods, and a target processing window containing different application information (i.e., different types of object information displayed in the running interface of the first application) is determined based on the target trigger event, thereby improving the diversity and flexibility of user interaction methods.

[0134] In some embodiments, after determining the target processing window corresponding to the target triggering event, that is, after the above step S13, the data processing method further includes at least one of the following steps S151 to S154:

[0135] Step S151: configuring the boundary of the target processing window to a specified first display parameter.

[0136] Here, after the target processing window is determined, a first display parameter is configured for the window boundary of the target processing window, so that the user can visually and intuitively feel that the current window is a task processing window in the AI mode.

[0137] In some embodiments, the first display parameter may be one or more of a color parameter, a brightness parameter, a width parameter, a shape parameter, or any other type of display parameter including a border of the target processing window.

[0138] Step S152: displaying a specified animation effect in the target processing window.

[0139] Here, after the target processing window is determined, a specified animation effect is displayed in the target processing window, so that the user can visually and intuitively feel that the current window is a task processing window in the AI mode.

[0140] In some implementations, the animation effect may be displayed within a specified time period after the target processing window is generated.

[0141] In some implementations, the animation effect may be continuously displayed while the target processing window is displayed.

[0142] In some embodiments, the animation effect may be any type of animation effect. For example, the animation effect may be a brightness gradient effect, a color gradient effect, etc. It should be noted that the display of the animation effect does not affect the interaction effect between the user and the target processing window.

[0143] Step S153 : updating display parameters of the target processing window and the running interface of the first application respectively, so that the display parameters of the target processing window are different from the display parameters of the running interface of the first application.

[0144] Here, after determining the target processing window, the display parameters of the target processing window and the running interface of the first application are updated respectively, that is, different display parameters are configured for the target processing window and the running interface of the first application so that the user can easily distinguish the target processing window from the display interface of the first application visually.

[0145] In some implementations, compared to the running interface of the first application, a higher brightness parameter may be configured for the target processing window, so that the user can intuitively feel that the target processing window is the current top window.

[0146] In some embodiments, different color parameters may be configured for the target processing window and the running interface of the first application, so that the user can easily distinguish the target processing window from the display interface of the first application based on different color information.

[0147] Step S154: configuring the display parameter of the second input information to a specified second display parameter; the second display parameter is different from the third display parameter corresponding to the first input information.

[0148] Here, after determining the target processing window, a second display parameter is configured for the second input information received in the target processing window, and the second display parameter is different from the third display parameter corresponding to the first input information, so that the user can intuitively feel that he is currently in AI mode based on the display effect of the second input information.

[0149] In some embodiments, the second display parameter and the third display parameter are different in brightness parameter, thickness parameter, color parameter, or gradient effect.

[0150] In the above-mentioned embodiments provided in the present application, by configuring specified display parameters for the target processing window, the running interface of the first application, or the first input information and the second input information, the user can visually and intuitively feel that the current AI mode is in place, as well as the range of the target processing window corresponding to the AI mode.

[0151] In some embodiments, before inputting the task information corresponding to the second input information into the target model in step S12, the following steps S161 and S162 are further included:

[0152] Step S161: Identify at least one object within the target processing window.

[0153] Here, after determining the target processing window based on the target trigger event, at least one object within the target processing window is identified, wherein the object may be a text object, a picture object, a video object, or a voice object in the running interface of the first application.

[0154] In some embodiments, the at least one object may be identified using any suitable method.

[0155] In some implementations, identifying at least one object within the target processing window may include: identifying at least one view control contained within the target processing window; and acquiring the at least one object based on the at least one view control.

[0156] Here, a view control refers to a component used to construct a user interface, and is used to implement data visualization and user interaction. In some embodiments, a view control may include a button, a text control, an image control, a list control, and the like.

[0157] In some implementations, identifying at least one view control contained in the target processing window may include identifying a text control (textview control), a picture control (imageview control), etc. contained in the target processing window.

[0158] In this way, after identifying at least one view control, the second application can access the at least one view control and obtain at least one object corresponding to the at least one view control, such as a text object, a picture object, etc.

[0159] In some embodiments, identifying at least one object within the target processing window may include: obtaining a window screenshot corresponding to the target processing window; inputting the window screenshot into the target model; and receiving at least one object corresponding to the window screenshot from the target model.

[0160] Here, the second application is used to perform screenshot processing on the target processing window to obtain a window screenshot, and the window screenshot is input into the target model to use the target model to identify at least one object in the window screenshot. In some embodiments, the target model can be a large language model, a visual language model, etc.

[0161] In some embodiments, when the second application cannot identify the view control in the target window, the second application is used to perform screenshot processing on the target processing window, and the target model is used to identify at least one object in the window screenshot.

[0162] In the above-mentioned embodiments provided by the present application, compared with obtaining at least one object in the target processing window by taking a screenshot, the present application obtains at least one object in the target processing window by identifying at least one view control in the target processing window, which can improve the quality of the obtained object, for example, a picture with the same picture quality as the original picture can be obtained, the original text can be obtained, etc.; compared with the user manually taking a screenshot and using picture editing software to identify at least one object in the screenshot, the present application uses a second application to perform a screenshot and uses a target model to identify at least one object in the window screenshot, which can simplify the user's operation steps, and using the target model to perform image recognition can improve the accuracy of identifying at least one object.

[0163] Step S162: Generate the task information based on the second input information and the at least one object.

[0164] Here, after determining at least one object in the target processing window, the second application receives second input information and determines a to-be-processed task for the at least one object based on the second input information, thereby generating task information.

[0165] In some implementations, the above step S162 can be implemented as the following steps S1621 to S1623:

[0166] Step S1621: Determine a third object from the at least one object based on the second input information.

[0167] Here, the second input information is a selection operation on a third object among the at least one object. In some embodiments, the second input information may include a click operation, a long press operation, a circle operation, or a check operation on the third object.

[0168] Step S1622: display and output at least one second control based on the object type of the third object.

[0169] In some implementations, the object type of the third object may include a text type, a picture type, a video type, a voice type, or the like.

[0170] The second control refers to an editing or processing control for the third object. In some embodiments, each second control can be presented in the form of an icon or text.

[0171] Thus, in some embodiments, when the object type of the third object is text, the at least one control may include a control for performing processing such as translation, summarization, copying, or finding similar text on the third object. In some embodiments, when the object type of the third object is an image, the at least one control may include a control for performing processing such as saving, sharpening, cropping, beautifying, or finding similar images on the third object. In some embodiments, when the object type of the third object is speech, the at least one control may include a control for performing processing such as speech recognition, denoising, background sound removal, or saving on the third object.

[0172] Step S1623 : In response to a triggering operation on a target second control among the at least one second control, generating the task information based on the target second control and the third object.

[0173] Here, in response to the user's triggering operation on the target second control in at least one second control, that is, the user's selection operation on the target second control, the processing or editing instruction corresponding to the target second control is taken as the task to be processed, and the third object is taken as the processing object of the task to be processed, and task information corresponding to the second input information is generated.

[0174] In the above-mentioned embodiment provided by the present application, at least one second control is displayed and output based on the type of the selected third object, so that the user can use the at least one second control to edit or process the third object, thereby improving the processing intelligence of the data processing method for objects of different types.

[0175] In some embodiments, when the target processing window is determined based on the fourth object in the running interface of the first application, before inputting the task information corresponding to the second input information into the target model in the above step S12, the following steps S122 to S123 are further included:

[0176] Step S122: display and output at least one third control based on the object type of the fourth object.

[0177] Here, the specific implementation method of displaying and outputting at least one third control based on the object type of the fourth object is similar to the specific implementation method of displaying and outputting at least one second control based on the object type of the third object in the above step S1622, and will not be repeated here.

[0178] Step S123 : In response to a triggering operation on a target third control among the at least one third control, generating the task information based on the target third control and the fourth object.

[0179] Here, the second input information includes a triggering operation on a target third control among the at least one third control. Thus, in response to the user triggering operation on the target third control among the at least one third control, i.e., the user selecting the target third control, the editing or processing instruction corresponding to the target third control is used as the instruction of the task to be processed, and the fourth object is used as the processing object corresponding to the target third control, thereby generating the task information.

[0180] In the above embodiment provided by the present application, when the object in the target window is a single object (ie, the fourth object), the second application can generate at least one third control based on the object type of the fourth object without the user having to perform the selection operation again.

[0181] In some embodiments, the second operating mode includes an inspiration album mode.

[0182] In some embodiments, in inspirational album mode, after determining the target processing window containing an image object, in response to a user's circle selection operation on a portion of the image, the image and the corresponding circle selection trajectory information are stored in the target album. In some embodiments, the user can choose to open only the images in the target album, or open both the images in the target album and the corresponding circle selection trajectory information.

[0183] In some embodiments, in inspirational album mode, after determining a target processing window containing an image object, in response to a user inputting text in the target processing window using a stylus, a second application recognizes the user's input text and generates corresponding text information at the location corresponding to the text input operation. The image and corresponding text information are then stored in the target album. In some embodiments, the user can choose to open only the images in the target album, or to open both the images in the target album and the corresponding circled track information.

[0184] In some embodiments, in inspirational album mode, in response to a user circling at least two images in a target album, at least one corresponding fourth control is generated. In response to a user selecting a target fourth control within the at least one fourth control, the at least two images and the target fourth control are input as task information into a target model, so that the target model executes the task information. The at least one fourth control may include a sharpening operation, a cutout operation, or an image fusion operation.

[0185] Next, combine Figures 2 to 3 An embodiment provided in this application is described.

[0186] like Figure 2 As shown, in the running interface 200 of the first application, a picture area 210 and a text area 220 are displayed.

[0187] When the user desires to perform a cutout process on the image displayed in the image area 210 of the operation interface 200 , the user can long press the image area 210 with the hand 230 to enter the second operation mode, ie, the AI mode.

[0188] In some embodiments, when the user long-presses the image area 210 for a short period of time, for example, 0.5 seconds, an AI portal is displayed in the image area 210 to prompt the user whether to enter AI mode; in response to the user triggering the AI portal (for example, a click), the AI mode is entered. In some embodiments, when multiple images are displayed in the running interface 200 of the first application, in response to the user's long-press operation, a corresponding AI portal is displayed in the area where each image is located.

[0189] In some embodiments, when the user presses the image area 210 for a long time, for example, 1.5 seconds, the AI entrance is not displayed in the image area 210, but the user directly enters the AI mode.

[0190] In AI mode, the second application identifies the picture object in the picture area 210 and generates a target processing window based on the picture object. Figure 3As shown, in AI mode, the display parameters of the running interface 310 of the first application are different from those of the target processing window 320, wherein the brightness of the running interface 310 of the first application is lower than the brightness of the target processing window 320; at the same time, multiple controls for the image object in the target processing window 320 are displayed in the floating window 330.

[0191] In some embodiments, Figure 4 The display mode shown shows the target processing window. Figure 4 As shown, in AI mode, the brightness of the running interface 410 of the first application is lower than the brightness of the target processing window 420; at the same time, for the image object displayed in the target processing window 420, multiple controls are displayed inside the target processing window 420, such as Figure 4 Multiple controls are shown in the dashed box 430.

[0192] In response to user Figure 3 or Figure 4 The second application selects the cutout control in the target processing window, transfers the image and cutout task in the target processing window to the target model, and performs cutout processing on the image using the target model; thereafter, the second application receives the cutout result from the target model.

[0193] In some embodiments, when the image in the target processing window includes multiple subjects (for example, multiple people), the target model performs cutout processing on each subject to obtain multiple cutout results corresponding to the multiple subjects.

[0194] In some embodiments, when the picture in the target processing window includes multiple subjects (for example, multiple people), the user can circle a subject from the multiple subjects and click the cutout control. The second application then transfers the picture in the target processing window, the trajectory information circled by the user, and the cutout task to the target model to perform cutout processing on the picture using the target model. In this way, the target model only performs cutout processing on the subject circled by the user.

[0195] Based on the foregoing embodiments, the present application provides a data processing device, which includes the various units included and the various modules included in each unit, and can be implemented by a processor in a computer device; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0196] Figure 5 A schematic diagram of the structure of a data processing device provided in this application is shown in FIG. Figure 5 As shown, the data processing device 500 includes: a mode switching module 510 and a processing module 520, wherein:

[0197] A mode switching module 510 is configured to switch the electronic device from a first operating mode to a second operating mode in response to a target triggering event; wherein, in the first operating mode, the first input information is received and processed by a first application;

[0198] The processing module 520 is configured to receive second input information using a second application in the second operating mode; input task information corresponding to the second input information into a target model; and receive processing result information corresponding to the task information from the target model;

[0199] The first input information and the second input information both represent input information related to the running interface of the first application.

[0200] In some embodiments, the mode switching module 510 is configured to determine a target processing window corresponding to the target triggering event based on the target triggering event;

[0201] The processing module 520 is configured to receive second input information corresponding to the target processing window using the second application.

[0202] In some embodiments, the mode switching module 510 is configured to perform at least one of the following:

[0203] generating the target trigger event based on a first trigger operation on a first control displayed on a display screen of the electronic device;

[0204] generating the target trigger event based on the obtained first gesture operation on the touch device; the touch device is communicatively connected with the electronic device;

[0205] generating the target trigger event based on a second gesture operation on the display screen of the electronic device;

[0206] The target trigger event is generated based on a first gesture operation of touching the display screen of the electronic device using a designated area of the touch device.

[0207] In some implementations, the target triggering event may be generated based on different types of interaction modes. The processing module 520 is configured to perform one or more of the following:

[0208] If the target triggering event is generated based on the first category of interaction, determining the target processing window based on all display interfaces output by the electronic device;

[0209] If the target trigger event is generated based on the second category of interaction, identifying at least one object displayed and output by the electronic device; in response to a user selecting a first object among the at least one object, determining the target processing window based on the first object;

[0210] If the target trigger event is generated based on a third type of interaction mode, a second object corresponding to the third type of interaction mode is determined; and based on the second object, the target processing window is determined.

[0211] In some embodiments, the processing module 520 is configured to perform at least one of the following:

[0212] configuring the boundary of the target processing window to be a specified first display parameter;

[0213] Displaying a specified animation effect in the target processing window;

[0214] updating display parameters of the target processing window and the running interface of the first application respectively, so that the display parameters of the target processing window are different from the display parameters of the running interface of the first application;

[0215] The display parameter of the second input information is configured as a specified second display parameter; the second display parameter is different from the third display parameter corresponding to the first input information.

[0216] In some embodiments, the processing module 520 is configured to:

[0217] identifying at least one object within the target processing window;

[0218] The task information is generated based on the second input information and the at least one object.

[0219] In some embodiments, the processing module 520 is configured to perform at least one of the following:

[0220] Identifying at least one view control contained in the target processing window; acquiring at least one object based on the at least one view control; the object comprising at least one of a text object, a picture object, a video object, or a voice object;

[0221] Obtain a window screenshot corresponding to the target processing window; input the window screenshot into the target model; and receive at least one object corresponding to the window screenshot from the target model.

[0222] In some embodiments, the processing module 520 is configured to:

[0223] determining a third object from the at least one object based on the second input information;

[0224] Based on the object type of the third object, display and output at least one second control;

[0225] In response to a triggering operation on a target second control among the at least one second control, the task information is generated based on the target second control and the third object.

[0226] In some implementations, when the target processing window is determined based on a fourth object in the running interface of the first application, the processing module 520 is configured to:

[0227] Based on the object type of the fourth object, display and output at least one third control;

[0228] In response to a triggering operation on a target third control among the at least one third control, the task information is generated based on the target third control and the fourth object.

[0229] The description of the above device embodiment is similar to the description of the above method embodiment and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided in the embodiments of the present application can be used to perform the methods described in the above method embodiments. For technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

[0230] On the other hand, the present application also provides an electronic device. Figure 6 As shown, the electronic device 600 includes a processor 610 and a display screen 620; wherein,

[0231] Processor 610 is configured to switch the electronic device from a first operating mode to a second operating mode in response to a target trigger event; wherein, in the first operating mode, first input information is received and processed using a first application; and in the second operating mode, second input information is received using a second application; task information corresponding to the second input information is input into a target model; and processing result information corresponding to the task information is received from the target model; wherein the first input information and the second input information both represent input information related to an operating interface of the first application;

[0232] The display screen 620 is used to display and output the processing result information.

[0233] It should be noted that the description of the above device embodiment is similar to the description of the above method embodiment and has similar beneficial effects as the method embodiment. In some embodiments, the functions or units included in the device provided in the embodiments of the present application can be used to perform the methods described in the above method embodiments. For technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

[0234] It should be noted that, in the embodiment of the present application, if the above-mentioned data processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software and firmware.

[0235] An embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0236] The present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements some or all of the steps in the above method. The computer-readable storage medium may be transient or non-transient.

[0237] An embodiment of the present application provides a computer program, including computer-readable code. When the computer-readable code is run in a computer device, a processor in the computer device executes some or all of the steps for implementing the above method.

[0238] An embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, implements some or all of the steps in the above method. The computer program product can be implemented specifically by hardware, software, or a combination thereof. In some embodiments, the computer program product is embodied as a computer storage medium. In other embodiments, the computer program product is embodied as a software product, such as a software development kit (SDK), etc.

[0239] It should be noted that the descriptions of the various embodiments above tend to emphasize the differences between the various embodiments, and their similarities or similarities can be referenced to each other. The descriptions of the above device, storage medium, computer program, and computer program product embodiments are similar to the descriptions of the above method embodiments and have similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the device, storage medium, computer program, and computer program product of this application, please refer to the description of the method embodiments of this application for understanding.

[0240] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned steps / processes does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0241] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0242] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0243] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed across multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0244] In addition, all functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the above-mentioned integrated units can be implemented in the form of hardware or in the form of hardware plus software functional units.

[0245] Those skilled in the art will understand that all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, and other media that can store program codes.

[0246] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0247] The above is only an implementation method of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed in this application, which should be covered by the scope of protection of the present application.

Claims

1. A data processing method, comprising: In response to a target trigger event, the electronic device switches from a first operating mode to a second operating mode; wherein, in the first operating mode, the first input information is received and processed by a first application; In the second operating mode, using a second application, receiving second input information; inputting task information corresponding to the second input information into a target model; and receiving processing result information corresponding to the task information from the target model; The first input information and the second input information both represent input information related to the running interface of the first application.

2. The method according to claim 1, further comprising: Based on the target triggering event, determining a target processing window corresponding to the target triggering event; The receiving the second input information by using the second application includes: The second application is used to receive second input information corresponding to the target processing window.

3. The method according to claim 1, further comprising at least one of the following: generating the target trigger event based on a first trigger operation on a first control displayed on a display screen of the electronic device; generating the target trigger event based on the obtained first gesture operation on the touch device; The touch control device is communicatively connected with the electronic device; generating the target trigger event based on a second gesture operation on the display screen of the electronic device; The target trigger event is generated based on a first gesture operation of touching the display screen of the electronic device using a designated area of the touch device.

4. The method according to claim 2, wherein the target triggering event can be generated based on different types of interaction modes, and determining the target processing window corresponding to the target triggering event includes one or more of the following: If the target triggering event is generated based on the first category of interaction, determining the target processing window based on all display interfaces output by the electronic device; If the target trigger event is generated based on the second category of interaction, identifying at least one object displayed and output by the electronic device; in response to a user selecting a first object among the at least one object, determining the target processing window based on the first object; If the target triggering event is generated based on the third type of interaction mode, determining a second object corresponding to the third type of interaction mode; Based on the second object, the target processing window is determined.

5. The method according to claim 2, further comprising, after determining the target processing window corresponding to the target triggering event, at least one of the following: configuring the boundary of the target processing window to be a specified first display parameter; Displaying a specified animation effect in the target processing window; updating display parameters of the target processing window and the running interface of the first application respectively, so that the display parameters of the target processing window are different from the display parameters of the running interface of the first application; The display parameter of the second input information is configured as a specified second display parameter; the second display parameter is different from the third display parameter corresponding to the first input information.

6. The method according to claim 2, before inputting the task information corresponding to the second input information into the target model, further comprising: identifying at least one object within the target processing window; The task information is generated based on the second input information and the at least one object.

7. The method according to claim 6, wherein identifying at least one object within the target processing window comprises at least one of the following: Identifying at least one view control contained in the target processing window; acquiring at least one object based on the at least one view control; the object comprising at least one of a text object, a picture object, a video object, or a voice object; Obtain a window screenshot corresponding to the target processing window; input the window screenshot into the target model; and receive at least one object corresponding to the window screenshot from the target model.

8. The method according to claim 6, wherein generating the task information based on the second input information and the at least one object comprises: determining a third object from the at least one object based on the second input information; Based on the object type of the third object, display and output at least one second control; In response to a triggering operation on a target second control among the at least one second control, the task information is generated based on the target second control and the third object.

9. The method according to claim 4, wherein, in a case where the target processing window is determined based on a fourth object in the running interface of the first application, before inputting the task information corresponding to the second input information into the target model, the method further comprises: Based on the object type of the fourth object, display and output at least one third control; In response to a triggering operation on a target third control among the at least one third control, the task information is generated based on the target third control and the fourth object.

10. An electronic device comprising: A processor, configured to switch the electronic device from a first operating mode to a second operating mode in response to a target trigger event; wherein, in the first operating mode, first input information is received and processed using a first application; and in the second operating mode, second input information is received using a second application; task information corresponding to the second input information is input into a target model; and processing result information corresponding to the task information is received from the target model; wherein the first input information and the second input information both represent input information related to an operating interface of the first application; A display screen is used to display and output the processing result information.

Images