Data processing method and electronic equipment

Abstract

The invention provides a data processing method and electronic equipment, and the method comprises the steps: responding to a first instruction, and determining target content based on the first instruction and display content in a target display area in the current electronic equipment; determining a second application program corresponding to the first instruction and a preset processing mode corresponding to the second application program, and processing the target content based on the preset processing mode; wherein different first instructions correspond to different second application programs.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to a data processing method and electronic equipment. Background Art

[0002] In the past, sharing real-life scenes on social media platforms required a cumbersome process: opening the camera to take a photo, saving it to the photo album, switching to the social app, manually selecting the photo and editing the text, and finally posting it. This multi-step and time-consuming process, especially for quick sharing (such as fleeting images), resulted in a poor user experience.

[0003] Although some mobile phones or social media apps offer quick sharing features (such as the system share menu), they still require multiple page jumps, making efficient "what you see is what you share" impossible. Therefore, a more convenient technical solution is urgently needed to optimize the process from shooting to sharing, reduce user operation steps, and improve sharing efficiency. Summary of the Invention

[0004] The present disclosure provides a data processing method and an electronic device to at least solve the above technical problems existing in the prior art.

[0005] According to a first aspect of the present disclosure, a data processing method is provided, applied to an electronic device, the method comprising:

[0006] In response to a first instruction, determining target content based on the first instruction and current display content within a target display area of the electronic device;

[0007] Determining a second application corresponding to the first instruction and a preset processing method corresponding to the second application, and processing the target content based on the preset processing method;

[0008] Different first instructions correspond to different second application programs.

[0009] In the above solution, the determining of the target content based on the first instruction and the current display content in the target display area of the electronic device includes:

[0010] If the displayed content is the content displayed on the first interface, data is collected as target content based on a target collection device, and the target collection device is a collection device corresponding to the first application corresponding to the first interface;

[0011] If the displayed content is the content displayed on the second interface, determining the target content based on the current displayed content;

[0012] The first application is different from the second application.

[0013] In the above scheme, the first instruction includes at least a touch instruction; if the first instruction is a touch instruction, and the display content is the content displayed on the first interface, then the touch area receiving the touch instruction is different from the display area where the target control in the first interface is located, and the target control is used to instruct the target acquisition device to collect data.

[0014] In the above solution, different second application programs correspond to different preset processing methods.

[0015] In the above solution, the preset processing method includes:

[0016] The target content is displayed and / or played based on a third interface corresponding to the second application.

[0017] In the above solution, the preset processing method corresponding to the second application includes displaying and / or editing the target content based on the fourth interface.

[0018] In the above solution, displaying and / or editing the target content based on the fourth interface includes:

[0019] Determining first text data corresponding to the target content;

[0020] Based on the first text data and the prompt information, generating second text data corresponding to the target content, and displaying the second text data on the fourth interface;

[0021] When a preset condition is met, the second text data and the target content are displayed on the third page of the second application.

[0022] In the above solution, generating second text data corresponding to the first image based on the first text data and the prompt information includes:

[0023] The first text data and the prompt information are input into a target model to obtain second text data corresponding to the first image.

[0024] In the above solution, the target model is trained in the following way:

[0025] Acquire at least one piece of historical information corresponding to the first preset processing function;

[0026] The target model is trained based on the text in each piece of historical information.

[0027] According to a second aspect of the present disclosure, there is provided an electronic device, including:

[0028] At least one display screen, at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform:

[0029] In response to a first instruction, determining target content based on the first instruction and display content within a target display area of a display screen;

[0030] Determine a preset processing method corresponding to the first instruction, and process the target content based on the preset processing method; wherein different first instructions correspond to different preset processing methods.

[0031] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The above and other objects, features and advantages of the exemplary embodiments of the present disclosure will become readily understood by reading the detailed description below with reference to the accompanying drawings, in which several embodiments of the present disclosure are shown by way of example and not limitation, wherein:

[0033] In the drawings, the same or corresponding reference numerals denote the same or corresponding parts.

[0034] Figure 1 A first optional flow chart of the data processing method provided by an embodiment of the present disclosure is shown;

[0035] Figure 2 A second optional flow chart of the data processing method provided by the embodiment of the present disclosure is shown;

[0036] Figure 3 A third optional flow chart of the data processing method provided by the embodiment of the present disclosure is shown;

[0037] Figure 4 A fourth optional flow chart of the data processing method provided by an embodiment of the present disclosure is shown;

[0038] Figure 5 A fifth optional flow chart of the data processing method provided in an embodiment of the present disclosure is shown;

[0039] Figure 6 A first optional structural diagram of an electronic device provided by an embodiment of the present disclosure is shown;

[0040] Figure 7A second optional structural diagram of an electronic device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0041] To make the purposes, features, and advantages of the present disclosure more apparent and understandable, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of the present disclosure without creative work shall fall within the scope of protection of the present disclosure.

[0042] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0043] In the following description, the terms "first\second" are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first\second" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present disclosure described herein can be implemented in an order other than that illustrated or described herein.

[0044] Unless otherwise defined, all technical and scientific terms used in this disclosure have the same meaning as commonly understood by those skilled in the art in the art of this disclosure. The terms used in this disclosure are only for the purpose of describing the embodiments of this disclosure and are not intended to limit this disclosure.

[0045] It should be understood that in the various embodiments of the present disclosure, the size of the serial number of each implementation process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present disclosure.

[0046] Figure 1 A first optional flow chart of the data processing method provided by an embodiment of the present disclosure is shown, and will be explained according to each step.

[0047] Step S101 : In response to a first instruction, determining target content based on the first instruction and the current display content in the target display area of the electronic device.

[0048] In some embodiments, the electronic device determines the target content in response to the first instruction based on the first instruction and the current display content within the target display area of the electronic device.

[0049] In some embodiments, the target display area may include the entire display area of the electronic device, the display area corresponding to any split screen after the electronic device is split, and the entire display area after the electronic device is split; if the electronic device includes multiple display areas (such as the electronic device is a foldable device, a scroll screen device, or an electronic device with multiple screens), then the target display area may include any display area (or any display screen) in the electronic device, or the area corresponding to any display area after the screen is split.

[0050] In some embodiments, the displayed content may include content displayed within an application, such as an application page and content displayed on the page; the displayed content may also include content displayed by an operating system corresponding to the electronic device, such as a desktop, system settings, etc.

[0051] In some embodiments, the first instruction may include at least one of a key instruction, a touch instruction, and a gesture instruction.

[0052] Step S102 : determining a second application corresponding to the first instruction and a preset processing method corresponding to the second application, and processing the target content based on the preset processing method.

[0053] In some embodiments, the electronic device determines a second application corresponding to the first instruction; the second application is an application installed and running on the electronic device, or a program running on other devices interconnected with the electronic device described in the embodiment of the present disclosure and an application that can be called by the electronic device described in the embodiment of the present disclosure, wherein the first instructions are different and the corresponding second applications are also different; the electronic device can set different button instructions, touch instructions and gesture instructions for different second applications; the electronic device can also set a first instruction, and after the first instruction is triggered, display at least one second application corresponding to an identifier on the display screen of the electronic device, and determine the second application based on the second instruction corresponding to the identifier corresponding to the at least one second application.

[0054] In some embodiments, the preset processing methods corresponding to different second applications are the same or different; the difference in the second applications may refer to the different types or implemented functions of the second applications, or different application names and version numbers; specifically, if the types of the second applications are the same (such as both are social applications), the preset processing methods may be the same or different; or if the functions implemented by the second applications are the same, the preset processing methods are the same; the difference in the second applications may also mean that the second applications themselves are different, that is, different applications published by the application publisher (different versions may be regarded as the same second application or different second applications), for example, application A and application B, both belonging to the social category, have similar functions (such as both can communicate with other users through the conversation function), but are different second applications; the difference in second applications may also refer to the same second application itself and its clone application, such as application C and its clone are different second applications.

[0055] In some embodiments, different first instructions correspond to different preset processing methods; that is, the electronic device can be set with multiple first instructions, and different first instructions can correspond to the same second application, but correspond to different preset processing methods, then determine the second application corresponding to the first instruction, and the preset processing method corresponding to the second application, and process the target content based on the preset processing method. Specifically, determine the second application corresponding to the first instruction, and the preset processing method corresponding to the first instruction and the second application, and process the target content based on the determined preset processing method; or, determine the second application corresponding to the first instruction, and the preset processing method corresponding to the second application, and process the target content based on the preset processing method can also include: determining the preset processing method based on the first instruction, and determining the second application that can implement the preset processing method based on the preset processing method.

[0056] In some embodiments, after the electronic device determines the second application and the corresponding preset processing method, it processes the target content based on the second application and the preset processing method.

[0057] In this way, through the data processing method provided by the embodiment of the present disclosure, in response to the first instruction, the second application and the preset processing method can be determined, and the content displayed in the target display area of the current electronic device can be processed based on the preset processing method, thereby simplifying the cross-application or cross-platform data processing process and improving the user experience.

[0058] Figure 2 A second optional flow chart of the data processing method provided by an embodiment of the present disclosure is shown, and will be explained according to each step.

[0059] Step S201: In response to a first instruction, determine target content.

[0060] In some embodiments, in response to the electronic device receiving the first instruction, the target content is determined based on the content displayed in the target display area of the electronic device.

[0061] In some embodiments, in response to the displayed content being content displayed on the first interface, data collected by a target collection device is used as the target content. The collection device may include at least one of an image collection device, an audio collection device, or a video collection device; and the corresponding target content includes at least one of an image, audio, or video.

[0062] Among them, the first interface may include an image acquisition preview interface in the application; accordingly, the first interface corresponds to the first application, and the first application includes an application that can acquire images through the acquisition device of the electronic device, such as an application that directly calls the acquisition device to acquire images, such as a camera, a social application (calling the acquisition device to acquire images and displaying the images in a session or platform), a content sharing application (calling the acquisition device to acquire images, audio or video, and displaying the images, audio or video in the platform), a science popularization application (calling the acquisition device to acquire images, and the application performs science popularization by recognizing images) or other applications involving QR code recognition (such as logging in through a QR code, or confirming information through a QR code, etc.).

[0063] In a specific implementation, in response to the display content being the content displayed on the first interface, the first instruction may further include an acquisition instruction, that is, acquiring the target content through an acquisition device.

[0064] Taking the first interface as the shooting preview interface of the camera application in the electronic device as an example, when the shooting preview interface is displayed in the target display area of the electronic device, the electronic device receives a first instruction, and then the electronic device determines that the content displayed in the current shooting preview interface and captured by the camera is the target content; the electronic device obtains the content displayed in the current shooting preview interface as the target content based on the first instruction.

[0065] In other embodiments, in response to the displayed content being content displayed on a second interface, the displayed content within the target display area of the electronic device is the target content. The second interface is an interface corresponding to an application other than a camera or recording application that requires sensor data collection; the second interface can be an interface within the application or a system interface; the system interface can include interfaces such as the desktop and system settings.

[0066] If the second interface is the corresponding interface within an application, the target content is the content currently displayed by the application, such as the text, image, video displayed in the second interface, or one of the images corresponding to the second interface; or, if the second interface is a desktop, the target content is the content currently displayed on the desktop.

[0067] Taking the second interface as an example of the interface displayed by the browser application in the electronic device, when the browser page is displayed in the target display area of the electronic device, the electronic device receives the first instruction, and then determines that all or part of the displayed content of the current browser page is the target content.

[0068] Taking the second interface as an interface displayed by the desktop or operating system setting in the electronic device as an example, when the electronic device displays the desktop or operating system interface, it receives the first instruction, and the electronic device determines that all or part of the display content of the current desktop or system interface is the target content.

[0069] In some embodiments, the electronic device can obtain all or part of the displayed content through a screenshot function; optionally, if the target content is partial displayed content, after receiving the first instruction, the electronic device can adjust the area corresponding to the partial displayed content based on the screen adjustment instruction, and obtain the content in the area as the target display content.

[0070] Step S202: Determine the second application program and the preset processing method corresponding to the first instruction.

[0071] In some embodiments, a correspondence between the first instruction and the second application can be set, and different second applications correspond to different first instructions, and each second application corresponds to a preset processing method; a correspondence between the first instruction and different preset processing methods of the second application can also be set. For example, in the second application, the preset processing method for sending the target content to the session is different from the preset processing method for sending the target content to the platform, and they correspond to different first instructions.

[0072] In other embodiments, a correspondence between the first instruction and the preset processing method, as well as a correspondence between the preset processing method and the second application can be set; that is, the electronic device confirms the preset processing method based on the first instruction; and then determines the second application that can implement the preset processing method based on the preset processing method.

[0073] Step S203: Process the target content based on a preset processing method.

[0074] In some embodiments, the electronic device outputs the target content to a second application program, and processes the target content based on the preset processing method.

[0075] In some embodiments, the electronic device displays and / or plays the target content based on a third interface corresponding to the second application; the third interface may include an editing interface, and the target content is displayed and / or played on the editing interface to achieve a preview of the target content.

[0076] In some embodiments, to meet the needs of different users, the first instruction, second application, and preset processing method can have a one-to-one correspondence. That is, different first instructions correspond to different second applications, and different second applications may correspond to different preset processing methods. For example, the preset processing method of application D includes sending the target content to a session; the preset processing method of application E includes sending the target content to an editing interface, and then editing the target content based on the received editing instruction.

[0077] In specific implementation, the electronic device can output the target content to the second application by calling the application program interface corresponding to the second application; and can also process the target content by calling the application program interface corresponding to the preset processing method in the second application.

[0078] In some embodiments, the preset processing method may include displaying the target content on the target interface; or displaying the edited target content on the target interface after editing the target content. The target interface is an interface within the second application, which may include a conversation interface and a platform interface; the editing may include intercepting the target content, adding images and text to the target content, and adding additional text.

[0079] In some embodiments, the electronic device can display and / or edit the target content on the third interface, such as by directly adding text corresponding to the target content on the third interface and displaying the target content and the text corresponding to the target content on the target interface. Alternatively, the electronic device can also display and / or edit the target content based on the fourth interface.

[0080] The fourth interface may include an interface within the second application, such as an image editing interface, an audio editing interface, or a video editing interface, displaying icons for target content processing methods, such as cropping, adding mosaics, adding text, underlining, or adding watermarks. The fourth interface may also include an interface within a third application. The third application may be a content editing application, such as an image editing application, an audio editing application, or a video editing application, or may be a large model application.

[0081] In a specific implementation, in response to the third application being a content editing application, the electronic device may edit the target content based on the third application, and display the edited target content in the target interface of the second electronic device.

[0082] Alternatively, in a specific implementation, in response to the third application being a large model type application, the electronic device can determine the first text data corresponding to the target content based on the target model corresponding to the third application; based on the first text data and prompt information (Prompt), generate the second text data corresponding to the target content and display it on the fourth interface; when the preset conditions are met, display the second text data and the target content on the third page of the second application.

[0083] The first text data includes descriptive text data of the target content, or text data extracted from the target content. If the target content includes a little girl wearing a hat, the first text data includes "The little girl in the red skirt smiles at the camera." Alternatively, if the target content is text content, the first text data includes text data corresponding to the text content. The preset condition may be receiving a third instruction for confirming that the second text data does not need to be edited; the third instruction includes one of a touch instruction, a gesture instruction, a key instruction, an action instruction, or a voice instruction; the preset condition may also include the time required for a third application to generate the second text data corresponding to the target content reaching a preset time, or generating the second text data corresponding to the target content reaching a preset number of times.

[0084] In some embodiments, the target model corresponding to the third application can obtain at least one historical information corresponding to the preset processing method, learn based on the language description method, language habits, writing habits, etc. in the at least one historical information, and generate second text data based on the learning results combined with the prompt information and target content; the historical information may include at least one historical information published by the object corresponding to the electronic device on the platform of the second application, and the historical information includes at least one of text information, graphic information, image information, video information and audio information.

[0085] For example, the preset processing method includes sending the target content to the platform, then the target model can obtain at least one historical information published by the object corresponding to the electronic device on the platform, and learn the language description method, language habits, writing habits, etc. of the object based on the at least one historical information, and produce second text data based on the learning results combined with the prompt words and target content.

[0086] In this way, through the data processing method provided by the embodiment of the present disclosure, in response to the first instruction, the second application and the preset processing method can be determined, and the content displayed in the target display area of the current electronic device can be processed based on the preset processing method, thereby simplifying the cross-application or cross-platform data processing process and improving the user experience.

[0087] Figure 3 A third optional flow chart of the data processing method provided by an embodiment of the present disclosure is shown, and will be explained according to each part.

[0088] Step S301: Receive a first instruction.

[0089] In some embodiments, the first instruction may include a touch instruction, a key instruction, and a gesture instruction.

[0090] In some embodiments, if the first instruction is a touch instruction and the displayed content is the content displayed on the first interface, then the touch area receiving the touch instruction is different from the display area of the first interface where the target control is located, and the target control is used to instruct the target acquisition device to collect data. That is, the first instruction is different from the touch instruction already in the first application; optionally, the first instruction is triggered in a different manner than the instruction corresponding to the operating system of the electronic device, that is, the first instruction does not conflict with the existing instructions. The triggering methods include touch triggering, key triggering, and gesture triggering.

[0091] Taking the first interface as the shooting preview interface corresponding to the camera application in the electronic device as an example, the touch area that receives the touch instruction is different from the display area where the target control that receives the shooting instruction in the first interface is located, that is, the touch instruction cannot be triggered by the shooting instruction and is an instruction different from the shooting instruction.

[0092] Step S302: In response to the first instruction, determine the target content.

[0093] The specific steps of step S302 are the same as those of step S201 and will not be repeated here.

[0094] Step S303: Determine the second application program and the preset processing method corresponding to the first instruction.

[0095] The specific steps of step S303 are the same as those of step S202 and will not be repeated here.

[0096] Step S304: Process the target content based on a preset processing method.

[0097] The specific steps of step S304 are the same as those of step S203 and will not be repeated here.

[0098] In this way, through the data processing method provided by the embodiment of the present disclosure, based on the electronic device receiving a first instruction that is different from the current operating system or application internal function triggering method, based on the first instruction, the second application and the preset processing method are determined, and the content displayed in the target display area in the current electronic device is processed based on the preset processing method, thereby simplifying the cross-application or cross-platform data processing process and improving the user experience.

[0099] Figure 4 A fourth optional flow chart of the data processing method provided by an embodiment of the present disclosure is shown, and will be explained according to each part.

[0100] In some embodiments, processing the target content based on a preset processing method includes the following steps:

[0101] Step S401: Based on the first interface provided by the second application, a third interface corresponding to the preset processing method is called, and the target content is displayed in the third interface.

[0102] In some embodiments, the first interface is an application programming interface provided by the second application; the third interface is an interface within the second application. In response to the preset processing method being to send the target content to a platform or session, the third interface can be an editing interface, that is, the target content can be edited through the editing interface.

[0103] Step S402: determining a second interface in the third page corresponding to the implementation of the preset processing method, calling the second interface, and processing the target content based on the preset processing method.

[0104] In some embodiments, the target interface corresponding to the preset processing method includes a target session interface or a target platform interface; the electronic device calls the second interface corresponding to the send button in the third page to send the target content to the target interface corresponding to the preset processing method.

[0105] For example, the preset processing method includes displaying the target content on the conversation interface, then the electronic device calls the first interface, displays the target content on the third interface, and then determines the second interface corresponding to the "Send" button in the third interface and calls it to display the target content on the conversation interface.

[0106] In some optional embodiments, before calling the second interface, the electronic device may further include receiving an editing instruction for the target content, editing the target content based on the editing instruction, and calling the second interface to display the edited target content in the target interface.

[0107] In other optional embodiments, before calling the second interface, the electronic device may also include calling a third interface, so that the third application corresponding to the third interface edits the target content based on the editing instruction, and calls the second interface to display the edited target content in the target interface.

[0108] In this way, through the data processing method provided by the embodiment of the present disclosure, the electronic device can call according to the interface provided by the second application, automatically implement the preset processing method, achieve the effect corresponding to the preset processing method, reduce user operations, and improve user experience.

[0109] Figure 5 A fifth optional flow chart of the data processing method provided in the embodiment of the present disclosure is shown, and will be explained according to each step.

[0110] Step S501: Set a first instruction.

[0111] In some embodiments, the electronic device sets a first instruction in the interface of a first application or an operating system interface; the first instruction can be a touch operation, such as sliding upward with two fingers, or sliding one finger with two fingers; optionally, the touch operation can be set to be triggered in a target area, such as the viewfinder area of an image preview interface; the first instruction can also be a key instruction, such as pressing a volume key, or any other instruction that is convenient to operate and does not conflict with other operating methods.

[0112] Step S502 : In response to a first instruction, determining target content based on the first instruction and the current display content in the target display area of the electronic device.

[0113] In some embodiments, after the electronic device detects the first instruction, it determines the target content based on the first instruction.

[0114] Taking the content displayed in the target display area of the current electronic device as the content displayed on the first interface as an example, that is, the target display area of the current electronic device displays the photo preview interface, then in response to the first instruction, the content displayed on the photo preview interface is obtained through the image acquisition device.

[0115] Step S503: Based on the first interface provided by the second application, a third interface corresponding to the preset processing method is called, and the target content is displayed in the third interface.

[0116] In some embodiments, after the electronic device obtains the target content, it determines the second application and the preset processing method corresponding to the first instruction, and triggers the second application to process the target content based on the preset processing method.

[0117] During specific implementation, the electronic device may call the third interface of the second application based on the first interface provided by the second application, and display the target content in the third interface.

[0118] For example, on the Android platform, this mechanism is called intent: any application (including the operating system itself and any app) can call up a specific interface of another app by sending an intent. The intent is defined by the application being called (the second application) in its own manifest file, AndroidManifest.xml.

[0119] For example, the second application has an Intent: com.tencent.mm.ui.tools.ShareToTimeLineUI to share to the platform.

[0120] Any other application can call up the sharing interface of the second application through the following code:

[0121] ComponentName comp=new ComponentName("com.tencent.mm","com.tencent.mm.ui.tools.ShareToTimeLineUI");

[0122] Intent shareIntent=new Intent();

[0123] shareIntent.setComponent(comp);

[0124] shareIntent.setAction(Intent.ACTION_SEND);

[0125] shareIntent.addFlags(Intent.FLAG_ACTIVITY_NEW_TASK);

[0126] shareIntent.putExtra(Intent.EXTRA_STREAM,imageUri);

[0127] shareIntent.putExtra("Kdescription","");

[0128] shareIntent.setType("image / *");

[0129] startActivity(Intent.createChooser(shareIntent,"Share my photo"));

[0130] Step S504: determining a second interface in the third page corresponding to the implementation of the preset processing method, calling the second interface, and processing the target content based on the preset processing method.

[0131] In some embodiments, after the first interface is called, the second interface can be called to confirm the send button, and the send button can be triggered in a simulated manner to implement the preset processing method.

[0132] For example, after the third interface of the second application is called up, you can use the Android platform's accessibility API to confirm the send button in the third interface and simulate the object clicking the send button. This will ultimately complete the automatic sending action to the platform. The code is as follows:

[0133] AccessibilityNodeInfo root = getRootInActiveWindow(); / / Find the top node of the platform sending interface window;

[0134] List <accessibilitynodeinfo>result = root.findAccessibilityNodeInfosByText("Send"); / / Search for nodes with the content "Send" from the top node step by step;

[0135] if(result.size()>0);

[0136] {

[0137] AccessibilityNodeInfo text_field=result.get(0);

[0138] text_field.performAction(AccessibilityNodeInfo.ACTION_CLICK); / / After finding, simulate the object touching the screen at this node.

[0139] }

[0140] Step S505: Edit the target content based on a third application.

[0141] In some embodiments, after the target content is displayed on the third interface, the target content can be edited based on a third application.

[0142] In a specific implementation, the electronic device can send the target content to a third application (such as a multimodal image recognition engine), which recognizes the first text data of the main content in the target content. Then, the target model is used to identify the second text data based on the first text data and the prompt information. The target model can be a large language model.

[0143] In specific implementations, the electronic device can find the text input control through the accessibility API (findAccessibilityNodeInfosByText), then call the LLM-related API, passing in the target content and prompt information to obtain the second text data. Then, through the accessibility API, the second text data is automatically filled into the input control area. Finally, after reviewing and making possible modifications, the user can send the second text data and the target content to the platform through a third instruction.

[0144] The following is the code that launches the second application's platform interface. The text label "Thinking about target model" set here will automatically be filled in the text input control where the second text data will be entered. This is done so that the text label can be used to easily find the text input control in the next step (this can be any text label).

[0145] ComponentName comp=new ComponentName("com.tencent.mm","com.tencent.mm.ui.tools.ShareToTimeLineUI");

[0146] Intent shareIntent=new Intent();

[0147] shareIntent.setComponent(comp);

[0148] shareIntent.setAction(Intent.ACTION_SEND);

[0149] shareIntent.addFlags(Intent.FLAG_ACTIVITY_NEW_TASK);

[0150] shareIntent.putExtra(Intent.EXTRA_STREAM,imageUri);

[0151] shareIntent.putExtra("Kdescription","Thinking about the target model");

[0152] shareIntent.setType("image / *");

[0153] startActivity(Intent.createChooser(shareIntent,"Share target content"));

[0154] The following is the code after detecting that the platform interface of the second application has been called up: using the set text identifier, the text input control is conveniently found, and the second text data generated by the target model according to the target content is automatically filled in it.

[0155] AccessibilityNodeInfo root=getRootInActiveWindow();

[0156] List <accessibilitynodeinfo>result = root.findAccessibilityNodeInfosByText("target model thinking");

[0157] if(result.size()>0)

[0158] {

[0159] AccessibilityNodeInfo text_field=result.get(0);

[0160] text_field.performAction(AccessibilityNodeInfo.ACTION_CLICK);

[0161] String description_text = CallLLMAPIToGetText(Image,"I want to publish this target content on the platform and add a sentence that matches the target content. Today is January 2, 2024. Write a copy, no more than 50 words");

[0162] arguments.putCharSequence(AccessibilityNodeInfo.ACTION_ARGUME NT_SET_TEXT_CHARSEQUENCE,

[0163] description_text

[0164] text_field.performAction(AccessibilityNodeInfo.ACTION_SET_TEXT,arguments);

[0165] }

[0166] }

[0167] For example, if the target content is an image with a billiards table, the prompt information may include: "I want to post this photo on my Moments and add a caption that matches the content in the photo. Today is January 2, 2024. Write a Moments caption that does not exceed 50 characters"; the corresponding second text data could be: "A new year, a new beginning. This green billiards table is like my life, empty, waiting for new challenges and opportunities. Would you like to create our story on this table with me?"; or, if the target content is a door-shaped display board at the headquarters of XX Company, the corresponding second text data could be: "At the headquarters of XX, a red door-shaped display board leads us into the infinite imagination of the 2024 AI new era. #XX##AI New Era#"

[0168] In this way, through the data processing method provided by this embodiment of the present disclosure, the electronic device can be called according to the interface provided by the second application program, automatically implement the preset processing method, generate second text data for the target content through the third application program, achieve the effect corresponding to the preset processing method, reduce user operations, and improve the user experience.

[0169] Figure 6 Figure 1 shows a first optional structural schematic diagram of an electronic device provided by an embodiment of the present disclosure, which will be described according to each part.

[0170] In some embodiments, the electronic device 800 includes a content determination unit 810 and a processing unit 811.

[0171] The content determination unit 810 is configured to, in response to a first instruction, determine the target content based on the first instruction and the display content in the target display area of the current electronic device 800;

[0172] The processing unit 811 is configured to determine the second application program corresponding to the first instruction, and the preset processing method corresponding to the second application program, and process the target content based on the preset processing method;

[0173] Among them, different first instructions correspond to different second application programs.

[0174] Specifically, the content determination unit 810 is configured to, if the display content is the content displayed on the first interface, use the data collected by the target acquisition device as the target content, and the target acquisition device is the acquisition device corresponding to the first application program corresponding to the first interface;

[0175] If the display content is the content displayed on the second interface, determine the target content based on the current display content;

[0176] The first application program is different from the second application program.

[0177] In some embodiments, the first instruction includes at least a touch instruction; if the first instruction is a touch instruction, and the display content is the content displayed on the first interface, then the touch area receiving the touch instruction is different from the display area where the target control in the first interface is located, and the target control is used to instruct the target acquisition device to collect data.

[0178] In some embodiments, different second applications correspond to different preset processing methods.

[0179] In some embodiments, the preset processing method includes:

[0180] The target content is displayed and / or played based on a third interface corresponding to the second application.

[0181] The processing unit 811 is specifically configured to display and / or edit the target content based on the fourth interface.

[0182] The processing unit 811 is specifically configured to determine first text data corresponding to the target content;

[0183] Based on the first text data and the prompt information, generating second text data corresponding to the target content and displaying the second text data on the fourth interface;

[0184] When a preset condition is met, the second text data and the target content are displayed on the third page of the second application.

[0185] The processing unit 811 is specifically configured to input the first text data and the prompt information into a target model to obtain second text data corresponding to the first image.

[0186] The processing unit 811 is specifically configured to train the target model in the following manner:

[0187] Obtaining at least one piece of historical information corresponding to the preset processing method;

[0188] The target model is trained based on the text in each piece of historical information.

[0189] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.

[0190] Figure 7 A second optional structural diagram of an electronic device provided by an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0191] like Figure 7 As shown, the electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the electronic device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0192] Multiple components in the electronic device 800 are connected to the I / O interface 805, including an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the electronic device 800 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0193] The computing unit 801 can be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as the data processing method. For example, in some embodiments, the data processing method can be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the data processing method described above can be performed. Alternatively, in other embodiments, the computing unit 801 can be configured to perform the data processing method in any other appropriate manner (e.g., by means of firmware).

[0194] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0195] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0196] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0197] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0198] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0199] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0200] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not a limitation herein.

[0201] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Thus, a feature identified as "first" or "second" may explicitly or implicitly include at least one such feature. Throughout this disclosure, "plurality" means two or more, unless otherwise specifically defined.

[0202] The above description is merely a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.< / accessibilitynodeinfo> < / accessibilitynodeinfo>

Claims

1. A data processing method, applied to an electronic device, comprising: In response to a first instruction, determining target content based on the first instruction and current display content within a target display area of the electronic device; Determining a second application corresponding to the first instruction and a preset processing method corresponding to the second application, and processing the target content based on the preset processing method; Different first instructions correspond to different second application programs.

2. The method according to claim 1, wherein determining target content based on the first instruction and the current display content within the target display area of the electronic device comprises: If the displayed content is the content displayed on the first interface, data is collected as target content based on a target collection device, and the target collection device is a collection device corresponding to the first application corresponding to the first interface; If the displayed content is the content displayed on the second interface, determining the target content based on the current displayed content; The first application is different from the second application.

3. According to the method according to claim 2, the first instruction includes at least a touch instruction; if the first instruction is a touch instruction, and the display content is the content displayed on the first interface, then the touch area receiving the touch instruction is different from the display area where the target control in the first interface is located, and the target control is used to instruct the target acquisition device to collect data.

4. The method according to claim 1, Different second application programs correspond to different preset processing methods.

5. The method according to claim 4, wherein the preset processing method comprises: The target content is displayed and / or played based on a third interface corresponding to the second application.

6. The method according to claim 1, wherein the preset processing mode corresponding to the second application comprises displaying and / or editing the target content based on a fourth interface.

7. The method according to claim 6, wherein displaying and / or editing the target content based on the fourth interface comprises: Determining first text data corresponding to the target content; Based on the first text data and the prompt information, generating second text data corresponding to the target content, and displaying the second text data on the fourth interface; When a preset condition is met, the second text data and the target content are displayed on the third page of the second application.

8. The method according to claim 7, wherein generating second text data corresponding to the first image based on the first text data and prompt information comprises: The first text data and the prompt information are input into a target model to obtain second text data corresponding to the first image.

9. The method according to claim 8, wherein the target model is trained by: Obtaining at least one piece of historical information corresponding to the preset processing method; The target model is trained based on the text in each piece of historical information.

10. An electronic device comprising: at least one display screen, at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform: In response to a first instruction, determining target content based on the first instruction and display content within a target display area of a display screen; Determine a preset processing method corresponding to the first instruction, and process the target content based on the preset processing method; wherein different first instructions correspond to different preset processing methods.

Images