Data processing method, device, electronic device and computer storage medium

Abstract

The embodiment of the present invention provides a data processing method, device, electronic device and computer storage medium, wherein the data processing method includes: triggering an operation control corresponding to target information to obtain the target information displayed on the current interface; performing a target operation according to the target information; and displaying the target operation result on the current interface. Through the embodiment of the present invention, the device can obtain the target information displayed on the current interface to perform the target operation, and the way of obtaining information is more flexible, and more functions can be realized.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of computer technology, and in particular to a data processing method, device, electronic device and computer storage medium. Background Art

[0002] With the development of Internet technology and mobile communication technology, more and more traditional projects are being digitized through applications (English: Application, APP), and users can use various functions through applications. However, when using an application, users can only input information displayed / collected by the application to realize the functions of the application. If one application is to be used to collect information in another application, it is necessary to switch applications continuously, which makes some functions very cumbersome to realize or impossible to realize. Summary of the invention

[0003] In view of this, embodiments of the present invention provide a data processing method, device, electronic device and computer storage medium to solve some or all of the above problems.

[0004] According to a first aspect of an embodiment of the present invention, a data processing method is provided, including: triggering an operation control corresponding to target information to obtain the target information displayed on a current interface; performing a target operation according to the target information; and displaying the target operation result on the current interface.

[0005] According to the second aspect of an embodiment of the present invention, a data processing device is provided, including: an acquisition module, used to trigger an operation control corresponding to target information, and obtain the target information displayed on the current interface; a processing module, used to perform a target operation according to the target information; and a display module, used to display the target operation result on the current interface.

[0006] According to a third aspect of an embodiment of the present invention, there is provided an electronic device comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the data processing method of the first aspect.

[0007] According to a fourth aspect of an embodiment of the present invention, there is provided a computer storage medium on which a computer program is stored. When the program is executed by a processor, the data processing method according to the first aspect is implemented.

[0008] According to the data processing method, device, electronic device and computer storage medium provided by the embodiments of the present invention, the operation control corresponding to the target information is triggered to obtain the target information displayed on the current interface; the target operation is performed according to the target information; and the target operation result is displayed on the current interface. Through the embodiments of the present invention, the device can obtain the target information displayed on the current interface to perform the target operation, and the way of obtaining information is more flexible, and more functions can be realized. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0010] Figure 1 A schematic diagram of a scenario of a data processing method provided in Embodiment 1 of the present invention;

[0011] Figure 2 A flowchart of a data processing method provided in Embodiment 1 of the present invention;

[0012] Figure 3 A flowchart of a data processing method provided in Embodiment 2 of the present invention;

[0013] Figure 3A A schematic diagram of a screenshot effect provided by Embodiment 2 of the present invention;

[0014] Figure 3B A schematic diagram of a search scenario provided in Embodiment 2 of the present invention;

[0015] Figure 3C A schematic diagram of a translation scenario provided in Embodiment 2 of the present invention;

[0016] Figure 4 A flowchart of a data processing method provided in Embodiment 3 of the present invention;

[0017] Figure 4A A schematic diagram of an audio capture effect provided by Embodiment 3 of the present invention;

[0018] Figure 4B A schematic diagram of a recording scene provided in Embodiment 3 of the present invention;

[0019] Figure 5A A schematic diagram of a tab page effect of a preset display control provided in the fourth embodiment of the present invention;

[0020] Figure 5B A schematic diagram of the effect of a preset display control provided in the fourth embodiment of the present invention;

[0021] Figure 5C A schematic diagram of the display effect of a preset display control provided in the fourth embodiment of the present invention;

[0022] Fig. 6A A schematic diagram of a triggering effect of a floating icon provided in the fourth embodiment of the present invention;

[0023] Figure 6B A schematic diagram of the movement effect of a floating icon provided in the fourth embodiment of the present invention;

[0024] Figure 6C A schematic diagram of a hiding effect of a floating icon provided in the fourth embodiment of the present invention;

[0025] Fig.6D A schematic diagram of a dynamic special effect of a floating icon provided in the fourth embodiment of the present invention;

[0026] Figure 7 A structural diagram of a data processing device provided in Embodiment 5 of the present invention;

[0027] Figure 8 This is a structural block diagram of an electronic device provided in Embodiment 5 of the present invention. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in the field based on the embodiments in the embodiments of the present invention should fall within the scope of protection of the embodiments of the present invention.

[0029] The specific implementation of the embodiment of the present invention is further described below in conjunction with the accompanying drawings of the embodiment of the present invention.

[0030] Embodiment 1

[0031] Embodiment 1 of the present invention provides a data processing method. For ease of understanding, refer to Figure 1 The following describes the application scenario of the data processing method of the first embodiment of the present invention. Figure 1 A schematic diagram of a data processing method provided in the first embodiment of the present invention. Figure 1 This is just one application scenario of the data processing method provided in the first embodiment of the present invention. It does not mean that the method can only be applied to Figure 1 The present invention does not limit the application scenario of the data processing method. This is just an exemplary description for ease of understanding. Figure 1In the present invention, the scene includes an electronic device 101 and a cloud 102, and the electronic device 101 and the cloud 102 are connected through a network and perform data exchange through the network. In the present invention, the network includes a local area network (LAN), a wide area network (WAN), and a mobile communication network; such as the World Wide Web (WWW), a long-term evolution (LTE), a 2G network (2nd Generation Mobile Network), a 3G network (3rd Generation Mobile Network), and a 5G network (5th Generation Mobile Network). Of course, this is only an exemplary description and does not mean that the present invention is limited to this.

[0032] The cloud 102 may include various devices connected through a network, such as servers, relay devices, and end-to-end (Device-to-Device, D2D) devices.

[0033] The electronic device 101 may be a device with a display function. The present invention does not limit the specific form of the electronic device. The electronic device may be a smart speaker, a smart phone, a tablet computer, a laptop computer, etc. Various application software are installed on the electronic device 101, and the cloud 102 may include a server of the application software installed on the electronic device 101. The user operates on the electronic device 101 to obtain data of the content displayed on the current interface, performs a target operation on the obtained target information to obtain a target operation result, and displays the target operation result on the current interface.

[0034] Combination Figure 1 The scene shown, see Figure 2 As shown, Figure 2 A flowchart of a data processing method provided in Embodiment 1 of the present invention, which can be applied to Figure 1 In the scenario shown, further, it can be applied to Figure 1 The electronic device shown in the figure, that is, the electronic device is used as the execution subject of the method. Of course, this is only an exemplary description and does not mean that the present invention is limited to this. Figure 1 In the scenario shown, the method comprises the following steps:

[0035] Step 201: trigger the operation control corresponding to the target information to obtain the target information displayed on the current interface.

[0036] The operation control can be a control for human-computer interaction, the operation control can be displayed in the current interface, the operation control can be a floating icon or a preset display control, the preset display control can include a preset display window or a preset display floating layer, and the present invention does not limit the specific form of expression of the operation control.

[0037] The triggering operation of the operation control can be in various forms, including touch operation and non-touch operation, wherein the touch operation includes touch operation, key operation, etc., and the non-touch operation includes gesture operation, voice operation, etc.

[0038] The trigger operation can trigger the display of various function icons of the operation control, including artificial intelligence recognition icon, search icon, translation icon, record icon, image upload icon, price comparison icon, comment icon, etc., and then, different functions can be realized by operating different icons.

[0039] In this embodiment, when obtaining the target information to be processed based on the content displayed on the current interface, data collection, such as image collection, text collection, audio collection, etc., can be performed on the content displayed on the current interface first, and then the target information is obtained based on the collected data. The target information includes but is not limited to: keywords, key words, key image data, key audio data, etc. The scope of keywords / words can be appropriately set by those skilled in the art according to actual needs. In some application scenarios, the scope of keywords / words can be all or part of the words / words after processing the collected data.

[0040] Optionally, triggering the operation control corresponding to the target information to obtain the target information displayed on the current interface includes: triggering the operation control corresponding to the target information to display at least one option included in the operation control; receiving a trigger operation on a target option in at least one option that matches the target information, and obtaining the target information that matches the target option based on the content displayed on the current interface.

[0041] The operation control includes at least one option, and the user can select different options to implement different functions, thereby improving the user experience. In one implementation, the operation control may be a floating icon, and when the floating icon is triggered, at least one option is displayed; in another implementation, the operation control may be a preset display control, and when the menu option of the preset display control is triggered, at least one option is displayed. Displaying at least one option can facilitate user selection, and the operation control does not need to display at least one option all the time, thereby reducing the area occupied by the operation control on the current interface and avoiding affecting the normal browsing of the user.

[0042] Optionally, triggering an operation control corresponding to the target information to obtain the target information displayed on the current interface includes: triggering an operation control corresponding to the target information to collect the content displayed on the current interface to obtain collected data; performing artificial intelligence recognition on the collected data, and obtaining the target information according to the recognition result. Through artificial intelligence recognition, the target information can be accurately and efficiently obtained.

[0043] It should be noted that the content displayed on the current interface includes the images, text, video, audio, etc. displayed on the current interface. The collection of the content displayed on the current interface can be through screen capture, video frame capture, audio capture, text capture, etc. The present invention does not limit this. Correspondingly, the collected data can include video, images, audio, text, etc. Because the collected data can contain data in various forms, different artificial intelligence models can be used for artificial intelligence recognition of the collected data according to the data type. For example, the collected data includes images, and the image recognition model is used to perform image recognition on the collected data; for another example, the collected data includes audio, and the audio recognition model is used to perform audio recognition on the collected data. The audio can include the user's voice, and the voice recognition model can be used to perform voice recognition on the voice data; for another example, the text can include language, text, numbers, formulas, etc., and different models are used for recognition of different texts; because the video is composed of video frames, a video frame can be regarded as an image, so the recognition of the video is similar to image recognition.

[0044] Further optionally, triggering the operation control corresponding to the target information to obtain the target information displayed on the current interface includes: triggering the operation control corresponding to the target information to display a capture frame; receiving an adjustment operation on the capture frame; collecting the content displayed on the current interface according to the adjusted capture frame to obtain collected data; performing artificial intelligence recognition on the collected data, and obtaining the target information according to the recognition result. Using the capture frame to select the captured content (i.e., the collected data) makes it convenient for users to choose which content to capture, thereby improving the user experience.

[0045] Based on the above description, different types of data can be collected through different methods. Here, three data collection methods are listed to illustrate how to obtain the collected data. This is only an exemplary description and does not mean that the present invention is limited to this:

[0046] Optionally, in the first data collection method, for image data, triggering an operation control corresponding to the target information, and collecting content displayed on the current interface to obtain collected data includes:

[0047] Trigger the operation control corresponding to the target information, and perform an image capture of the content displayed on the current interface to obtain collected data. Image capture here can also be called screen capture, and the collected data obtained is image data. In many application scenarios, users browse information through display screens. Screen capture can meet the needs of users to obtain information through target applications in many application scenarios, improve the convenience of target applications to collect / input information, and also improve user experience. Further optionally, the content displayed on the current interface is captured according to the adjusted capture frame to obtain collected data, including: receiving a size adjustment operation and / or a position adjustment operation on the capture frame, and performing an image capture of the content area corresponding to the capture frame in the current interface to obtain collected data.

[0048] Optionally, in the second data collection method, for video data, triggering an operation control corresponding to the target information, collecting content displayed on the current interface to obtain collected data, including:

[0049] Trigger the operation control corresponding to the target information, and capture the video frame in the video displayed on the current interface according to the trigger time to obtain the collected data. Video frame capture allows users to capture the content they are watching while watching the video. Video is widely used in life because it transmits information more intuitively. Capturing video frames while users are watching videos further enriches the way the target application collects information, allowing the target application to obtain information in the video screen to provide users with intelligent services, further enriching the functions of the target application and improving the user experience.

[0050] Optionally, in the third data collection method, for audio data, the content displayed on the current interface is collected according to the adjusted capture frame to obtain collected data, including:

[0051] Receive the length adjustment operation and / or position adjustment operation of the interception frame, and perform audio interception on the content area corresponding to the interception frame in the current interface to obtain collected data. Transmitting information through audio is also an important way of information transmission. During the audio playback process, the target application can intercept the audio data to collect the audio data, which further enriches the data type collected by the target application, can provide more functions for users, and improve the user experience.

[0052] These three data collection methods are divided according to different data types. For the target operation indicated by the user's trigger operation, the three data collection methods can be combined with any operation. For example, the data collected by the three data collection methods can be used for any operation of artificial intelligence recognition, search, translation, recording, and image uploading. The operation performed is the data processing stage, and data collection is the data acquisition stage. Therefore, data collection can be combined with different operations to realize different functions, so that electronic devices can provide users with more functions and improve user experience.

[0053] The recognition of the collected data is completed by calling the target application. In one implementation, the electronic device may call the program of the target application to perform artificial intelligence recognition on the collected data to obtain the recognition result, and obtain the target information according to the recognition result; in another implementation, the electronic device may call the program of the target application to transmit the collected data to the cloud, and the cloud performs artificial intelligence recognition on the collected data to obtain the recognition result and obtain the target information, and then the cloud transmits the target information to the electronic device. Of course, this is only an exemplary description, and the present invention is not limited to this. Usually, the computing power of the electronic device is weaker than that of the cloud. If it is a complex calculation, the cloud computing speed is faster. If it is a simple calculation, the electronic device directly interacts with the user and eliminates the data transmission, so the response speed is faster. Based on the above analysis, if it is some artificial intelligence recognition with a small amount of calculation, the electronic device directly performs the recognition and responds faster. If it is some artificial intelligence recognition with a large amount of calculation, the cloud performs the calculation and returns the target information to the electronic device faster. Different methods can be used to improve the response speed in different scenarios.

[0054] For the target information, it may include the recognition result after artificial intelligence recognition of the collected data, or it may include the key content obtained after extracting the recognition result. For different functions triggered by the user, the content contained in the target information may be different. Optionally, in one implementation, the collected data includes the collected image data, and the target information includes the text obtained after text recognition of the image data, or the target element obtained after target element recognition of the image data. Optionally, in another implementation, the collected data includes the collected audio data, and the target information includes the audio key information obtained after key information extraction of the audio data, or the text key information obtained after the audio data is converted into text and the text is extracted from the text. By obtaining text after recognizing the image data, it is equivalent to converting the information contained in the image into text, performing more operations suitable for text processing, and realizing more functions; recognizing the image data to obtain the operation control is to extract the target information in the image data. Of course, obtaining text after recognizing the image data can also realize the extraction of the target information, and processing the target information improves the computational efficiency of data processing.

[0055] Step 202: Execute the target operation according to the target information.

[0056] Optionally, performing a target operation according to the target information and obtaining a target operation result includes:

[0057] The target application to which the operation control belongs is called to perform the target operation on the target information to obtain the target operation result.

[0058] By triggering the operation control, the content displayed on the current interface can be collected, and the target application to which the operation control belongs can be called to perform the target operation, breaking the limitation of data collection within the application, allowing the target application to collect more data, and also allowing users to directly call the target application for artificial intelligence recognition in the current interface when browsing more interfaces, enriching the functions of electronic equipment and improving user experience.

[0059] The operation control may be a control belonging to the target application, and the target application may be called to provide services through the operation control, but the current interface may not be an interface belonging to the target application. In this way, in any interface of the electronic device, the content displayed on the current interface can be collected and the target application can be called for processing by the operation control, which can realize more functions and, to a certain extent, break the restrictions on user information input in the application. Optionally, the application to which the current interface belongs is different from the target application.

[0060] Combined with the description of the various functions triggered by the user's triggering operation in step 201, in step 202, different functions correspond to different operations. Here, five specific examples are listed for illustration. Of course, this is just an example and does not mean that the present invention is limited to this.

[0061] Optionally, in the first example, when the operation control includes an option for indicating to search, performing a target operation according to the target information includes:

[0062] The target information is searched to obtain search results corresponding to the target information, and the target operation result includes the search results. Optionally, the target application to which the operation control belongs can be called to search the target information to obtain search results corresponding to the target information. The electronic device can transmit the target information to the cloud, and the cloud searches network resources according to the target information to obtain search results, and transmits the search results to the electronic device. In this example, combined with the exemplary description of obtaining the target information in step 201, optionally, after performing artificial intelligence recognition on the collected data to obtain the recognition result, at least one keyword is extracted from the recognition result and the target information is generated, and the target information includes at least one keyword. This example can be combined with any of the three data collection methods listed in step 201.

[0063] Using search, users can search for content they are interested in from the content displayed on the current interface. There is no need to open other applications and the operation can be completed directly on the current interface. User search is more convenient and they can search for content they are interested in immediately after browsing it, providing a better user experience.

[0064] Optionally, the search results may include at least one link related to the target information; the method further includes: receiving a trigger operation of the user on the link, and jumping to the page corresponding to the link according to the trigger operation. The user can jump to the corresponding page by clicking the link, and the user does not need to search again, which is more convenient. For example, the link can be a purchase link for an item; for another example, the link can be a link for instructions for use of an item. Of course, this is only an exemplary description and does not mean that the present invention is limited to this.

[0065] Optionally, in the second example, when the operation control includes an option for indicating translation, performing a target operation according to the target information includes:

[0066] The target information is translated to obtain a translation result corresponding to the target information. Optionally, the target information can be translated to obtain a translation result corresponding to the target information, and the target operation result includes the translation result. The electronic device can transmit the target information to the cloud, and the cloud translates the target information using a translation model to generate a translation result, and transmits the translation result to the electronic device. In this example, combined with the exemplary description of obtaining the target information in step 201, optionally, after calling the target application to perform artificial intelligence recognition on the collected data to obtain a recognition result, the recognition result is used as the target information. This example can be combined with any of the three data collection methods listed in step 201.

[0067] In many scenarios, users must input text to obtain the corresponding translated content of the text, and in many cases the content displayed on the current interface is not only text, but may also be images, videos, audio, etc., and the user cannot obtain text information for input. The data processing method provided by the present invention allows the user to trigger an operation so that the electronic device can collect the content displayed on the current interface to obtain target information and translate the target information, which is more convenient for user operation. Moreover, the user can translate the browsed images, videos, audio, etc., not limited to text, and the user experience is better.

[0068] Optionally, in the third example, when the operation control includes an option for indicating recording, performing a target operation according to the target information includes:

[0069] The target information is recorded to obtain a record result corresponding to the target information. Optionally, the target information can be converted into an editable record result, and the target operation result includes an editable record result. The electronic device can generate an editable record result based on the target information. The text, images and other displayed contents in many interfaces cannot be edited. In this example, the user can identify the content displayed on the current interface by recording, and generate an editable record result based on the recognition result, which is convenient for the user to edit. In this example, combined with the exemplary description of obtaining the target information in step 201, optionally, after calling the target application to perform artificial intelligence recognition on the collected data to obtain the recognition result, the recognition result is used as the target information. This example can be combined with any of the three data collection methods listed in step 201.

[0070] Optionally, in the fourth example, the target operation is performed according to the target information, including: comparing the price of the target item indicated in the target information to obtain the price comparison result of the target item, and the target operation result includes the price comparison result. Optionally, the target application to which the operation control belongs can be called to transmit the target information to the cloud, and the cloud searches for the price of the target item in the network resources according to the target information, and compares to obtain the price comparison result, and transmits the price comparison result to the electronic device. In this example, the user can intuitively browse the price comparison results of the target item, which is convenient for the user to make a choice when purchasing. This example can be combined with any of the three data collection methods listed in step 201.

[0071] Further optionally, the price comparison result includes at least one purchase link of the target item; the method further includes: displaying a page corresponding to the purchase link according to a triggering operation on the purchase link. Displaying the purchase link in the price comparison result can directly open the page corresponding to the purchase link, making it convenient for the user to make a purchase.

[0072] Optionally, in the fifth example, performing a target operation according to the target information includes: obtaining comment information, and adding comments to the target information according to the comment information to obtain comment results. When browsing the current interface, the user can add comments to the target information included in the current interface, making it more convenient for the user to comment.

[0073] Step 203: Display the target operation result on the current interface.

[0074] Optionally, the operation control includes a preset display window, and the target operation result is displayed in the current interface, including: determining that the target operation result corresponding to the target operation is obtained, triggering the display of the preset display window; and displaying the target operation result in the preset display window.

[0075] The preset display controls can not only be used to trigger corresponding functions, but also display results for user browsing convenience.

[0076] The size and position of the preset display control can be adjusted. For example, in one implementation, the method further includes: receiving a size adjustment operation and / or a position adjustment operation for the preset display window; displaying the preset display window on the current interface according to the adjusted size and / or position, and updating the display of the target operation result in the adjusted preset display window. By adjusting the size of the preset display window, the user can browse the target operation result through the preset display window, and by adjusting the position of the preset display window, the preset display window can be prevented from affecting the user's browsing of other content on the current interface.

[0077] Optionally, the preset display window may include at least one tab page, and displaying the target operation result in the preset display window includes: displaying the target operation result in the tab page corresponding to the target operation in the preset display window. Different tab pages display different operation results, and when the user switches the tab page, the corresponding operation result can be seen, which is convenient for the user to browse.

[0078] It should be noted that the operation control also includes a floating icon. If the user does not want to continue viewing after browsing the target operation result, the preset display window can be closed or switched to a floating icon. The method also includes: receiving a switching operation on the preset display window, reducing the preset display window to a floating icon; and displaying the floating icon at the edge of the current interface. After switching the preset display window to a floating icon, the floating icon does not affect the user's browsing of the current interface, and various functions can be realized by triggering the floating icon, which is convenient for users.

[0079] In combination with the five operations listed in step 202, the corresponding target operation result displayed is the target operation result corresponding to the target operation. For example, corresponding to the first example in step 202, when the operation control includes an object for indicating a search, the target operation result includes a search result; for another example, corresponding to the second example in step 202, when the operation control includes an object for indicating a translation, the target operation result includes a translation result; for another example, corresponding to the third example in step 202, when the operation control includes an object for indicating a record, the target operation result includes an editable record result, and in the current interface, displaying the target operation result includes: displaying the editable record result in the current interface and displaying at least one editing tool option; for another example, corresponding to the fourth example in step 202, when the operation control includes an object for indicating a price comparison, the target operation result includes a price comparison result; for another example, corresponding to the fifth example in step 202, when the operation control includes an object for indicating a comment, the target operation result includes a comment result.

[0080] It should be noted that the operation control can be a preset display control, which can be a floating layer or window in the current interface. The size of the preset display control can be adjusted without affecting the user's browsing of the current interface.

[0081] The data processing method provided by the embodiment of the present invention triggers the operation control corresponding to the target information, obtains the target information displayed on the current interface; performs the target operation according to the target information; and displays the target operation result on the current interface. Through the embodiment of the present invention, the device can obtain the target information displayed on the current interface to perform the target operation, and the way of obtaining information is more flexible, and more functions can be realized.

[0082] Embodiment 2

[0083] Based on the data processing method described in the first embodiment, the second embodiment of the present invention provides a data processing method. The second embodiment takes screenshot search as an example for illustrative description, but does not mean that the present invention is limited to this. Figure 3 As shown, the method comprises the following steps:

[0084] Step 301: When a screenshot search is triggered for the content displayed on the current interface, a screenshot frame is used to capture an image of the content displayed on the current interface to obtain collected data.

[0085] Step 301 is based on the description in step 201 of the first embodiment, and is a further detailed description of "triggering the operation control corresponding to the target information, and collecting the content displayed on the current interface to obtain the collected data" in the scenario of screenshot search.

[0086] Here are two specific examples to explain image capture in detail:

[0087] Optionally, in the first example, a capture frame is used to capture an image of the content displayed on the current interface to obtain collected data, including:

[0088] The content area of ​​the content displayed on the current interface is detected, and an image of the detected content area is captured using a capture frame whose size matches the size of the content area to obtain collected data.

[0089] Optionally, in the second example, a capture frame is used to capture an image of the content displayed on the current interface to obtain collected data, including:

[0090] The content area of ​​the content displayed on the current interface is detected, and a capture frame is displayed in the content area of ​​the current interface; according to the size adjustment operation and / or position adjustment operation of the capture frame, the adjusted capture frame is used to capture the image of the detected content area to obtain the collected data. The user can adjust the capture frame to determine the content to be captured, which can better meet the user's needs and improve the user experience.

[0091] like Figure 3A As shown, Figure 3A A schematic diagram of a screenshot effect provided in the second embodiment of the present invention, Figure 3A In the process of searching for screenshots of the contents displayed on the current interface based on the user's triggering operation of the displayed operation control, the operation control can be hidden, and the current interface displays a capture frame. The user can adjust the size and position of the capture frame by dragging it. After the user has adjusted the size and position, the capture can be completed by confirming the operation, and the electronic device uses the capture frame to capture the image; or the user can cancel the screenshot by canceling the operation. Figure 3A In the dialog box, the "Confirm" icon indicates confirmation, and the "Cancel" icon indicates cancellation. Figure 3A This is only an illustration and does not mean that the present invention is limited thereto.

[0092] Step 302: Call the target application to perform artificial intelligence recognition on the collected data, and obtain target information based on the recognition results.

[0093] In this embodiment, the collected data may include screenshot images, and the screenshot images may be recognized using an image recognition model to obtain recognition results. It should be noted that, in this embodiment, the recognition results may include text obtained after text recognition of text in the screenshot images, or relevant information of operation controls obtained after recognition of operation controls in the screenshot images.

[0094] Step 303: Call the target application to which the operation control belongs to search for the target information, and obtain search results corresponding to the target information.

[0095] Here, step 303 is the same as the first example in step 202 in embodiment 1, and will not be described again here.

[0096] Step 304: Based on the current interface, display the search results through the operation controls.

[0097] Step 304 is the same as step 203 in the first embodiment and will not be described again here.

[0098] Combined with 3B, Figure 3B A schematic diagram of a search scenario provided in Embodiment 2 of the present invention, Figure 3B The scenario shown is based on the data processing method provided in the second embodiment, and illustrates a specific scenario of the search described in the first example in step 202. Figure 3B In interface 1, the operation control is displayed as a floating icon, that is, Figure 3B The user can realize the search by triggering the floating icon. This scenario is just an example of the floating icon, and it does not mean that the present invention is limited to this. The floating icon is displayed on the current interface, and the current interface can be any interface. Figure 3B Interface 1 in the figure shows a question, which is only an exemplary description and does not mean that the present invention is limited to this. Figure 3B In interface 2, the user's trigger operation can be to click the floating icon, and click the floating icon (i.e., the trigger operation) to trigger the search and enter Figure 3BInterface 3 in the figure is the screen capture interface; in interface 3, the dotted frame represents the capture frame, and the user can adjust the position and size of the capture frame by dragging the capture frame. It should be noted that confirmation and cancel buttons can be displayed below the capture frame. Of course, the confirmation button and cancel button are virtual buttons, and clicking the confirmation button and cancel button can be achieved through touch operation. The user can confirm the completion of the adjustment of the size and position of the capture frame through the confirmation operation, and trigger the image capture of the content in the capture frame; Figure 3B As shown in interface 4, the user's confirmation operation can be to click a confirmation button. If the user clicks a cancel button, the current search is canceled. After the user clicks the confirmation button, the electronic device captures the content in the capture box in the current interface (also called screen capture) and obtains a captured image, such as Figure 3B As shown in interface 5 in the figure, interface 5 shows a captured image. Interface 5 is illustrated by taking a user capturing a title displayed in the current interface as an example, which does not mean that the present invention is limited to this; the electronic device calls the target application corresponding to the operation control (i.e., the floating icon) to perform image recognition on the captured image to obtain a recognition result, and the recognition result may include text obtained after text recognition on the captured image, and / or target elements obtained after target element recognition on the image data, extract keywords from the recognition result to obtain key information, search based on the key information, and combine Figure 3B , the captured image contains a question, and the search can search for the answer to the question; Figure 3B As shown in the middle interface 6, the answer is displayed in the preset display window, and the preset display window is suspended on the current interface. The user can adjust the size and position of the preset display window by dragging, which does not affect the user's browsing of the content of the current interface. Interfaces 1 to 6 exemplify the process of screenshot search. Because the operation control is set, the user can trigger the collection of the content displayed on the current interface through triggering operations, breaking the way of data collection within the application. The user does not need to open the application. When browsing any interface, the data collection can be triggered by triggering the operation control, and then the search and other operations are completed, enriching the functions that can be realized by the electronic device. Of course, this is just an exemplary description, and the data processing method provided by the present invention can also be applied to other scenarios.

[0099] Combined with 3C, Figure 3C A schematic diagram of a translation scenario provided in the second embodiment of the present invention, Figure 3C The scenario shown is based on the data processing method provided in the second embodiment, and illustrates a specific scenario of the translation described in the second example in step 202. Figure 3C In interface 1, the operation control is displayed as a preset display control, that is, Figure 3CThe control at the bottom of the middle interface. This scenario is only illustrated by taking the preset display control as an example, and does not mean that the present invention is limited to this. The user can achieve translation by triggering the preset display control. The preset display control is displayed floating on the current interface, and the current interface can be any interface. Figure 3C Interface 1 in the figure shows an English article. Of course, this is just an exemplary description and does not mean that the present invention is limited to this. Figure 3C In interface 2, the user's triggering operation may be clicking a translation button in the preset display control. In this example, the translation button is a virtual button. Clicking the translation button through a touch operation triggers translation. Before translation, the current interface must be captured first, such as Figure 3C Interface 3 in the figure is the screen capture interface; in interface 3, the dotted frame represents the capture frame, and the user can adjust the position and size of the capture frame by dragging the capture frame. It should be noted that confirmation and cancel buttons can be displayed below the capture frame. Of course, the confirmation button and cancel button are virtual buttons, and clicking the confirmation button and cancel button can be achieved through touch operation. The user can confirm the completion of the adjustment of the size and position of the capture frame through the confirmation operation, and trigger the image capture of the content in the capture frame; Figure 3C As shown in interface 4, the user's confirmation operation can be to click a confirmation button. If the user clicks a cancel button, the current translation is canceled. After the user clicks the confirmation button, the electronic device captures the content in the capture box in the current interface (also referred to as screen capture) and obtains a captured image, such as Figure 3C As shown in interface 5 in the figure, interface 5 displays a captured image. Interface 5 is illustrated by taking an example of a user capturing an English article displayed in the current interface, which does not mean that the present invention is limited to this; the electronic device calls the target application corresponding to the operation control (i.e., the preset display control) to perform image recognition on the captured image to obtain a recognition result, and the recognition result may include text obtained after text recognition on the captured image. In this example, the recognized text is used as target information, and translation is performed based on the target information. The target language of the translation can be set by the user. In this example, English is translated into Chinese for exemplary description; Figure 3CAs shown in the middle interface 6, the translation result, that is, the translated Chinese, is displayed in the preset display control. The preset display control is suspended on the current interface. The user can adjust the size and position of the preset display control by dragging, which does not affect the user's browsing of the content of the current interface. Interfaces 1 to 6 exemplarily show the process of screenshot translation. Because the operation control is set, the user can trigger the collection of the content displayed on the current interface through a trigger operation, breaking the way of data collection within the application. The user does not need to open the application. When browsing any interface, the data collection can be triggered by triggering the operation control, and then the translation and other operations are completed, enriching the functions that can be realized by the electronic device. Of course, this is just an exemplary description, and the data processing method provided by the present invention can also be applied to other scenarios.

[0100] Embodiment 3

[0101] Based on the data processing method described in the first embodiment, the third embodiment of the present invention provides a data processing method. The third embodiment takes the recording of audio as an example for illustrative description, but does not mean that the present invention is limited to this. Figure 4 As shown, the method comprises the following steps:

[0102] Step 401: When triggering audio processing of the content displayed on the current interface, audio data of the audio content displayed on the current interface is intercepted according to the interception frame to obtain collected data.

[0103] Step 401 is based on the description in step 201 of the first embodiment, and further explains in detail "triggering the operation control corresponding to the target information, collecting the content displayed on the current interface to obtain the collected data" in the audio search scenario.

[0104] Optionally, audio data is intercepted from the audio content displayed on the current interface according to the interception frame to obtain collected data, including:

[0105] Display a capture frame in the current interface; receive a user's length adjustment operation and / or position adjustment operation on the capture frame, and use the adjusted capture frame to capture audio data of the audio content displayed on the current interface to obtain collected data.

[0106] like Figure 4A As shown, Figure 4A A schematic diagram of an audio capture effect provided by Embodiment 3 of the present invention is shown in FIG. Figure 4A In the , two icons that can be moved on the timeline are set at both ends of the interception frame. Dragging the icons at both ends can change the position and time length of the interception frame on the timeline, so as to determine which section of audio data to intercept. Figure 4A This is only an exemplary description and does not mean that the present invention is limited thereto.

[0107] Step 402: Call the target application to perform artificial intelligence recognition on the collected data, and obtain target information based on the recognition results.

[0108] Step 403: Convert the target information into an editable record result.

[0109] Here, step 403 is the same as the first example of step 202 in the first embodiment, and will not be described again here.

[0110] Step 404: Based on the current interface, the editable record results are displayed through a preset display control.

[0111] Step 404 is the same as step 203 in the first embodiment and will not be described again here.

[0112] Combined with 4B, Figure 4B A schematic diagram of a recording scene provided in Embodiment 3 of the present invention, Figure 4B The scenario shown is based on the data processing method provided in the third embodiment of the present invention, and is a specific scenario of the record described in the third example in step 202. Figure 4B In interface 1, the operation control is displayed as a preset display control, that is, Figure 4B The control at the bottom of the middle interface, in this scenario, the preset display control is used as an example for exemplary description, and the present invention is not limited to this. The user can realize recording by triggering the preset display control. The preset display control is suspended and displayed on the current interface, and the current interface can be any interface. Figure 4B The interface 1 in FIG. 1 is an audio playback interface. Of course, this is only an exemplary description and does not mean that the present invention is limited to this. Figure 4B In interface 2, the user's trigger operation can be clicking the record button in the preset display control. In this example, the record button is a virtual button. Clicking the record button through a touch operation triggers recording. Before recording, the audio data played on the current interface must be intercepted, such as Figure 4B In interface 3, two solid triangle marks represent the interception frame, which correspond to the start time and end time of the intercepted audio data respectively. The user can adjust the position and length of the interception frame by dragging the interception frame. It should be noted that confirmation and cancel buttons can be displayed below the interception frame. Of course, the confirmation button and cancel button are virtual buttons. Clicking the confirmation button and cancel button can be realized by touch operation. The user can confirm the completion of the adjustment of the size and length of the interception frame by the confirmation operation, and trigger the audio data interception of the content in the interception frame; Figure 4BAs shown in interface 4 in the figure, the user's confirmation operation can be clicking a confirmation button. If the user clicks a cancel button, the current recording is canceled. After the user clicks the confirmation button, the electronic device intercepts the audio data of the content in the interception box in the current interface and obtains the intercepted audio data. The electronic device calls the target application corresponding to the operation control (i.e., the preset display control) to perform image recognition on the intercepted audio data to obtain a recognition result. The recognition result may include text obtained after text recognition of the intercepted audio data. In this example, the recognized text is used as the target information, and the target information is recorded to generate an editable recording result. Figure 4B As shown in the middle interface 5, the editable record results are displayed in the preset display control. The preset display control is suspended on the current interface. The user can adjust the size and position of the preset display control by dragging. For the editable record results, if the preset display control is too small and the user is not convenient to edit, it can be enlarged by dragging, as shown in the following figure. Figure 4B As shown in the middle interface 6, after the preset display control is enlarged, the user editable area is also relatively large, which is convenient for users to edit. The recording is triggered by the preset display control, and the non-editable audio data is converted into editable text, which is convenient for users to edit and complete the recording, enriching the functions that can be realized by the electronic device. Of course, this is only an exemplary description, and the data processing method provided by the present invention can also be applied to other scenarios.

[0113] In this embodiment, the collected data may include intercepted audio data, and the audio data may be recognized using an audio recognition model to obtain a recognition result. It should be noted that, in this embodiment, the recognition result may include text or audio information after the audio data is recognized, and the target information includes audio target information obtained after target information is extracted from the audio data, or text target information obtained after converting the audio data into text and extracting target information from the text.

[0114] Embodiment 4

[0115] In combination with the data processing methods described in the above embodiments 1 to 3, the fourth embodiment lists two specific application scenarios to illustrate the operation controls. The operation controls may include preset display controls or floating icons. Of course, this is only an exemplary description. The operation controls can have multiple forms and can be switched between different forms. This is not limited to this. The description in the two application scenarios of the fourth embodiment can be used to explain any of the data processing methods described in the first to third embodiments.

[0116] Optionally, in the first application scenario, taking a preset display control as an example, the preset display control includes at least one tab page, and the data processing method of any embodiment of the present invention further includes:

[0117] If it is detected that the target tab page of the operation control is triggered, the content of the target tab page is displayed, and the operation control includes at least one tab page.

[0118] like Figure 5A As shown, Figure 5A A schematic diagram of a tab page effect of a preset display control provided in Example 4 of the present invention, where one tab page may correspond to one function. When a user selects the corresponding tab page, the preset display control displays the result of the corresponding function display, that is, the operation result obtained by implementing the function through the corresponding operation.

[0119] The size of the preset display control can be adjusted. When the user adjusts the height of the preset display control to the minimum, the preset display control only displays a few shortcut options, such as Figure 5B As shown, Figure 5B The effect diagram of a preset display control provided in the fourth embodiment of the present invention may include options such as minimize, exit, menu, and quick screen recognition. When the user clicks exit, the preset display control can be closed. When the user clicks quick screen recognition, the screen can be recognized. When the user clicks the menu, at least one option can be displayed. The user can select these options through touch operation to realize the corresponding function. Figure 5C As shown, Figure 5C A schematic diagram of a display effect of a preset display control provided in the fourth embodiment of the present invention, Figure 5C In the figure, four options, i.e. four functions, are displayed. One option corresponds to one function, including AI recognition, search, translation, recording, and image upload, which correspond to the four options of the floating icon.

[0120] Optionally, when the user clicks minimize, the preset display control can be switched to the floating icon. Optionally, in an implementation, the data processing method of any embodiment of the present invention further includes:

[0121] When a first switching operation on a preset display control is detected, the preset display control is hidden and switched to displaying a floating icon.

[0122] Optionally, in the second application scenario, the operation control is a floating icon. When a trigger operation on the floating icon is detected, at least one option included in the floating icon is displayed; if a target option in at least one option is triggered, target information matching the target option is obtained based on the content displayed on the current interface. It should be noted that at least one option of the floating icon can correspond to at least one option of the preset display control. One option corresponds to one function, including artificial intelligence recognition, search, translation, recording, image upload, etc.

[0123] like Fig. 6A As shown, Fig. 6AA schematic diagram of a triggering effect of a floating icon provided in the fourth embodiment of the present invention; Fig. 6A In the example, when the user clicks the floating icon, four function options are displayed around the floating icon (that is, at least one option, and one function option is one option). Fig. 6A This is an example. There may be more function options. Users can select function options to implement corresponding functions. Users can trigger the display of four function options by clicking on the floating icon. Users can trigger the display of four function options by long pressing the floating icon. It should be noted that in one implementation, when the user long presses the floating icon, the user can also move the position of the floating icon by dragging it, such as Figure 6B As shown, Figure 6B A schematic diagram of the movement effect of a floating icon provided in Embodiment 4 of the present invention.

[0124] Optionally, in an implementation manner, the data processing method of any embodiment of the present invention further includes: when an operation for instructing to hide the floating icon is detected, hiding the floating icon at an edge of the current interface.

[0125] Optionally, the operation of instructing to hide the floating icon may be to drag the floating icon to the edge of the current interface. When the user drags the floating icon to the edge of the current interface, the floating icon is hidden. Figure 6C As shown, Figure 6C A schematic diagram of the hiding effect of a floating icon provided in Example 4 of the present invention. In the present invention, hiding the floating icon means that the floating icon is only partially displayed at the edge of the current interface, not completely displayed, so as to avoid affecting the user's browsing of the content of the current interface. In the present invention, hiding the floating icon does not mean that the floating icon is not displayed at all.

[0126] Optionally, in an implementation manner, the data processing method of any embodiment of the present invention further includes: detecting a moving trajectory of the operation position, and controlling the floating icon to display dynamic special effects according to the moving trajectory.

[0127] Reference Fig.6D As shown, Fig.6D A schematic diagram of a dynamic special effect of a floating icon provided in the fourth embodiment of the present invention. Fig.6D In the floating icon, a solid dot is included. The solid dot points to the user's operation position in the floating icon. When the user's operation position changes, the solid dot changes with the user's operation position in the floating icon. Dynamic effects can improve the user experience during use. Of course, Fig.6D This is only an exemplary description and does not mean that the present invention is limited thereto.

[0128] Optionally, in an implementation manner, the data processing method of any embodiment of the present invention further includes: when a second switching operation on the floating icon is detected, hiding the floating icon and switching to displaying a preset display window.

[0129] The second switching operation may be an operation in which the user selects any one of the functions, that is, when the user selects any one of the functions, the floating icon is switched to a preset display control.

[0130] Embodiment 5

[0131] In combination with the methods described in the above-mentioned embodiments 1 to 4, the fifth embodiment of the present invention provides a data processing device for executing the methods described in the above-mentioned embodiments 1 to 4, referring to Figure 7 As shown, the data processing device 70 includes:

[0132] The acquisition module 701 is used to trigger the operation control corresponding to the target information and acquire the target information displayed on the current interface;

[0133] A processing module 702 is used to perform a target operation according to the target information;

[0134] The display module 703 is used to display the target operation result in the current interface.

[0135] Optionally, in one implementation, the acquisition module 701 is used to trigger the operation control corresponding to the target information and display at least one option included in the operation control; receive a trigger operation on a target option that matches the target information in at least one option, and acquire the target information that matches the target option based on the content displayed on the current interface.

[0136] Optionally, in one implementation, the operation control includes a preset display window, and the display module 703 is used to determine that a target operation result corresponding to the target operation is obtained, trigger the display of the preset display window; and display the target operation result in the preset display window.

[0137] Optionally, in one implementation, the preset display window includes at least one tab page, and the display module 703 is used to display the target operation result on the tab page corresponding to the target operation in the preset display window.

[0138] Optionally, in one implementation, the display module 703 is used to receive a size adjustment operation and / or a position adjustment operation on a preset display window; display the preset display window on the current interface according to the adjusted size and / or position, and display the target operation result in the adjusted preset display window.

[0139] Optionally, in one implementation, the display module 703 is used to receive a switching operation on a preset display window, reduce the preset display window to a floating icon, and display the floating icon at the edge of the current interface.

[0140] Optionally, in one implementation, the processing module 702 is configured to perform price comparison on the target item indicated in the target information to obtain a price comparison result of the target item, and the target operation result includes the price comparison result.

[0141] Optionally, in one implementation, the price comparison result includes at least one purchase link of the target item, and the display module 702 is used to display a page corresponding to the purchase link according to a triggering operation on the purchase link.

[0142] Optionally, in one implementation, the processing module 702 is used to obtain comment information, and add comments to the target information according to the comment information to obtain comment results, and the target operation result includes the comment results.

[0143] Optionally, in one implementation, the processing module 702 is used to search for target information to obtain search results corresponding to the target information, and the target operation result includes the search results.

[0144] Optionally, in one implementation, the processing module 702 is used to translate the target information to obtain a translation result corresponding to the target information, and the target operation result includes the translation result.

[0145] Optionally, in one implementation, the processing module 702 is used to convert the target information into an editable record result, and the target operation result includes the editable record result; the display module 703 is used to display the editable record result in the current interface and display at least one editing tool option.

[0146] Optionally, in one implementation, the display module 703 is used to trigger the operation control corresponding to the target information to display the capture frame; the acquisition module 701 is used to receive the adjustment operation of the capture frame; and the content displayed on the current interface is collected according to the adjusted capture frame to obtain the collected data;

[0147] Perform artificial intelligence recognition on the collected data and obtain target information based on the recognition results.

[0148] Optionally, in one implementation, the acquisition module 701 is used to receive a size adjustment operation and / or a position adjustment operation on the capture frame, and perform image capture on a content area corresponding to the capture frame in the current interface to obtain collected data.

[0149] Optionally, in one implementation, the acquisition module 701 is used to receive a length adjustment operation and / or a position adjustment operation on the capture frame, and perform audio capture on a content area corresponding to the capture frame in the current interface to obtain collected data.

[0150] Optionally, in one implementation, the acquisition module 701 is used to perform content area detection on the content displayed on the current interface, and display a screenshot frame in the content area in the current interface; according to a size adjustment operation and / or a position adjustment operation of the screenshot frame, the adjusted screenshot frame is used to capture an image of the detected content area to obtain collected data.

[0151] Optionally, in one implementation, the acquisition module 701 is used to trigger an operation control corresponding to the target information, and capture a video frame in the video displayed on the current interface according to the triggering time to obtain collected data.

[0152] Optionally, in one implementation, the collected data includes collected image data, and the target information includes text obtained after performing text recognition on the image data, or target elements obtained after performing target element recognition on the image data.

[0153] Optionally, in one implementation, the collected data includes collected audio data, and the target information includes audio key information obtained after extracting key information from the audio data, or text key information obtained after converting the audio data into text and extracting key information from the text.

[0154] Optionally, in one implementation, the processing module 702 is used to call a target application to which the operation control belongs to perform a target operation on the target information to obtain a target operation result.

[0155] The data processing device provided by the embodiment of the present invention triggers the operation control corresponding to the target information, obtains the target information displayed on the current interface; performs the target operation according to the target information; and displays the target operation result on the current interface. Through the embodiment of the present invention, the device can obtain the target information displayed on the current interface to perform the target operation, and the way of obtaining information is more flexible, and more functions can be realized.

[0156] Embodiment 6

[0157] In combination with the methods described in the above embodiments 1 to 4, the sixth embodiment of the present invention provides an electronic device for executing the methods described in the above embodiments 1 to 4, referring to Figure 8 As shown, Figure 8 This is a structural block diagram of an electronic device provided in Embodiment 6 of the present invention.

[0158] like Figure 8As shown, the electronic device 80 may include: a processor (processor) 802 , a communication interface (Communications Interface) 804 , a memory (memory) 806 , and a communication bus 808 .

[0159] in:

[0160] The processor 802 , the communication interface 804 , and the memory 806 communicate with each other via a communication bus 808 .

[0161] The communication interface 804 is used to communicate with other electronic devices such as terminal devices or servers.

[0162] The processor 802 is used to execute the program 810, and specifically can execute the relevant steps in the above data processing method embodiment.

[0163] Specifically, the program 810 may include program codes, which include computer operation instructions.

[0164] The processor 802 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention. The one or more processors included in the electronic device may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.

[0165] The memory 806 is used to store the program 810. The memory 806 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0166] The program 810 may be specifically used to enable the processor 802 to execute the methods described in the aforementioned first to fourth embodiments.

[0167] The specific implementation of each step in program 810 can refer to the corresponding description of the corresponding steps and units in the above data processing method embodiment, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above method embodiment, which will not be repeated here.

[0168] The electronic device provided by the embodiment of the present invention triggers the operation control corresponding to the target information, obtains the target information displayed on the current interface; performs the target operation according to the target information; and displays the target operation result on the current interface. Through the embodiment of the present invention, the device can obtain the target information displayed on the current interface to perform the target operation, and the way of obtaining information is more flexible, and more functions can be realized.

[0169] Embodiment 7

[0170] In combination with the methods described in the above-mentioned embodiments 1 to 4, embodiment 7 of the present invention provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the method described in any embodiment of the present invention is implemented.

[0171] The computer storage medium provided by the embodiment of the present invention triggers the operation control corresponding to the target information when the stored computer program is executed, obtains the target information displayed on the current interface; performs the target operation according to the target information; and displays the target operation result on the current interface. Through the embodiment of the present invention, the device can obtain the target information displayed on the current interface to perform the target operation, and the way of obtaining information is more flexible, and more functions can be realized.

[0172] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present invention can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present invention.

[0173] The above-described method according to an embodiment of the present invention may be implemented in hardware, firmware, or as software or computer code that may be stored in a recording medium (such as a CD ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code that is originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded over a network and will be stored in a local recording medium, so that the method described herein may be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an ASIC or FPGA). It is understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code, and when the software or computer code is accessed and executed by a computer, a processor, or hardware, the data processing method described herein is implemented. In addition, when a general-purpose computer accesses the code for implementing the data processing method shown herein, the execution of the code converts the general-purpose computer into a dedicated computer for executing the data processing method shown herein.

[0174] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present invention.

[0175] The above implementation methods are only used to illustrate the embodiments of the present invention, and are not limitations of the embodiments of the present invention. Ordinary technicians in the relevant technical field may make various changes and modifications without departing from the spirit and scope of the embodiments of the present invention. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present invention. The patent protection scope of the embodiments of the present invention should be defined by the claims.

Claims

1. A data processing method, comprising: Triggering the operation control corresponding to the target information to obtain the target information displayed on the current interface, wherein triggering the operation control corresponding to the target information to obtain the target information displayed on the current interface includes: triggering the operation control corresponding to the target information to collect the content displayed on the current interface to obtain collected data, calling the program of the target application to perform artificial intelligence recognition on the collected data to obtain a recognition result, and obtaining the target information according to the recognition result; Executing a target operation according to the target information, wherein executing the target operation according to the target information comprises: calling a target application to which the operation control belongs to execute the target operation on the target information; In the current interface, the target operation result is displayed.

2. The method according to claim 1, wherein: The trigger target information corresponding to the operation control obtains the target information displayed on the current interface, including: triggering an operation control corresponding to the target information, and displaying at least one option included in the operation control; A trigger operation for a target option that matches the target information in the at least one option is received, and the target information that matches the target option is acquired based on content displayed on a current interface.

3. The method according to claim 1 or 2, wherein: The operation control includes a preset display window, and the target operation result is displayed in the current interface, including: Determine that the target operation result corresponding to the target operation is obtained, and trigger the display of the preset display window; The target operation result is displayed in the preset display window.

4. The method according to claim 3, wherein: The preset display window includes at least one tab page, and displaying the target operation result in the preset display window includes: The target operation result is displayed in the preset display window on a tab page corresponding to the target operation.

5. The method according to claim 3, wherein: The method further comprises: Receiving a size adjustment operation and / or a position adjustment operation on the preset display window; The preset display window is displayed on the current interface according to the adjusted size and / or position, and the display of the target operation result is updated in the adjusted preset display window.

6. The method according to claim 3, wherein: The operation control includes a floating icon, and the method further includes: A switching operation on the preset display window is received, and the preset display window is reduced to the floating icon; and the floating icon is displayed at the edge of the current interface.

7. The method according to claim 1, wherein: The performing a target operation according to the target information includes: A price comparison is performed on the target item indicated in the target information to obtain a price comparison result of the target item, and the target operation result includes the price comparison result.

8. The method according to claim 7, wherein: The price comparison result includes at least one purchase link of the target item; the method further includes: According to the triggering operation on the purchase link, a page corresponding to the purchase link is displayed.

9. The method according to claim 1, wherein: The performing a target operation according to the target information includes: Acquire comment information, and add comments to the target information according to the comment information to obtain comment results, wherein the target operation result includes the comment results.

10. The method according to claim 1, wherein: The performing a target operation according to the target information includes: The target information is searched to obtain search results corresponding to the target information, and the target operation result includes the search results.

11. The method according to claim 1, wherein: The performing a target operation according to the target information includes: Converting the target information into an editable record result, wherein the target operation result includes the editable record result; On the current interface, the target operation results are displayed, including: The editable recording result is displayed on the current interface, and at least one editing tool option is displayed.

12. The method according to any one of claims 7 to 11, wherein: The trigger target information corresponding to the operation control obtains the target information displayed on the current interface, including: Triggering the operation control corresponding to the target information to display a capture frame; receiving an adjustment operation on the capture frame, and collecting content displayed on the current interface according to the adjusted capture frame to obtain collected data; Perform artificial intelligence recognition on the collected data, and obtain the target information based on the recognition result.

13. The method according to claim 12, wherein: The receiving an adjustment operation on the capture frame, and collecting content displayed on the current interface according to the adjusted capture frame to obtain collected data, includes: A size adjustment operation and / or a position adjustment operation of the capture frame is received, and an image capture is performed on a content area corresponding to the capture frame in the current interface to obtain the collected data.

14. The method according to claim 12, wherein: The receiving an adjustment operation on the capture frame, and collecting content displayed on the current interface according to the adjusted capture frame to obtain collected data, includes: A length adjustment operation and / or a position adjustment operation of the interception frame is received, and audio is intercepted from a content area corresponding to the interception frame in the current interface to obtain the collected data.

15. The method according to claim 12, wherein: The trigger target information corresponding to the operation control obtains the target information displayed on the current interface, including: The operation control corresponding to the target information is triggered, and video frames are captured in the video displayed on the current interface according to the triggering time to obtain the collected data.

16. The method according to claim 12, wherein: The collected data includes collected image data, and the target information includes text obtained after performing text recognition on the image data, or target elements obtained after performing target element recognition on the image data.

17. The method according to claim 12, wherein: The collected data includes collected audio data, and the target information includes audio key information obtained after extracting key information from the audio data, or text key information obtained after converting the audio data into text and extracting key information from the text.

18. A data processing device, comprising: An acquisition module, used to trigger an operation control corresponding to target information, and acquire the target information displayed on the current interface. The triggering of the operation control corresponding to the target information, and acquiring the target information displayed on the current interface, includes: triggering the operation control corresponding to the target information, collecting the content displayed on the current interface to obtain collected data, calling a target application program to perform artificial intelligence recognition on the collected data to obtain a recognition result, and acquiring the target information according to the recognition result; A processing module, configured to perform a target operation according to the target information, wherein the performing of the target operation according to the target information comprises: calling a target application to which the operation control belongs to perform the target operation on the target information; The display module is used to display the target operation result in the current interface.

19. An electronic device comprising: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the data processing method according to any one of claims 1 to 17.

20. A computer storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the data processing method according to any one of claims 1 to 17 is implemented.

Images