Interaction method and interaction device of application program

Abstract

The invention provides an interaction method and an interaction device of an application program. The interaction method is applied to a target application program. When the target application program runs in the background, displaying the target application program on an interactive interface of a first application program running in the foreground in the terminal in the form of a suspension control; the interaction method comprises the following steps: in response to a trigger operation for a suspension control, switching the suspension control into an activated state; receiving a target application service request through the suspended control in the activated state; obtaining to-be-processed information in the terminal in response to the target application service request; and processing the to-be-processed information according to the target application service request. Thus, in other application program pages, a user can also conveniently use the service of the target application program, and the purposes of expanding the information acquisition mode of the target application program and reducing the application switching cost are achieved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an application program interaction method and an application program interaction device. Background Art

[0002] In practice, users have the need to conveniently use a certain application in different application scenarios. Taking AI assistants as an example, most existing AI assistants exist as independent applications (APPs) or browser plug-ins (robot assistants). The prototypes of AI assistants on some AI devices are generally bound to specific computer / mobile phone brands (such as Siri, etc.).

[0003] On the one hand, this will lead to obvious switching costs when using AI assistants across applications. For example, a piece of text copied on APP A needs to be sent to another APP page to get AI help; or, the content of a page screenshot needs to be switched to another APP page for recognition to get AI help. On the other hand, there is also the problem of context recognition barriers. AI assistants can only receive information sent by users. For example, in a chat record, the user only sends a certain section of the record. At this time, due to the limited information obtained, it is difficult for AI assistants to make responses that fit the specific context. Summary of the invention

[0004] In view of this, the purpose of the present application is to provide an application interaction method and an interaction device, which, when the target application is running in the background, is displayed in the form of a floating control on the interaction interface of the first application running in the foreground of the terminal. The user can activate the floating control on the interaction interface so that the target application receives the target application service request and automatically obtains the information to be processed in the terminal, so as to expand the information acquisition method of the target application. After that, the target application processes the information and provides application services to the user. In this way, the user can also conveniently use the services of the target application on other application pages, thereby achieving the purpose of reducing the cost of application switching.

[0005] The embodiment of the present application provides an application interaction method, which is applied to a target application; when the target application is running in the background, it is displayed in the form of a floating control on the interaction interface of a first application running in the foreground of a terminal; the interaction method includes:

[0006] In response to a trigger operation on the floating control, switching the floating control to an activated state;

[0007] Receiving a target application service request through the floating control in an activated state;

[0008] In response to the target application service request, obtaining the to-be-processed information in the terminal;

[0009] The to-be-processed information is processed according to the target application service request.

[0010] Furthermore, the information to be processed includes at least one of the following: request information included in the target application service request, page information presented in the interactive interface, application information in the second application, and real physical world information collected through the terminal.

[0011] Further, when the information to be processed includes page information presented in the interactive interface, the obtaining the information to be processed in the terminal in response to the target application service request includes:

[0012] In response to the target application service request, the page information presented in the interactive interface is obtained through an accessible interface; or, a page recording program or a page monitoring program is called to obtain the page information presented in the interactive interface.

[0013] Further, when the information to be processed includes application information in the second application, the target application service request includes an application identifier of the second application and an information identifier of the application information in the second application;

[0014] The step of obtaining the information to be processed in the terminal in response to the target application service request includes:

[0015] In response to the target application service request, determining the second application program according to the application identifier;

[0016] The application information is requested from the second application through a program interface according to the information identifier to obtain the application information fed back by the second application.

[0017] Further, when the information to be processed includes real physical world information collected by the terminal, the obtaining of the information to be processed in the terminal in response to the target application service request includes:

[0018] In response to the target application service request, the target information type is determined, and a corresponding acquisition program is called to control the hardware device in the terminal to acquire the real physical world information.

[0019] Further, according to the target application service request, the to-be-processed information is processed, including:

[0020] Determining the information modality included in the information to be processed;

[0021] If the information modality includes pictures, extracting picture information from the information to be processed by a picture recognition module;

[0022] If the information modality includes a web page link, obtaining web page information through the web page link in the information to be processed;

[0023] If the information modality includes text, extracting the text information in the information to be processed;

[0024] If the information modality includes speech, converting the speech in the information to be processed into text information by a speech-to-text conversion module;

[0025] splicing the image information and / or the web page information and / or the text information to obtain splicing information;

[0026] The splicing information is processed according to the target application service request.

[0027] Further, the processing of the to-be-processed information according to the target application service request includes:

[0028] Generate output information according to the target application service request and the application information in the second application;

[0029] The output information is displayed through the floating control; or the output information is sent to the second application so that the output information is output through the program function of the second application.

[0030] Further, in response to a triggering operation on the floating control, switching the floating control to an activated state includes:

[0031] When a click operation on the floating control is detected on the page, the floating control is switched to an activated state;

[0032] Alternatively, when a preset activation word is recognized from the received voice instruction, the floating control is switched to an activated state;

[0033] Alternatively, when a preset operation is detected in the page, a prompt window is displayed; in response to the user's confirmation operation on the prompt window, the floating control is switched to an activated state.

[0034] The embodiment of the present application further provides an application interaction device, which is applied to a target application; when the target application is running in the background, it is displayed in the form of a floating control on the interaction interface of a first application running in the foreground of the terminal; the interaction device includes:

[0035] A switching module, configured to switch the floating control to an activated state in response to a triggering operation on the floating control;

[0036] A receiving module, configured to receive a target application service request through the floating control in an activated state;

[0037] An acquisition module, configured to acquire the information to be processed in the terminal in response to the target application service request;

[0038] A processing module is used to process the information to be processed according to the target application service request.

[0039] An embodiment of the present application also provides an electronic device, including: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the steps of the interaction method of the application as described above are performed.

[0040] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the application program interaction method as described above are executed.

[0041] The embodiment of the present application provides an application interaction method and an interaction device, which, when the target application is running in the background, is displayed in the form of a floating control on the interaction interface of the first application running in the foreground of the terminal. The user can activate the floating control on the interaction interface so that the target application receives the target application service request and automatically obtains the information to be processed in the terminal, so as to expand the information acquisition method of the target application. The target application then processes the information and provides application services to the user. In this way, the user can also conveniently use the services of the target application on other application pages, thereby reducing the cost of application switching.

[0042] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0044] Figure 1 A flowchart of an application interaction method provided in an embodiment of the present application is shown;

[0045] Figure 2A schematic diagram showing the structure of an interactive device for an application program provided in an embodiment of the present application is shown;

[0046] Figure 3 A schematic structural diagram of an electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0047] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, each other embodiment obtained by those skilled in the art without making creative work belongs to the scope of protection of the present application.

[0048] Research has found that in practice, users have the need to conveniently use a certain application in different application scenarios. Taking AI assistants as an example, most existing AI assistants exist as independent applications (APPs) or browser plug-ins (robot assistants). The prototypes of AI assistants on some AI devices are generally bound to specific computer / mobile phone brands (such as Siri, etc.).

[0049] On the one hand, this will lead to obvious switching costs when using AI assistants across applications. For example, a piece of text copied on APP A needs to be sent to another APP page to get AI help; or, the content of a page screenshot needs to be switched to another APP page for recognition to get AI help. On the other hand, there is also the problem of context recognition barriers. AI assistants can only receive information sent by users. For example, in a chat record, the user only sends a certain section of the record. At this time, due to the limited information obtained, it is difficult for AI assistants to make responses that fit the specific context.

[0050] Based on this, an embodiment of the present application provides an application interaction method. Under other application pages, users can also conveniently use the services of the target application, thereby expanding the information acquisition method of the target application and reducing the cost of application switching.

[0051] The interaction method provided in the embodiment of the present application is applied to a target application installed in a terminal device, wherein the terminal device may be a local electronic device that has downloaded and can run the target application, such as a smart phone, a personal computer, a tablet computer, etc.

[0052] When the target application is running in the background, the target application is displayed in the form of a floating control on the interactive interface of the first application running in the foreground of the terminal. Among them, the program running in the foreground refers to the program that is currently interacting directly with the user. The user can interact with the program through input devices such as keyboard, mouse, touch screen, microphone, camera, etc., and the output of the program will also be displayed directly on the screen. The program running in the background refers to the program that continues to execute without directly interacting with the user. This means that these programs are still running, but are not displayed at the forefront of the screen. The first application refers to other applications other than the target application, which may include system applications, such as the system desktop, etc., and may also include installed third-party applications, such as music, shopping applications, etc.

[0053] In the embodiment of the present application, the target application running in the background is displayed on the interactive interface of the first application in the form of a floating control. The floating control is a user interface interactive element that can be flexibly moved and resized, such as a "floating ball". Through this floating control, the user can directly interact with the target application on the interactive interface of the first application, including sending information to the target application and receiving feedback information from the target application.

[0054] The following takes the target application as an AI application (AI assistant) as an example to introduce in detail the various implementation steps of this application.

[0055] It should be noted that in order for the target application to be displayed as a floating control, user authorization must be obtained in advance. In one possible implementation, based on the installed AI application, the user's authorization to open the floating ball (window) application permission is obtained, so that the AI ​​application floating ball (window) is always suspended on the page.

[0056] When or after turning on the floating ball (window), screen recording and / or monitoring permissions can be enabled at the same time based on user authorization, so as to obtain a more comprehensive and intelligent AI service experience in real time through the AI ​​application floating ball (window).

[0057] See also Figure 1 , Figure 1 This is a flow chart of an application interaction method provided in an embodiment of the present application. Figure 1 As shown in , the interaction method provided by the embodiment of the present application includes:

[0058] S101. In response to a triggering operation on the floating control, switching the floating control to an activated state.

[0059] It should be noted that the state of the floating control may include an activated state, a waiting-for-activation state, etc. (eg, a semi-transparent state and a retracted state).

[0060] In a possible implementation, the display effect of the floating control may be different in different states. For example, in the retracted state, a portion of the floating ball (window) may be hidden outside the screen, leaving only a portion exposed, so as not to affect the user's use of other first applications as much as possible; in the translucent state, the transparency of the floating ball (window) may be set to translucent, which may also not affect the user's use of other first applications as much as possible. Furthermore, the floating control may also be set not to be displayed on the interface of certain applications.

[0061] After detecting a trigger operation on the floating control, the floating control can be switched to an activated state; in the activated state, the floating control can open an interactive window floating on the display interactive interface, and the target application interacts with the user through this interactive window, such as receiving or outputting text, voice or video information.

[0062] In another possible implementation, the display effect of the floating control in different states may be the same. In this case, the different states of the floating control determine the different functions that can be executed; in the activated state, information interaction with the user can be carried out, but the display effect in the interactive interface remains unchanged, for example, the interactive window is not opened, but interaction is carried out through voice.

[0063] In a possible implementation, step S101 may include:

[0064] Method 1: When a click operation on the floating control is detected on the page, the floating control is switched to an activated state.

[0065] In this mode, the user can click on the floating control displayed on the interactive interface; at this time, the target application listens to the click operation on the floating control in the page, that is, it listens to the trigger operation on the floating control, and in response to this trigger operation, switches the floating control to an activated state.

[0066] Alternatively, method 2: when a preset activation word is recognized from the received voice instruction, the floating control is switched to an activated state.

[0067] In this mode, an activation word library is preset in the target application, and the target application can monitor voice information in real time based on prior user authorization; when a preset activation word is recognized from the voice instruction indicated by the voice information, it is determined that a trigger operation for the floating control is generated, and in response to this trigger operation, the floating control is switched to an activated state.

[0068] Alternatively, in a third method, when a preset operation is detected on the page, a prompt window is displayed; in response to a user's confirmation operation on the prompt window, the floating control is switched to an activated state.

[0069] In this mode, a specific operation is preset in the target application. When the preset operation is detected in the page, a prompt window is displayed; after determining that the user has performed a confirmation operation on the prompt window, it is determined that a trigger operation has been generated for the floating control, and in response to this trigger operation, the floating control is switched to an activated state. Exemplarily, the preset specific operation can be a screenshot operation; when the user's screenshot operation is detected, a corresponding prompt window pops up, and the prompt window prompts the target application to perform image recognition processing on the screenshot; if the user confirms to perform image recognition processing on the screenshot, the floating control can be switched to an activated state. In this way, through the active prompts of the prompt window and the user's confirmation operation, it is possible to guide users to use program functions and prevent accidental touches.

[0070] In this way, the embodiments of the present application provide a variety of activation methods for floating controls, so that users can freely activate floating controls and use subsequent functions in a variety of application scenarios according to their needs, which can improve user convenience.

[0071] S102: Receive a target application service request through the floating control in an activated state.

[0072] Among them, through the interactive function of the floating control in the activated state, the user can send a target application service request to the floating control in the activated state; the target application service request can indicate relevant information of the required application service.

[0073] S103: In response to the target application service request, obtain information to be processed in the terminal.

[0074] Here, the information to be processed includes at least one of the following: request information included in the target application service request, page information presented in the interactive interface, application information in the second application, and real physical world information collected through the terminal.

[0075] In this step, the target application can determine which one or several of the above-mentioned items of information to be processed are required by parsing the target application service request. For example, by parsing the target application service request, it can be directly determined whether the information to be processed includes the request information itself, page information, application information, or real physical world information through the information keywords in the request. For another example, the target application service request is parsed to determine the service scenario, and the information to be processed is determined according to the type of information required under the preset service scenario. In one example, the target application service request is an empathy request in a drama-watching scenario (watch a drama with me), or a compliment request in a game scenario (play a game with me). At this time, the information to be processed should at least include the page information presented in the interactive interface (i.e., the episode video information or the game screen information).

[0076] In a first possible implementation, when the information to be processed includes request information included in the target application service request, step S103 may include: parsing the target application service request, and determining the parsed request information as the information to be processed.

[0077] In this way, the target application service request carries the relevant information of the required application service (i.e., request information). For example, a user sends a text or a picture to the AI ​​assistant through a floating control, requesting the AI ​​assistant to reply to the text or output a caption that matches the picture.

[0078] In a second possible implementation, when the information to be processed includes page information presented in the interactive interface, step S103 may include:

[0079] In response to the target application service request, the page information presented in the interactive interface is obtained through an accessible interface; or, a page recording program or a page monitoring program is called to obtain the page information presented in the interactive interface.

[0080] Among them, barrier-free interface refers to a set of functions and tools designed in software, applications or operating systems to help people with disabilities use computers and mobile devices more conveniently, such as screen readers. Page recording programs or page monitoring programs can record page information in interactive interfaces.

[0081] In this step, the page information presented in the current interactive interface can be easily obtained through an accessible interface, or by calling a page recording program or a page monitoring program; compared with the user's manual copying method, the target application automatically obtains page context information in a wider range, in a more convenient and efficient manner, and can solve the problem of context recognition obstacles existing in the prior art.

[0082] In a third possible implementation, when the information to be processed includes application information in the second application, the target application service request includes an application identifier of the second application and an access address of the application information in the second application.

[0083] Accordingly, step S103 may include:

[0084] In response to the target application service request, the second application is determined according to the application identifier; and the application information is requested from the second application through a program interface according to the information identifier to obtain the application information fed back by the second application.

[0085] Here, the second application refers to the first application corresponding to the current interactive interface and other applications other than the target application. In this step, the target application can determine the second application from multiple applications installed in the terminal according to the application identifier, and then request application information from the program interface exposed to the second application based on the information identifier, and obtain the application information fed back by the second application through this program interface. The information identifier can be an information code or an information address, etc.

[0086] In one example, when a user is watching a video through a video software, the notification bar shows that the contact Xiao A has sent a chat message through the chat software. Therefore, the video software is the first application, and the chat software a is the second application. At this time, the user can activate the floating ball displayed in the interactive interface of the video software, and send a target application service request "Help me reply to Xiao A's message in chat software a". Therefore, the application identifier is "chat software a" and the information identifier is "message sent by Xiao A". By parsing this target application service request, the AI ​​assistant can request the chat history between Xiao A and the user from chat software a.

[0087] In a fourth possible implementation, when the information to be processed includes real physical world information collected by the terminal, step S103 may include:

[0088] In response to the target application service request, the target information type is determined, and a corresponding acquisition program is called to control the hardware device in the terminal to acquire the real physical world information.

[0089] In this way, users can also collect real physical world information through target application service requests; the target information type can include audio or video, such as collecting user audio by calling a microphone or collecting user video by calling a camera, that is, users can make voice calls or video calls with the AI ​​assistant through a floating window.

[0090] S104: Process the information to be processed according to the target application service request.

[0091] Here, the relevant information of the required application service carried in the target application service request can indicate the user's processing intention for the information to be processed. For example, requesting the AI ​​assistant to reply to a text or output a text that matches the picture. The target application can determine the processing intention by parsing the target application service request, and then process the information to be processed according to the processing intention, thereby realizing the ability to provide AI services to users.

[0092] In a possible implementation, step S104 may include:

[0093] First, determine the information modality included in the information to be processed. Information modality generally refers to the way in which information is presented. It should be understood that the information to be processed may include one or more information modalities, such as text, pictures, voice, etc.

[0094] If the information modality includes a picture, the picture information in the information to be processed is extracted by an image recognition module. Here, the picture information can be extracted from the picture by using image processing related techniques through the image recognition module in the target application.

[0095] If the information modality includes a web page link, the web page information is obtained through the web page link in the information to be processed; here, the corresponding web page can be accessed through the Url web page link and the web page information can be obtained.

[0096] If the information modality includes text, the text information in the information to be processed is extracted. Here, the text information can be extracted by using a text processing module in the target application using a natural language processing related technology.

[0097] If the information modality includes speech, the speech in the information to be processed is converted into text information through a speech-to-text conversion module; here, the speech can be converted into text information by using speech recognition technology through the speech-to-text conversion module in the target application.

[0098] Afterwards, the image information and / or the webpage information and / or the text information are spliced ​​to obtain spliced ​​information, and the spliced ​​information is processed according to the target application service request. That is, the spliced ​​information is processed using the function of the target application according to the processing intention of the user; for example, the large language model in the target application can be called to process the spliced ​​information to obtain the reply information.

[0099] The processed results can be fed back to the user through the floating control. For example, when a paragraph is generated, the user can copy the feedback result through the floating control, and then manually modify and paste it.

[0100] Further, corresponding to the above embodiment, when the information to be processed includes application information in the second application, S104 may include:

[0101] Output information is generated according to the target application service request and the application information in the second application; and the output information is displayed through the floating control.

[0102] Here, the output information is displayed to the user through a floating control, and the user can perform subsequent manual operations. For example, the user can copy the output information, then manually open the chat software, and paste the output information to send.

[0103] Alternatively, the output information is sent to the second application so that the output information is output through a program function of the second application.

[0104] Here, the target application can directly send the output information to the second application, and directly control the program function of the second application to automatically output the output information according to the user's processing intention. Corresponding to the above example, the AI ​​assistant generates the user's reply information to Xiao A, and then the reply information can be directly sent to Xiao A through the chat software a.

[0105] In this way, the user does not need to manually switch between the first application and the second application (video software and chat software), and can automatically operate the second application with the help of the function of the target application displayed in the form of a floating control.

[0106] The various activation methods and various methods for obtaining information to be processed provided by the embodiments of the present application greatly expand the application scenarios of the interaction method. For example, the following can be achieved through the floating control:

[0107] 1. Help users write: For example, when there is input content, rewrite it in different styles and appropriately expand the user input; when there is no input content, obtain the conversation context as information to be processed and help users draft a reply.

[0108] 2. Help users summarize and analyze: for example, summarize article content; analyze financial reports; create mind maps.

[0109] 3. Help users find: for example, provide original film information based on video screenshots; find the same low-priced products based on product screenshots.

[0110] 4. Help users process images: for example, provide corresponding answers to identified questions; automatically retouch and edit taken pictures and videos.

[0111] 5. Empathize with users: For example, watch videos with users and give comments; play games with users and praise their performance.

[0112] An embodiment of the present application provides an application interaction method, which is applied to a target application; when the target application is running in the background, it is displayed in the form of a floating control on the interaction interface of a first application running in the foreground of a terminal; the interaction method includes: in response to a trigger operation on the floating control, switching the floating control to an activated state; receiving a target application service request through the floating control in the activated state; in response to the target application service request, obtaining to-be-processed information in the terminal; and processing the to-be-processed information according to the target application service request.

[0113] In this way, when the target application is running in the background, it is displayed in the form of a floating control on the interactive interface of the first application running in the foreground of the terminal. The user can activate the floating control on the interactive interface, so that the target application receives the target application service request and automatically obtains the information to be processed in the terminal, so as to expand the information acquisition method of the target application. After that, the target application processes the information and provides application services to the user. In this way, the user can also conveniently use the services of the target application on other application pages, thereby reducing the cost of application switching.

[0114] See also Figure 2 , Figure 2 A schematic diagram of the structure of an interactive device for an application provided in an embodiment of the present application. The interactive device is applied to a target application; when the target application is running in the background, it is displayed in the form of a floating control on the interactive interface of the first application running in the foreground of the terminal; Figure 2 As shown in , the interaction device 200 includes:

[0115] A switching module 210, configured to switch the floating control to an activated state in response to a triggering operation on the floating control;

[0116] The receiving module 220 is used to receive a target application service request through the floating control in an activated state;

[0117] The acquisition module 230 is used to obtain the information to be processed in the terminal in response to the target application service request;

[0118] The processing module 240 is used to process the information to be processed according to the target application service request.

[0119] Furthermore, the information to be processed includes at least one of the following: request information included in the target application service request, page information presented in the interactive interface, application information in the second application, and real physical world information collected through the terminal.

[0120] Further, when the information to be processed includes page information presented in the interactive interface, when the acquisition module 230 is used to respond to the target application service request and acquire the information to be processed in the terminal, the acquisition module 230 is used to:

[0121] In response to the target application service request, the page information presented in the interactive interface is obtained through an accessible interface; or, a page recording program or a page monitoring program is called to obtain the page information presented in the interactive interface.

[0122] Further, when the information to be processed includes application information in the second application, the target application service request includes an application identifier of the second application and an information identifier of the application information in the second application;

[0123] When the acquisition module 230 is used to respond to the target application service request and acquire the information to be processed in the terminal, the acquisition module 230 is used to:

[0124] In response to the target application service request, determining the second application program according to the application identifier;

[0125] The application information is requested from the second application through a program interface according to the information identifier to obtain the application information fed back by the second application.

[0126] Further, when the information to be processed includes real physical world information collected by the terminal, when the acquisition module 230 is used to respond to the target application service request and acquire the information to be processed in the terminal, the acquisition module 230 is used to:

[0127] In response to the target application service request, the target information type is determined, and a corresponding acquisition program is called to control the hardware device in the terminal to acquire the real physical world information.

[0128] Further, when the processing module 240 is used to process the information to be processed according to the target application service request, the processing module 240 is used to:

[0129] Determining the information modality included in the information to be processed;

[0130] If the information modality includes pictures, extracting picture information from the information to be processed by a picture recognition module;

[0131] If the information modality includes a web page link, obtaining web page information through the web page link in the information to be processed;

[0132] If the information modality includes text, extracting the text information in the information to be processed;

[0133] If the information modality includes speech, converting the speech in the information to be processed into text information by a speech-to-text conversion module;

[0134] splicing the image information and / or the web page information and / or the text information to obtain splicing information;

[0135] The splicing information is processed according to the target application service request.

[0136] Further, when the processing module 240 is used to process the information to be processed according to the target application service request, the processing module 240 is used to:

[0137] Generate output information according to the target application service request and the application information in the second application;

[0138] The output information is displayed through the floating control; or the output information is sent to the second application so that the output information is output through the program function of the second application.

[0139] Further, when the switching module 210 is used to switch the floating control to an activated state in response to a triggering operation on the floating control, the switching module 210 is used to:

[0140] When a click operation on the floating control is detected on the page, the floating control is switched to an activated state;

[0141] Alternatively, when a preset activation word is recognized from the received voice instruction, the floating control is switched to an activated state;

[0142] Alternatively, when a preset operation is detected in the page, a prompt window is displayed; in response to the user's confirmation operation on the prompt window, the floating control is switched to an activated state.

[0143] In this way, when the target application is running in the background, it is displayed in the form of a floating control on the interactive interface of the first application running in the foreground of the terminal. The user can activate the floating control on the interactive interface, so that the target application receives the target application service request and automatically obtains the information to be processed in the terminal, so as to expand the information acquisition method of the target application. After that, the target application processes the information and provides application services to the user. In this way, the user can also conveniently use the services of the target application on other application pages, thereby reducing the cost of application switching.

[0144] See also Figure 3 , Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 3 As shown in , the electronic device 300 includes a processor 310 , a memory 320 and a bus 330 .

[0145] The memory 320 stores machine-readable instructions executable by the processor 310. When the electronic device 300 is running, the processor 310 communicates with the memory 320 via the bus 330. When the machine-readable instructions are executed by the processor 310, the above-mentioned Figure 1The steps of the application interaction method in the method embodiment shown, the specific implementation method can be found in the method embodiment, and will not be repeated here.

[0146] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program can execute the above-mentioned Figure 1 The steps of the application interaction method in the method embodiment shown, the specific implementation method can be found in the method embodiment, and will not be repeated here.

[0147] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0148] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0149] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0150] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0151] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application can essentially be embodied in the form of a software product, or in other words, the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0152] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. An application interaction method, characterized in that: The interactive method is applied to a target application; when the target application is running in the background, it is displayed in the form of a floating control on the interactive interface of the first application running in the foreground of the terminal; the interactive method includes: In response to a trigger operation on the floating control, switching the floating control to an activated state; Receiving a target application service request through the floating control in an activated state; In response to the target application service request, obtaining the to-be-processed information in the terminal; The to-be-processed information is processed according to the target application service request.

2. The interactive method according to claim 1, characterized in that: The information to be processed includes at least one of the following: request information included in the target application service request, page information presented in the interactive interface, application information in the second application, and real physical world information collected through the terminal.

3. The interactive method according to claim 2, characterized in that: When the information to be processed includes page information presented in the interactive interface, the step of obtaining the information to be processed in the terminal in response to the target application service request includes: In response to the target application service request, the page information presented in the interactive interface is obtained through an accessible interface; or, a page recording program or a page monitoring program is called to obtain the page information presented in the interactive interface.

4. The interactive method according to claim 2, characterized in that: When the information to be processed includes application information in the second application, the target application service request includes an application identifier of the second application and an information identifier of the application information in the second application; The step of obtaining the information to be processed in the terminal in response to the target application service request includes: In response to the target application service request, determining the second application program according to the application identifier; The application information is requested from the second application through a program interface according to the information identifier to obtain the application information fed back by the second application.

5. The interactive method according to claim 2, characterized in that: When the information to be processed includes real physical world information collected by the terminal, the step of obtaining the information to be processed in the terminal in response to the target application service request includes: In response to the target application service request, the target information type is determined, and a corresponding acquisition program is called to control the hardware device in the terminal to acquire the real physical world information.

6. The interactive method according to claim 1, characterized in that: Processing the information to be processed according to the target application service request includes: Determining the information modality included in the information to be processed; If the information modality includes pictures, extracting picture information from the information to be processed by a picture recognition module; If the information modality includes a web page link, obtaining web page information through the web page link in the information to be processed; If the information modality includes text, extracting the text information in the information to be processed; If the information modality includes speech, converting the speech in the information to be processed into text information by a speech-to-text conversion module; splicing the image information and / or the web page information and / or the text information to obtain splicing information; The splicing information is processed according to the target application service request.

7. The interactive method according to claim 4, characterized in that: The processing of the to-be-processed information according to the target application service request includes: Generate output information according to the target application service request and the application information in the second application; The output information is displayed through the floating control; or the output information is sent to the second application so that the output information is output through the program function of the second application.

8. The interactive method according to claim 1, characterized in that: In response to a trigger operation on the floating control, switching the floating control to an activated state includes: When a click operation on the floating control is detected on the page, the floating control is switched to an activated state; Alternatively, when a preset activation word is recognized from the received voice instruction, the floating control is switched to an activated state; Alternatively, when a preset operation is detected in the page, a prompt window is displayed; in response to the user's confirmation operation on the prompt window, the floating control is switched to an activated state.

9. An interactive device for an application, characterized in that: The interactive device is applied to a target application; when the target application is running in the background, it is displayed in the form of a floating control on the interactive interface of the first application running in the foreground of the terminal; the interactive device includes: A switching module, configured to switch the floating control to an activated state in response to a triggering operation on the floating control; A receiving module, configured to receive a target application service request through the floating control in an activated state; An acquisition module, configured to acquire the information to be processed in the terminal in response to the target application service request; A processing module is used to process the information to be processed according to the target application service request.

10. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate through the bus, and the machine-readable instructions are executed by the processor to perform the steps of the application interaction method as described in any one of claims 1 to 8.

Images