Response method and device based on third-party application, terminal equipment and storage medium

By obtaining screenshots of third-party application interfaces and using artificial intelligence models to extract and respond to user problems, the problems of low communication efficiency and poor user experience caused by third-party applications not supporting intelligent replies are solved, and intelligent replies and user experience are improved.

CN119520453APending Publication Date: 2025-02-25SHENZHEN WORKEC TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411501818.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-25
Publication Date
2025-02-25

AI Technical Summary

Technical Problem

Because third-party applications do not support smart reply devices, they have low communication efficiency and poor user experience.

Method used

By obtaining screenshots of the application interface of a third-party application, screenshots of text information are taken, converted into text information, using the first artificial intelligence model to extract questions and user information, and using the second artificial intelligence model to find answers and send them to users.

Benefits of technology

It realizes intelligent responses to third-party application user problems, improves communication efficiency with users, and improves user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119520453A_ABST
    Figure CN119520453A_ABST
Patent Text Reader

Abstract

The invention is suitable for the technical field of computers, and provides a response method and device based on a third-party application, terminal equipment and a storage medium, and the response method based on the third-party application comprises the following steps: obtaining an application interface screenshot of the third-party application; intercepting a text information screenshot from the application interface screenshot; converting the text information screenshot into text information; obtaining unanswered interrogative sentence information and user information from the character information based on a first artificial intelligence model; obtaining answer information corresponding to the unanswered interrogative sentence information based on a second artificial intelligence model; and sending the answer information to the user. According to the technical scheme, the problem that the reply efficiency is low due to the fact that the third-party application does not support intelligent reply is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of computer technology, and in particular relates to a response method, device, terminal equipment and storage medium based on a third-party application. Background Art

[0002] Artificial intelligence is an important part of the intelligent discipline, which produces a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is a very broad science, including robotics, speech recognition, image recognition, natural language processing, expert systems, machine learning, computer vision, etc.

[0003] In fact, more and more companies and individuals are using artificial intelligence to solve problems at work. For example, more and more sales teams and customer service teams use artificial intelligence's intelligent replies to communicate with users to improve work efficiency.

[0004] However, since most instant messaging software, such as WeChat, Enterprise WeChat, DingTalk, QQ, etc., do not support intelligent reply devices, companies and individuals need to use manual reply methods to answer users' questions, which will result in untimely replies and low reply efficiency, thus affecting user experience. Summary of the invention

[0005] The embodiment of the present invention provides a response method based on a third-party application, aiming to solve the problem of low response efficiency caused by the third-party application not supporting an intelligent reply device.

[0006] The embodiment of the present invention is implemented as follows: a response method based on a third-party application, the response method based on the third-party application comprises the following steps:

[0007] Get screenshots of the application interface of third-party applications;

[0008] Capturing a text message screenshot from the application interface screenshot;

[0009] Converting the text message screenshot into text message;

[0010] Acquire unanswered question information and user information from the text information based on the first artificial intelligence model;

[0011] Acquire answer information corresponding to the unanswered question information based on the second artificial intelligence model;

[0012] The answer information is sent to the user.

[0013] Furthermore, the step of capturing a text information screenshot from the application interface screenshot includes:

[0014] Scanning the RGB value of each pixel of the application interface screenshot in sequence;

[0015] Determine the starting screenshot position and the ending screenshot position of the text information screenshot according to the RGB value of each pixel point;

[0016] The text information screenshot is captured from the application interface screenshot according to the starting screenshot position and the ending screenshot position.

[0017] Furthermore, the step of obtaining unanswered question information and user information from the text information based on the first artificial intelligence model includes:

[0018] determining the conversation content and the title content from the text information based on the first artificial intelligence model;

[0019] Acquiring the unanswered question information according to the conversation content;

[0020] The user information is determined according to the title content.

[0021] Furthermore, the second artificial intelligence model is used to obtain answer information corresponding to the unanswered question information.

[0022] Sending the unanswered question information to the second artificial intelligence model, so that the second artificial intelligence model searches for answer information corresponding to the unanswered question information from a local database or an artificial intelligence knowledge base;

[0023] Receive answer information corresponding to the unanswered question information returned by the second artificial intelligence model.

[0024] Furthermore, after the step of sending the answer information to the user, the method further includes:

[0025] Clear the cache and return to step 1: Get a screenshot of the application interface of the third-party application.

[0026] Furthermore, after the step of sending the answer information to the user, the method further includes:

[0027] Obtaining satisfaction evaluation information fed back by the user;

[0028] The answer information is graded according to the satisfaction evaluation information.

[0029] Furthermore, it is characterized in that the step of sending the answer information to the user comprises:

[0030] The answer information is sent to the user through multiple channels.

[0031] The present invention also provides a response device based on a third-party application, the response device based on a third-party application comprises: an acquisition module, an interception module, a conversion module and a sending module;

[0032] The acquisition module is used to acquire a screenshot of an application interface of a third-party application;

[0033] The capture module is used to capture a text information screenshot from the application interface screenshot;

[0034] The conversion module is used to convert the text information screenshot into text information;

[0035] The acquisition module is further used to acquire unanswered question information and user information from the text information based on the first artificial intelligence model;

[0036] The acquisition module is further used to acquire answer information corresponding to the unanswered question information based on the second artificial intelligence model;

[0037] The sending module is used to send the answer information to the user.

[0038] The present invention also provides a terminal device, comprising: a memory, a processor, and a response program based on a third-party application stored in the memory and executable on the processor, wherein the response program based on the third-party application, when executed by the processor, implements the response method based on the third-party application as described above.

[0039] The present invention also provides a storage medium, on which a response program based on a third-party application is stored, and when the response program based on the third-party application is executed by a processor, the response method based on the third-party application as described above is implemented.

[0040] The technical solution of the present invention first obtains a screenshot of the application interface of the third-party application, then extracts a screenshot of the text message from the screenshot of the application interface, converts the screenshot of the text message into text information, then extracts the question sentence and user information from the text information based on the first artificial intelligence model, and finds the answer corresponding to the question sentence based on the second artificial intelligence model and sends it to the user. Since the present invention can realize intelligent replies to user questions of third-party applications, it can solve the problem of low efficiency in communication with users and poor user experience due to the failure of third-party applications to support intelligent reply devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 It is a flowchart of an embodiment of a response method based on a third-party application provided in an embodiment of the present invention;

[0042] Figure 2 yes Figure 1A schematic diagram of a flow chart of an embodiment of step S2 in FIG.

[0043] Figure 3 It is a structural block diagram of an embodiment of a response device based on a third-party application provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0045] The technical solution of the present invention first obtains a screenshot of the application interface of the third-party application, then extracts a screenshot of the text message from the screenshot of the application interface, converts the screenshot of the text message into text information, then extracts the question sentence and user information from the text information based on the first artificial intelligence model, and finds the answer to the question sentence based on the second artificial intelligence model and sends it to the user. Since the present invention can realize intelligent replies to user questions of third-party applications, it can solve the problem of low communication efficiency with users and poor user experience due to the failure of third-party applications to support intelligent reply devices.

[0046] Embodiment 1

[0047] Reference Figure 1 The present invention provides a response method based on a third-party application, comprising the following steps:

[0048] Step S1, obtaining a screenshot of the application interface of a third-party application;

[0049] After the application is started, a screenshot is taken on the application interface of the third-party application at a scheduled time or in real time to obtain an application interface screenshot. The third-party application may be an instant messaging software currently in use, and the application interface represents a visual and operating interface for the user to interact with the third-party application.

[0050] Step S2, capturing a text information screenshot from the application interface screenshot;

[0051] The text message may be the conversation content and user information displayed on the third-party application interface. The text message screenshot may be a screenshot containing the conversation content and user information. The system identifies the target area containing the conversation content and user information from the application interface screenshot, and takes a screenshot of the target area, and the resulting screenshot is the text message screenshot. The size of the text message screenshot is smaller than the size of the application interface screenshot.

[0052] Reference Figure 2 In an optional embodiment, step S2 includes:

[0053] Step S21, sequentially scanning the RGB value of each pixel point of the application interface screenshot;

[0054] Step S22, determining a starting screenshot position and an ending screenshot position of the text information screenshot according to the RGB value of each pixel point;

[0055] Step S23, capturing the text information screenshot from the application interface screenshot according to the starting screenshot position and the ending screenshot position.

[0056] Pre-configure the background color for the dialog box of the third-party application, that is, the interface that displays information to the user or obtains the user input response. Specifically, the first RGB value can be set for the interface background of the dialog box of the third-party application, the second RGB value can be set for the background of the message sent in the dialog box, and the third RGB value can be set for the background of the message received, and the first RGB value, the second RGB value and the third RGB value are not equal. After the program is started, first take a screenshot of the third-party application interface to obtain the application interface screenshot, and then scan each pixel in the application interface screenshot in turn, and use the differences in the interface background RGB value, the message sending background RGB value and the message receiving background RGB value to accurately obtain the starting screenshot position and the ending screenshot position of the text message screenshot. That is, the starting screenshot position and the ending screenshot position of the text message screenshot are determined by the RGB value of each pixel, and then the screenshot containing the text information content is accurately captured from the application interface screenshot.

[0057] The specific process is:

[0058] (1) Read pixels from the image coordinates (0, 0) of the screenshot of the application interface, start the message screenshot scanner, and read pixels from the image coordinates (0, 0). The coordinates start from (0, 0);

[0059] (2) Start the message screenshot scanner, the X coordinate increases, the Y coordinate increases by 1, and the end point of the X coordinate value is the image width;

[0060] (3) Incremental scanning starts and determines whether the RGB value of the pixel is the RGB value of the background of the sent message or the RGB value of the background of the received message. If it is "yes", it determines again whether the cache has a record of the new message start message revelation position. If it is "no", it records the current X, Y coordinate value and RGB value, indicating the starting position of the message content;

[0061] (4) Determine whether the RGB value of the pixel is the RGB value of the background of the sent message or the RGB value of the background of the received message. If it is "no", determine again whether the cache has a record of the start message position of the new message. If it is "yes", it indicates the end position of the message content. Record the current X, Y coordinate value and RGB value to indicate the end position of the message content.

[0062] (5) The message area image can be captured by the coordinate values ​​X, Y of the start position of the message content and the coordinate values ​​X, Y of the end position of the message content. The captured image is the complete message image, i.e., the text information screenshot. The text content is obtained by OCR conversion.

[0063] (6) After completion, the X and Y coordinates of the start position of the message content and the X and Y coordinates of the end position of the message content are cleared; the X coordinate is 0 and the Y coordinate is the end position Y coordinate is passed to the next scanner to intercept the next message.

[0064] Step S3, converting the text message screenshot into text information;

[0065] The text in the text information screenshot can be extracted through specific application software or tools, such as universal text recognition software, Adobe Acrobat, WPS and other tools to obtain the text information in the screenshot.

[0066] In an optional embodiment, the text information screenshot can be converted into text information by using OCR (Optical Character Recognition) technology. OCR technology has the advantages of improving work efficiency, realizing digital conversion, reducing labor costs, improving recognition accuracy, multi-language support, real-time recognition capability and data extraction and analysis, which makes OCR technology very efficient and convenient when processing text in text information screenshots. The present invention can use OCR technology to convert text information screenshots into text information to obtain a text information set.

[0067] Step S4, obtaining unanswered question information and user information from the text information based on the first artificial intelligence model;

[0068] The first artificial intelligence model is an AI large model engine for identifying the conversation content and user information displayed on the third-party application interface. The first artificial intelligence model can be an AI model such as GPT (Generative Pre-Trained Transformer) and Wenxinyiyan. In this embodiment, the first artificial intelligence model can be used to identify interrogative sentences and user information from the acquired text information set, and the user information includes but is not limited to user name, contact information, gender and other information.

[0069] In one embodiment, step S4 includes:

[0070] Step S41, determining the conversation content and the title content from the text information based on the first artificial intelligence model;

[0071] Step S42, obtaining the unanswered question information according to the conversation content;

[0072] Step S43: determining the user information according to the title content.

[0073] The first artificial intelligence model is used to determine the conversation content and title information from the recognized text information, unanswered question information is identified through the conversation content, and user information corresponding to the unanswered question information is identified through the title content, and the user information includes but is not limited to name, contact information, gender, etc.

[0074] Step S5, obtaining answer information corresponding to the unanswered question information based on the second artificial intelligence model;

[0075] The second artificial intelligence model is an AI model engine for searching for answers related to the interrogative sentence. Specifically, the second artificial intelligence model can obtain the answer corresponding to the interrogative sentence through a local database or an artificial intelligence knowledge base.

[0076] In one embodiment, step S5 includes:

[0077] Step S51, sending the unanswered question information to the second artificial intelligence model, so that the second artificial intelligence model searches for answer information corresponding to the unanswered question information from a local database or an artificial intelligence knowledge base;

[0078] Step S52: receiving answer information corresponding to the unanswered question information returned by the second artificial intelligence model.

[0079] After the first artificial intelligence module identifies the unanswered question information, the identified question information is sent to the second artificial intelligence model, which first searches for the answer in the local database and returns the answer to the application; if there is no corresponding answer in the local database, the artificial intelligence knowledge base of the second artificial intelligence model is used to search for the answer and return the answer to the application. After getting the answer, the cache can be cleaned up before answering the next question.

[0080] Specifically:

[0081] (1) After the application obtains the unanswered question information, it sends instruction 001 to the second artificial intelligence model to obtain question classification;

[0082] (2) querying the classified data in the database by classification, and providing the classified data to the second artificial intelligence model as an answer cache;

[0083] (3) After completing the classification query, send an Ai command + question form to let the second artificial intelligence model find the answer. If the local database does not have the answer, use GPT's own knowledge base to search;

[0084] (4) After obtaining the answer, clear the cache and then proceed to answer the next question.

[0085] It can be understood that the first artificial intelligence model of the present invention is used to identify the conversation content and user information displayed on the third-party application interface, which is an AI large model engine for information identification; and the second artificial intelligence model is used to answer questions, which is an AI large model knowledge base engine. It can be understood that the present invention uses a multi-engine mode to perform different functions to achieve the purpose of improving the working efficiency of the program, avoiding delays, and optimizing the effect.

[0086] Step S6: sending the answer information to the user.

[0087] The answer information corresponding to the unanswered question information is sent to the corresponding user, so as to realize the quick reply to the user's question in the third-party application. Furthermore, the answer information can be sent to the user through multiple channels, which can include copying and pasting the answer information into the send message input box, sending the answer to the user via SMS, and supporting automatic sending if it is this application. Afterwards, the cache can be cleaned up to reply to the next question.

[0088] In order to improve the user experience, it is also possible to send out satisfaction surveys to users and receive satisfaction evaluation information from users' replies. The answers in the database can be classified according to the satisfaction evaluation of users' replies. For example, if the user satisfaction is 10 points, the answer to the question is marked as level one; if the user satisfaction is 9 points, the answer to the question is marked as level two; if the user satisfaction is 8 points, the answer to the question is marked as level three, and so on. The answers to the questions are classified to facilitate providing users with better replies later.

[0089] The technical solution of the present invention first obtains a screenshot of the application interface of a third-party application, and then takes a screenshot of the application interface screenshot again to obtain a screenshot of text information, and then converts the text information screenshot into text information, extracts question sentences and user information from the text information based on a first artificial intelligence model, and finds answers to unanswered questions based on a second artificial intelligence model and sends them to the user, thereby realizing intelligent replies to user questions of third-party applications, solving the problem of low communication efficiency and poor user experience caused by the third-party application not supporting intelligent reply devices. The present invention is conducive to improving the reply efficiency of enterprises and individuals to users and enhancing user experience.

[0090] The embodiment of the present invention also provides a response device based on a third-party application.

[0091] Reference Figure 3 In a possible embodiment, the response device based on the third-party application includes: an acquisition module 100, an interception module 200, a conversion module 300 and a sending module 400.

[0092] An acquisition module 100 is used to acquire a screenshot of an application interface of a third-party application;

[0093] After the application is started, a screenshot is taken on the application interface of the third-party application at a scheduled time or in real time to obtain an application interface screenshot. The third-party application may be an instant messaging software currently in use, and the application interface represents a visual and operating interface for the user to interact with the third-party application.

[0094] The capture module 200 is used to capture a text information screenshot from the application interface screenshot;

[0095] The text message may be the conversation content and user information displayed on the third-party application interface. The text message screenshot may be a screenshot containing the conversation content and user information. The system identifies the target area containing the conversation content and user information from the application interface screenshot, and takes a screenshot of the target area, and the resulting screenshot is the text message screenshot. The size of the text message screenshot is smaller than the size of the application interface screenshot.

[0096] A conversion module 300, used to convert the text message screenshot into text information;

[0097] The text in the text information screenshot can be extracted through specific application software or tools, such as universal text recognition software, Adobe Acrobat, WPS and other tools to obtain the text information in the screenshot.

[0098] In a specific embodiment, the text information screenshot can be converted into text information by OCR (Optical Character Recognition) technology. OCR technology has the advantages of improving work efficiency, realizing digital conversion, reducing labor costs, improving recognition accuracy, multi-language support, real-time recognition capability and data extraction and analysis, which makes OCR technology very efficient and convenient when processing text in text information screenshots. The present invention can use OCR technology to convert text information screenshots into text information to obtain a text information set.

[0099] The acquisition module 100 is further used to acquire unanswered question information and user information from the text information based on the first artificial intelligence model;

[0100] The first artificial intelligence model is an AI large model engine for identifying the conversation content and user information displayed on the third-party application interface. The first artificial intelligence model can be an AI model such as GPT (Generative Pre-Trained Transformer) and Wenxinyiyan. In this embodiment, the first artificial intelligence model can be used to identify interrogative sentences and user information from the acquired text information set, and the user information includes but is not limited to user name, contact information, gender and other information.

[0101] The acquisition module 100 is further used to acquire answer information corresponding to the unanswered question information based on the second artificial intelligence model;

[0102] The second artificial intelligence model is an engine for searching for answers related to the interrogative sentence. Specifically, the second artificial intelligence model can obtain the answer corresponding to the interrogative sentence through a local database or an artificial intelligence knowledge base.

[0103] The sending module 400 is used to send the answer information to the user.

[0104] The answer information corresponding to the unanswered question information is sent to the corresponding user, so as to realize the quick reply to the user's question in the third-party application. Furthermore, the answer information can be sent to the user through multiple channels, which can include copying and pasting the answer information into the send message input box, sending the answer to the user via SMS, and supporting automatic sending if it is this application. Afterwards, the cache can be cleaned up to reply to the next question.

[0105] In order to improve the user experience, it is also possible to send out satisfaction surveys to users and receive satisfaction evaluation information from users' replies. The answers in the database can be classified according to the satisfaction evaluation of users' replies. For example, if the user satisfaction is 10 points, the answer to the question is marked as level one; if the user satisfaction is 9 points, the answer to the question is marked as level two; if the user satisfaction is 8 points, the answer to the question is marked as level three, and so on. The answers to the questions are classified to facilitate providing users with better replies later.

[0106] The technical solution of the present invention first obtains a screenshot of the application interface of a third-party application, and then takes a screenshot of the application interface screenshot again to obtain a screenshot of text information, and then converts the text information screenshot into text information, extracts question sentences and user information from the text information based on a first artificial intelligence model, and finds answers to unanswered questions based on a second artificial intelligence model and sends them to the user, thereby realizing intelligent replies to user questions of third-party applications, solving the problem of low communication efficiency and poor user experience caused by the third-party application not supporting intelligent reply devices. The present invention is conducive to improving the reply efficiency of enterprises and individuals to users and enhancing user experience.

[0107] An embodiment of the present invention also proposes a terminal device, which includes: a memory, a processor, and a response program based on a third-party application stored in the memory and executable on the processor, wherein the response program based on the third-party application, when executed by the processor, implements the response method based on the third-party application as described above.

[0108] The embodiment of the present invention further provides a storage medium, namely, a computer-readable storage medium.

[0109] The storage medium of the present invention stores a response program based on a third-party application, and when the response program based on a third-party application is executed by a processor, the steps of the response method based on a third-party application as described above are implemented.

[0110] Among them, the method implemented when the response program based on the third-party application running on the processor is executed can refer to the various embodiments of the method based on the third-party application of the present invention, which will not be repeated here.

[0111] Exemplarily, the computer program may be divided into one or more modules, one or more modules are stored in a memory and executed by a processor to complete the present invention. One or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in a computer device. For example, the computer program may be divided into the steps of the method for responding based on a third-party application provided in each of the above-mentioned method embodiments.

[0112] Those skilled in the art will understand that the description of the terminal device above is merely an example and does not constitute a limitation on the terminal device. The terminal device may include more or fewer components than described above, or a combination of certain components, or different components, for example, input and output devices, network access devices, buses, etc.

[0113] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the computer device, and uses various interfaces and lines to connect various parts of the entire user terminal.

[0114] The memory can be used to store the computer program and / or module, and the processor realizes various functions of the terminal device by running or executing the computer program and / or module stored in the memory, and calling the data stored in the memory. The memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0115] The computer program may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of each of the above method embodiments may be implemented. The computer program includes computer program code, and the computer program code may be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium.

[0116] It is understandable that those skilled in the art can, under the guidance of the above embodiments, combine various implementation methods in the above embodiments to obtain technical solutions of multiple implementation methods.

[0117] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A response method based on a third-party application, characterized in that: The third-party application-based response method comprises the following steps: Get screenshots of the application interface of third-party applications; Capturing a text message screenshot from the application interface screenshot; Converting the text message screenshot into text message; Acquire unanswered question information and user information from the text information based on the first artificial intelligence model; Acquire answer information corresponding to the unanswered question information based on the second artificial intelligence model; The answer information is sent to the user.

2. The third-party application-based response method according to claim 1, characterized in that: The step of capturing a text information screenshot from the application interface screenshot comprises: Scanning the RGB value of each pixel of the application interface screenshot in sequence; Determine the starting screenshot position and the ending screenshot position of the text information screenshot according to the RGB value of each pixel point; The text information screenshot is captured from the application interface screenshot according to the starting screenshot position and the ending screenshot position.

3. The third-party application-based response method according to claim 2, characterized in that: The step of obtaining unanswered question information and user information from the text information based on the first artificial intelligence model includes: determining the conversation content and the title content from the text information based on the first artificial intelligence model; Acquiring the unanswered question information according to the conversation content; The user information is determined according to the title content.

4. The third-party application-based response method according to claim 3, characterized in that: The step of acquiring answer information corresponding to the unanswered question information based on the second artificial intelligence model includes: Sending the unanswered question information to the second artificial intelligence model, so that the second artificial intelligence model searches for answer information corresponding to the unanswered question information from a local database or an artificial intelligence knowledge base; Receive answer information corresponding to the unanswered question information returned by the second artificial intelligence model.

5. The third-party application-based response method according to claim 1, characterized in that: After the step of sending the answer information to the user, the method further includes: Clear the cache and return to step 1: Get a screenshot of the application interface of the third-party application.

6. The third-party application-based response method according to claim 1, characterized in that: After the step of sending the answer information to the user, the method further includes: Obtaining satisfaction evaluation information fed back by the user; The answer information is graded according to the satisfaction evaluation information.

7. The third-party application-based response method according to any one of claims 1 to 6, characterized in that: The step of sending the answer information to the user comprises: The answer information is sent to the user through multiple channels.

8. A response device based on a third-party application, characterized in that: The response device based on the third-party application includes: an acquisition module, an interception module, a conversion module and a sending module; The acquisition module is used to acquire a screenshot of an application interface of a third-party application; The capture module is used to capture a text information screenshot from the application interface screenshot; The conversion module is used to convert the text information screenshot into text information; The acquisition module is further used to acquire unanswered question information and user information from the text information based on the first artificial intelligence model; The acquisition module is further used to acquire answer information corresponding to the unanswered question information based on the second artificial intelligence model; The sending module is used to send the answer information to the user.

9. A terminal device, characterized in that: The terminal device includes: a memory, a processor, and a response program based on a third-party application stored in the memory and executable on the processor, wherein the response program based on the third-party application, when executed by the processor, implements the response method based on the third-party application as described in any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores a response program based on a third-party application, and when the response program based on a third-party application is executed by a processor, the response method based on a third-party application as described in any one of claims 1 to 7 is implemented.