Intelligent customer intercommunication system and method based on UI automation

Abstract

The invention relates to the technical field of the Internet, in particular to an intelligent customer intercommunication system and method based on UI automation, which centrally manages, receives, forwards and processes information of each platform through an automation tool, improves the intelligence and efficiency of information processing, can expand information analysis, further excavates customer demands, and improves the user experience. And meanwhile, high expandability and adaptability are achieved, and the customer service satisfaction degree and the operation convenience are greatly improved.

Description

Technical Field

[0001] The present invention relates to the field of Internet technologies, and more specifically, to an intelligent customer communication system and method based on UI automation. Background Art

[0002] With the development of computer technologies and the improvement of people's living standards, people are becoming increasingly dependent on the Internet to provide various services. Providing various corresponding services through various service-providing servers has been increasingly widely applied to people's lives, bringing great convenience to people's lives.

[0003] Especially in the current business environment, enterprises are becoming increasingly dependent on third-party media platforms for customer service and interaction. However, the following problems and disadvantages exist in the current existing technologies: Scattered communication: Enterprises need to use multiple applications and platforms to manage communication with customers, resulting in scattered information and difficult management. Different media platforms have different user interfaces and operation processes, making it difficult for enterprises to manage uniformly.

[0004] Complicated manual operations: Due to the different interfaces and operation methods of different platforms, enterprise personnel need to spend a lot of time and energy switching between multiple platforms for manual operations. This method is not only inefficient but also error-prone.

[0005] Difficult data integration: It is very difficult to collect and integrate customer data from multiple platforms, which affects the enterprise's customer relationship management and data analysis. Enterprises are difficult to obtain comprehensive customer behavior and demand data, which affects service quality and customer satisfaction.

[0006] Lack of automation support: The current communication methods mainly rely on manual operations and lack automation tools to simplify and accelerate the customer service process. Enterprises are difficult to achieve rapid response and efficient management.

[0007] Therefore, it is necessary to design an intelligent customer communication system and method based on UI automation, which centrally manages, receives, forwards, and processes information from each platform through automation tools, improves the intelligence and efficiency of information processing, and can expand information analysis to further explore customer needs. At the same time, it has high scalability and adaptability, greatly improving customer service satisfaction and operation convenience. Summary of the Invention

[0008] The purpose of the present invention is to overcome the deficiencies of the prior art and provide an intelligent customer communication system and method based on UI automation, which centrally manages, receives, forwards, and processes information from each platform through automation tools, improves the intelligence and efficiency of information processing, and can expand information analysis to further explore customer needs. At the same time, it has high scalability and adaptability, greatly improving customer service satisfaction and operation convenience.

[0009] To achieve the above object, the present invention provides an intelligent customer communication system based on UI automation. The architecture of the system includes a service layer and an infrastructure layer; The service layer includes a script end and a server end. The script end includes mobile phone connection and control, mobile phone element positioning and operation, chat list page monitoring, and message capture and sending; the server end includes message reception and forwarding, data storage, device status management, and device monitoring and alarm; The infrastructure layer includes environment configuration and data storage.

[0010] The environment configuration includes Python, Appium, and Android SDK, and the data storage includes MySQL and Redis.

[0011] An intelligent customer communication method based on UI automation includes the following steps: S1, Initialize the mobile phone environment and connect to the mobile phone with appium; S2, Enter the chat page of the tripartite media platform; S3, Confirm whether there are unread messages. If so, capture and process the messages and enter S4; S4, Forward the messages to the enterprise CRM system; S5, After message inspection, enter S2 again; S6, If there are no unread messages in S3, confirm whether there are messages to be sent. If so, enter the corresponding user chat page, send the messages, and then enter S5; S7, If the confirmation in S6 of whether there are messages to be sent is negative, directly enter S5.

[0012] The message capture in S3 is specifically as follows: Use Appium to control the mobile phone to enter the chat page and capture the unread message copy; the specific capture method is: Use Appium to locate elements in the way of xpath, and use the methods encapsulated by Appium to operate elements, and finally encapsulate to achieve element location and operation.

[0013] The operations of elements include clicking, swiping, and obtaining copy.

[0014] An electronic device includes a processor and a memory storing a program. The program includes instructions that, when executed by the processor, cause the processor to execute an intelligent customer communication method based on UI automation.

[0015] A non-transitory computer-readable storage medium storing computer instructions, where the computer instructions are used to cause a computer to execute an intelligent customer communication method based on UI automation.

[0016] Compared with the prior art, the present invention has the following beneficial effects: Improve communication efficiency: By using automated tools to uniformly manage messages on multiple third-party media platforms, the cumbersome manual operations are reduced, and the communication efficiency is improved. Enterprises can respond to customer needs faster and enhance customer satisfaction.

[0017] Centralized information management: All the captured messages are stored in a unified database, facilitating centralized management and data analysis. Enterprises can conveniently view and retrieve all customer communication records, improving management efficiency.

[0018] Reduce labor costs: The automated workflow reduces the dependence on manual labor and lowers labor costs.

[0019] Enhance the customer experience: By processing and forwarding messages quickly and accurately, the response speed and quality of customer service are improved, enhancing the customer experience. Customers will receive more timely and personalized services, increasing customer loyalty.

[0020] Data-driven decision-making: By analyzing historical chat records, enterprises can gain valuable customer insights, optimize the decision-making process and service strategies. Data analysis can help enterprises discover potential problems and opportunities and enhance competitiveness.

[0021] Strong adaptability: This system can be customized and extended according to the needs of different enterprises and third-party media platforms, with good adaptability. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a schematic diagram of the overall architecture of the present invention.

[0023] Figure 2 It is a schematic diagram of the processing flow of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0024] The present invention will be further described below in conjunction with the accompanying drawings.

[0025] Refer to Figures 1 to 2 , the present invention provides an intelligent customer communication system based on UI automation. The architecture of the system includes a service layer and an infrastructure layer. The service layer includes a script end and a server end. The script end includes mobile phone connection and control, and mobile phone element positioning and operation. The mobile phone element positioning and operation are as follows: Use Appium to locate elements by means of xpath, and use the methods encapsulated by Appium to operate elements (such as clicking, swiping, obtaining text, etc.). Finally, the above methods are encapsulated to achieve element positioning and operation.

[0026] It also includes chat list page monitoring, message scraping and sending; The server includes message receiving and forwarding, data storage, device status management and device monitoring and alarming; The infrastructure layer includes environment configuration and data storage.

[0027] The environment configuration includes Python, Appium and Android SDK, and the data storage includes MySQL and Redis.

[0028] The above environment configuration is the pre - setting of the physical architecture such as the language, configuration and storage of the computer. Specifically: Install the Python language environment on the computer, install the Node language environment on the computer, install the Appium server and the Uiautomator2 driver of Appium, and install and configure the Android SDK; The data storage depends on Mysql and Redis, and uses the Pymysql library and Redis library of Python for curd operations.

[0029] An intelligent customer inter - communication method based on UI automation includes the following steps: S1, Initialize the mobile phone environment and connect the mobile phone with appium; S2, Enter the chat page of the third - party media platform. Here, the third - party media are media platforms such as Xiaohongshu, Weibo, Toutiao, Zhihu, etc.

[0030] S3, Confirm whether there are unread messages. If so, scrape and process the messages and enter S4; The above scraping method is: Use Appium to control the mobile phone to enter the chat page and scrape the unread message copywriting. The scraping method is the same as the above mobile phone element positioning operation. S4, Forward the message to the enterprise CRM system; S5, After message inspection, enter S2 again; S6, If there are no unread messages in S3, confirm whether there are messages to be sent. If so, enter the corresponding user chat page, send the message and then enter S5; S7, If the confirmation in S6 whether there are messages to be sent is no, directly enter S5.

[0031] An electronic device includes a processor and a memory storing a program. The program includes instructions that, when executed by the processor, cause the processor to execute an intelligent customer inter - communication method based on UI automation.

[0032] A non - transitory computer - readable storage medium storing computer instructions for causing a computer to execute an intelligent customer inter - communication method based on UI automation.

[0033] To better facilitate the understanding of the operation steps of the present invention, the following takes the Xiaohongshu third-party media platform as an example to further illustrate the working process of the front-end of the present invention: Open Xiaohongshu; Enter the "My" page and record the Xiaohongshu number of the current account by means of element capture; Enter the chat list page; Obtain the elements of the chat list page and identify whether there is an unread message prompt; If there are unread messages, enter the chat details page of this user; Click on the user's avatar from the chat details page to enter the user's homepage and obtain the user's Xiaohongshu number; Return to the chat page and obtain the unread messages; Send the unread messages to the enterprise CRM system and return to the chat page to repeat operation 4; If there are no unread messages, obtain the messages to be sent from Redis; If there are messages to be sent, enter the user chat page and send the messages; If there are no messages to be sent, wait silently for a period of time and repeat operation 4.

[0034] The above is only the preferred embodiment of the present invention, which is only used to help understand the method and its core idea of the present application. The protection scope of the present invention is not limited to the above embodiments. All technical solutions falling within the idea of the present invention belong to the protection scope of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present invention, several improvements and refinements should also be regarded as the protection scope of the present invention.

[0035] In the description of the present invention, it should be noted that the orientation or positional relationship indicated by the terms "upper", "lower", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the present invention.

[0036] As a whole, the present invention solves the deficiencies in the prior art that enterprises encounter when using third-party media platforms for customer service and interaction, such as scattered communication, cumbersome operations, difficult data integration, and inability to execute automatically. By using automated tools to centrally manage, receive, forward, and process information from various platforms, it improves the intelligence and efficiency of information processing, and can also expand information analysis to further explore customer needs. At the same time, it has high scalability and adaptability, greatly improving customer service satisfaction and operation convenience.

Claims

1. An intelligent customer intercommunication system based on UI automation, characterized in that: The architecture of the system includes a service layer and an infrastructure layer; The service layer includes a script end and a server end. The script end includes mobile phone connection and control, mobile phone element positioning and operation, chat list page monitoring, and message capture and sending; the server end includes message reception and forwarding, data storage, device status management, and device monitoring alarms; The infrastructure layer includes environment configuration and data storage.

2. The UI automated intelligent client intercommunication system according to claim 1, characterized in that: The environment configuration includes Python, Appium and Android SDK, and the data storage includes MySQL and Redis.

3. A smart client intercommunication method based on UI automation as claimed in claim 1, characterized in that: The following steps are involved: S1, initialize the mobile phone environment and connect the mobile phone with appium; S2, enter the chat page of the third-party media platform; S3, confirm whether there are unread messages, if so, capture and process the messages and enter S4; S4, forward the message to the enterprise CRM system; S5, after message inspection, enter S2 again; S6, if there is no unread message in S3, confirm whether there is a message to be sent, if so, enter the corresponding user chat page and send the message and then enter S5; S7, if the confirmation in S6 as to whether there is a message to be sent is no, directly enter S5.

4. The UI automated intelligent client intercommunication system according to claim 3, characterized in that: The captured message in S3 is specifically: Use Appium to control the mobile phone to enter the chat page and capture the unread message copy; the specific method of capturing is: Use Appium to locate elements through xpath, and use Appium encapsulation method to operate elements, and finally encapsulate to achieve element positioning and operation.

5. The UI automated intelligent client intercommunication system according to claim 4, characterized in that: The operations of the element include clicking, sliding, and obtaining text.

6. An electronic device, characterized in that: The method comprises a processor and a memory storing a program, wherein the program comprises instructions which, when executed by the processor, cause the processor to perform the method according to any one of claims 3.

7. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the method according to any one of claim 3.

Images