Automatic information input method and system, computer equipment and storage medium
By crawling the business system page and establishing a mapping relationship between the input element ID and the customer's unique identity, automated information entry is realized, solving the problems of low manual entry efficiency, poor accuracy and difficulty in privacy protection, and improving the efficiency and accuracy of information entry and security.
Patent Information
- Application Number
- CN202411202467.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-29
- Publication Date
- 2025-02-18
Smart Images

Figure CN119474503A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of information processing technology, and in particular to an automatic information entry method, system, computer equipment and non-volatile computer-readable storage medium. Background Art
[0002] At present, with the rapid development of information technology, the auto insurance and non-auto insurance businesses of insurance companies play an increasingly important role in the field of customer service. However, there are some urgent problems in the existing agent operation mode, which not only affect the operation efficiency, but also pose challenges to the accuracy of business and the protection of customer privacy, such as:
[0003] 1. Operation efficiency issues: In auto insurance and non-auto insurance businesses, agents need to enter a large amount of customer information into the business system, including but not limited to customer name, mobile phone number, ID number, license plate number, etc. The entry of this information is cumbersome and time-consuming, which seriously affects the agent's operation efficiency;
[0004] 2. Information accuracy issues: Manual information entry is prone to errors, which may cause problems in subsequent business processes and require additional human resources to correct and resolve, further increasing business costs;
[0005] 3. Privacy protection issues: Customer information contains a large amount of private data. How to ensure accurate entry of information while protecting customer privacy is a difficult problem. The existing masking method for private information has defects. Not adding a mask may lead to privacy leakage, while adding a mask may increase the risk of entry errors, causing inconvenience to agents in verifying information.
[0006] Based on this, how to provide an automatic information entry method, system, computer device and non-volatile computer-readable storage medium that can avoid the defects of manual information entry through automation technology and improve the efficiency, accuracy and security of information entry is a problem that needs to be urgently solved by technical personnel in this field. Summary of the invention
[0007] In view of the above-mentioned deficiencies in the prior art, the object of the present invention is to provide an automatic information entry method, system, computer device and non-volatile computer-readable storage medium that can be used in financial technology or other related fields, aiming to solve the problem of how to avoid the defects of manual information entry through automation technology and improve the efficiency, accuracy and security of information entry.
[0008] In order to achieve the above object, the present invention adopts the following technical solutions:
[0009] A method for automatic information entry, comprising:
[0010] Crawl all pages that need to be entered into the business system, and organize corresponding crawling information, wherein the crawling information includes the entry element ID of each of the pages;
[0011] Based on the preset integration information, the mapping relationship between the input element ID of each page and the integration information and the customer unique identifier is sorted to obtain corresponding mapping relationship information;
[0012] When the target page of the business system needs to enter information, the target customer unique identifier and the target entry element ID of the target page are extracted;
[0013] Based on the mapping relationship information, the target information required to be entered on the target page is queried in the integrated information according to the target customer unique identifier and the target entry element ID;
[0014] The target information is automatically entered into the target page.
[0015] In a further technical solution, the automatic information entry method, wherein the crawling requires entering all pages of the business system, and collating the corresponding crawling information, wherein the crawling information includes the entry element ID of each of the pages, including:
[0016] All pages that need to be entered into the business system are crawled by the crawler component, and the corresponding crawling information is sorted out. The crawling information includes the title, url, and entry element ID of each of the pages.
[0017] In a further technical solution, the automatic information entry method, wherein the mapping relationship between the entry element ID of each page and the integration information and the customer unique identifier is sorted out based on the preset integration information to obtain the corresponding mapping relationship information, includes:
[0018] Pre-extracting unstructured information of the business system and converting the unstructured information into structured information;
[0019] Based on the structured information and historical information extracted in advance from other data sources, corresponding integrated information is obtained;
[0020] Based on the integration information, the mapping relationship between the input element ID of each page and the integration information and the customer unique identifier is sorted to obtain corresponding mapping relationship information.
[0021] In a further technical solution, the automatic information entry method, wherein when the target page of the business system needs to enter information, extracting the target customer unique identifier and the target entry element ID of the target page, comprises:
[0022] When the target page of the business system needs to enter information, the target customer unique identifier and the target entry element ID of the target page are extracted through the jsagent embedded in the target page.
[0023] In a further technical solution, the method for automatically entering information, wherein the step of automatically entering the target information into the target page includes:
[0024] The target information is automatically entered into the target page through the js agent.
[0025] In a further technical solution, the automatic information entry method, wherein the unstructured information of the business system is extracted in advance and the unstructured information is converted into structured information, comprises:
[0026] The Bert model is used in advance to extract unstructured information from the call text and / or WeChat communication text of the business system, and the unstructured information is converted into structured information.
[0027] In a further technical solution, the automatic information entry method, wherein the Bert model is used in advance to extract unstructured information from the call text and / or WeChat communication text of the business system, and the unstructured information is converted into structured information, wherein,
[0028] The unstructured information includes customer name, ID card information, license plate information, address information, and purchase intention.
[0029] An automatic information entry system, comprising:
[0030] A crawling module is used to crawl all pages that need to be entered into the business system, and to organize the corresponding crawling information, wherein the crawling information includes the entry element ID of each of the pages;
[0031] A sorting module, used for sorting the mapping relationship between the input element ID of each page and the integration information and the customer unique identifier based on the preset integration information, and obtaining corresponding mapping relationship information;
[0032] An extraction module, used for extracting a target customer unique identifier and a target entry element ID of the target page when the target page of the business system needs to enter information;
[0033] A query module, configured to query the integrated information based on the mapping relationship information, the target customer unique identifier and the target entry element ID to obtain the target information required to be entered on the target page;
[0034] An input module is used to automatically input the target information into the target page.
[0035] A computer device, wherein the computer device comprises at least one processor; and
[0036] a memory communicatively connected to the at least one processor; wherein,
[0037] The memory stores a computer program that can be executed by the at least one processor. When the computer program is executed by the at least one processor, the automatic information entry method as described in any one of the above items can be implemented.
[0038] A non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium stores a computer program, and when the computer program is executed by at least one processor, it can implement any of the above-mentioned methods for automatic information entry.
[0039] Compared with the prior art, the present invention provides an automatic information entry method, system, computer device and non-volatile computer-readable storage medium, wherein the method comprises: crawling all pages that need to be entered into the business system, and sorting out corresponding crawling information, wherein the crawling information includes the entry element ID of each of the pages; based on the preset integration information, sorting out the mapping relationship between the entry element ID of each of the pages and the integration information and the customer unique identifier, and obtaining corresponding mapping relationship information; when the target page of the business system needs to enter information, extracting the target customer unique identifier and target entry element ID of the target page; based on the mapping relationship information, querying the target information required to be entered for the target page in the integration information according to the target customer unique identifier and the target entry element ID; and automatically entering the target information into the target page. In this way, the method of the present invention can avoid the defects of manual information entry through automation technology, and improve the efficiency, accuracy and security of information entry. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0041] Figure 1 A schematic diagram of a flow chart of an automatic information entry method provided by an embodiment of the present invention.
[0042] Figure 2A schematic diagram of functional modules of an automatic information entry system provided in an embodiment of the present invention.
[0043] Figure 3 A schematic diagram of the hardware structure of a computer device provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0044] In order to make the purpose, technical solution and effect of the present invention clearer and more specific, the present invention is further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0045] In the description of the present invention, the terms "include", "including", "have", "contain", etc. are all open terms, which mean including but not limited to. The descriptions with reference to the terms "one embodiment", "a specific embodiment", "some embodiments", "for example", etc. mean that the specific features, structures or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. The order of steps involved in each embodiment is used to schematically illustrate the implementation of the present application, and the order of steps therein is not limited and can be appropriately adjusted as needed.
[0046] Various non-limiting embodiments of the present invention are described in detail below in conjunction with the accompanying drawings.
[0047] At present, with the rapid development of information technology, the auto insurance and non-auto insurance businesses of insurance companies play an increasingly important role in the field of customer service. However, there are some urgent problems in the existing agent operation mode, which not only affect the operation efficiency, but also pose challenges to the accuracy of business and the protection of customer privacy, such as:
[0048] 1. Operation efficiency issues: In auto insurance and non-auto insurance businesses, agents need to enter a large amount of customer information into the business system, including but not limited to customer name, mobile phone number, ID number, license plate number, etc. The entry of this information is cumbersome and time-consuming, which seriously affects the agent's operation efficiency;
[0049] 2. Information accuracy issues: Manual information entry is prone to errors, which may cause problems in subsequent business processes and require additional human resources to correct and resolve, further increasing business costs;
[0050] 3. Privacy protection issues: Customer information contains a large amount of private data. How to ensure accurate entry of information while protecting customer privacy is a difficult problem. The existing masking method for private information has defects. Not adding a mask may lead to privacy leakage, while adding a mask may increase the risk of entry errors, causing inconvenience to agents in verifying information.
[0051] Based on this, how to provide an automatic information entry method, system, computer device and non-volatile computer-readable storage medium that can avoid the defects of manual information entry through automation technology and improve the efficiency, accuracy and security of information entry is a problem that needs to be urgently solved by technical personnel in this field.
[0052] Therefore, to solve the above problem, please refer to Figure 1 The embodiment of the present invention provides a method for automatic information entry, wherein the method comprises the steps of:
[0053] S100, crawling all pages that need to be entered into the business system, and sorting out corresponding crawling information, wherein the crawling information includes the entry element ID of each of the pages;
[0054] S200, based on preset integration information, sorting out the mapping relationship between the input element ID of each page and the integration information and the customer unique identifier to obtain corresponding mapping relationship information;
[0055] S300, when the target page of the business system needs to enter information, extract the target customer unique identifier and the target entry element ID of the target page;
[0056] S400, based on the mapping relationship information, query the target information required to be entered on the target page in the integrated information according to the target customer unique identifier and the target entry element ID;
[0057] S500: Automatically enter the target information into the target page.
[0058] Furthermore, in the automatic information entry method, in step S100, all pages that need to be entered into the business system are crawled, and corresponding crawled information is obtained by sorting, and the crawled information includes the entry element ID of each of the pages, including:
[0059] All pages that need to be entered into the business system are crawled by the crawler component, and the corresponding crawling information is sorted out. The crawling information includes the title, url, and entry element ID of each of the pages.
[0060] In the specific implementation, in this embodiment, all pages that need to be entered into the business system are crawled by the crawler component, and the corresponding crawling information is sorted out. The crawling information includes the title, url, and entry element ID of each of the pages. The specific implementation process is as follows:
[0061] 1) Demand Analysis
[0062] Determine the scope of the business system pages and target fields (title, url, input element ID) that need to be crawled;
[0063] 2) Crawler design
[0064] Design the crawler architecture and choose the appropriate programming language and library (such as Python's Scrapy or BeautifulSoup);
[0065] 3) Configure the crawler
[0066] Set the crawler's crawling strategy, including crawling depth, frequency, user agent, etc.
[0067] 4) Page visits
[0068] The crawler simulates a browser to access the business system page and obtain the page content;
[0069] 5) HTML parsing
[0070] Use HTML parser to parse the page HTML and extract the required information;
[0071] 6) Information Extraction
[0072] According to the page structure, write rules to extract the page title, URL and input element ID;
[0073] Through this process, an efficient, stable and compliant crawler component can be built to automatically extract key information from business system pages.
[0074] Furthermore, in the automatic information entry method, the step S200, based on the preset integration information, sorts out the mapping relationship between the entry element ID of each page and the integration information and the customer unique identifier to obtain the corresponding mapping relationship information, including:
[0075] Pre-extracting unstructured information of the business system and converting the unstructured information into structured information;
[0076] Based on the structured information and historical information extracted in advance from other data sources, corresponding integrated information is obtained;
[0077] Based on the integration information, the mapping relationship between the input element ID of each page and the integration information and the customer unique identifier is sorted to obtain corresponding mapping relationship information.
[0078] In the specific implementation, in this embodiment, the unstructured information of the business system is extracted in advance, and the unstructured information is converted into structured information; based on the structured information and the historical information extracted in advance from other data sources, the corresponding integrated information is sorted out; based on the integrated information, the mapping relationship between the input element ID of each page and the integrated information and the customer unique identifier is sorted out to obtain the corresponding mapping relationship information; wherein, the specific implementation process is as follows:
[0079] 1) Pre-extract unstructured information
[0080] Data collection: Collect unstructured data in business systems, such as call texts, WeChat communication texts, etc.
[0081] Preprocessing: Clean and format unstructured data, such as word segmentation of text, removal of stop words, etc.
[0082] 2) Convert unstructured information into structured information
[0083] Entity recognition: Use natural language processing technology to identify key entities (names, places, times, etc.) from text;
[0084] Relationship extraction: Identify the relationships between entities and transform implicit information in unstructured data into clear structured relationships;
[0085] Data modeling: Design a data model and map the extracted entities and relationships into the model to form structured data;
[0086] 3) Structured information integration
[0087] Historical data extraction: extracting historical information from other data sources, such as customer databases, transaction records, etc.
[0088] Data fusion: Fuse the extracted historical information with the newly extracted structured information to form a complete data set;
[0089] Data cleaning: Clean the integrated data to ensure data consistency and accuracy;
[0090] 4) Establishing mapping relationship
[0091] Mapping rule design: Design the mapping rules for input element ID, integration information and customer unique identifier according to business requirements;
[0092] Mapping implementation: associate the fields in the integrated information related to the customer's unique identifier with the input element ID on the page to establish a mapping relationship;
[0093] Mapping verification: Verify the accuracy of the mapping relationship, ensure that the data can be correctly filled into the corresponding page elements, and organize the corresponding mapping relationship information;
[0094] Through this process, an automated information extraction, integration, and mapping program can be built to improve the efficiency of business system entry, reduce human errors, and ensure the accuracy and security of customer information.
[0095] Furthermore, the automatic information entry method, wherein the pre-extracting of the unstructured information of the business system and converting the unstructured information into structured information, comprises:
[0096] The Bert model is used in advance to extract unstructured information from the call text and / or WeChat communication text of the business system, and the unstructured information is converted into structured information.
[0097] Furthermore, the automatic information entry method, wherein the Bert model is used in advance to extract unstructured information from the call text and / or WeChat communication text of the business system, and the unstructured information is converted into structured information, wherein:
[0098] The unstructured information includes customer name, ID card information, license plate information, address information, and purchase intention, etc.
[0099] In the specific implementation, in this embodiment, the Bert model is used in advance to extract unstructured information from the call text and / or WeChat communication text of the business system, and the unstructured information is converted into structured information. The specific implementation process is as follows:
[0100] 1) Data collection and preprocessing
[0101] Collect text data: collect call text transcriptions and WeChat communication texts in business systems;
[0102] Text cleaning: preprocessing text data, including removing irrelevant characters, punctuation marks, correcting typos, etc.
[0103] 2) Define labeling rules
[0104] Determine entity type: define the entity type to be extracted, such as customer name, ID number, license plate number, address, purchase intention, etc.
[0105] Label samples: select samples from text data for manual labeling to train the Bert model;
[0106] 3) Training the Bert model
[0107] Select a pre-trained model: Select a suitable Bert pre-trained model as the basis;
[0108] Fine-tuning the model: Use labeled sample data to fine-tune the Bert model to adapt to specific information extraction tasks;
[0109] 4) Entity Recognition and Information Extraction
[0110] Run the model: Apply the Bert model to the entire text dataset to identify and extract relevant entities such as customer names, ID numbers, license plate numbers, and addresses;
[0111] For non-physical information such as purchase intention, intent recognition can be performed to determine whether a specific intention or demand is expressed in the text;
[0112] 5) Structured information generation
[0113] Information structuring: Convert the identified entities and intents into a structured format, such as JSON or a database table, for easy storage and further processing;
[0114] Through this process, key information can be effectively extracted from unstructured communication texts and converted into structured data that can be used in business processes, improving efficiency and reducing manual entry errors; at the same time, ensuring the security and privacy of customer data.
[0115] Furthermore, the automatic information entry method, wherein the step S300, when the target page of the business system needs to enter information, extracts the target customer unique identifier and the target entry element ID of the target page, comprises:
[0116] When the target page of the business system needs to enter information, the target customer unique identifier and the target entry element ID of the target page are extracted through the jsagent embedded in the target page.
[0117] In specific implementation, in this embodiment, when the target page of the business system needs to enter information, the target customer unique identifier and the target entry element ID of the target page are extracted through the js agent embedded in the target page, wherein the specific implementation process is as follows:
[0118] 1) Target page analysis
[0119] Page structure analysis: Analyze the HTML structure of the target page to determine the location of the target customer's unique ID and the target input element ID;
[0120] 2) js agent development
[0121] Write javascript code: develop js agent to automatically perform extraction tasks when the page is loaded;
[0122] 3) Extraction of customer unique identifier
[0123] Define identifier rules: determine the source of the target customer's unique identifier, such as URL parameters, form fields, hidden elements, etc.
[0124] Implement extraction logic: Implement logic in the js agent to find and extract the unique identifier of the target customer;
[0125] 4) Enter element ID to extract
[0126] Determine the input elements: Identify all elements on the target page that require input information and their IDs;
[0127] Write an extraction script: Write a script in the js agent to collect all target input element IDs;
[0128] 5) Embed the page in js agent
[0129] Embed code: put the js agent code in <script>标签的形式嵌入到目标页面的HTML中;
[0130] 通过这一过程,可以实现自动化提取目标页面上的关键信息,并为后续的自动化填充或数据处理提供基础;这种方式可以显著提高数据录入的效率,减少人为错误,并改善用户体验。
[0131] 进一步地,所述的信息自动录入方法,其中,所述步骤S400、基于所述映射关系信息,根据所述目标客户唯一标识及所述目标录入元素ID于所述整合信息中查询得到所述目标页面所需录入的目标信息;
[0132] 具体实施时,本实施例中,当得到对应的映射关系信息、以及目标页面的目标客户唯一标识与目标录入元素ID之后,然后,基于所述映射关系信息,再根据所述目标客户唯一标识及所述目标录入元素ID于所述整合信息中查询得到所述目标页面所需录入的目标信息。
[0133] 进一步地,所述的信息自动录入方法,其中,所述步骤S500、将所述目标信息自动录入所述目标页面,包括:
[0134] 通过所述js agent将所述目标信息自动录入所述目标页面。
[0135] 具体实施时,本实施例中,通过所述js agent将所述目标信息自动录入所述目标页面,其中,具体的实现过程如下:
[0136] 1)数据接收与处理
[0137] js agent接收返回的目标信息,并进行必要的处理和格式化,以适应目标页面的录入要求;
[0138] 2)自动填充逻辑实现
[0139] 在js agent中实现自动填充逻辑,根据目标录入元素ID将目标信息填充到对应的页面元素中;
[0140] 3)事件触发
[0141] 当然,也可根据需要,监听某些事件(如页面加载完成、用户点击按钮等)来触发自动填充;
[0142] 4)用户界面反馈
[0143] 在自动填充后,更新用户界面,可以包括禁用编辑、显示确认信息等;
[0144] 5)安全性考虑
[0145] 确保数据传输安全,使用HTTPS等加密协议,对敏感信息进行加密处理,防止数据泄露;
[0146] 6)异常处理
[0147] 实现异常处理机制,当自动填充失败时提供用户友好的错误提示;
[0148] 通过这一过程,可以实现在目标页面上自动化录入目标信息,减少人工手动输入的工作量,降低出错率,提高效率;同时,确保了操作的安全性和用户的良好体验。
[0149] 由以上方法实施例可知,本发明提供的信息自动录入方法,至少包括:爬取需要录入业务系统的所有页面,并整理得到对应的爬取信息,所述爬取信息包括各所述页面的录入元素ID;基于预设的整合信息,整理各所述页面的所述录入元素ID与所述整合信息及客户唯一标识的映射关系,得到对应的映射关系信息;当所述业务系统的目标页面需要录入信息时,则提取所述目标页面的目标客户唯一标识及目标录入元素ID;基于所述映射关系信息,根据所述目标客户唯一标识及所述目标录入元素ID于所述整合信息中查询得到所述目标页面所需录入的目标信息;将所述目标信息自动录入所述目标页面;等等。这样,通过本发明的方法可通过自动化技术避免人工录入信息的缺陷,并提高信息录入的效率、准确性及安全性。
[0150] 具体地,本发明实施例提供的信息自动录入方法,至少可实现如下有益的技术效果:
[0151] 1、本发明利用AI将非结构化数据提取为结构化数据,方便后续工作的数据分析统计使用;
[0152] 2、本发明自动帮助坐席录入,可减轻坐席的录入工作,提升坐席作业效率;
[0153] 3、本发明自动录入的信息会自动增加掩码,坐席可以进行前后部分内容的核对,既能保证信息正确性又可解决隐私暴露的风险(防止隐私信息被偷窥);
[0154] 4、本发明使用统一的方案进行信息录入,在系统维护修改时,只需要进行简单的配置,无需再次开发,同时也可以推广至其他系统使用。
[0155] 应该理解的是,虽然本申请提供了如实施例或流程图所述的方法操作步骤,但基于常规或者无创造性的劳动可以包括更多或者更少的操作步骤,这些操作步骤并不是必然按照实施例或流程图的顺序依次执行。实施例或流程图中列举的步骤顺序仅仅为众多步骤执行顺序中的一种方式,不代表唯一的执行顺序。需要说明的是,上述各步骤之间并不必然存在一定的先后顺序,本领域普通技术人员,根据本发明实施例的描述可以理解,不同实施例中,上述各步骤可以有不同的执行顺序,亦即,可以并行执行,亦可以交换执行等等。而且,实施例或流程图中的至少一部分步骤可以包括多个子步骤或者多个阶段,这些子步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些子步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤的子步骤或者阶段的至少一部分轮流、交替或者同步地执行。
[0156] 基于上述方法实施例,请参阅图2,本发明另一实施例还提供了一种信息自动录入系统,其中,所述系统包括:
[0157] 爬取模块11,用于爬取需要录入业务系统的所有页面,并整理得到对应的爬取信息,所述爬取信息包括各所述页面的录入元素ID;
[0158] 整理模块12,用于基于预设的整合信息,整理各所述页面的所述录入元素ID与所述整合信息及客户唯一标识的映射关系,得到对应的映射关系信息;
[0159] 提取模块13,用于当所述业务系统的目标页面需要录入信息时,则提取所述目标页面的目标客户唯一标识及目标录入元素ID;
[0160] 查询模块14,用于基于所述映射关系信息,根据所述目标客户唯一标识及所述目标录入元素ID于所述整合信息中查询得到所述目标页面所需录入的目标信息;
[0161] 录入模块15,用于将所述目标信息自动录入所述目标页面。
[0162] 进一步地,所述的信息自动录入系统,其中,所述爬取需要录入业务系统的所有页面,并整理得到对应的爬取信息,所述爬取信息包括各所述页面的录入元素ID,包括:
[0163] 通过爬虫组件爬取需要录入业务系统的所有页面,并整理得到对应的爬取信息,所述爬取信息包括各所述页面的title、url、及录入元素ID。
[0164] 具体实施时,本实施例中,通过爬虫组件爬取需要录入业务系统的所有页面,并整理得到对应的爬取信息,所述爬取信息包括各所述页面的title、url、及录入元素ID,其中,具体的实现过程如下:
[0165] 1)需求分析
[0166] 确定需要爬取的业务系统页面范围和目标字段(title、url、录入元素ID);
[0167] 2)爬虫设计
[0168] 设计爬虫的架构,选择合适的编程语言和库(如Python的Scrapy或BeautifulSoup);
[0169] 3)配置爬虫
[0170] 设置爬虫的爬取策略,包括爬取深度、频率、用户代理(UserAgent)等;
[0171] 4)页面访问
[0172] 爬虫模拟浏览器访问业务系统页面,获取页面内容;
[0173] 5)HTML解析
[0174] 使用HTML解析器解析页面HTML,提取所需的信息;
[0175] 6)信息提取
[0176] 根据页面结构,编写规则提取页面的title、url和录入元素ID;
[0177] 通过这一过程,可以构建一个高效、稳定且符合规范的爬虫组件,用于自动化提取业务系统页面的关键信息。
[0178] 进一步地,所述的信息自动录入系统,其中,所述基于预设的整合信息,整理各所述页面的所述录入元素ID与所述整合信息及客户唯一标识的映射关系,得到对应的映射关系信息,包括:
[0179] 预先提取所述业务系统的非结构化信息,并将所述非结构化信息转化为结构化信息;
[0180] 基于所述结构化信息以及预先从其他数据源抽取的历史信息,整理得到对应的整合信息;
[0181] 基于所述整合信息,整理各所述页面的所述录入元素ID与所述整合信息及客户唯一标识的映射关系,得到对应的映射关系信息。
[0182] 具体实施时,本实施例中,预先提取所述业务系统的非结构化信息,并将所述非结构化信息转化为结构化信息;基于所述结构化信息以及预先从其他数据源抽取的历史信息,整理得到对应的整合信息;基于所述整合信息,整理各所述页面的所述录入元素ID与所述整合信息及客户唯一标识的映射关系,得到对应的映射关系信息;其中,具体的实现过程如下:
[0183] 1)预先提取非结构化信息
[0184] 数据收集:收集业务系统中的非结构化数据,如通话文本、微信沟通文本等;
[0185] 预处理:对非结构化数据进行清洗和格式化,如文本的分词、去除停用词等;
[0186] 2)非结构化信息转化为结构化信息
[0187] 实体识别:使用自然语言处理技术从文本中识别出关键实体(人名、地点、时间等);
[0188] 关系抽取:识别实体之间的关系,将非结构化数据中的隐含信息转化为明确的结构化关系;
[0189] 数据建模:设计数据模型,将提取的实体和关系映射到模型中,形成结构化数据;
[0190] 3)结构化信息整合
[0191] 历史数据抽取:从其他数据源抽取历史信息,如客户数据库、交易记录等;
[0192] 数据融合:将抽取的历史信息与新提取的结构化信息进行融合,形成完整的数据集;
[0193] 数据清洗:对整合后的数据进行清洗,确保数据的一致性和准确性;
[0194] 4)映射关系建立
[0195] 映射规则设计:根据业务需求,设计录入元素ID与整合信息及客户唯一标识的映射规则;
[0196] 映射实施:将客户唯一标识相关的整合信息中的字段与页面上的录入元素ID进行关联,建立映射关系;
[0197] 映射验证:验证映射关系的准确性,确保数据能够正确填充到相应的页面元素中,整理得到对应的映射关系信息;
[0198] 通过这一过程,可以构建一个自动化的信息提取、整合和映射程序,进而提高业务系统的录入效率,减少人为错误,并确保客户信息的准确性和安全性。
[0199] 进一步地,所述的信息自动录入系统,其中,所述预先提取所述业务系统的非结构化信息,并将所述非结构化信息转化为结构化信息,包括:
[0200] 预先利用Bert模型从所述业务系统的通话文本和 / 或微信沟通文本中提取非结构化信息,并将所述非结构化信息转化为结构化信息。
[0201] 进一步地,所述的信息自动录入系统,其中,所述预先利用Bert模型从所述业务系统的通话文本和 / 或微信沟通文本中提取非结构化信息,并将所述非结构化信息转化为结构化信息,其中,
[0202] 所述非结构化信息包括客户姓名、身份证信息、车牌信息、住址信息、及购买意向等。
[0203] 具体实施时,本实施例中,预先利用Bert模型从所述业务系统的通话文本和 / 或微信沟通文本中提取非结构化信息,并将所述非结构化信息转化为结构化信息,其中,具体的实现过程如下:
[0204] 1)数据收集与预处理
[0205] 收集文本数据:搜集业务系统中的通话文本转录和微信沟通文本;
[0206] 文本清洗:对文本数据进行预处理,包括去除无关字符、标点符号、纠正错别字等;
[0207] 2)定义标注规则
[0208] 确定实体类型:定义需要提取的实体类型,如客户姓名、身份证号、车牌号、住址、购买意向等;
[0209] 标注样本:从文本数据中选取样本进行人工标注,以训练Bert模型;
[0210] 3)训练Bert模型
[0211] 选择预训练模型:选择适合的Bert预训练模型作为基础;
[0212] 微调模型:使用标注好的样本数据对Bert模型进行微调,以适应特定的信息提取任务;
[0213] 4)实体识别与信息提取
[0214] 运行模型:将Bert模型应用于整个文本数据集,识别并提取相关的客户姓名、身份证号码、车牌号码和住址等实体;
[0215] 对于购买意向等非实体信息,可以进行意图识别,判断文本中是否表达了某种特定的意图或需求;
[0216] 5)结构化信息生成
[0217] 信息结构化:将识别出的实体与意图转换为结构化的格式,如JSON或数据库表格,以便于存储和进一步处理;
[0218] 通过这一过程,可以有效地从非结构化的通信文本中提取关键信息,并将其转化为可用于业务流程的结构化数据,提高效率并减少手动录入的错误;同时,确保了客户数据的安全和隐私。
[0219] 进一步地,所述的信息自动录入系统,其中,所述当所述业务系统的目标页面需要录入信息时,则提取所述目标页面的目标客户唯一标识及目标录入元素ID,包括:
[0220] 当所述业务系统的目标页面需要录入信息时,则通过所述目标页面内嵌的jsagent提取所述目标页面的目标客户唯一标识及目标录入元素ID。
[0221] 具体实施时,本实施例中,当所述业务系统的目标页面需要录入信息时,则通过所述目标页面内嵌的js agent提取所述目标页面的目标客户唯一标识及目标录入元素ID,其中,具体的实现过程如下:
[0222] 1)目标页面分析
[0223] 页面结构分析:分析目标页面的HTML结构,确定目标客户唯一标识和目标录入元素ID的位置;
[0224] 2)js agent开发
[0225] 编写javascript代码:开发js agent,使其能够在页面加载时自动执行提取任务;
[0226] 3)客户唯一标识提取
[0227] 定义标识符规则:确定目标客户唯一标识的来源,如URL参数、表单字段、隐藏元素等;
[0228] 实现提取逻辑:在js agent中实现逻辑,用于查找并提取目标客户唯一标识;
[0229] 4)录入元素ID提取
[0230] 确定录入元素:识别目标页面上所有需要录入信息的元素及其ID;
[0231] 编写提取脚本:在js agent中编写脚本,用于收集所有目标录入元素ID;
[0232] 5)js agent内嵌入页面
[0233] 内嵌代码:将js agent的代码以<script>标签的形式嵌入到目标页面的HTML中;
[0234] 通过这一过程,可以实现自动化提取目标页面上的关键信息,并为后续的自动化填充或数据处理提供基础;这种方式可以显著提高数据录入的效率,减少人为错误,并改善用户体验。
[0235] 进一步地,所述的信息自动录入系统,其中,所述基于所述映射关系信息,根据所述目标客户唯一标识及所述目标录入元素ID于所述整合信息中查询得到所述目标页面所需录入的目标信息;
[0236] 具体实施时,本实施例中,当得到对应的映射关系信息、以及目标页面的目标客户唯一标识与目标录入元素ID之后,然后,基于所述映射关系信息,再根据所述目标客户唯一标识及所述目标录入元素ID于所述整合信息中查询得到所述目标页面所需录入的目标信息。
[0237] 进一步地,所述的信息自动录入系统,其中,所述将所述目标信息自动录入所述目标页面,包括:
[0238] 通过所述js agent将所述目标信息自动录入所述目标页面。
[0239] 具体实施时,本实施例中,通过所述js agent将所述目标信息自动录入所述目标页面,其中,具体的实现过程如下:
[0240] 1)数据接收与处理
[0241] js agent接收返回的目标信息,并进行必要的处理和格式化,以适应目标页面的录入要求;
[0242] 2)自动填充逻辑实现
[0243] 在js agent中实现自动填充逻辑,根据目标录入元素ID将目标信息填充到对应的页面元素中;
[0244] 3)事件触发
[0245] 当然,也可根据需要,监听某些事件(如页面加载完成、用户点击按钮等)来触发自动填充;
[0246] 4)用户界面反馈
[0247] 在自动填充后,更新用户界面,可以包括禁用编辑、显示确认信息等;
[0248] 5)安全性考虑
[0249] 确保数据传输安全,使用HTTPS等加密协议,对敏感信息进行加密处理,防止数据泄露;
[0250] 6)异常处理
[0251] 实现异常处理机制,当自动填充失败时提供用户友好的错误提示;
[0252] 通过这一过程,可以实现在目标页面上自动化录入目标信息,减少人工手动输入的工作量,降低出错率,提高效率;同时,确保了操作的安全性和用户的良好体验。
[0253] 由以上系统实施例可知,本发明提供的信息自动录入系统,至少包括:爬取需要录入业务系统的所有页面,并整理得到对应的爬取信息,所述爬取信息包括各所述页面的录入元素ID;基于预设的整合信息,整理各所述页面的所述录入元素ID与所述整合信息及客户唯一标识的映射关系,得到对应的映射关系信息;当所述业务系统的目标页面需要录入信息时,则提取所述目标页面的目标客户唯一标识及目标录入元素ID;基于所述映射关系信息,根据所述目标客户唯一标识及所述目标录入元素ID于所述整合信息中查询得到所述目标页面所需录入的目标信息;将所述目标信息自动录入所述目标页面;等等。这样,通过本发明的系统可通过自动化技术避免人工录入信息的缺陷,并提高信息录入的效率、准确性及安全性。
[0254] 具体地,本发明实施例提供的信息自动录入系统,至少可实现如下有益的技术效果:
[0255] 1、本发明利用AI将非结构化数据提取为结构化数据,方便后续工作的数据分析统计使用;
[0256] 2、本发明自动帮助坐席录入,可减轻坐席的录入工作,提升坐席作业效率;
[0257] 3、本发明自动录入的信息会自动增加掩码,坐席可以进行前后部分内容的核对,既能保证信息正确性又可解决隐私暴露的风险(防止隐私信息被偷窥);
[0258] 4、本发明使用统一的方案进行信息录入,在系统维护修改时,只需要进行简单的配置,无需再次开发,同时也可以推广至其他系统使用。
[0259] 基于上述方法实施例,请参阅图3,本发明另一实施例还提供了一种计算机设备,其中,所述计算机设备10包括:
[0260] 存储器120以及一个或多个处理器110,图3中以一个处理器110为例进行介绍,处理器110和存储器120可以通过通信总线或者其他方式连接,图3中以通过通信总线连接为例。
[0261] 处理器110用于完成计算机设备10的各种控制逻辑,其可以为通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)、单片机、ARM(Acorn RISCMachine)或其它可编程逻辑器件、分立门或晶体管逻辑、分立的硬件组件或者这些部件的任何组合。还有,处理器110还可以是任何传统处理器、微处理器或状态机。处理器110也可以被实现为计算设备的组合,例如,DSP和微处理器的组合、多个微处理器、一个或多个微处理器结合DSP、或任何其它这种配置。
[0262] 存储器120作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块,如本发明实施例中的信息自动录入方法对应的计算机程序。处理器110通过运行存储在存储器120中的非易失性软件程序、指令以及单元,从而执行计算机设备10的各种功能应用以及数据处理,即实现上述方法实施例中的信息自动录入方法。
[0263] 存储器120可以包括存储程序区和存储数据区,其中,存储程序区可存储操作装置、至少一个功能所需要的应用程序;存储数据区可存储根据计算机设备10使用所创建的数据等。此外,存储器120可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器120可选包括相对于处理器110远程设置的存储器,这些远程存储器可以通过网络连接至计算机设备10。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
[0264] 一个或者多个单元存储在存储器120中,当被一个或者多个处理器110执行时,可实现如上述任一项方法实施例中的信息自动录入方法,例如,可实现以上描述的图1中的方法步骤S100至步骤S500。
[0265] 本领域技术人员可以理解,图3中示出的硬件结构示意图,仅仅是与本发明方案相关的部分结构的示意图,并不构成对本发明方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多的部件,或者组合某些部件,或者具有不同的部件布置。
[0266] 基于上述方法实施例,本发明另一实施例还提供了一种非易失性计算机可读存储介质,其中,所述非易失性计算机可读存储介质存储有计算机程序,所述计算机程序被至少一个处理器执行时,可实现如上述任一项方法实施例中的信息自动录入方法,例如,可实现以上描述的图1中的方法步骤S100至步骤S500。
[0267] 作为示例,非易失性存储介质能够包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦ROM(EEPROM)或闪速存储器。易失性存储器能够包括作为外部高速缓存存储器的随机存取存储器(RAM)。通过说明并非限制,RAM可以以诸如同步RAM(SRAM)、动态RAM、(DRAM)、同步DRAM(SDRAM)、双数据速率SDRAM(DDR SDRAM)、增强型SDRAM(ESDRAM)、Synch link DRAM(SLDRAM)以及直接Rambus(兰巴斯)RAM(DRRAM)之类的许多形式得到。本文中所描述的操作环境的所公开的存储器组件或存储器旨在包括这些和 / 或任何其他适合类型的存储器中的一个或多个。
[0268] 基于上述方法实施例,本发明另一实施例还提供了一种计算机程序产品,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被处理器执行时,可实现如上述任一项方法实施例中的信息自动录入方法,例如,可实现以上描述的图1中的方法步骤S100至步骤S500。
[0269] 以上所描述的实施例仅仅是示意性的,其中作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际需要选择其中的部分或者全部模块来实现本实施例方案的目的。
[0270] 通过以上的实施例的描述,本领域的技术人员可以清楚地了解到各实施例可借助软件加通用硬件平台的方式来实现,当然也可以通过硬件实现。基于这样的理解,上述技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存在于计算机可读存储介质中,如ROM / RAM、磁碟、光盘等,包括若干指令用以使得一台计算机装置(可以是个人计算机,服务器,或者网络装置等)执行各个实施例或者实施例的某些部分的方法。
[0271] 除了其他之外,诸如"能够”、"能”、"可能”或"可以”之类的条件语言除非另外具体地陈述或者在如所使用的上下文内以其他方式理解,否则一般地旨在传达特定实施方式能包括(然而其他实施方式不包括)特定特征、元件和 / 或操作。因此,这样的条件语言一般地还旨在暗示特征、元件和 / 或操作对于一个或多个实施方式无论如何都是需要的或者一个或多个实施方式必须包括用于在有或没有输入或提示的情况下判定这些特征、元件和 / 或操作是否被包括或者将在任何特定实施方式中被执行的逻辑。
[0272] 已经在本文中、在本说明书和附图中描述的内容包括能够提供一种信息自动录入方法、系统、计算机设备以及非易失性计算机可读存储介质的示例。当然,不能够出于描述本公开的各种特征的目的来描述元件和 / 或方法的每个可以想象的组合,但是可以认识到,所公开的特征的许多另外的组合和置换是可能的。因此,显而易见的是,在不脱离本公开的范围或精神的情况下能够对本公开做出各种修改,但是,所有这些各种修改都应属于本发明所附权利要求的保护范围。此外,或在替代方案中,本公开的其他实施例从对本说明书和附图的考虑以及如本文中所呈现的本公开的实践中可能是显而易见的。意图是,本说明书和附图中所提出的示例在所有方面被认为是说明性的而非限制性的。尽管在本文中采用了特定术语,但是它们在通用和描述性意义上被使用并且不用于限制的目的。< / script>
Claims
1. A method for automatic information entry, characterized in that: include: Crawl all pages that need to be entered into the business system, and organize corresponding crawling information, wherein the crawling information includes the entry element ID of each of the pages; Based on the preset integration information, the mapping relationship between the input element ID of each page and the integration information and the customer unique identifier is sorted to obtain corresponding mapping relationship information; When the target page of the business system needs to enter information, the target customer unique identifier and the target entry element ID of the target page are extracted; Based on the mapping relationship information, the target information required to be entered on the target page is queried in the integrated information according to the target customer unique identifier and the target entry element ID; The target information is automatically entered into the target page.
2. The method for automatic information entry according to claim 1, characterized in that: The crawling needs to enter all pages of the business system, and organizes the corresponding crawling information, the crawling information includes the entry element ID of each page, including: All pages that need to be entered into the business system are crawled by the crawler component, and the corresponding crawling information is sorted out. The crawling information includes the title, url, and entry element ID of each of the pages.
3. The method for automatic information entry according to claim 1, characterized in that: Based on the preset integration information, the mapping relationship between the input element ID of each page and the integration information and the customer unique identifier is sorted to obtain corresponding mapping relationship information, including: Pre-extracting unstructured information of the business system and converting the unstructured information into structured information; Based on the structured information and historical information extracted in advance from other data sources, corresponding integrated information is obtained; Based on the integration information, the mapping relationship between the input element ID of each page and the integration information and the customer unique identifier is sorted to obtain corresponding mapping relationship information.
4. The method for automatic information entry according to claim 3, characterized in that: When the target page of the business system needs to enter information, the target customer unique identifier and the target entry element ID of the target page are extracted, including: When the target page of the business system needs to enter information, the target customer unique identifier and the target entry element ID of the target page are extracted through the js agent embedded in the target page.
5. The method for automatic information entry according to claim 4, characterized in that: The step of automatically entering the target information into the target page includes: The target information is automatically entered into the target page through the js agent.
6. The automatic information entry method according to claim 3, 4 or 5, characterized in that: The pre-extracting of the unstructured information of the business system and converting the unstructured information into structured information includes: The Bert model is used in advance to extract unstructured information from the call text and / or WeChat communication text of the business system, and the unstructured information is converted into structured information.
7. The method for automatic information entry according to claim 6, characterized in that: The Bert model is used in advance to extract unstructured information from the call text and / or WeChat communication text of the business system, and the unstructured information is converted into structured information, wherein: The unstructured information includes customer name, ID card information, license plate information, address information, and purchase intention.
8. An automatic information entry system, characterized in that: include: A crawling module is used to crawl all pages that need to be entered into the business system, and to organize the corresponding crawling information, wherein the crawling information includes the entry element ID of each of the pages; A sorting module, used for sorting the mapping relationship between the input element ID of each page and the integration information and the customer unique identifier based on the preset integration information, and obtaining corresponding mapping relationship information; An extraction module, used for extracting a target customer unique identifier and a target entry element ID of the target page when the target page of the business system needs to enter information; A query module, configured to query the integrated information based on the mapping relationship information, the target customer unique identifier and the target entry element ID to obtain the target information required to be entered on the target page; An input module is used to automatically input the target information into the target page.
9. A computer device, characterized in that: The computer device comprises at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor. When the computer program is executed by the at least one processor, the automatic information entry method according to any one of claims 1 to 7 can be implemented.
10. A non-volatile computer-readable storage medium, characterized in that: The non-volatile computer-readable storage medium stores a computer program, and when the computer program is executed by at least one processor, the automatic information entry method according to any one of claims 1 to 7 can be implemented.