Search service configuration method and device, equipment and medium

Abstract

The invention relates to a search service configuration method and device, equipment and a medium, and the method comprises the steps: obtaining user configuration information submitted through an interaction page, and extracting business data parameters and environment deployment parameters corresponding to a search service; respectively converting the service data parameters and the environment deployment parameters into an executable service configuration file and an environment configuration file by applying a conversion template; respectively applying and deploying the business configuration file and the environment configuration file to an offline data synchronization service and an online query service corresponding to the search service; and starting the online query service to open the search service to a terminal user through the online query service. According to the method and the device, service configuration and environment configuration are separated for independent configuration management, so that the configuration flexibility and the system maintainability are improved.

Description

Technical Field

[0001] The present application relates to the field of e-commerce information technology, and in particular to a search service configuration method and its device, equipment, and medium. Background Art

[0002] With the rapid development of e-commerce, more and more business domains need to access search services for online queries. However, the way to access search services by writing code is not only difficult for non-technical users to understand, but also difficult to master quickly. In order to overcome this problem, the search platform introduces easy-to-understand visual interactive pages, shielding complex search domain knowledge to simplify the complex search configuration process, allowing users to easily configure search services through intuitive visual pages, thereby meeting the rapid growth of business needs.

[0003] In traditional search service configuration methods, business configuration and environment configuration are often tightly coupled, which makes configuration management complicated and difficult to adapt to the rapid changes in business needs. When business needs change, the entire search service system usually needs to be reconfigured, which is not only inefficient but also increases the risk of errors. In addition, due to the lack of independent management of configuration files, any small configuration change may cause instability in the entire system, thereby affecting the performance and reliability of the search service. Summary of the invention

[0004] The purpose of this application is to provide a search service configuration method and its device, equipment, and medium.

[0005] According to one aspect of the present application, a search service configuration method is provided, comprising:

[0006] Obtain user configuration information submitted through the interactive page, and extract business data parameters and environment deployment parameters corresponding to the search service, wherein the business data parameters define data business logic corresponding to the business data required by the search service from the data source, and the environment deployment parameters define environment business logic corresponding to the search engine executing the search for the business data;

[0007] Applying the conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively;

[0008] The business configuration file and the environment configuration file are respectively applied and deployed to the offline data synchronization service and the online query service corresponding to the search service, the online query service implements the business logic of searching by using the business data, and the offline data synchronization service implements data synchronization and update from the data source to the business data;

[0009] The online query service is started to open the search service to the terminal user through the online query service.

[0010] According to another aspect of the present application, a search service configuration device is provided, including:

[0011] A parameter extraction module is used to obtain user configuration information submitted through an interactive page, and extract business data parameters and environment deployment parameters corresponding to the search service, wherein the business data parameters define the data business logic corresponding to the business data required by the search service from the data source, and the environment deployment parameters define the environment business logic corresponding to the search engine executing the search for the business data;

[0012] An executable configuration file generation module, used to apply a conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively;

[0013] A configuration file deployment module, used to deploy the business configuration file and the environment configuration file to the offline data synchronization service and the online query service corresponding to the search service, respectively, so that the online query service implements the business logic of searching using the business data, and the offline data synchronization service implements data synchronization and update from the data source to the business data;

[0014] The online query service starting module is used to start the online query service to open the search service to the terminal user through the online query service.

[0015] According to another aspect of the present application, a computer device is provided to meet one of the purposes of the present application, including a central processing unit and a memory, wherein the central processing unit is used to call and run a computer program stored in the memory to execute the steps of the search service configuration method described in the present application.

[0016] According to another aspect of the present application, a computer-readable storage medium is provided to meet another purpose of the present application, which stores a computer program implemented according to the search service configuration method in the form of computer-readable instructions, and when the computer program is called and executed by a computer, it executes the steps included in the method.

[0017] The technical solution of this application has many advantages, including but not limited to the following aspects:

[0018] Different from the traditional search service configuration method, the present application extracts the business data parameters and environment deployment parameters from the user configuration information submitted by the user on the interactive page, and then uses the conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively. Through the implementation of this step, the business configuration and environment configuration are separated, and then the business configuration file and environment configuration file are respectively deployed to the offline data synchronization service and online query service corresponding to the search service to achieve independent management of the business configuration and environment configuration. When the business configuration file or the environment configuration file changes, the business configuration or the environment configuration can be updated independently without reconfiguring the entire search service, thereby improving the configuration flexibility and the maintainability of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 A schematic diagram of a typical network deployment architecture related to implementing the technical solution of this application;

[0021] Figure 2 A flowchart of a typical embodiment of the search service configuration method of the present application;

[0022] Figure 3 A schematic diagram of a process for generating business data required for a search service in an embodiment of the present application;

[0023] Figure 4 A schematic diagram of a process for generating a configuration file in an embodiment of the present application;

[0024] Figure 5 A flowchart of deploying a search service by responding to a version update event in an embodiment of the present application;

[0025] Figure 6 This is a flow chart of gradually switching a user request from an old service to a new service in an embodiment of the present application;

[0026] Figure 7 A schematic diagram of the process of parsing a configuration file for deployment in an embodiment of the present application;

[0027] Figure 8 This is a flowchart of testing the search service in an embodiment of the present application;

[0028] Fig. 9A block diagram of the search service configuration device of the present application;

[0029] Fig.10 A schematic diagram of the structure of a computer device used in this application. DETAILED DESCRIPTION

[0030] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be interpreted as limiting the present application.

[0031] It will be understood by those skilled in the art that, unless expressly stated, the singular forms "one", "said", and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present application refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be an intermediate element. In addition, the "connection" or "coupling" used herein may include wireless connection or wireless coupling. The term "and / or" used herein includes all or any unit and all combinations of one or more associated listed items.

[0032] It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as those generally understood by those skilled in the art to which this application belongs. It should also be understood that terms such as those defined in general dictionaries should be understood to have meanings consistent with those in the context of the prior art, and will not be interpreted with idealized or overly formal meanings unless specifically defined as here.

[0033] Those skilled in the art should be aware that, although the various methods of the present application are described based on the same concept and thus present commonality to each other, unless otherwise specified, these methods can be independently executed. Similarly, for each embodiment disclosed in the present application, they are all proposed based on the same inventive concept, therefore, concepts with the same expression, and concepts that are appropriately changed for convenience despite different expressions, should be understood as equivalent.

[0034] Unless the mutually exclusive relationship between the embodiments to be disclosed in this application is explicitly stated, the relevant technical features involved in each embodiment can be cross-combined to flexibly construct a new embodiment, as long as such combination does not deviate from the creative spirit of this application and can meet the needs of the prior art or solve certain deficiencies in the prior art. Those skilled in the art should be aware of this flexibility.

[0035] See also Figure 1 The hardware foundation required for the implementation of the relevant technical solutions of this application can be deployed according to the architecture shown in the figure, including an independent station 80, a configuration server 81 and a consumer user's terminal device 82. The technical solution of this application uses the operating environment of the e-commerce platform as its application environment. The e-commerce platform can implement its corresponding independent station 80 for each merchant to run its corresponding online store; provide merchants with corresponding search service instances for merchants to establish, maintain and run one or more independent stations 80. The search service instance can be configured in the independent station 80 through interfaces or built-in components. The search service instance is configured in a configuration server 81, which runs a configuration system. The configuration system can receive configuration information input by the user, generate business configuration files and environment configuration files based on the configuration information input by the user, and deploy the generated business configuration files and environment configuration files in the configuration server 81 to the offline data synchronization service and online query service corresponding to the search service instance. The deployed search service instance is a core component that the independent station relies heavily on. Tens of thousands of independent stations 80 can share the search service. The search service can be presented in the independent station 80 for terminal users through interfaces or built-in components. The terminal user can access the web page of the online store implemented by the e-commerce platform through his terminal device 82, and trigger the search process through the search box provided on the web page to realize the search function.

[0036] See also Figure 2 A search service configuration method of the present application, in its typical embodiment, comprises the following steps:

[0037] Step S1100: Obtain user configuration information submitted through the interactive page, and extract business data parameters and environment deployment parameters corresponding to the search service, wherein the business data parameters define data business logic corresponding to the business data required by the search service from the data source, and the environment deployment parameters define environment business logic corresponding to the search engine executing the search for the business data;

[0038] In this typical embodiment, user configuration information refers to configuration information input by the user in a visual input component of an interactive page, wherein the user inputs configuration information required for the search service through input components such as text boxes, drop-down menus, radio buttons, check boxes, etc. in the interactive page. For example, a check box allows the user to select one or more buttons from a group of options, wherein the check box options include exact retrieval, range retrieval, and fuzzy retrieval. A retrieval method is configured for each table field by selecting one or more buttons in the options, thereby determining a set of retrieval rules for the search service. This step is to visualize a check box component in the interactive page for the user to input to configure the retrieval method for each table field. Thus, the configuration information required for the search service input by the user can be obtained by means of a visual input component. In one embodiment, the user configuration information obtained includes business configuration information and environment configuration information, wherein the business configuration information refers to the configuration information related to the business data required by the search service and input by the user in the input component, wherein the business data required by the search service in this embodiment refers to the data stored in the target data warehouse in the following specific implementation mode, that is, the business data obtained after executing the offline data synchronization service, and the source database corresponding to the business data can be a product information library in an independent station, which stores a full amount of product information, and the business data is usually part of the information extracted from the product information library according to the business, for example, the call for key data corresponding to the product advertisement is extracted from the product information library, which includes fields such as the product picture, product title, product price, product page link, etc., that is, a business data table can be defined according to the fields; the environment configuration information refers to the configuration information related to the search engine environment required by the search service and input by the user in the input component, and the environment The configuration information includes the corresponding retrieval rules when the search engine searches the business data. The retrieval rules are the retrieval methods for each field in the business data. The retrieval methods include precise retrieval, range retrieval, and fuzzy retrieval, etc. The search engine can use the search rules to retrieve the corresponding results from the business data, and then extract the business data parameters and environment deployment parameters corresponding to the search service from the business configuration information and environment configuration information obtained from the interactive page respectively. Correspondingly, the business data parameters define the data business logic corresponding to the business data required by the search service from the data source. The data business logic includes the connection information of the data source, the data table structure information, and the data synchronization logic, etc. The environment deployment parameters define the environment business logic corresponding to the search engine's search for the business data. The environment business logic includes the selection of the search engine, the retrieval rules of the index field, the field weight allocation, the query result sorting rules and display methods, and the online query logic, etc.

[0039] In another embodiment, the system provides an interactive page designed with multiple visual input components, typically including text boxes, drop-down menus, radio buttons, check boxes, etc. These input components allow the user to input business configuration information corresponding to the business data required for the search service and environment configuration information corresponding to the search engine required for the search service. After the system obtains the configuration information input by the user, it extracts the business data parameters and the environment configuration parameters from the business configuration information and the environment configuration information in the user configuration information, respectively, and uses the collected business data parameters and environment configuration parameters as input for subsequent application conversion templates.

[0040] Step S1200: Apply the conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively;

[0041] In one embodiment, the conversion template is a predefined framework, which is divided into a business logic template and an environment deployment template, wherein the business logic template contains placeholders related to connection information of the data source, data table structure information, and data synchronization logic, and the environment deployment template contains placeholders related to retrieval rules of index fields, field weight allocation, query result sorting rules and display methods, and online query logic, etc. The business logic template and the environment deployment template are respectively used to convert business data parameters and environment deployment parameters into configuration files in a specific format. The conversion template predefines the structure and format requirements of the configuration file, as well as the necessary parameter placeholders, and can automatically generate business configuration files and environment configuration files that meet the format required by the search service by filling the extracted parameters into the corresponding placeholder positions in the conversion template; the business configuration file and the environment configuration file are a kind of standardized file, the business configuration file contains the data business logic corresponding to the business data required from the data source to the search service, and the environment configuration file contains the environment business logic corresponding to the search engine performing the search for the business data.

[0042] Step S1300: deploy the business configuration file and the environment configuration file to the offline data synchronization service and the online query service corresponding to the search service, respectively, so that the online query service implements the business logic of searching by using the business data, and the offline data synchronization service implements data synchronization and update from the data source to the business data;

[0043] The business configuration file includes data business logic related to the search service, such as connection information of the data source, data table structure information, and data synchronization logic, etc. By deploying the business configuration file to the offline data synchronization service corresponding to the search service, after the deployment is completed, the offline data synchronization service will implement data synchronization and update tasks according to the data business logic in the business configuration file, that is, the offline synchronization service will synchronize the data from the data source to the target data warehouse according to the data business logic in the business configuration file, and the obtained business data can be used for online query services; the environment configuration file includes the corresponding environment business logic when the search engine performs a search for the business data, such as the selection of the search engine, the retrieval rules of the index field, the field weight allocation, the query result sorting rules and display methods, and the online query logic, etc. By deploying the environment configuration file to the online query service, after the deployment is completed, the online query service performs online query on the business data based on the retrieval rules in the retrieval logic.

[0044] In one implementation, the business configuration file defines the connection information of the data source in detail. For example, the business configuration file specifies that the IP address connected to the MySQL database server is 192.168.1.10, the port number is 3306, the database name is 'AS', and defines the data table structure information, such as defining the data table name as 'products', the data table fields include 'product_name', 'product_descr ipt ion', the table field type, etc. This information is obtained through user input on the interactive page. Deploy this configuration file to the offline data synchronization service, the offline data synchronization service executes the synchronization task, and synchronizes and updates the 'products' table with the data imported from the 'AS' database to the target data warehouse in real time according to the data synchronization logic defined in the configuration file. At the same time, the environment configuration file includes the selection of search engines, search rules for index fields, field weight allocation, query result sorting rules and display methods, and online query logic. For example, the search engine selects the es search engine, selects the search method for the table field 'product_name' as exact search, selects the search method for the table field 'product_descr ipt ion' as fuzzy search, and defines the index weight of each field, such as the weight of the 'product_name' field is 2, the weight of the 'product_descr ipt ion' field is 1.5, and the default sorting rules and display methods during search are set to highlight search terms. After deploying this environment configuration file to the online query service, the online query service can build indexes according to these rules in the environment configuration file and respond to user search requests. For example, when a user searches for "smart watch", the service will quickly return the most relevant product information according to the defined weight and sorting rules.

[0045] Step S1400: Start the online query service to open the search service to the terminal user through the online query service.

[0046] After the deployment of the business configuration file and the environment configuration file is completed in the above implementation, the system can trigger the startup command of the online query service through the automated deployment script. After startup, the system will enter the listening state, and receive and respond to the search request of the terminal user in real time. When the user accesses the independent station server (online store), the user enters keywords in the search box to initiate a search request. At this time, the independent station server will pass the user's search request to the search service deployed on the independent station server. The search service calls the online query service and performs online query on the business data in the target data warehouse according to the environmental business logic defined in the environment configuration file, such as the selection of search engines, the retrieval rules of index fields, the field weight allocation, the query result sorting rules and display methods, and the online query logic, and the query results are fed back to the search page of the independent station according to the query result sorting rules, and finally presented to the terminal user.

[0047] In one embodiment, the online query service will first retrieve relevant business data from the target data warehouse using the retrieval rules of the index field according to the environmental business logic defined in the environmental configuration file, then filter the preliminary retrieval results according to the field weight distribution, sort the filtered data according to the query result sorting rules, and finally feed back the sorted query results to the terminal user according to the environmental settings of the search service, such as conditional filtering of the query results, highlighting of search terms, etc.

[0048] In this embodiment, the user enters user configuration information in the visual input component of the interactive page. The visual input component on the interactive page is provided for user input, which greatly simplifies the process of user configuration of the search service. The user can use intuitive input components such as text boxes, drop-down menus, radio buttons and check boxes to easily configure the business configuration information and environment configuration information of the search service separately, ensuring that subsequent steps can process the business configuration information and environment configuration information separately.

[0049] By introducing predefined conversion templates, the automatic conversion of business data parameters and environment deployment parameters to specific configuration files is achieved. Specifically, predefined business logic templates and environment deployment templates are used to automatically fill in the necessary parameter placeholders to generate standardized business configuration files and environment configuration files. This not only improves the efficiency of configuration file generation, but also reduces the possibility of human errors.

[0050] The generated business configuration files and environment configuration files are actually deployed to the corresponding components of the search service. The business configuration files instruct the offline data synchronization service on how to synchronize and update business data from the data source to the target data warehouse, while the environment configuration files ensure that the online query service can perform search tasks according to the set indexing rules, weight distribution, sorting rules and other parameters. This step enables the search service to efficiently process data synchronization and query requests while maintaining a clear separation between business logic and environment logic.

[0051] The online query service is officially launched to enable it to receive and respond to search requests from end users. This step can be triggered by automated scripts to start the service, ensuring rapid deployment and stable operation of the service. The online query service performs efficient search operations on business data in the target data warehouse based on the logic defined in the environment configuration file, and feeds back the results to users in real time.

[0052] It can be known from the typical embodiments of the present application that the technical solution of the present application has many advantages, including but not limited to the following aspects:

[0053] Different from the traditional search service configuration method, the present application extracts the business data parameters and environment deployment parameters from the user configuration information submitted by the user on the interactive page, and then uses the conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively. Through the implementation of this step, the business configuration and environment configuration are separated, and then the separated business configuration files and environment configuration files are respectively deployed to the offline data synchronization service and online query service corresponding to the search service to achieve independent management of the business configuration and environment configuration. When the business configuration file or the environment configuration file changes, the business configuration or the environment configuration can be updated independently without reconfiguring the entire system, thereby improving the configuration flexibility and the maintainability of the system.

[0054] Based on any embodiment of the method of this application, please refer to Figure 3 , obtain the user configuration information submitted through the interactive page, and extract the business data parameters corresponding to the search service, including:

[0055] Step S1110: Create data tables that need to be synchronized on the visualization page through the visualization input component, assign corresponding data sources to each table, and store the configured data tables in the source database;

[0056] In one embodiment, the user only needs to follow the guiding prompts on the visualization page and perform corresponding operations to create the data table that needs to be synchronized. The system presents the data source in a visual form in the drop-down menu of the interactive page for the user to select the corresponding data source for each data table, or a visual text box for the user to enter the data source connection information to import the data source. The data source connection information generally includes the IP address or domain name of the data source server, the port number, the database name, etc. Finally, the configured data table is stored in the source database as the business data required for the search service.

[0057] In another embodiment, a series of visual input components are designed in the interactive page. The user clicks the "Create Data Table" option in the interactive page, and then enters the name of the data table, the data table ID, and the names of each field of the data table in the text box of the data table creation page. For each table field, the user can select an appropriate data type through a drop-down menu, wherein the data type generally includes basic data types such as integer, floating point, character, and Boolean. The integer data type includes byte, short, int, long, etc., the floating point data type includes fl oat, double, etc., the character data type includes char, etc., and the Boolean data type includes boolean. In the process of creating a data table, the user can also set the association between tables, which usually involves defining primary key and foreign key constraints. For the selection of data sources, the drop-down menu on the interactive page will visualize all pre-configured data source options. The user only needs to click to select an option in the drop-down menu to select the corresponding data source for the data table. After completing the creation and configuration of the data table, the user clicks the submit button to submit the input configuration information to the system, and the system stores the configuration of the data table in the source database.

[0058] In another embodiment, the user operates through the visual interface of the interactive page, first selects the "Create Data Table" option, enters the data table creation page, the user enters "Emp l oyees" in the data table name input text box on the data table creation page, enters "001" in the data table ID input text box, and clicks the "Add Field" button. At this time, the interactive page visualizes the field name input text box, the field data type drop-down menu, whether it is a primary key selection button, whether it is a foreign key selection button, and whether to design the field as a self-increment attribute. The user enters the data field name "Emp l oyee ID" in the field name input text box, selects the data type as int in the field data type drop-down menu, clicks the "Yes" option in the whether it is a primary key selection button component, clicks the "No" option in the whether it is a foreign key selection button component, and clicks the "Yes" option in the whether to design the field as a self-increment attribute component; continue to click the "Add Field" button, the data field name is "Name" in the field name input text box, and selects the data type as fl in the field data type drop-down menu. oat, click "No" in the "Primary Key" button component, click "No" in the "Foreign Key" button component, and click "No" in the "Whether to Design Field as Self-Increment Property" component; after creating the data table to be synchronized, in the data source selection phase, the user selects the database named "HumanResourcesDB" from the pre-configured options through the drop-down menu as the data source of the data table. In addition, the user also defines the foreign key association between the "Emp l oyees" table and the "Departments" table, and specifies the "Department ID" field as the foreign key of the "Departments" table. The creation of the "Departments" table is not described here. After completing these configurations, the user clicks the "Submit" button, and the system stores the detailed configuration of the data table named "Emp l oyees" in the source database named "CompanyDB".

[0059] Step S1120: Capture the change events in the source database, encapsulate them into corresponding messages, and send them to the message queue cluster;

[0060] The previous step stores the configured data table in the source database. The system starts to monitor the source database to capture any change events, and then encapsulates each captured change event into a message serialization and sends it to the message queue cluster for storage. The stored messages can be consumed by subsequent consumers. The message queue cluster includes any one of the Kafka clusters, RocketMQ clusters, RabbitMQ clusters, NSQ clusters or other message queue clusters.

[0061] In one embodiment, the user defines a data table named "Orders" on the interactive page, which contains the fields "Order ID" (data type is int), "CustomerName" (data type is char) and "OrderDate" (data type is char). The user selects a database named "Sales" as the data source. The system configures a data capture mechanism to monitor changes in the "Orders" table in the source database. When a new order is found to be added, such as an order record with Order ID of 1001, CustomerName of "John Doe", and OrderDate of 2024-05-22, the system will immediately capture the change event, serialize and encapsulate the change event information into a message, and then send the message to the Kafka cluster.

[0062] Step S1130: By consuming the messages stored in the message queues in the message queue cluster in parallel, automatic offline synchronization of data from the source database to the target data warehouse is triggered, thereby realizing the conversion from the data source to the business data required by the search service.

[0063] In the application scenario of e-commerce platforms, we will face the problem of increasing data volume and increasingly complex data structure in a single table, and the source database cannot directly perform data analysis. At this time, the data table in the source database will be synchronized offline to a target data warehouse that can store and process ultra-large data sets for data analysis.

[0064] In one embodiment, the system designs a parallel processing mechanism for efficiently consuming stored messages from a message queue cluster and triggering automated offline synchronization of data from a source database to a target data warehouse. Specifically, the system deploys multiple consumer processes or threads, and consumers are configured to listen to different queues or topics in a message queue cluster. Once a new message appears in the message queue, i.e., a message that encapsulates the source database data, the consumer begins to pull these messages in parallel and process the data contained in the message. The consumer process decodes each message, parses the data in the source database, and performs necessary data conversion operations such as data cleaning, format conversion, data aggregation, etc. according to the business logic defined in the business configuration file. The converted data is then loaded into the target data warehouse, which is used to store the business data required by the search service for indexing and querying by the search engine.

[0065] In one embodiment, it is assumed that the user has created a data table named "Products" through the interactive page. The data table is designed with fields "Product ID" (data type is int, set as auto-increment primary key), "ProductName" (data type is float), "Price" (data type is float), and "StockQuantity" (data type is int), and a database named "InventoryDB" is configured as the data source. The data capture service monitors that a new record is added to the "Products" table, in which "Product ID" is 101, "Product Name" is "Laptop", "Price" is 999, and "StockQuantity" is 50. The record is encapsulated into a message, serialized into JSON format: `{"Product ID":101,"ProductName":"Laptop","Price":999,"StockQuantity":50,"EventType":"Insert"}`, and sent to the "ProductUpdates" topic of the Kafka cluster. In this embodiment, the consumer service of the target data warehouse consumes messages from the "ProductUpdates" topic in parallel. The consumer service parses the message content and triggers the data synchronization process to insert new records into the corresponding data table of the target data warehouse, realizing automatic offline synchronization between the source database and the target data warehouse, ensuring that the business data required by the search service is updated and converted in a timely manner.

[0066] In this embodiment, by visualizing the input components in the interactive page, users do not need to write code, but only need to follow the guiding prompts on the visual page and perform corresponding operations to create the data table that needs to be synchronized, which greatly simplifies the process of user configuration search service. Users can use intuitive input components such as text boxes, drop-down menus, radio buttons, and check boxes to easily assign data sources to each data table, select field types, and define relationships between tables, such as primary key and foreign key constraints, and store the configured data tables in the source database, providing the necessary business data foundation for subsequent data synchronization and search services.

[0067] The system can automatically capture change events in the source database, encapsulate these events into messages and send them to the message queue cluster. Real-time monitoring and response to data changes ensure that any data updates can be quickly captured and prepared for transmission. The use of message queue clusters such as Kafka, RocketMQ, etc. can not only handle high-concurrency data streams, but also ensure the reliability and flexibility of data transmission, providing a solid foundation for subsequent data synchronization operations.

[0068] Through the parallel processing mechanism, the system can efficiently consume messages in the message queue and trigger necessary data conversion and synchronization operations, realizing the automated offline synchronization of data from the source database to the target data warehouse. This step reduces manual intervention through automated processes and improves the efficiency of data processing.

[0069] Based on any embodiment of the method of this application, please refer to Figure 4 , applying the conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively, including:

[0070] Step S1210: Match the corresponding business logic template and environment deployment template according to the business data parameters and environment deployment parameters in the user configuration information, and match the business data parameters and environment deployment parameters to the placeholders of the corresponding templates;

[0071] In the above specific implementation method, business data parameters and environment deployment parameters are extracted. Business data parameters generally include connection information of data sources, data table structure information, data synchronization logic, etc., while environment deployment parameters involve the configuration environment of the search engine, such as retrieval rules, field weight allocation, query result sorting rule display method, and online query logic, etc. The system parses the extracted parameters and selects corresponding business logic templates and environment deployment templates from the predefined template library according to the parsing results to convert user configuration information, wherein the business logic template and environment deployment template are the frameworks of predefined configuration files and contain specific placeholders; the system identifies and loads the matched business logic templates and environment deployment templates through the template engine, wherein the template engine is responsible for parsing the template and embedding the business data parameters and environment deployment parameters into the corresponding placeholders to dynamically generate an executable configuration document.

[0072] Step S1220: Generate a business logic configuration draft and an environment deployment configuration draft based on the filled template, perform logic verification on the drafts, and convert the verified configuration drafts into formal business configuration files and environment configuration files;

[0073] In the above specific implementation, based on user configuration information, the template engine is used to fill business data parameters and environment deployment parameters into the corresponding business logic template and environment deployment template, and a business logic configuration draft and an environment deployment configuration draft are generated based on the filled templates, wherein the generated business logic configuration draft and environment deployment configuration draft need to undergo logic verification, and the verification process usually includes checking the accuracy of data source connection information, the feasibility of data synchronization logic, the rationality of field weight allocation, and whether all placeholders in the configuration file have been filled, etc. Once the configuration draft passes the logic verification, the system converts these drafts into formal business configuration files and environment configuration files. Among them, the business configuration file contains all business data-related configuration information, which is used to deploy online query services, and the environment configuration file contains the environment settings required by the search engine, which is used to configure the operating environment of the search engine.

[0074] Step S1230: Determine a service version identifier for the service configuration file and the environment configuration file, store each configuration file in a central file storage system, and register the service version identifier in a version information repository.

[0075] The business logic configuration draft and environment deployment configuration draft in the above specific implementation mode are converted into formal business configuration files and environment configuration files after logical verification. In one embodiment, the system determines a unique business version identifier for each generated business configuration file and environment configuration file. The business version identifier can be generated according to the generation date, timestamp, version number or specific serial number string of the configuration file, etc., and is used to clearly identify and distinguish different versions of configuration files; the system securely stores these configuration files with unique identifiers in a central file storage system, which can be a network attached storage (NAS), a storage area network (SAN) or a cloud storage service. After the storage is completed, the system registers the business version identifier in the version information library. The version information library is a database or registration service for recording the version information of all configuration files, including but not limited to the configuration file identifier, storage location and version change history. In another embodiment, when the search service needs to be started, the required version information is determined based on the configuration parameters passed when the search service is started. The system then retrieves the corresponding executable configuration file from the central file storage system. Once the configuration file is found, the system loads the corresponding executable configuration file into the corresponding platform framework. When it is necessary to roll back to an old version of the configuration or update to a new version of the configuration, the system can quickly and accurately locate and apply the correct configuration file.

[0076] In this embodiment, the template engine is responsible for parsing the business logic template and the environment deployment template and embedding the business data parameters and the environment deployment parameters into the corresponding placeholders, thereby generating an executable configuration file. The consistency and standardization of the configuration file are ensured by the template method. In addition, through the use of the template engine, the system can dynamically generate configuration documents, reduce manual input errors, and allow rapid adaptation to changes in user needs. The business logic configuration draft and the environment deployment configuration draft are generated based on the filled template, and the generated configuration draft is logically verified. The verification process covers the accuracy of the data source connection information, the rationality of the data synchronization logic, and the appropriateness of the field weight allocation. Service failures caused by configuration errors are avoided. Through logical verification, the system can promptly discover and correct potential problems, improve the stability and reliability of the system, and once the configuration draft passes the verification and is converted into a formal configuration file, the generated configuration file can be used to deploy and start the service, ensuring that the search service can be accurately executed according to the predetermined business rules and environment settings.

[0077] By assigning a unique business version identifier to each configuration file, the system can clearly distinguish different versions of configuration files and record their change history. The business version identifier usually contains information such as date, timestamp, version number, etc., which provides a reliable basis for tracking and managing configuration files. The configuration files are stored in the central file storage system and the identifiers are registered in the version information library, which enhances the security and manageability of the configuration files. When users configure, they can easily retrieve the required configuration files directly from the central file storage system through the version identifier for deployment. This step simplifies the user's configuration work and provides a high degree of convenience. At the same time, when a configuration update or rollback to an old version is required, the system can quickly locate and apply the correct configuration file.

[0078] Based on any embodiment of the method of this application, please refer to Figure 5 , respectively deploying the business configuration file and the environment configuration file to the online query service and the offline data synchronization service corresponding to the search service, including:

[0079] Step S1310: monitor whether the business version identifier of the search service in the version information library is changed, and if so, trigger a version update event;

[0080] In one embodiment, the system continuously monitors whether the business version identifier of the search service recorded in the version information library has changed by deploying an automated monitoring mechanism. The change of the business version identifier indicates the generation of a new configuration file or the update of the existing configuration. When a change is detected in the business version identifier of the search service in the version information library, a version update event is automatically triggered. The version update event includes stopping the use of the old version of the service, deploying the configuration file of the new version, verifying the validity of the new configuration, and gradually switching to the new service version. The version update event ensures a smooth transition of the search service to the updated configuration.

[0081] Step S1320: In response to the version update event, deploy the offline data synchronization service and / or the online query service of the search service according to the corresponding business configuration file and / or environment configuration file;

[0082] When the system version identifier changes, a version update event is triggered, and the latest version of the business configuration file and environment configuration file is used to redeploy or update the offline data synchronization service and / or online query service of the search service. Specifically, the system identifies and retrieves the business configuration file and environment configuration file corresponding to the latest business version identifier registered in the version information library. The business configuration file and environment configuration file contain the updated data business logic and environment business logic respectively. During the deployment process, the system usually adopts strategies such as blue-green deployment, rolling update or canary release.

[0083] In one embodiment, the system maintains two identical production environments, one called the blue environment and the other called the green environment. In the initial state, user traffic is routed to the blue environment, which runs the current stable version of the search service. When new business configuration files and environment configuration files need to be deployed, the system will first apply these updates in the green environment to deploy the new version of the search service. After the deployment is completed in the green environment and sufficient testing and verification, the system will switch user traffic from the blue environment to the green environment. At this time, the green environment becomes active and begins to process the search requests of terminal users. If there is a problem with the newly deployed service, the system can quickly switch the traffic back to the blue environment, that is, roll back to the previous stable version, thereby ensuring the continuity and stability of the service.

[0084] In another embodiment, the system updates service instances one by one or in batches, rather than replacing all instances at once. Initially, all search service instances are running the old version of the software. When the update starts, the system first selects an instance to update, applies the new business configuration file and environment configuration file, and restarts it as a new version of the service. The system then monitors the updated instance to ensure that it is running normally and that the performance meets expectations. Once confirmed, the system continues to select the next instance to update until all instances are updated to the new version. This step can reduce service interruptions during the update process, allowing the system to continue to provide services to the outside world while updating the software.

[0085] Step S1330: When the deployment of the search service fails, a rollback operation is performed on the search service to roll back to the search service state corresponding to the business configuration file and / or the environment configuration file corresponding to the previous version;

[0086] In one embodiment, when the system receives a version update event and starts to deploy new business configuration files and environment configuration files, a monitoring mechanism is started at the same time. When the system detects a signal of deployment failure, whether it is due to a configuration error, system anomaly, or any other factor that causes service instability, a rollback mechanism will be automatically triggered. The rollback mechanism is pre-set, and when the rollback mechanism is triggered, it will first stop deploying the new version of the configuration file, and quickly retrieve the business configuration file and environment configuration file of the previous stable version from the central file storage system described in the above specific implementation method. The system will then redeploy the retrieved configuration files to the offline data synchronization service and the online query service, and restore the online query service and the offline data synchronization service to the state of the previous version. In another embodiment, if a portion of the traffic has already been switched to the new service provider, the system will reroute the traffic back to the old service provider.

[0087] Ensures that the service can be quickly restored to a known stable state.

[0088] In this embodiment, through the automated monitoring mechanism, the system can monitor the business version identifier in the version information library in real time to ensure that any changes to the configuration files can be responded to quickly. When the identifier changes, the system automatically triggers a version update event, which includes deactivating the old service, deploying the new configuration, verifying the validity of the new configuration, and gradually switching to the new service, thereby ensuring that the search service can smoothly transition to the new configuration and reducing the risks and potential service interruptions caused by manual updates. When responding to a version update event, the system can redeploy or update the service based on the latest business configuration files and environment configuration files. By adopting strategies such as blue-green deployment, rolling updates, or canary releases, the system can be updated in a controlled and incremental manner, thereby minimizing service interruptions and risks during the update process.

[0089] When the search service deployment fails, the system can perform a rollback operation and quickly restore to the previous stable version of the search service state. The automatic rollback mechanism is pre-set and can be triggered immediately when a deployment failure signal is detected, stopping the deployment of the new version and quickly retrieving the stable old version configuration file from the central file storage system for redeployment. If part of the traffic has been switched to the new service, the system will also reroute the traffic back to the old service to ensure that the service can quickly return to a known stable state, thereby ensuring the continuity of the search service and the user experience.

[0090] Based on any embodiment of the method of this application, please refer to Figure 6 , respectively deploying the business configuration file and the environment configuration file to the online query service and the offline data synchronization service corresponding to the search service, including:

[0091] Step S1341: deploy the newly generated business configuration file and environment configuration file to the new search service instance, and perform preliminary testing in an isolated environment;

[0092] In one embodiment, the system deploys the newly generated business configuration file and environment configuration file to a newly created search service instance, and the system performs preliminary tests on these configuration files in an isolated environment. The isolated environment is a controlled test area that simulates the production environment, but is isolated from actual user queries, thereby allowing comprehensive verification and performance evaluation of the new instance without affecting existing services. In the isolated environment, the system can execute a series of test cases, including functional testing, load testing, stress testing, and recovery testing, to verify whether the new instance can correctly respond to search queries, process data synchronization tasks, and maintain stable operation under high load. In one embodiment, the system checks whether the business logic and environment settings in the configuration file are correctly implemented, and ensures that all dependencies and integration points work as expected. Through these tests, the system can identify and fix possible problems and improve the success rate of the new search service instance in actual deployment. Once the new instance passes the test in the isolated environment, the system deploys the instance to the production environment to provide services to end users, ensuring that only fully tested and verified service instances will be promoted, thereby ensuring the reliability of the search service and user satisfaction.

[0093] Step S1342: after the search service instance passes the test and becomes a new service, a traffic switching period is entered, during which part of user requests accessing the search service are gradually switched from the old service of the search service to the new service;

[0094] After the new search service instance in the above specific implementation mode passes the preliminary test in the isolated environment, the system deploys the instance to the production environment. This process is called traffic switching. During the traffic switching, the system uses a progressive approach to gradually migrate user requests from the old search service instance to the new service instance. Specifically, the system first directs a small number of user requests to the new service instance to monitor the performance of the new instance under actual user load. As the new service instance runs successfully, the system gradually increases the proportion of traffic directed to the new service instance while reducing the traffic to the old service instance. This process can be automatic or manually adjusted according to predefined performance indicators and success rates. In one embodiment, the entire traffic switching cycle is set as one day, and the day is divided into several continuous time periods, for example, every four hours is a time period. In each time period, the system directs a specific number of user search requests to the new service instance, for example, 1,000 user requests. Then the new service instance collects corresponding performance indicators in the time period, and performs comprehensive score calculation by weighting the performance indicators. For example, the response time accounts for 30% of the total score, the system throughput accounts for 40%, the error rate accounts for 20%, and the query success rate accounts for 10%. By setting a preset threshold for the comprehensive score, the new service instance will be comprehensively scored when testing each time period. If the comprehensive score of the new service instance in the current time period is higher than the preset threshold, the system will increase the number of user requests directed to the new service instance in the next time period, for example, to 2,000 user requests. As the new service instance gradually takes on more user requests, the system continuously monitors its performance and evaluates it at the end of each time period. If the comprehensive score of the new service instance continues to be higher than the preset threshold for multiple consecutive time periods, the traffic proportion will continue to increase. When the comprehensive score of the new service instance in the last time period is higher than the preset threshold, the system will complete the full switch from the old service instance to the new service instance.

[0095] During the traffic switching period, the system will closely monitor the performance indicators of the two service instances, including response time, error rate, system throughput, etc., to evaluate the health status and user satisfaction of the new service instance. At the same time, the system implements monitoring and alarm mechanisms. If the new service instance performs poorly or fails, the system will quickly roll back to the old service instance to ensure the stability and reliability of the service. As the new service gradually takes on more user requests and performs stably throughout the process, the system will continue to increase the traffic proportion of the new service until it is completely switched to the new service.

[0096] Step S1343: During the traffic switching period, the performance indicators of the new service are monitored in real time. When the performance indicators meet the preset conditions, all remaining user requests of the old service are switched to the new service, and the old version of the search service is disabled.

[0097] During the traffic switching period, the performance of the new service is monitored in real time. At this time, the system will deploy a series of performance monitoring tools, which are used to track the key performance parameters of the new search service instance, such as response time, throughput, system resource utilization, error rate, and query success rate. The system will continue to analyze these performance parameters and compare the monitored key performance parameters with the preset conditions to determine whether the performance parameters meet the preset conditions. Once the monitoring data shows that the performance parameters of the new service instance continue to meet all the preset conditions for a certain period of time, the system will automatically or through manual confirmation issue an instruction to transfer all remaining user requests that are still directed to the old service instance to the new service instance. After the switch is completed, the system will gradually deactivate the old version of the search service, which includes shutting down the operation of the old service instance, releasing related resources, and ensuring that all users are migrated to the new service.

[0098] In this embodiment, by deploying and testing a new search service instance in an isolated environment and ensuring that the business logic and environment settings in the configuration file are correctly implemented, the system can ensure that all dependencies and integration points work as expected, further improving the deployment success rate. Only when the new instance passes the test in the isolated environment will the system deploy it to the production environment, ensuring that fully tested and verified services are provided to end users, thereby improving user satisfaction.

[0099] By first directing a small number of user requests to the new service instance, the system can monitor the performance of the new instance under actual user load and gradually increase the traffic ratio based on predefined performance indicators and success rates, allowing the system to smoothly transition to the new service while minimizing potential service interruptions and performance issues. This step allows the system to gradually expand the influence of the new service without affecting the user experience, and quickly roll back to the old service instance when necessary to ensure the stability and reliability of the service. This step avoids sudden changes that affect the user experience and achieves a seamless transition of service updates.

[0100] Based on any embodiment of the method of this application, please refer to Figure 7 , respectively deploying the business configuration file and the environment configuration file to the online query service and the offline data synchronization service corresponding to the search service, including:

[0101] Step S1411, parsing the environment configuration file to determine the environment settings and query parameters required for the online query service, and parsing the business configuration file to determine the business logic and synchronization parameters required for the offline data synchronization service;

[0102] By parsing the environment configuration file, the environment settings and query parameters in the environment deployment parameters can be obtained. The environment settings include query result sorting rules and display methods and online query logic. The query parameters include search engine selection, index field retrieval rules and field weight allocation. Similarly, by parsing the business configuration file, the business logic and synchronization parameters in the business deployment parameters can be obtained. The business logic includes data synchronization logic, and the synchronization parameters include data source connection information and data table structure information.

[0103] During the deployment of the search service, the system parses the environment configuration file to obtain the environment settings and query parameters required for the online query service. The environment settings are used for subsequent adaptation and initialization operations on the online query service, and the query parameters are used for subsequent adjustment of the search engine's index and query strategy. For specific steps, please refer to the subsequent specific implementation methods, which will not be repeated here. By parsing the business configuration file, the business logic and synchronization parameters required for the offline data synchronization service are obtained. The business logic is used for subsequent adaptation and initialization operations on the offline data synchronization service, and the synchronization parameters are used for subsequent data source connection and synchronization plan settings. For specific steps, please refer to the subsequent specific implementation methods, which will not be repeated here.

[0104] Step S1412: Adapt and initialize the online query service and offline data synchronization service according to the environment settings and business logic obtained through the analysis, so that each service can run according to the requirements of the corresponding configuration files;

[0105] According to the environment settings and business logic obtained by parsing in the previous step, the online query service and offline data synchronization service are carefully adapted and initialized. The environment settings include query result sorting rules and display methods and online query logic. The business logic includes data synchronization logic. In one embodiment, the system will configure the query result sorting rules and display methods, as well as the online query logic according to the environment settings, for example, sorting search results according to relevance or user-defined rules, setting filtering conditions or highlighting search terms, etc. For offline data synchronization services, the system will configure offline data synchronization services according to the data synchronization logic in the business logic, for example, through message queue transmission, consumer concurrent consumption, etc. Adapt and initialize the online query service and offline data synchronization service according to the environment settings and business logic, so that the search service runs according to the configured online query service and offline data synchronization service requirements.

[0106] Step S1413: adjusting the search engine's index and query strategy according to the query parameters, and setting the data source connection and synchronization plan according to the synchronization parameters.

[0107] Fine-tune the search engine's index and query strategy based on the query parameters extracted from the environment configuration file, including but not limited to selecting a suitable search engine, setting retrieval rules for index fields, and assigning weights to index fields. At the same time, the system will set up data source connections and synchronization plans based on the synchronization parameters in the business configuration file, including but not limited to configuring data source connection details, such as server address, port, database name, etc., and data table structure information, such as data table name, data table ID, field name, etc. Through these adjustments and settings, the system can automatically extract the data required for the business from the source database and store it in the configured data table for subsequent synchronization updates to the target data warehouse.

[0108] In this embodiment, by parsing the environment configuration file, the system can determine the specific environment settings and query parameters required for the online query service, and by parsing the business configuration file, the system can determine the business logic and synchronization parameters required for the offline data synchronization service;

[0109] In this step, first, the environment configuration file and the business configuration file are separated, which are used to deploy the online query service and the offline data synchronization service respectively. Furthermore, the environment settings and query parameters are separated by parsing the environment configuration file, and the business logic and synchronization parameters are separated by parsing the business configuration file. Through this separation step, the flexibility and maintainability of the configuration are enhanced. The implementation of this step allows the online query service and the offline data synchronization service to be updated and optimized independently, while simplifying the deployment process and reducing the difficulty of maintenance.

[0110] Based on any embodiment of the method of this application, please refer to Figure 8 , before starting the online query service to open the search service to the terminal user through the online query service, comprising:

[0111] Step S1421: deploy and start the offline data synchronization service and the online query service in the test environment;

[0112] Before the system officially launches the online query service and develops the search service for end users, it first deploys and starts the offline data synchronization service and the online query service in the test environment. Specifically, the system deploys the offline data synchronization service and the online query service to a simulated production environment but isolated test environment. In the test environment, the system will configure the necessary hardware and software resources and build an infrastructure similar to the production environment to simulate the actual operating conditions. After the service is fully tested and verified in the test environment, the system will decide whether to deploy the service to the production environment and open the search service to end users based on the test results. In one embodiment, the test environment allows load testing and stress testing of the service to ensure that the service can withstand the expected user request volume and data synchronization load. In another embodiment, the system performs a series of performance tests, such as search latency, system throughput, and resource usage, to ensure that the online query service can run stably under high concurrency conditions. Through the performance test, the system can identify any potential performance bottlenecks or functional defects, and optimize and repair them before the service is officially launched.

[0113] Step S1422: input predefined test data in the visual search box corresponding to the online query service, and collect the returned search results;

[0114] In one embodiment, after the offline data synchronization service and the online query service are deployed and started in the test environment, the system first uses an automated test script to simulate the operation of the terminal user entering a search term in the visual search box on the online query service page in the test environment. The search term can be pre-defined test data or a common query extracted from the user search log. Once the search term is entered and submitted, the system begins to collect the search results returned by the search engine and analyze and evaluate them according to predetermined evaluation criteria. In one embodiment, the system checks whether the ranking of the returned results is consistent with expectations, and verifies whether the search algorithm can correctly parse the query intent and return the most relevant answer.

[0115] Step S1423: comparing the search results with preset benchmark data or search service results of a previous version to determine the accuracy score of the search results;

[0116] The system compares and analyzes the collected search results with the pre-set benchmark data or the search service results of the previous stable running version. In one embodiment, the system uses various algorithms and evaluation indicators to quantify the accuracy of the search results, including precision (the proportion of relevant results accurately returned), recall (the proportion of retrieved relevant results to all relevant results), F1 score (the harmonic mean of precision and recall), etc. Through this comparison, the system calculates an accuracy score for the search results, and then accumulates the accuracy scores of each collected search result and divides it by the number of collections to obtain an average accuracy score. The subsequent implementation method uses the average accuracy score.

[0117] In one embodiment, if the accuracy score of the search results reaches or exceeds the preset threshold, that is, the performance of the new search service meets or exceeds the expected target, it can be safely deployed to the production environment and opened to end users. If the score does not meet the standard, the system will make necessary adjustments and optimizations based on the evaluation results, and then retest until all predetermined performance standards are met.

[0118] Step S1424: When the accuracy score is greater than a preset threshold, the search service is opened to the terminal user.

[0119] If the search result accuracy score calculated in the above specific implementation exceeds the preset performance threshold, the system will enter the final opening stage. The threshold is a standard set by those skilled in the art based on business needs and user expectations to ensure that the performance of the search service has reached an acceptable level before it is opened to the public. In one embodiment, the system will migrate the search services that meet the opening conditions from the test environment to the production environment, and then start the online query service in the production environment.

[0120] In this embodiment, in the test environment, the system will configure the necessary hardware and software resources and build an infrastructure similar to the production environment to simulate real operating conditions and ensure the effectiveness and accuracy of the test. By simulating user search behavior through automated test scripts, the system can collect search results and compare the search results with preset benchmark data or the results of the previous version of the search service. The system can quantify the accuracy of the search results and use evaluation indicators such as precision, recall rate, F1 score, etc. to calculate the accuracy score of the search results. If the accuracy score of the search results reaches or exceeds the preset threshold, it indicates that the performance of the new search service meets or exceeds the expected goals and can be safely deployed to the production environment and opened to end users. This step ensures that only services that have been fully tested and meet all predetermined performance standards will be open to the public, thereby ensuring the quality of user experience and the stability of the service.

[0121] See also Fig. 9 Another embodiment of the present application further provides a search service configuration device, which includes a parameter extraction module 5100, an executable configuration file generation module 5200, a configuration file deployment module 5300, and an online query service startup module 5400, wherein the parameter extraction module 5100 is used to obtain user configuration information submitted through an interactive page, and extract business data parameters and environment deployment parameters corresponding to the search service, wherein the business data parameters define the data business logic corresponding to the business data required from the data source to the search service, and the environment deployment parameters define the environment business logic corresponding to the search engine executing the search for the business data; the executable configuration file generation module 5200, used to apply the conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively; the configuration file deployment module 5300, used to apply and deploy the business configuration files and environment configuration files respectively to the offline data synchronization service and online query service corresponding to the search service, the online query service implements the business logic of searching using the business data, and the offline data synchronization service implements data synchronization and update from the data source to the business data; the online query service startup module 5400, used to start the online query service to open the search service to the terminal users through the online query service.

[0122] Based on any embodiment of the device of the present application, the parameter extraction module 5100 includes: a source database creation submodule, which is configured to create a data table that needs to be synchronized through a visual input component on a visualization page, and assign a corresponding data source to each table, and store the configured data table in the source database; a change event encapsulation submodule, which is configured to capture the change events in the source database and encapsulate them into corresponding messages, and send them to the message queue cluster; an offline synchronization submodule, which is configured to trigger automatic offline synchronization of data from the source database to the target data warehouse by consuming the messages stored in the message queue in the message queue cluster in parallel, so as to realize the conversion from the data source to the business data required by the search service.

[0123] Based on any embodiment of the device of the present application, the executable configuration file generation module 5200 includes: a template matching submodule, which is configured to match the corresponding business logic template and environment deployment template according to the business data parameters and environment deployment parameters in the user configuration information, and match the business data parameters and environment deployment parameters to fill the placeholders of the corresponding templates; a configuration draft verification submodule, which generates a business logic configuration draft and an environment deployment configuration draft based on the filled template, performs logic verification on the draft, and converts the configuration draft that passes the verification into a formal business configuration file and environment configuration file; a configuration file identification submodule, which is configured to determine a business version identifier for the business configuration file and the environment configuration file, and store each configuration file in a central file storage system to register the business version identifier in the version information library.

[0124] Based on any embodiment of the device of the present application, the configuration file deployment module 5300 includes: a change monitoring submodule, configured to monitor whether the business version identifier of the search service in the version information library changes, and if so, trigger a version update event; a version update event response submodule, configured to respond to the version update event, and deploy the offline data synchronization service and / or online query service of the search service according to the corresponding business configuration file and / or environment configuration file; a search service rollback submodule, configured to perform a rollback operation on the search service when the deployment of the search service fails, and roll back to the search service state corresponding to the business configuration file and / or environment configuration file corresponding to the previous version.

[0125] Based on any embodiment of the device of the present application, the configuration file deployment module 5300 also includes: a preliminary testing sub-module, configured to deploy the newly generated business configuration file and environment configuration file to the new search service instance, and perform preliminary testing in an isolated environment; a service switching sub-module, configured to enter a traffic switching period after the search service instance passes the test and becomes a new service, and during the traffic switching period, some user requests accessing the search service are gradually switched from the old service of the search service to the new service; a performance indicator judgment sub-module, configured to monitor the performance indicator of the new service in real time during the traffic switching period, and when the performance indicator meets the preset conditions, all remaining user requests of the old service are switched to the new service, and the old version of the search service is disabled.

[0126] Based on any embodiment of the device of the present application, the configuration file deployment module 5300 also includes: a configuration file parsing submodule, configured to parse the environment configuration file to determine the environment settings and query parameters required for the online query service, and to parse the business configuration file to determine the business logic and synchronization parameters required for the offline data synchronization service; an adaptation and initialization submodule, configured to adapt and initialize the online query service and the offline data synchronization service according to the environment settings and business logic obtained by the analysis, so that each service can run in accordance with the requirements of the corresponding configuration file; a data source connection and synchronization submodule, configured to adjust the search engine's index and query strategy according to the query parameters, and set the data source connection and synchronization plan according to the synchronization parameters.

[0127] Based on any embodiment of the device of the present application, the online query service startup module 5400 includes: a search service deployment submodule, which is configured to deploy and start an offline data synchronization service and an online query service in a test environment; a search result collection submodule, which is configured to input predefined test data in a visual search box corresponding to the online query service and collect the returned search results; an accuracy score determination submodule, which is configured to compare the search results with preset benchmark data or the results of a previous version of the search service to determine the accuracy score of the search results; and a search service opening submodule, which opens the search service to terminal users when the accuracy score is greater than a preset threshold.

[0128] In order to solve the above technical problems, the present application also provides a computer device. Fig.10 As shown, a schematic diagram of the internal structure of a computer device. The computer device includes a processor, a computer-readable storage medium, a memory, and a network interface connected via a system bus. Among them, the computer-readable storage medium of the computer device stores an operating system, a database, and computer-readable instructions. The database may store a control information sequence. When the computer-readable instructions are executed by the processor, the processor may implement a search service configuration method. The processor of the computer device is used to provide computing and control capabilities to support the operation of the entire computer device. The memory of the computer device may store computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor may execute the search service configuration method of the present application. The network interface of the computer device is used to connect and communicate with a terminal. Those skilled in the art will understand that Fig.10 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0129] In this embodiment, the processor is used to execute Fig. 9 The memory stores the program code and various data required to execute the above modules or submodules. The network interface is used to transmit data between user terminals or servers. The memory in this embodiment stores the program code and data required to execute all modules / submodules in the search service configuration device of this application, and the server can call the program code and data of the server to execute the functions of all submodules.

[0130] The present application also provides a storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the steps of the search service configuration method of any embodiment of the present application. A person of ordinary skill in the art can understand that the implementation of all or part of the processes in the above-mentioned embodiment method of the present application can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the aforementioned storage medium can be a computer-readable storage medium such as a disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0131] It will be understood by those skilled in the art that the various operations, methods, steps, measures, and schemes in the processes discussed in this application may be alternated, changed, combined, or deleted. Furthermore, other steps, measures, and schemes in the various operations, methods, and processes discussed in this application may also be alternated, changed, rearranged, decomposed, combined, or deleted. Furthermore, the steps, measures, and schemes in the various operations, methods, and processes in the prior art that are open source and in this application may also be alternated, changed, rearranged, decomposed, combined, or deleted.

[0132] The above is only a partial implementation method of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A search service configuration method, characterized in that: include: Obtaining user configuration information submitted through the interactive page, and extracting business data parameters and environment deployment parameters corresponding to the search service, wherein the business data parameters define data business logic corresponding to the business data required by the search service from the data source, and the environment deployment parameters define environment business logic corresponding to the search engine executing the search for the business data; Applying the conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively; The business configuration file and the environment configuration file are respectively applied and deployed to the offline data synchronization service and the online query service corresponding to the search service, the online query service implements the business logic of searching by using the business data, and the offline data synchronization service implements data synchronization and update from the data source to the business data; The online query service is started to open the search service to the terminal user through the online query service.

2. The search service configuration method according to claim 1, characterized in that: Obtain the user configuration information submitted through the interactive page, and extract the business data parameters corresponding to the search service, including: On the visualization page, create the data tables that need to be synchronized through the visualization input component, assign the corresponding data source to each table, and store the configured data tables in the source database; Capturing the change events in the source database, encapsulating them into corresponding messages, and sending them to the message queue cluster; By consuming the messages stored in the message queues in the message queue cluster in parallel, the data is triggered to be automatically synchronized offline from the source database to the target data warehouse, thereby realizing the conversion from the data source to the business data required by the search service.

3. The search service configuration method according to claim 1, characterized in that: Applying the conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively includes: According to the business data parameters and environment deployment parameters in the user configuration information, the corresponding business logic template and environment deployment template are matched respectively, and the business data parameters and environment deployment parameters are matched and filled into the placeholders of the corresponding templates respectively; Generate business logic configuration draft and environment deployment configuration draft based on the filled template, perform logic verification on the draft, and convert the verified configuration draft into a formal business configuration file and environment configuration file; A service version identifier is determined for the service configuration file and the environment configuration file, and each configuration file is stored in a central file storage system to register the service version identifier in a version information repository.

4. The search service configuration method according to claims 1 to 3, characterized in that: The business configuration file and the environment configuration file are respectively applied and deployed to the online query service and the offline data synchronization service corresponding to the search service, including: Monitor whether the service version identifier of the search service in the version information library is changed, and if so, trigger a version update event; In response to the version update event, according to the corresponding business configuration file and / or environment configuration file, the offline data synchronization service and / or the online query service of the search service are deployed accordingly; When the deployment of the search service fails, a rollback operation is performed on the search service to roll back to the search service state corresponding to the business configuration file and / or the environment configuration file corresponding to the previous version.

5. The search service configuration method according to claims 1 to 3, characterized in that: The business configuration file and the environment configuration file are respectively applied and deployed to the online query service and the offline data synchronization service corresponding to the search service, including: Deploy the newly generated business configuration file and environment configuration file to the new search service instance and perform preliminary testing in an isolated environment; After the search service instance passes the test and becomes a new service, it enters a traffic switching period, and during the traffic switching period, some user requests accessing the search service are gradually switched from the old service of the search service to the new service; During the traffic switching period, the performance indicators of the new service are monitored in real time. When the performance indicators meet the preset conditions, all remaining user requests of the old service are switched to the new service, and the old version of the search service is disabled.

6. The search service configuration method according to claims 1 to 3, characterized in that: The business configuration file and the environment configuration file are respectively applied and deployed to the online query service and the offline data synchronization service corresponding to the search service, including: Parse the environment configuration file to determine the environment settings and query parameters required for the online query service, and parse the business configuration file to determine the business logic and synchronization parameters required for the offline data synchronization service; According to the environment settings and business logic obtained through analysis, the online query service and offline data synchronization service are adapted and initialized so that each service can run according to the requirements of the corresponding configuration files; The search engine's index and query strategy are adjusted according to the query parameters, and the data source connection and synchronization plan are set according to the synchronization parameters.

7. The search service configuration method according to claim 1, characterized in that: Before the step of starting the online query service to open the search service to the terminal user through the online query service, the method includes: Deploy and start offline data synchronization services and online query services in the test environment; Entering predefined test data in the visual search box corresponding to the online query service, and collecting the returned search results; Comparing the search results with preset benchmark data or previous versions of search service results to determine the accuracy score of the search results; When the accuracy score is greater than a preset threshold, the search service is opened to the end user.

8. A search service configuration device, characterized in that: include: A parameter extraction module is used to obtain user configuration information submitted through an interactive page, and extract business data parameters and environment deployment parameters corresponding to the search service. The business data parameters define the data business logic corresponding to the business data required by the search service from the data source, and the environment deployment parameters define the environment business logic corresponding to the search engine executing the search for the business data. An executable configuration file generation module, used to apply a conversion template to convert the business data parameters and environment deployment parameters into executable business configuration files and environment configuration files respectively; A configuration file deployment module, used to deploy the business configuration file and the environment configuration file to the offline data synchronization service and the online query service corresponding to the search service, respectively, so that the online query service implements the business logic of searching using the business data, and the offline data synchronization service implements data synchronization and update from the data source to the business data; The online query service starting module is used to start the online query service to open the search service to the terminal user through the online query service.

9. A computer device comprising a central processing unit and a memory, characterized in that: The central processing unit is used to call and run a computer program stored in the memory to execute the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: It stores a computer program implemented according to the method described in any one of claims 1 to 7 in the form of computer-readable instructions, and when the computer program is called and executed by a computer, the steps included in the corresponding method are executed.

Images