Data real-time labeling method and device, equipment and medium

By obtaining user information, collecting tag information, writing asynchronously to the tag library and monitoring in real time, the problem of low data synchronization and real-time tag generation in the existing technology is solved, and efficient and accurate data synchronization and real-time tag generation are achieved.

CN119444286APending Publication Date: 2025-02-14CHINA PING AN LIFE INSURANCE CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411568270.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-05
Publication Date
2025-02-14

AI Technical Summary

Technical Problem

In the prior art, the problem of low data synchronization efficiency and low real-time tag generation efficiency leads to inability to timely reflect changes in user behavior and preferences, affecting system performance and user experience.

Method used

By obtaining user information, the preset software development toolkit module collects the tag information of the changed user information, and sends the tag information to the message component using non-blocking input and output methods, writes it asynchronously to the tag library, and monitors the tag library in real time The tag information within it generates real-time tags.

Benefits of technology

It improves data synchronization efficiency and real-time label generation efficiency, ensures data accuracy and timeliness, optimizes resource usage efficiency, and enhances system flexibility and scalability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119444286A_ABST
    Figure CN119444286A_ABST
Patent Text Reader

Abstract

The invention relates to the field of big data technology and financial science and technology, and discloses a data real-time labeling method, device and equipment and a storage medium, and the method comprises the steps: obtaining user information, collecting label information of the changed user information through a preset software development kit module, and sending the label information to a preset message component by using a non-blocking input and output mode, asynchronously writing the label information in the message component into a label library, and generating a real-time label by using change data of the label information in the label library. According to the invention, the data synchronization efficiency and the real-time label generation efficiency can be effectively improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the fields of big data technology and financial technology, and in particular to a method, device, equipment and medium for real-time data labeling. Background Art

[0002] In the traditional model, the generation of user tags mainly relies on offline calculations of big data, which usually involves the analysis and processing of a large amount of historical data. Although this method can generate relatively accurate user portraits, its timeliness is limited, resulting in the inability to reflect changes in user behavior and preferences in real time. The execution interval of scheduled tasks often leads to a lag in information updates, making it impossible to respond to market demand or user dynamics in a timely manner.

[0003] In addition, the calculation and synchronization of large batches of data consumes a lot of computing resources and network bandwidth, which not only increases the operation and maintenance costs, but may also affect the overall performance of the system. For some business scenarios that require rapid response to market changes, traditional offline computing methods are particularly insufficient. For example, during periods of stock market fluctuations, investors' risk preferences and investment strategies may change significantly. If user tag updates lag behind, financial service providers may not be able to provide investment advice or financial products that meet user needs in a timely manner, which in turn affects customer experience and investment decisions.

[0004] The existing technologies currently have problems with low data synchronization efficiency and low real-time label generation efficiency. Summary of the invention

[0005] The present invention provides a method, device, equipment and medium for real-time labeling of data, the main purpose of which is to solve the problems of low data synchronization efficiency and low real-time label generation efficiency.

[0006] In a first aspect, to achieve the above-mentioned purpose, the present invention provides a method for real-time data labeling, comprising:

[0007] Obtain user information and collect tag information of changed user information through a preset software development toolkit module;

[0008] Sending the tag information to a preset message component using a non-blocking input and output method;

[0009] Asynchronously writing the tag information in the message component into a tag library;

[0010] The real-time tags are generated by using the change data of the tag information in the tag library.

[0011] In a second aspect, the present invention further provides a device for real-time data labeling, the device comprising:

[0012] An information collection module is used to obtain user information and collect tag information of changed user information through a preset software development toolkit module;

[0013] A label sending module, used for sending the label information to a preset message component by using a non-blocking input and output method;

[0014] A tag writing module, used for asynchronously writing the tag information in the message component into a tag library;

[0015] The label generation module is used to generate real-time labels using the change data of the label information in the label library.

[0016] In a third aspect, the present invention further provides an electronic device, the electronic device comprising:

[0017] at least one processor; and,

[0018] a memory communicatively connected to the at least one processor; wherein,

[0019] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the above-mentioned method for real-time data tagging.

[0020] In a fourth aspect, the present invention further provides a computer-readable storage medium, wherein at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is executed by a processor in an electronic device to implement the above-mentioned method of real-time data labeling.

[0021] The present invention obtains user information, collects tag information of changed user information through a preset software development toolkit module, sends the tag information to a preset message component using a non-blocking input and output method, and defines a storage queue to effectively manage the received tag information, which not only ensures that a large amount of data can be processed efficiently and stably, but also triggers further processing when a preset quantity threshold is reached, thereby effectively optimizing the efficiency of resource use, and asynchronously writes the tag information in the message component to a tag library. The asynchronous writing method can better utilize system resources and enhance the flexibility and scalability of the system. Real-time monitoring of the tag information in the tag library can ensure the accuracy and timeliness of the data. When changed data is found, the system can intelligently define the attributes and categories of the tags by extracting key user behaviors, thereby generating real-time tags using the changed data of the tag information in the tag library, effectively improving data synchronization efficiency and real-time tag generation efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0023] Figure 1 This is a schematic diagram of an application environment of a method for real-time data labeling in one embodiment of the present invention;

[0024] Figure 2 A schematic diagram of a flow chart of a method for real-time data labeling provided by an embodiment of the present invention;

[0025] Figure 3 A schematic diagram of a module of a device for real-time data labeling provided by an embodiment of the present invention;

[0026] Figure 4 A schematic diagram of the structure of an electronic device for implementing a method for real-time data tagging provided by an embodiment of the present invention;

[0027] Figure 5 It is another structural schematic diagram of an electronic device for implementing a method for real-time data tagging provided by an embodiment of the present invention.

[0028] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the technical solution of the present disclosure, and to fully understand and implement how the present disclosure applies technical means to solve technical problems and achieve the corresponding technical effects, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only embodiments of a part of the present disclosure, not all of the embodiments. The embodiments of the present disclosure and the various features in the embodiments can be combined with each other without conflict, and the technical solutions formed are all within the scope of protection of the present disclosure. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative work should fall within the scope of protection of the present disclosure.

[0030] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, device, product or equipment that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0031] An embodiment of the present application provides a method for real-time labeling of data, and the execution subject of the method for real-time labeling of data includes but is not limited to at least one of the electronic devices such as a server, a terminal, etc. that can be configured to execute the device provided in the embodiment of the present application. In other words, the method for real-time labeling of data can be executed by software or hardware installed on a terminal device or a server device. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc. The server can be an independent server, or it can be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms.

[0032] The present invention provides a method for real-time data labeling, which can be applied in the following aspects: Figure 1In the application environment. Among them, the client communicates with the server through the network. The server can obtain user information through the client, collect the tag information of the changed user information through the preset software development kit module, send the tag information to the preset message component using a non-blocking input and output method, define a storage queue to effectively manage the received tag information, trigger further processing when the preset quantity threshold is reached, thereby effectively optimizing the efficiency of resource use, and asynchronously write the tag information in the message component to the tag library. The asynchronous writing method can enhance the flexibility and scalability of the system, and the real-time monitoring of the tag information in the tag library can ensure the accuracy and timeliness of the data. When the changed data is found, by extracting key user behaviors, the system can intelligently define the attributes and categories of the tags, thereby generating real-time tags using the changed data of the tag information in the tag library, and feeding back the final real-time tags to the client. Among them, the client can be but not limited to various personal computers, laptops, smart phones, tablet computers and portable wearable devices. The server can be implemented with an independent server or a server cluster consisting of multiple servers. The present invention is described in detail below through specific embodiments.

[0033] Reference Figure 2 FIG. 1 is a flow chart of a method for real-time data labeling provided by an embodiment of the present invention. In this embodiment, the method for real-time data labeling includes:

[0034] S1. Obtain user information and collect label information of changed user information through a preset software development toolkit module.

[0035] In an embodiment of the present invention, changed user information refers to any changes made by the user to the user's personal profile, settings or preferences within a specific time period, including: personal information (such as name, email address, address); account settings (such as password, notification settings); usage behavior (such as frequency of use, functions accessed); preference settings (such as language, theme), etc.

[0036] A software development kit module is a collection of tools, libraries, and documents that help developers create software applications. A software development kit usually provides predefined functions and interfaces to simplify the integration process of a specific platform or service. By using a software development kit, developers can quickly implement complex functions such as data access, user authentication, or calling third-party services, thereby improving development efficiency and reducing development costs.

[0037] By initializing the preset software development kit module, monitoring user operations, and collecting and storing change information, we can not only understand user behavior changes in a timely manner, but also provide data support for the subsequent generation of real-time tags.

[0038] In detail, the tag information of the changed user information is collected by the preset software development kit module, including:

[0039] generating a first tag according to the user information;

[0040] Configuring a preset listener into the software development kit module to obtain a listening module;

[0041] Using the monitoring module to monitor the change status of the user information to obtain the change information;

[0042] The change information is marked, and the marked change information is written into the first tag to obtain tag information.

[0043] Furthermore, a preset listener configuration is performed on the software development kit mode. First, a listener interface is created, the listener is instantiated and connected to the above interface, the instantiated object will respond to changes in user information, and then the instantiated changed user information is registered in the software development kit module. The software development kit module checks the status of user information regularly or when a specific event is triggered (for example, when the user performs an update operation). If it is found that the user information has changed, such as an update of the user's name, email address or other information, change monitoring is triggered. Once the change is detected, the software development kit will record the user information before and after the change. The user information before and after the change is passed to the listener, the changed user information is marked, and the marked user information is written to the preset first tag. Finally, the processed user information will form tag information.

[0044] In detail, marking the change information, writing the marked change information into the first tag, and obtaining the tag information includes:

[0045] Marking the change information using a preset status tag to obtain marking information;

[0046] Matching the marking information with the first label to determine whether the first label contains content consistent with the marking information;

[0047] When the first tag contains content consistent with the marking information, the match is successful, and the tag to which the marking information belongs is updated according to the matched first tag to obtain the tag information;

[0048] When the first tag does not contain content consistent with the tag information, the match fails, and a preset second tag is created, and the tag information is written into the second tag to obtain tag information.

[0049] In detail, the status tags include: "new", "modified", "deleted", etc., indicating the type of change. Define a series of first tags, which can be classifications for user interests, behavior patterns, purchase intentions, etc., such as "high-value users", "potential churn users", "frequent shopping", etc. Ensure that the first tags can cover the identified change information to facilitate matching the change information with related tags.

[0050] In a specific embodiment, user behavior analysis is crucial to risk management and customer relationship maintenance. Suppose a bank wants to identify potential abnormal behaviors through user transaction data. First, the bank uses preset status tags, such as "high-risk transactions", "normal transactions" and "pending transactions", to mark the user's change information. For example, if a user's change information is the transaction amount, the transaction amount is abnormal and comes from a high-risk area, the change information is marked as "high-risk transaction". Then, the marked information is matched with the existing first tag to determine whether there is content consistent with the marked information in the first tag. If it is found that there is consistent content of "high-risk transaction" in the existing tag, the match is successful, and the tag to which the marked information belongs is updated according to the matched first tag. If the match fails, that is, no relevant information is found in the first tag, the system creates a new second tag, marked as "new risk transaction", and writes the marked information into it.

[0051] By configuring the preset listener for the SDK module, we can achieve real-time monitoring of user information. When user information changes, the monitoring module can quickly capture these changes and generate corresponding change information. Subsequently, the change information is marked and written into the preset first tag, which can effectively manage and organize user data, not only improving the efficiency of data processing, but also enhancing the efficiency of data synchronization.

[0052] S2. Send the tag information to a preset message component using a non-blocking input and output method.

[0053] In an embodiment of the present invention, non-blocking I / O operations are performed using Java non-blocking input and output or other programming languages ​​that support non-blocking input and output in a software development kit module. By utilizing the asynchronous characteristics of non-blocking input and output, the execution of the main thread will not be blocked during the generation of tag information, which can improve the response speed and processing power of the overall system. Message components refer to modules or units used to send, receive and process messages in a software architecture or system. They are usually responsible for transmitting information between different systems, services or components to achieve loose coupling, asynchronous communication and efficient data exchange.

[0054] In detail, the step of sending the tag information to a preset message component by using a non-blocking input and output method includes:

[0055] Receiving the tag information using a non-blocking input and output method;

[0056] Writing the tag information into a preset storage queue, and counting the amount of the tag information in the storage queue;

[0057] Determine whether the amount of the tag information is greater than a preset amount threshold;

[0058] If the tag information is less than or equal to the quantity threshold, continue to write the tag information into the storage queue;

[0059] If the amount of the tag information is greater than the amount threshold, packaging the tag information in the storage queue into a message body;

[0060] The message body is sent to the message component.

[0061] Furthermore, the receiving the tag information by using a non-blocking input and output method includes:

[0062] Get the selector, channel, and monitoring event type of non-blocking input and output mode;

[0063] Register the channel to the selector, and read the data in the channel according to the listening event type;

[0064] When the tag information in the channel conforms to the listening event type and can be read, the tag information is received through the selector.

[0065] In detail, the selector is responsible for listening to the I / O events of multiple channels, while the channel is used to interact with external systems for data. Register the channel to the selector to listen to the connection and data reception events. When registering, you can specify the event type to listen to and define the event type to listen to, such as readable and writable. Using the selector and channel mechanism for non-blocking input and output, efficient non-blocking I / O operations can be achieved. This method allows applications to process multiple channels at the same time, and dynamically monitor which channels have readable data through the selector, thereby reducing thread creation and context switching. When the data in the channel meets the listening event type, the selector can quickly respond and process the data, ensuring real-time and high efficiency, greatly enhancing the responsiveness and resource utilization of the application when handling a large number of concurrent connections.

[0066] In the process of receiving tag information using non-blocking input and output methods and storing the tag information in a queue, a storage queue can be defined to effectively manage the received tag information, which not only ensures that a large amount of data can be processed efficiently and stably, but also triggers further processing when a preset quantity threshold is reached, thereby avoiding performance bottlenecks due to data overload. By processing messages in batches, the efficiency of resource utilization can also be effectively optimized.

[0067] S3. Asynchronously write the tag information in the message component into the tag library.

[0068] In the embodiment of the present invention, asynchronous refers to an operation mode in which the execution of a task and the processing of the result of the task do not have to be completed at the same time in the system. In the asynchronous model, the caller does not need to wait for the task to be completed before continuing to perform subsequent operations, but can continue to perform other tasks while the task is in progress.

[0069] In detail, the step of asynchronously writing the tag information in the message component into the tag library includes:

[0070] Obtaining a message body of the tag information from the message component;

[0071] Parsing the message body and extracting key information from the parsed message body;

[0072] The key information is formatted and the format-converted key information is asynchronously written into a tag library.

[0073] Furthermore, by obtaining the message body of the tag information, the latest tag data can be received in real time. The message body is parsed, and key information such as tag ID, name, timestamp, etc. in the parsed message body is extracted to provide data support for the subsequent generation of real-time tags. The key information is converted into the format required by the tag library. For example, the name or data type of certain fields is adjusted to ensure that it matches the data structure of the tag library. The asynchronous writing method allows other operations to be not blocked when the key information after format conversion is stored in the database, thereby improving the overall processing efficiency. The write operation will be performed in the background, allowing the system to continue to receive and process new messages, improving the system's responsiveness and throughput.

[0074] In a specific embodiment, assume that a financial institution is using a message component to process market data. This message component receives information from various data sources (such as stock exchanges, news organizations, social media, etc.). The message body contains a real-time update about a certain stock, including the stock code, current price, increase or decrease, trading volume, etc. After receiving the message body, the message body is parsed to extract key information, such as: stock code: AAPL, current price: 150.25USD, increase or decrease: +2.5%, trading volume: 1,000,000 shares. After parsing the key information, the key information is formatted. For example, the increase or decrease is converted from a percentage to a decimal format. The key information after these format conversions will be written to the tag library in an asynchronous manner, and the tag library can dynamically update the corresponding tags based on this information.

[0075] By obtaining the message body of the tag information from the message component and parsing it, extracting the key information, converting the format of this information and asynchronously writing it into the tag library, the data processing efficiency and system responsiveness can be significantly improved. The asynchronous writing method can better utilize system resources, enhance the flexibility and scalability of the system, and provide users with a smoother operating experience.

[0076] S4. Generate real-time tags using the change data of tag information in the tag library.

[0077] In an embodiment of the present invention, a tag library is a database for storing, managing and querying tag information. Tags are usually keywords or tags used to classify and describe data, content or resources. The tag library provides a structured way to process these tags for subsequent data management and analysis. Real-time tags refer to tags that are dynamically generated and updated based on changes in data within the system or user behavior. Real-time tags can instantly reflect the current status, trends or specific conditions, and are used to describe, classify or enhance the usability of data.

[0078] The system continuously monitors the tag information in the tag library, obtains real-time information, and compares it with the existing first tag to determine whether the real-time information is consistent with the tag information in the tag library. If the real-time information is consistent with the tag library, the system will continue to monitor; if not, the system will extract the change data and analyze the key user behaviors of the change data, match the attributes and categories of the relevant tags based on these key behaviors, and finally generate new real-time tags.

[0079] In detail, the step of generating a real-time tag using the change data of the tag information in the tag library includes:

[0080] Performing real-time monitoring on the tag information in the tag library to obtain real-time information;

[0081] Determine whether the real-time information is consistent with the tag information in the tag library;

[0082] If the real-time information is consistent with the tag information in the tag library, returning to the step of real-time monitoring of the tag information in the tag library;

[0083] If the real-time information is inconsistent with the tag information in the tag library, extract the inconsistent data in the real-time information according to the tag information in the tag library to obtain the changed data;

[0084] Extract key user behaviors of the change data;

[0085] Matching the attributes and categories of the first tag and the second tag according to the key user behavior;

[0086] Real-time tags are generated according to the key user behaviors, the attributes, and the categories.

[0087] In detail, the first tag refers to a tag generated in advance according to user information, and the second tag refers to a new tag created according to the tag information when no corresponding tag is found in the first tag.

[0088] For example, the interests, geographic location, age and other information filled in by the user when registering can form the first label. For example, a user's first label may be "sports enthusiast", "male", "from Shanghai". Users often browse finance-related content during use, but do not provide relevant information when registering, and no relevant information is found in the first label, then a second label will be generated based on their behavior, such as "focus on finance". This can better understand the diverse interests of users and provide more accurate personalized recommendations and services. By labeling user information, it is possible to more effectively analyze user behavior, optimize marketing strategies, improve user experience, and ultimately achieve higher conversion rates and customer satisfaction.

[0089] Before generating real-time tags, you need to define specific attributes and categories for these tags. For example, tags can be classified based on user interests (such as "technology enthusiasts", "sports enthusiasts"), purchase intentions (such as "about to buy", "following"), or other behaviors (such as "active users", "potential churners"). Clarifying the purpose and usage scenarios of tags will help to apply these tags more effectively in subsequent data processing and analysis.

[0090] Furthermore, the latest tag information is queried from the tag library, and the target customer groups are identified and divided based on the latest tag information. According to the real-time tag information, the marketing strategy, user grouping or pushed content can be adjusted. The system can automatically update the target user range by analyzing the user's tag information to achieve more accurate marketing. Suppose there is an activity open to active users in the last 30 days. According to the active tag information in the database, the user group that has been active in the last 30 days is circled. When the user performs an operation on the APP (such as logging in, browsing, etc.), the system will instantly update the active tags of the user in the tag library. The system will automatically add newly active users in the last 30 days to the corresponding user groups in an event-driven manner.

[0091] Real-time monitoring of tag information in the tag library is the key to ensuring data accuracy and timeliness. When changing data is identified, by extracting key user behaviors, the attributes and categories of tag information can be intelligently defined, which not only optimizes the real-time tag generation process, but also enhances the adaptability of data. For example, by analyzing users' real-time behaviors such as browsing, clicking, and purchasing, the system can quickly identify users' latest interests and needs, thereby adjusting tags more accurately.

[0092] In detail, it not only significantly improves the data synchronization rate and effectively reduces the delay problem existing in traditional offline computing methods, so that tags can instantly reflect changes in user behavior. It also improves the efficiency of generating real-time tags, can automatically process and update tag information, and reduces the complexity of manual intervention and data processing.

[0093] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0094] like Figure 3 , which is a functional module diagram of a data real-time tag device provided by an embodiment of the present invention.

[0095] In the embodiment of the present disclosure, a device for real-time data labeling is provided, and the device for real-time data labeling corresponds to the method for real-time data labeling in the above embodiment. Figure 3 As shown, the device 100 for real-time data labeling can be installed in an electronic device. According to the functions to be implemented, the device 100 for real-time data labeling includes an information collection module 101, a label sending module 102, a label writing module 103, and a label generating module 104. The functional modules are described in detail as follows:

[0096] The information collection module 101 is used to obtain user information and collect tag information of the changed user information through a preset software development toolkit module;

[0097] The tag sending module 102 is used to send the tag information to a preset message component by using a non-blocking input and output method;

[0098] The tag writing module 103 is used to asynchronously write the tag information in the message component into the tag library;

[0099] The label generation module 104 is used to generate real-time labels using the change data of the label information in the label library.

[0100] In one embodiment, when the information collection module 101 acquires user information and collects tag information of the changed user information through a preset software development kit module, it is used to:

[0101] generating a first tag according to the user information;

[0102] Configuring a preset listener into the software development kit module to obtain a listening module;

[0103] Using the monitoring module to monitor the change status of the user information to obtain the change information;

[0104] The change information is marked, and the marked change information is written into the first tag to obtain tag information.

[0105] In one embodiment, when the information collection module 101 performs tagging of the change information and writes the marked change information into the first tag to obtain the tag information, it is used to:

[0106] Marking the change information using a preset status tag to obtain marking information;

[0107] Matching the marking information with the first label to determine whether the first label contains content consistent with the marking information;

[0108] When the first tag contains content consistent with the marking information, the match is successful, and the tag to which the marking information belongs is updated according to the matched first tag to obtain the tag information;

[0109] When the first tag does not contain content consistent with the tag information, the match fails, and a preset second tag is created, and the tag information is written into the second tag to obtain tag information.

[0110] In one embodiment, when the tag sending module 102 sends the tag information to a preset message component by using a non-blocking input and output method, it is used to:

[0111] Receiving the tag information using a non-blocking input and output method;

[0112] Writing the tag information into a preset storage queue, and counting the amount of the tag information in the storage queue;

[0113] Determine whether the amount of the tag information is greater than a preset amount threshold;

[0114] If the tag information is less than or equal to the quantity threshold, continue to write the tag information into the storage queue;

[0115] If the amount of the tag information is greater than the amount threshold, packaging the tag information in the storage queue into a message body;

[0116] The message body is sent to the message component.

[0117] In one embodiment, when the tag sending module 102 receives the tag information by using a non-blocking input and output method, it is used to:

[0118] Get the selector, channel, and monitoring event type of non-blocking input and output mode;

[0119] Register the channel to the selector, and read the data in the channel according to the listening event type;

[0120] When the tag information in the channel conforms to the listening event type and can be read, the tag information is received through the selector.

[0121] In one embodiment, when executing the asynchronous writing of the tag information in the message component into the tag library, the tag writing module 103 is used to:

[0122] Obtaining a message body of the tag information from the message component;

[0123] Parsing the message body and extracting key information from the parsed message body;

[0124] The key information is formatted and the format-converted key information is asynchronously written into a tag library.

[0125] In one embodiment, when the tag generation module 104 generates real-time tags using the change data of the tag information in the tag library, it is used to:

[0126] Performing real-time monitoring on the tag information in the tag library to obtain real-time information;

[0127] Determine whether the real-time information is consistent with the tag information in the tag library;

[0128] If the real-time information is consistent with the tag information in the tag library, returning to the step of real-time monitoring of the tag information in the tag library;

[0129] If the real-time information is inconsistent with the tag information in the tag library, then extracting the inconsistent data in the real-time information according to the tag information in the tag library to obtain the changed data;

[0130] Extract key user behaviors of the change data;

[0131] Matching the attributes and categories of the first tag and the second tag according to the key user behavior;

[0132] Real-time tags are generated according to the key user behaviors, the attributes, and the categories.

[0133] In the present invention, for a data real-time tag, first, user information is obtained, and the tag information of the changed user information is collected through a preset software development kit module. Then, the tag information is sent to a preset message component using a non-blocking input and output method, and a storage queue is defined to effectively manage the received tag information, which not only ensures that a large amount of data can be processed efficiently and stably, but also triggers further processing when a preset quantity threshold is reached, thereby effectively optimizing the efficiency of resource use, and asynchronously writing the tag information in the message component to the tag library. The asynchronous writing method can better utilize system resources and enhance the flexibility and scalability of the system. Finally, real-time monitoring of the tag information in the tag library can ensure the accuracy and timeliness of the data. When changing data is found, by extracting key user behaviors, the system can intelligently define the attributes and categories of the tags, thereby generating real-time tags using the changing data of the tag information in the tag library, effectively improving data synchronization efficiency and real-time tag generation efficiency. The specific definition of a data real-time tag device can refer to the definition of a data real-time tag method in the above text, which will not be repeated here. The various modules in the above-mentioned data real-time tag device can be implemented in whole or in part by software, hardware and their combination. The above modules may be embedded in or independent of a processor in a computer device in the form of hardware, or may be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to the above modules.

[0134] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 4As shown. The computer device includes a processor, a memory, a network interface and a database connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile and / or volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external client via a network connection. When the computer program is executed by the processor, it implements the functions or steps of a method for real-time data labeling on the service side.

[0135] In one embodiment, a computer device is provided. The computer device may be a client, and its internal structure diagram may be as follows: Figure 5 As shown. The computer device includes a processor, a memory, a network interface, a display screen and an input device connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external server via a network connection. When the computer program is executed by the processor, the functions or steps on the client side of a method for real-time data labeling are implemented.

[0136] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:

[0137] Obtain user information and collect tag information of changed user information through a preset software development toolkit module;

[0138] Sending the tag information to a preset message component using a non-blocking input and output method;

[0139] Asynchronously writing the tag information in the message component into a tag library;

[0140] The real-time tags are generated by using the change data of the tag information in the tag library.

[0141] In the several embodiments provided by the present invention, it should be understood that the disclosed devices and apparatuses can be implemented in other ways. For example, the system embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation.

[0142] In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0143] Therefore, no matter from which point of view, the embodiments should be regarded as illustrative and non-restrictive, and the scope of the present invention is limited by the appended claims rather than the above description, so it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention. Any attached figure mark in the claims should not be regarded as limiting the claims involved.

[0144] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0145] In some implementations of this embodiment, a computer-readable storage medium is provided, on which a computer program is stored, characterized in that when the computer program is executed by a processor, the steps of the method described in the above embodiment are implemented.

[0146] The readable storage medium of the present invention stores a computer program, and when the computer program is executed by a processor of an electronic device, the computer program can achieve:

[0147] Obtain user information and collect tag information of changed user information through a preset software development toolkit module;

[0148] Sending the tag information to a preset message component using a non-blocking input and output method;

[0149] Asynchronously writing the tag information in the message component into a tag library;

[0150] The real-time tags are generated by using the change data of the tag information in the tag library.

[0151] It should be noted that the above functions or steps that can be implemented by the computer-readable storage medium or computer device can refer to the relevant descriptions on the server side and the client side in the aforementioned method embodiment. To avoid repetition, they will not be described one by one here.

[0152] The computer-readable storage medium may also store at least one computer executable program / instruction, which may be, for example, a computer-readable instruction. The computer-readable storage medium includes, but is not limited to, for example, a volatile memory and / or a non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The computer-readable storage medium may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. For example, a non-transitory computer-readable storage medium may be connected to a computing device such as a computer, and then, when the computing device runs the computer-readable instructions stored on the computer-readable storage medium, the various methods described above may be performed.

[0153] In addition, the computer device may also include (but not limited to) a data bus, an input / output (I / O) bus, a display, and input / output devices (eg, keyboard, mouse, speaker, etc.), etc.

[0154] The processor may communicate with external devices via an I / O bus via a wired or wireless network.

[0155] In one embodiment, the at least one computer executable instruction may also be compiled into or constitute a software product / computer program product, wherein one or more computer executable instructions are executed by a processor to perform the various functions and / or method steps in the embodiments described in the present technology.

[0156] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0157] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0158] In the embodiments provided in the present disclosure, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the above-mentioned module, program segment or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0159] It should be noted that in the present disclosure, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element limited by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0160] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

[0161] It should be noted that if software tools or components other than those of our company appear in the embodiments of the present application, they are only used for illustrative purposes and do not represent actual use.

Claims

1. A method for real-time data labeling, characterized in that: The method comprises: Obtain user information and collect tag information of changed user information through a preset software development toolkit module; Sending the tag information to a preset message component using a non-blocking input and output method; Asynchronously writing the tag information in the message component into a tag library; The real-time tags are generated by using the change data of the tag information in the tag library.

2. A method for real-time data labeling as claimed in claim 1, characterized in that: The tag information of the changed user information is collected by the preset software development toolkit module, including: generating a first tag according to the user information; Configuring a preset listener into the software development kit module to obtain a listening module; Using the monitoring module to monitor the change status of the user information to obtain the change information; The change information is marked, and the marked change information is written into the first tag to obtain tag information.

3. A method for real-time data labeling as claimed in claim 2, characterized in that: The step of marking the change information and writing the marked change information into the first tag to obtain tag information includes: Marking the change information using a preset status tag to obtain marking information; Matching the marking information with the first label to determine whether the first label contains content consistent with the marking information; When the first tag contains content consistent with the marking information, the match is successful, and the tag to which the marking information belongs is updated according to the matched first tag to obtain the tag information; When the first tag does not contain content consistent with the tag information, the match fails, and a preset second tag is created, and the tag information is written into the second tag to obtain tag information.

4. A method for real-time data labeling as claimed in claim 1, characterized in that: The step of sending the tag information to a preset message component by using a non-blocking input and output method includes: Receiving the tag information using a non-blocking input and output method; Writing the tag information into a preset storage queue, and counting the amount of the tag information in the storage queue; Determine whether the amount of the tag information is greater than a preset amount threshold; If the tag information is less than or equal to the quantity threshold, continue to write the tag information into the storage queue; If the amount of the tag information is greater than the amount threshold, packaging the tag information in the storage queue into a message body; The message body is sent to the message component.

5. A method for real-time data labeling as claimed in claim 4, characterized in that: The receiving the label information by using a non-blocking input and output method includes: Get the selector, channel, and monitoring event type of non-blocking input and output mode; Register the channel to the selector, and read the data in the channel according to the listening event type; When the tag information in the channel conforms to the listening event type and can be read, the tag information is received through the selector.

6. A method for real-time data labeling as claimed in claim 1, characterized in that: The step of asynchronously writing the tag information in the message component into a tag library includes: Obtaining a message body of the tag information from the message component; Parsing the message body and extracting key information from the parsed message body; The key information is formatted and the format-converted key information is asynchronously written into a tag library.

7. A method for real-time data labeling as claimed in claim 1, characterized in that: The step of generating a real-time label by using the change data of the label information in the label library includes: Performing real-time monitoring on the tag information in the tag library to obtain real-time information; Determine whether the real-time information is consistent with the tag information in the tag library; If the real-time information is consistent with the tag information in the tag library, returning to the step of real-time monitoring of the tag information in the tag library; If the real-time information is inconsistent with the tag information in the tag library, extract the inconsistent data in the real-time information according to the tag information in the tag library to obtain the changed data; Extract key user behaviors of the change data; Matching the attributes and categories of the first tag and the second tag according to the key user behavior; Real-time tags are generated according to the key user behaviors, the attributes, and the categories.

8. A device for real-time data labeling, characterized in that: The device comprises: An information collection module is used to obtain user information and collect tag information of changed user information through a preset software development toolkit module; A label sending module, used for sending the label information to a preset message component by using a non-blocking input and output method; A tag writing module, used for asynchronously writing the tag information in the message component into a tag library; The label generation module is used to generate real-time labels using the change data of the label information in the label library.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute a method for real-time data tagging as described in any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, a method for real-time data labeling as described in any one of claims 1 to 7 is implemented.

Citation Information

Cited By

  • Label management method and system, terminal and storage medium

    CN120578669A