1331 results about "Message processing" patented technology

The invention relates to a lightweight asynchronous message processing method and system for a high-concurrency scene, and the method comprises the steps: receiving a message request of a client, carrying out the preprocessing of the message request, and generating a to-be-processed message; distributing the to-be-processed message to a multi-level priority queue based on a priority scheduling mechanism; dynamically adjusting the number of core threads and the maximum number of threads of the thread pool according to the resource state data, and forming a thread pool resource configuration scheme of the current scheduling period; dynamically calculating the message processing quantity of the current scheduling batch based on the message accumulation quantity of each priority queue, the thread pool resource configuration scheme, the CPU utilization rate in the resource state data and the JVM heap memory utilization rate; and based on the out-of-heap memory buffer area reference, assigning the to-be-processed message object to a corresponding processing thread to execute a service processing logic until the processing operation of the messages in all the scheduling units is completed. The method has the effect of improving the resource adaptability of the asynchronous message processing architecture.

The invention provides a main Monitor service pressure optimization method in a distributed storage cluster, and the method comprises the steps: S1, collecting the load state information of each Monitor node in real time through a monitoring module, and enabling the load state information to comprise the CPU utilization rate, the memory occupancy rate and the network bandwidth occupancy rate; s2, a load balancing module calculates the load weight of each Monitor node based on the load state information, and dynamically adjusts a message distribution strategy according to the load weight; s3, the multi-stage message distribution module distributes the state updating message to a plurality of Monitor nodes for parallel processing according to the message distribution strategy; and S4, the state synchronization module maintains the state consistency among the Monitor nodes through a consistency protocol, and regularly verifies the data version of each node. According to the main Monitor service pressure optimization method in the distributed storage cluster provided by the embodiment of the invention, the load pressure of the main Monitor node in the distributed storage upgrading process is effectively reduced, and the system message processing efficiency and stability are improved.

The invention provides an intelligent self-adaptive RDMA message processing method for power grid data transmission, and the method comprises the steps: S1, obtaining parameters, carrying out the initialization of a credit line value and a retransmission priority, and creating a data transmission task; s2, sending the data message to a second RDMA network card of an opposite terminal device through the first RDMA network card; after receiving the data message, the second RDMA network card generates a corresponding response message and sends the response message back to the sending end; s3, analyzing the response message, determining the type of the response message, and storing correctly received data; s4, performing error detection and retransmission processing by analyzing the PSN serial number of the RDMA message; and S5, dynamically adjusting and optimizing the credit line and the retransmission priority of the data message. According to the method, resource allocation can be dynamically optimized according to the real-time state of the network, priority transmission of high-priority data including power control instructions and the like is ensured, and the transmission efficiency and reliability of key data are remarkably improved.

The invention belongs to the field of computer systems, and provides a low-latency RDMA (Remote Direct Memory Access) acceleration system based on memory registration, which comprises the following steps of: registering a memory region applied by an application program by utilizing a memory pin technology in a kernel; receiving a remote direct memory access (RDMA) work request initiated by an application program, and packaging information comprising a source virtual address and a target virtual address in the request to form a work queue element; the assembly line is used for processing data receiving from a remote system and sending of local data, and hardware logic used for table look-up, QoS detection and message processing is embedded in the assembly line; the server manages the working queue, the data transmission state and the abnormal information processing in a unified manner, and is used for adjusting the transmission parameters of the RDMA acceleration system in real time according to the received context signal; a standardized software calling interface is provided, and cooperative control between software and hardware is achieved.

The invention discloses a heterogeneous unmanned aerial vehicle cluster communication message processing method and system. The method comprises the following steps that a user uploads a communication protocol document and scene description of an unmanned aerial vehicle; the method comprises the following steps: designing a multi-modal analysis mechanism on the basis of a retrieval enhancement generation (RAG) technology endowed by a large language model (LLM), automatically identifying and processing a communication protocol document, and generating a knowledge graph and a communication message specification library; based on the knowledge graph and the communication message specification library, generating a structured definition according to a scene, and converting the structured definition into a multi-format message instance; and simulating a communication scene, verifying message transmission validity, and outputting an optimization suggestion. By adopting the technical scheme, the heterogeneous unmanned aerial vehicle protocol multi-modal analysis method based on LLM + RAG improves the time for analyzing the standard document and the message instance generation efficiency.

The embodiment of the invention provides a network message processing method and device, a storage medium and electronic equipment, and the method comprises the steps: creating a group of virtual interfaces, configuring at least one associated interface for each protocol stack in a plurality of protocol stacks, carrying out the recognition of a network message under the condition that the network message is received, and transmitting the network message to a server; obtaining a message feature of the network message; and according to the message characteristics of the network message, determining a target association interface for the network message from the at least one association interface associated with each protocol stack, and forwarding the network message to a target protocol stack through the target association interface, so that the target protocol stack analyzes the network message. Through the message processing method and device, the problem that the delay of message processing is increased when the message is forwarded in the prior art is solved, the message does not need to go through unnecessary software stack overhead and directly enters the target protocol stack to be analyzed and processed, and the message processing efficiency is improved.

A message processing method includes displaying a message aggregation interface corresponding to a session interface, where the message aggregation interface includes a plurality of messages classified and displayed based on a message type, and the plurality of messages are all messages in the session interface; receiving a first input of a user for at least one first message in the plurality of messages; in response to the first input, selecting the at least one first message; receiving a second input of the user; and in response to the second input, performing a target operation on the at least one first message, where the target operation corresponds to the second input.

The invention discloses a streaming telemetry data plane forwarding method and device, and belongs to the technical field of communication. According to the method disclosed by the invention, stream telemetering is realized by processing the header of a service message through multi-level cache, and satellite nodes and paths in a spatial network are measured and monitored in a high-fineness manner; according to the method, the proportional sampling of the stream telemetering is realized through the stream classification list, so that the resource overhead of the stream telemetering is saved, and the occurrence of network congestion possibly caused by the stream telemetering is reduced; the end-to-end sending of the telemetering message is realized by pre-configuring the telemetering message output interface, and the telemetering message uploading process is simplified. Based on the streaming telemetry data plane forwarding method, the streaming telemetry data plane forwarding device comprises a service message processing subsystem which is used for service message analysis, processing and stream classification; the telemetering message processing subsystem is used for constructing and uploading a telemetering message; and the message forwarding subsystem is used for forwarding the service message and the telemetering message.

The invention provides a message processing method and device, electronic equipment and a storage medium. The method comprises the following steps: in response to a service request, executing a distributed cache operation and generating a processing message containing a service parameter; asynchronously submitting the processing message to a message queue service; if the first submission fails, triggering an instant retry mechanism to resubmit the processing message for at least one time; if the retry mechanism fails, converting the processing message into a failure record and persistently storing the failure record in a database; and scanning the failure record in the database through a timing compensation service, regenerating a processing message and submitting the processing message to a message queue service. According to the method and the device, the requirement of manual intervention is completely eliminated, the high performance of the system is maintained while the reliability of the message is ensured through cooperation of all links, and the problems of response delay, insufficient reliability and the like existing in a traditional manual processing mode are perfectly solved.

The invention relates to a message processing method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: in response to an RDMA request of a sending end, obtaining an RoCE message corresponding to the RDMA request; converting the QP pair information in the RoCE message into a corresponding hash operation result; and generating an RDMA flow identifier of the RoCE message according to the Hash operation result. By adopting the method, the load balancing effect can be improved.

The invention relates to a short message fraud detection method based on semantic and behavior feature fusion. The method comprises the following steps of short message collection, short message processing, feature extraction, fraud short message recognition and fraud short message submission. According to the method, the semantic features and the behavior features of the short messages are fused, and the overall detection precision and robustness are effectively improved.

The invention discloses an asynchronous processing method and device for business process data, and belongs to a distributed system data processing technology, and the method comprises the following steps: S101, receiving a business request message, and persistently storing the business request message in a main message queue; s102, acquiring a to-be-processed message from the main message queue, and locking an associated target data record before executing processing; s103, verifying data consistency based on the version number recorded by the target data, if the version number is matched, executing processing and updating the version number, and otherwise, discarding the message; s104, after successful processing, sending a confirmation instruction deletion message to the main message queue; through persistent storage of the main message queue, a version number verification mechanism and management of the dead message queue, the problem of data inconsistency caused by concurrent operation is effectively prevented, reliable transmission of messages is ensured, loss of service data is avoided, dead message processing efficiency is optimized, and the method has the advantages of ensuring data consistency, preventing message loss and improving system reliability.

The embodiments of the present application relate to the field of computer technology, and in particular to a data display method, device, electronic device and storage medium, which are used to solve the problem of not being able to conveniently perform interactive processing operations on data obtained from an API data source. The method is as follows: the terminal sends a first request message carrying query configuration information and operation configuration information to a processing server, and the processing server obtains API data from the API data source based on the first request message, and processes the API data based on the API fields and operation configuration information in the query configuration information, and returns the API data processing results to the terminal for display, wherein the API data source can be regarded as a database; in this way, the terminal can conveniently complete the setting of the query configuration information and the operation configuration information in the visual interface, and the processing server can perform corresponding processing on the API data based on the instructions of the terminal, thereby effectively improving the efficiency of data processing.

The invention relates to an RDMA read message processing method, an RDMA read message processing unit, a network interface card, an RDMA communication system, a computer readable storage medium and a computer program product. Determining the number n of request messages which can be sent at present according to the number of read response messages to be received at the local RDMA end and the maximum read response message window threshold allowed by the single QP; and according to the receiving sequence of the RDMA read messages and the initial position of the current RDMA read message to be processed, sequentially selecting one or more RDMA read messages from the RDMA read messages to be processed, and according to the selected one or more RDMA read messages, generating n request messages and sending the n request messages to a far-end RDMA end. And the network effective bandwidth is improved.

The embodiments of the disclosure disclose a method, an apparatus, a device and storage medium for message processing, and relate to the technical field of computers. The method includes: displaying a predetermined message identifier in a target interface, wherein at least one of predetermined media content and target resource information is presented in the target interface, and the predetermined message identifier is set to indicate that an unread message currently exists; and in response to a triggering operation of a for the predetermined message identifier, presenting a message interaction area in the target interface, and presenting the unread message sent by at least one sender in the message interaction area, wherein the message interaction area is set for message interaction between the current user and the at least one sender of a unread message.

The invention relates to the technical field of information management methods, and discloses a data query management method based on dynamic cache optimization. Comprising the steps of constructing a dynamic aging adjustment engine, and automatically adjusting cache time based on data change frequency; real-time monitoring is carried out through a database trigger and log analysis; the method comprises the following steps: acquiring a historical query record, predicting query types and time possibly initiated by a user in the future through a machine learning model, before the query time is predicted, loading predicted query type data to a cache, dynamically marking hotspot data according to an access frequency, preferentially allocating cache resources to the hotspot data, and prolonging the time efficiency; constructing a multi-level cache architecture based on a local cache and a distributed cache, and acquiring data by adopting a cache degradation strategy; an enhanced Kafka message processing mechanism is introduced; the method has the advantages of improving data query efficiency and ensuring data consistency.

The invention discloses a message processing method and device, computer equipment and a storage medium, and relates to the technical field of communication, and the method comprises the steps: reading write data belonging to a current round based on a bus when it is monitored that a central processing unit executes a C language printing function; acquiring a data identifier corresponding to the write data, and querying a corresponding printing redundancy level by using the data identifier; comparing the printing redundancy level with the current set level of the verification environment to obtain a comparison result; and executing corresponding processing operation on the write data based on the printing processing strategy corresponding to the comparison result. According to the SoC verification method and device, the problem that the efficiency is low when the problem range needs to be narrowed through printing information of a log file and then a signal positioning problem is checked through a simulation waveform in the development process due to the fact that an SoC system scene is generally subjected to verification simulation in combination with a C use case and a UVM verification platform is solved, and the technical effect of improving the SoC verification efficiency is achieved.

The invention relates to a message uploading method, a data processing unit and a computer program product, and the method comprises the steps: firstly caching and updating a count after receiving a queue message, determining the number n1 of descriptors needing to be read according to a descriptor index when a queue does not cache a descriptor, reading m1 descriptors (m1 is greater than or equal to n1) from a host side according to cache line alignment, writing the message into a host cache by using n1 descriptors, and updating a count and an index; if the message is processed and the descriptors are left, caching the descriptors which are not used; when the queue has cache descriptors, the cache descriptors are preferentially used for writing messages, if the cache descriptors are not completely written, the number n2 of the descriptors needing to be read is determined according to the descriptor index, m2 (m2 > = n2) descriptors are read from the host side according to cache line alignment to process remaining messages, and if the messages are completely processed and the descriptors are remaining after updating, the descriptors are not used in the same cache. According to the invention, the problem of read delay of the descriptor can be solved, and the overall message processing efficiency is improved.

The invention discloses a data consistency processing method, a distributed storage system and electronic equipment, and belongs to the field of distributed data storage systems, and the data consistency processing method comprises the following steps: when any storage node in the distributed storage system receives to-be-updated data sent by a client, obtaining a corresponding data updating path by taking the storage node as a first storage node; according to the data updating path, each storage node carries out data persistence on itself after receiving the data to be updated, if persistence succeeds, the data to be updated is transmitted to the next storage node, if persistence fails, data rollback is carried out, and feedback information of path updating failure is sent to the upstream of the data updating path; and after receiving the information, each upstream storage node carries out data rollback on the current updated data. According to the scheme, even if the update message processing flow fails, the consistency of the data between the survival copies / fragments can be ensured in real time.

The invention relates to a message processing method and device, an electronic device and a storage medium. The method comprises the following steps: in response to a to-be-processed source message, acquiring analysis rule configuration information corresponding to the source message through a rule real-time monitor so as to analyze and convert the source message into a first intermediate message of a memory object structure; obtaining a message filtering rule corresponding to each message theme from the rule offline file through a rule real-time monitor so as to filter the first intermediate message to obtain a second intermediate message matched with each message theme; obtaining generation rule configuration information configured under each message theme and a target theme subscribed by a target receiving end; and performing message format conversion processing on the second intermediate message matched with the corresponding message theme by using the generation rule configuration information to obtain a target message, and forwarding the target message matched with the target theme to a target receiving end. On the premise of not invading logic of a generator end and a consumer end, messages can be filtered and forwarded universally and flexibly.

The invention discloses a large-volume vehicle-mounted CAN (Controller Area Network) message storage and query system, which comprises a message capturing unit for capturing message data, a message receiving and checking unit for receiving messages and checking message formats, and a message processing unit for caching the messages and finishing unloading of message storage, the message storage unit is used for storing message data; the message query unit is used for completing query of the message data; and meanwhile, the invention also discloses a specific control method. According to the method, storage and synchronous archiving of a large amount of vehicle-mounted CAN messages can be completed, it is guaranteed that data are not lost, and meanwhile rapid query of the messages can be achieved.

The invention relates to a message processing method and device of an optical network, communication equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: receiving a wireless local area network management and control interface message from optical network master equipment; determining a processing priority corresponding to the wireless local area network management and control interface message according to the message type information of the wireless local area network management and control interface message; distributing the wireless local area network management and control interface message to a message processing queue corresponding to the processing priority; and processing the wireless local area network management and control interface messages in each message processing queue in sequence according to the processing priority sequence corresponding to each message processing queue. By adopting the method, the overall stability of the optical network can be improved.

The invention discloses a message processing method and device and electronic equipment. The method comprises the steps that a message processing template is generated based on object information and service information, and the object information is attribute information of an object for message transmission; the template content of the message processing template is verified multiple times, a first verification result of the message processing template is obtained, multiple times of verification comprise integrity verification and safety verification, the integrity verification is used for verifying whether the message processing template comprises service information or not, and the safety verification is used for verifying whether transmission of the message processing template is safe or not; generating a target message based on a message processing template and a preset generation rule under the condition that the first verification result is successful verification; performing accuracy verification on the target message to obtain a second verification result of the target message; and processing the target message based on the second verification result. According to the invention, the technical problem of low message processing efficiency in related technologies is solved.

Systems and methods for supporting generic pointers in hardware of a graphics processing unit (GPU) are provided. In various examples, a GPU includes multiple sub-cores each having a processing resource and a load / store pipeline. The processing resource is operable to receive a memory access message including a generic pointer. The processing resource is further operable to output a load or store operation to the load / store pipeline based on the memory access message, in which an address for the load or store operation is determined based on a base address of a named memory type of a plurality of named memory types referenced by the generic pointer and an offset into a memory of the named memory type. The load / store pipeline is operable to, responsive to receipt of the load or store operation, access the memory at the address.

The embodiment of the invention belongs to the field of data processing, and relates to a flow control method and device, computer equipment and a storage medium, and the method comprises the steps: receiving a request message sent by a client; performing global token bucket inspection on the request message to obtain a first request message passing the inspection and a second request message not passing the inspection; performing sliding window check on the second request message to obtain a third request message passing the check and a fourth check message not passing the check; adding the fourth request message into a delay queue; and executing a message processing flow of the first request message and the third request message according to service logic. According to the method, a three-level flow limiting system of the global token bucket, the sliding window check and the delay queue is constructed, so that hierarchical control and dynamic buffering of the high-concurrency requests are realized, the stability and the processing capability of the system under burst flow are effectively improved, meanwhile, the requests are prevented from being lost, and the service availability and the response performance are enhanced.

Embodiments of the present disclosure provide a message processing method, a cloud platform, a computing device, a computer readable storage medium, and a computer program product. The method comprises: acquiring a first timed message; on the basis of a current delay time of the first timed message, searching for a first storage file corresponding to a first time dimension to which the current delay time belongs, wherein the current delay time refers to a delay processing time of the first timed message relative to a current time point, and a plurality of mutually independent storage files are correspondingly set for each level of time dimension; and writing the first timed message into the first storage file. On the basis of the current delay time of the first timed message, the first storage file is searched for in the order of levels of time dimensions from low to high, so as to store timed messages according to time dimensions and expand the time range for storing the timed messages; and by writing the first timed message into the first storage file, the timed messages can be sequentially read on the basis of storage files, thereby improving the delivery efficiency of the timed messages.

The invention belongs to the field of computer networks, data compression and mobile internet and wireless communication, and discloses a TCP (Transmission Control Protocol) data packet compression and aggregation self-adaption method, which comprises the following steps of: 1, receiving a TCP data packet and separating a header from a payload; step 2, storing the effective load part; step 3, compressing the head and updating context data according to the serial number, the confirmation number, the mark and the window size field of the head; step 4, combining the compressed header with the effective load to obtain a compressed message; 5, extracting the compressed messages according to a set aggregation threshold value, aggregating the compressed messages, and sending the aggregated compressed messages to a data link layer; and step 6, storing the operation records, comparing the operation records with the previous N operation records, and changing a set aggregation threshold according to a comparison result. According to the invention, the message can be efficiently processed under the condition of a complex network, so that the overall network throughput and the message processing efficiency are improved.

The invention provides a message processing method, device, system and equipment based on multi-agent cooperation, and relates to the technical field of artificial intelligence. The method comprises the following steps: in response to access of a target object, creating an object proxy agent, controlling the object proxy agent to obtain a to-be-processed message input by the target object, and forwarding the to-be-processed message to an event bus; sending the to-be-processed message on the event bus to an execution agent with corresponding processing capability, and sending a feedback message generated by the execution agent after execution to the event bus; and controlling the object proxy agent to obtain the feedback message from the event bus, so that the object proxy agent forwards the obtained feedback message to the target object. According to the embodiment of the invention, regulation and control of the multiple agents are realized based on the communication connection of the event bus, so that the multiple agents are completely decoupled, the universality and the configurability are relatively high, the method can be widely adapted to scenes in which multiple different roles process complex tasks, and the overall processing efficiency can be improved.

The invention provides a service message processing method, electronic equipment, a storage medium and a program product. Service messages sent by the bottom cloud pool and message flow values are obtained, the service messages are classified, and the classified service messages and corresponding service type identifiers are obtained; determining a target business service module and a target message queue according to the business type identifier, and determining business priorities corresponding to the classified business messages; and determining a target node number of the service nodes in the target business service module according to the message traffic value and the business priority. Sending the classified service messages to a target message queue; sending the classified business messages to a target business service module through the target message queue; calling a service node through a target business service module, processing the classified business message, and generating a message processing result; sending the message processing result to the target service application; the problem that the processing efficiency is low when the service message is processed is solved.

The invention relates to the technical field of data processing, and particularly provides a micro-service message processing method, system and device and a storage medium, and the method comprises the steps: a message management micro-service receives a message sent by other micro-services, and extracts a user ID from the message; the message management micro-service converts the message into a desensitized message based on a preset processing rule; the message management micro-service pushes the desensitization message to a message management user side according to the user ID; and the message management user side arranges and displays the received desensitized messages from high priority to low priority according to the priorities of the micro-services to which the desensitized messages belong. According to the method, the messages are received, desensitized and pushed in a unified manner through the message management micro-service, so that repeated development of message processing logic by each micro-service is avoided, the system development and maintenance cost is remarkably reduced, and the processing efficiency is improved.