Material delivery data processing method and device and computer equipment

By receiving and processing material shipping data in parallel through multi-threading, data with different vehicle information is selected and processed in the message queue is solved, and data processing is improved by improving the efficiency and accuracy of material shipping data processing. sex.

CN118939448APending Publication Date: 2024-11-12SUZHOU YIJI INTELLIGENT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410940336.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-15
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

During the material shipment process, network failure or system failure causes the shipping data to be unable to be sent in real time, resulting in multiple shipping data being created separately during parallel processing, affecting the accuracy of data processing.

Method used

The shipping data is received in parallel by multiple threads and stored in the message queue, and the target shipping data with different vehicle information is filtered out, and multi-threaded parallel processing is adopted. After the processing is completed, the consumption confirmation message is feedbacked to the message queue to delete the completed data.

Benefits of technology

This improves the efficiency of material shipping data processing and the accuracy of results, and avoids the reduction in accuracy caused by the creation of new shipping records separately when processing the same shipping task in parallel.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939448A_ABST
    Figure CN118939448A_ABST
Patent Text Reader

Abstract

The invention relates to a material delivery data processing method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: receiving forwarding data in parallel through a plurality of receiving threads, and storing the forwarding data in a message queue; obtaining a target number of pieces of to-be-processed shipping data from the message queue, and screening out target shipping data with different vehicle information from the to-be-processed shipping data; and adopting a plurality of processing threads to process the target shipping data in parallel, and feeding back a consumption confirmation message to the message queue after the processing is completed, the consumption confirmation message being used for indicating the message queue to delete the processed target shipping data. By adopting the method, the situation that the accuracy of a shipping data processing result is reduced due to the fact that new shipping records are created respectively when multiple pieces of shipping data of the same shipping task are processed in parallel by the processing threads can be avoided, and the purpose of considering the material shipping data processing efficiency and the processing result accuracy is achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a material shipment data processing method, device, computer equipment, storage medium and computer program product. Background Art

[0002] When shipping materials in industries such as coal mining, metallurgy, building materials, and grain, a weighbridge system is usually used for weighing and measuring, and the order management system will record relevant shipping information for order accounting. In order to improve the accuracy and reliability of material shipping information used for order accounting, a method has emerged in which a monitoring system verifies the shipping information of an order management system based on reference weighing data from a weighbridge system, such as the shipping information verification method disclosed in Chinese patent application CN118171995A. In this method, the monitoring system needs to receive the weighing data of the vehicle at each weighing node sent by the weighbridge system and / or the order management system, and record each weighing data belonging to the same shipping task in the same shipping record, so as to judge the shipping status of each vehicle performing the material shipping task based on the shipping record, and to perform shipping information comparison and verification based on the data in the shipping record.

[0003] In order to improve the processing efficiency of shipping data, the monitoring system can use multi-threaded parallel processing. However, in actual applications, there are situations where shipping data cannot be sent to the monitoring system in real time due to network failure or system failure. After the failure is eliminated, batches of non-real-time shipping data will be resent to the monitoring system in a short time. When a vehicle performs the same shipping task and the weighing data of multiple weighing nodes are resent at the same time or almost at the same time (in a short time), and there is no shipping record of the shipping task in the historical shipping record, each processing thread will create a new shipping record for the shipping task during parallel processing, which will affect the accuracy of the data processing results such as judging the shipping status based on the shipping record and comparing and approving the shipping information. Summary of the invention

[0004] Based on this, it is necessary to provide a material shipment data processing method, device, computer equipment, computer-readable storage medium and computer program product that can take into account both material shipment data processing efficiency and processing result accuracy in response to the above technical problems.

[0005] In a first aspect, the present application provides a material shipping data processing method. The method comprises:

[0006] Receiving the shipping data in parallel through multiple receiving threads, and storing the shipping data in a message queue;

[0007] Acquire a target number of to-be-processed shipping data from the message queue, and filter out target shipping data with different vehicle information from the to-be-processed shipping data;

[0008] The target shipping data is processed in parallel using multiple processing threads, and a consumption confirmation message is fed back to the message queue after the processing is completed, wherein the consumption confirmation message is used to instruct the message queue to delete the target shipping data after the processing is completed.

[0009] In one embodiment, the step of filtering out target shipping data having different vehicle information from the shipping data to be processed includes:

[0010] The vehicle information contained in each of the pending shipment data is compared. If there are two or more pending shipment data containing the same vehicle information, one pending shipment data with the same vehicle information is selected as the target shipment data, and the other pending shipment data with different vehicle information are determined as the target shipment data.

[0011] In one embodiment, selecting one piece of to-be-processed shipping data as target shipping data from the to-be-processed shipping data with the same vehicle information includes:

[0012] It is determined whether each piece of to-be-processed shipping data with the same vehicle information is real-time data. If real-time data exists, the real-time data is used as the target shipping data.

[0013] In one embodiment, storing the shipping data in a message queue includes:

[0014] Determining whether the received shipping data is real-time data;

[0015] In the case where the shipping data is real-time data, calling a processing thread to process the shipping data;

[0016] In the case that the shipping data is non-real-time data, the shipping data is stored in a message queue.

[0017] In one embodiment, the receiving of the shipping data in parallel through multiple receiving threads and storing the shipping data in a message queue includes:

[0018] Call multiple receiving threads to receive shipping data in parallel;

[0019] When the receiving thread receives the shipping data, it feeds back the received message to the data sender and pushes the shipping data to the corresponding transfer thread; one receiving thread corresponds to one transfer thread;

[0020] The transit thread determines whether the shipping data is real-time data, and if the shipping data is real-time data, calls the processing thread to process the shipping data, and if the shipping data is non-real-time data, stores the shipping data in a message queue.

[0021] In one embodiment, the method further comprises:

[0022] When the message queue receives the consumption confirmation message fed back by the consumer thread, it determines the identifier of the processed target shipment data contained in the consumption confirmation message, deletes the target shipment data from the message queue, and pushes the next set of shipment data to be processed to the consumer thread.

[0023] In a second aspect, the present application also provides a material shipment data processing device. The device comprises:

[0024] A receiving module, used for receiving the shipping data in parallel through multiple receiving threads, and storing the shipping data in a message queue;

[0025] A screening module, used for obtaining a target number of to-be-processed shipment data from the message queue, and screening out target shipment data with different vehicle information from the to-be-processed shipment data;

[0026] The processing module is used to use multiple processing threads to process the target shipping data in parallel, and after the processing is completed, it feeds back a consumption confirmation message to the message queue, wherein the consumption confirmation message is used to instruct the message queue to delete the target shipping data that has been processed.

[0027] In a third aspect, the present application further provides a computer device, wherein the computer device comprises a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the method described in the first aspect are implemented.

[0028] In a fourth aspect, the present application further provides a computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method described in the first aspect are implemented.

[0029] In a fifth aspect, the present application further provides a computer program product, wherein the computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the method described in the first aspect are implemented.

[0030] The material shipment data processing method, device, computer equipment, storage medium and computer program product receive data in parallel through multiple threads, store the received shipment data in a message queue, and filter the multiple shipment data consumed each time when consuming messages from the message queue, filter out target shipment data with different vehicle information, and then call multiple threads to process the target shipment data in parallel to ensure that each shipment data processed in parallel does not belong to the same shipment task, thereby avoiding the situation where each processing thread creates a new shipment record when processing multiple shipment data of the same shipment task in parallel, resulting in a decrease in the accuracy of the shipment data processing results. Therefore, this solution can improve the material shipment data processing efficiency and the accuracy of the processing results. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 This is an application environment diagram of a material shipment data processing method in an example;

[0032] Figure 2 A schematic diagram of a process flow of a material shipment data processing method in one embodiment;

[0033] Figure 3 is a structural block diagram of a material shipment data processing device in one embodiment;

[0034] Figure 4 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0036] The material shipment data processing method provided in the embodiment of the present application can be applied to Figure 1In the application environment shown. Among them, the monitoring system 102 is connected in communication with the weighing system 104 and the order management system 106. The weighing system 104 includes a plurality of weighing nodes, each weighing node usually having a weighing device (such as a floor scale or a truck scale) and a corresponding card reading device (such as a card reader or a card reader and code scanner integrated machine). The order management system 106 can be implemented by a server and / or a terminal, and is connected in communication with the weighing system 104 (at least part of the weighing nodes) to obtain the data of the vehicle swiping the card and weighing at the corresponding weighing node, and record it as shipping information. The monitoring system 102 may include a server and a client, and the server receives the vehicle information, weighing time, weighing node identification, weighing data and other shipping data sent by the weighing system and / or the order management system (a weighing operation at a weighing node during the vehicle's execution of the shipping task will generate a shipping data). The server can record each shipping data received in the matching shipping record, and then perform shipping status judgment and shipping information comparison and approval based on the shipping record, and the processing result can be displayed through the client. The monitoring system can be implemented through a server and / or a terminal.

[0037] It can be understood that a material shipping site is usually equipped with a weighing system and an order management system. The monitoring system of this solution can be connected with the order management systems and weighing systems of multiple material shipping sites, and receive and process the shipping data of multiple material shipping sites. For example, the monitoring system can be deployed at the headquarters of a coal mining group to monitor the material shipping status of each coal yard under the group.

[0038] In order to improve the processing efficiency of shipping data, the monitoring system can adopt multi-threaded parallel processing. However, in actual applications, there are situations where the shipping data cannot be sent to the monitoring system in real time due to network failure or system failure. After the failure is eliminated, the batch of non-real-time shipping data will be reissued to the monitoring system in a short time. When a vehicle performs the same shipping task, the weighing data of multiple weighing nodes are reissued at the same time or almost at the same time (in a short time), each processing thread may create a new shipping record for the shipping task during parallel processing (each processing thread did not find the historical shipping record of the shipping task in the historical shipping record, so each newly created shipping record), thereby affecting the accuracy of the data processing results such as judging the shipping status based on the shipping record and comparing and approving the shipping information. This solution can avoid the situation where each processing thread creates a new shipping record when processing multiple shipping data of the same shipping task in parallel, which leads to a decrease in the accuracy of the shipping data processing results, so as to achieve the purpose of taking into account the processing efficiency of material shipping data and the accuracy of the processing results.

[0039] In one embodiment, Figure 2 As shown, a material shipping data processing method is provided, which can be applied to Figure 1In this embodiment, the method comprises the following steps:

[0040] Step 202, receiving the shipping data in parallel through multiple receiving threads, and storing the shipping data in a message queue.

[0041] In implementation, when a vehicle performs a material shipping task, it is necessary to perform weighing operations at multiple weighing nodes (at least including tare weight nodes and gross weight nodes). The order management system will record the weighing data of each weighing node as shipping information for order accounting. When a vehicle performs a shipping task and performs a weighing operation at a weighing node, a piece of shipping data will be generated. In order to achieve the supervision of shipping information, the order management system can send the shipping data generated by each weighing node to the monitoring system in real time. It is understandable that in order to improve the monitoring effect of shipping information, the weighing system can also set up multiple approved weighing nodes, and the shipping data generated by the vehicle weighing at the approved weighing node can be directly sent by the weighing system to the monitoring system.

[0042] The monitoring system can enable multiple receiving threads to receive multiple shipment data in parallel and store the shipment data in a message queue. The message queue can be a queue such as RabbitMQ. Specifically, the receiving thread can verify the legitimacy of the received shipment data, and after the verification, it can feedback the message received to the data sender, and send the shipment data to the transit thread, which will store the shipment data in the message queue.

[0043] It should be noted that the shipping data received by the monitoring system can be real-time data (shipping data sent promptly after vehicle weighing) or non-real-time data (shipping data reissued after network or system failures are eliminated).

[0044] Step 204 , obtaining a target number of to-be-processed shipping data from the message queue, and filtering out target shipping data with different vehicle information from the to-be-processed shipping data.

[0045] In implementation, the consumer thread and message consumption logic (including the message pulling mechanism and the number of messages pulled each time) can be pre-configured. The consumer thread can pull the target number of shipment data (a set of data) to be processed from the message queue each time (which can be a preset fixed value or dynamically adjusted according to a certain logic), and then filter the shipment data to be processed, and select the target shipment data with different vehicle information to ensure that the shipment data processed in parallel this time is the data of different shipment tasks.

[0046] Among them, the process of screening target shipment data may include: comparing the vehicle information contained in each shipment data to be processed, if there are two or more shipment data to be processed containing the same vehicle information, then screening out one shipment data to be processed from each shipment data to be processed with the same vehicle information as the target shipment data, and determining all other shipment data to be processed with different vehicle information as the target shipment data. The rule for screening out one shipment data to be processed as the target shipment data may be to select one at random, or to select one based on the order in the message queue or the weighing time in the shipment data (such as the earliest weighing time). Alternatively, real-time data (if any) may be selected as the target shipment data, so as to process the real-time data in a timely manner and improve the accuracy of the reference weighing data read. If the vehicle information contained in the obtained group of shipment data to be processed is not the same, then all of the group of shipment data to be processed will be used as the target shipment data.

[0047] Step 206, multiple processing threads are used to process the target shipping data in parallel, and after the processing is completed, a consumption confirmation message is fed back to the message queue, where the consumption confirmation message is used to instruct the message queue to delete the target shipping data after the processing is completed.

[0048] In implementation, the consumer thread can call a corresponding number of processing threads to process each target shipping data in parallel according to the number of target shipping data. The processing process of each processing thread may include: determining the shipping record that matches the shipping data, recording the shipping data (vehicle information, weighing time, weighing node, weighing data, etc.) in the matching shipping record, and judging whether the shipping data is real-time data. In the case of real-time data, reading the reference weighing data from the weighing node contained in the shipping data and recording it in the shipping record. Among them, the vehicle information can be a license plate number, or other identification information that can correspond to the vehicle one by one, such as the driver's ID number, the card number collected before entering the site, etc., and then the corresponding license plate number can be found through the identification information. Then, the processing thread can judge the shipping status of the shipping task to which the shipping record belongs based on the node sequence of each weighing node currently recorded in each shipping record, and perform shipping information comparison and approval and other processing when the shipping status reaches the target state.

[0049] Among them, the process of determining the matching shipment record can be: taking the weighing time contained in the shipment data as the target weighing time, and searching for the previous shipment data and the next shipment data whose historical weighing times are adjacent to the target weighing time in the historical shipment data of the historical shipment records of the transport vehicle; based on the weighing sequence of the weighing nodes corresponding to the previous shipment data and the weighing sequence of the weighing nodes corresponding to the currently processed shipment data, determine the target shipment record in the historical shipment record to which the previous shipment data belongs, the historical shipment record to which the next shipment data belongs, and the newly created shipment record. When the weighing sequence of the weighing nodes corresponding to the previous shipment data is not later than the weighing sequence of the weighing nodes corresponding to the currently processed shipment data, the historical shipment record to which the previous shipment data belongs is determined as the target shipment record; when the weighing sequence of the weighing nodes corresponding to the previous shipment data is later than the weighing sequence of the weighing nodes corresponding to the currently processed shipment data, and there is a next shipment data, the historical shipment record to which the next shipment data belongs is determined as the target shipment record; when the weighing sequence of the weighing nodes corresponding to the previous shipment data is later than the weighing sequence of the weighing nodes corresponding to the currently processed shipment data, and there is no next shipment data, a new shipment record corresponding to the transport vehicle is created as the target shipment record.

[0050] After the processing thread completes the processing of the shipping data, it can feedback a processing completion message to the consumer thread (it can be a processing completion message for successful processing of valid messages, or it can be a processing completion message for failed processing or discarded invalid messages). After the consumer thread receives the processing completion message fed back by each called processing thread, it can feedback a consumption confirmation message to the broker, the proxy component of the message queue. The consumption confirmation message can include the identifier of the target shipping data that has been processed (such as the sequence number of the shipping data in the message queue) or other identification information, so as to mark the shipping data that has been successfully consumed, and the filtered out pending shipping data (vehicle information is the same as a certain target shipping data) and unprocessed target shipping data (if it exists, for example, the call of a certain processing thread failed to process the target shipping data) belong to the shipping data that has not been successfully consumed. The broker, the proxy component of the message queue, can delete the successfully consumed shipping data from the message queue based on the identifier of the processed target shipping data, and retain the shipping data that has not been successfully consumed. Then, the message queue can push the next set of shipment data to be processed to the consumer thread, so that the consumer thread performs the steps of screening the target shipment data for the next set of shipment data to be processed, calling the processing thread for parallel processing, and feeding back the consumption confirmation message. As a result, each target shipment data processed in parallel each time will not contain the shipment data of the vehicle executing the same shipment task, avoiding the situation where each processing thread creates a new shipment record when processing multiple shipment data of the same shipment task in parallel, thereby reducing the accuracy of the shipment data processing results.

[0051] In another embodiment, the process of storing the shipping data in the message queue in step 202 includes: determining whether the received shipping data is real-time data; if the shipping data is real-time data, calling a processing thread to process the shipping data; if the shipping data is non-real-time data, storing the shipping data in the message queue.

[0052] In this embodiment, the receiving thread can send the received shipping data to the transit thread, and the transit thread can determine whether the shipping data is real-time data based on the weighing time and the current system time contained in the shipping data. If it is real-time data (the time difference is less than the preset threshold), the processing thread can be directly called to process the shipping data so as to process it in time and improve the accuracy of the reference weighing data read. If it is non-real-time data (the time difference is not less than the preset threshold), that is, it is reissued data, there may be a situation where multiple shipping data of the same shipping task are received in parallel, so the shipping data is stored in the message queue for subsequent screening and processing to avoid the situation where direct parallel processing leads to repeated creation of shipping records.

[0053] In the above-mentioned material shipment data processing method, data is received in parallel through multiple threads, and the received shipment data is stored in the message queue. When consuming messages from the message queue, multiple shipment data consumed each time are filtered to screen out target shipment data with different vehicle information, and then multiple threads are called to process the target shipment data in parallel. After the processing is completed, the processed shipment data (successfully consumed messages) are deleted from the message queue, and the unprocessed shipment data (unsuccessfully consumed messages) are retained to ensure that each shipment data processed in parallel does not belong to the same shipment task, thereby avoiding the situation where each processing thread creates a new shipment record when processing multiple shipment data of the same shipment task in parallel, which leads to a decrease in the accuracy of the shipment data processing results. Therefore, this solution can take into account both the material shipment data processing efficiency and the accuracy of the processing results.

[0054] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0055] Based on the same inventive concept, the embodiment of the present application also provides a material shipment data processing device for implementing the material shipment data processing method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more material shipment data processing device embodiments provided below can refer to the limitations of the material shipment data processing method above, and will not be repeated here.

[0056] In one embodiment, Figure 3 As shown, a material delivery data processing device 300 is provided, comprising: a receiving module 301, a screening module 302 and a processing module 303, wherein:

[0057] The receiving module 301 is used to receive the shipping data in parallel through multiple receiving threads and store the shipping data in a message queue.

[0058] The screening module 302 is used to obtain a target number of to-be-processed shipping data from the message queue, and screen out target shipping data with different vehicle information from the to-be-processed shipping data.

[0059] The processing module 303 is used to process the target shipping data in parallel using multiple processing threads, and feed back a consumption confirmation message to the message queue after the processing is completed, wherein the consumption confirmation message is used to instruct the message queue to delete the target shipping data after the processing is completed.

[0060] In one embodiment, the screening module 302 is also used to compare the vehicle information contained in each of the pending shipment data. If there are two or more pending shipment data containing the same vehicle information, one piece of pending shipment data with the same vehicle information is screened out as the target shipment data, and the other pending shipment data with different vehicle information are determined as the target shipment data.

[0061] In one embodiment, the screening module 302 is further used to determine whether each to-be-processed shipping data with the same vehicle information is real-time data; if real-time data exists, the real-time data is used as the target shipping data.

[0062] In one of the embodiments, the receiving module 301 is also used to determine whether the received shipping data is real-time data; if the shipping data is real-time data, call a processing thread to process the shipping data; if the shipping data is non-real-time data, store the shipping data in a message queue.

[0063] In one of the embodiments, the receiving module 301 is also used to call multiple receiving threads to receive shipping data in parallel; when the receiving thread receives the shipping data, it feeds back a message to the data sender that the shipping data has been received, and pushes the shipping data to the corresponding transfer thread; one receiving thread corresponds to one transfer thread; the transfer thread determines whether the shipping data is real-time data, and if the shipping data is real-time data, calls the processing thread to process the shipping data; if the shipping data is non-real-time data, the shipping data is stored in the message queue.

[0064] In one of the embodiments, the device also includes a deletion module, which is used for the message queue to determine the identifier of the processed target shipment data contained in the consumption confirmation message when the message queue receives the consumption confirmation message fed back by the consumer thread, delete the target shipment data from the message queue, and push the next set of shipment data to be processed to the consumer thread.

[0065] Each module in the material shipment data processing device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0066] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 4 As shown. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data required or generated for executing the above-mentioned material shipment data processing method. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a material shipment data processing method is implemented.

[0067] Those skilled in the art will understand that Figure 4 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0068] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.

[0069] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0070] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0071] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0072] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited thereto. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited thereto.

[0073] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0074] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A material shipment data processing method, characterized in that: The method comprises: Receiving the shipping data in parallel through multiple receiving threads, and storing the shipping data in a message queue; Acquire a target number of to-be-processed shipping data from the message queue, and filter out target shipping data with different vehicle information from the to-be-processed shipping data; The target shipping data is processed in parallel using multiple processing threads, and a consumption confirmation message is fed back to the message queue after the processing is completed, wherein the consumption confirmation message is used to instruct the message queue to delete the target shipping data after the processing is completed.

2. The method according to claim 1, characterized in that The step of selecting target shipping data having different vehicle information from the shipping data to be processed includes: The vehicle information contained in each of the pending shipment data is compared. If there are two or more pending shipment data containing the same vehicle information, one pending shipment data with the same vehicle information is selected as the target shipment data, and the other pending shipment data with different vehicle information are determined as the target shipment data.

3. The method according to claim 1, characterized in that: The step of selecting one piece of to-be-processed shipping data as target shipping data from the to-be-processed shipping data with the same vehicle information includes: It is determined whether each piece of to-be-processed shipping data with the same vehicle information is real-time data. If real-time data exists, the real-time data is used as the target shipping data.

4. The method according to claim 1, characterized in that: The storing the shipping data into a message queue comprises: Determining whether the received shipping data is real-time data; In the case where the shipping data is real-time data, calling a processing thread to process the shipping data; In the case that the shipping data is non-real-time data, the shipping data is stored in a message queue.

5. The method according to claim 1, characterized in that The receiving of the shipping data in parallel through multiple receiving threads and storing the shipping data in a message queue includes: Call multiple receiving threads to receive shipping data in parallel; When the receiving thread receives the shipping data, it feeds back the received message to the data sender and pushes the shipping data to the corresponding transfer thread; one receiving thread corresponds to one transfer thread; The transit thread determines whether the shipping data is real-time data, and if the shipping data is real-time data, calls the processing thread to process the shipping data, and if the shipping data is non-real-time data, stores the shipping data in a message queue.

6. The method according to claim 1, characterized in that The method further comprises: When the message queue receives the consumption confirmation message fed back by the consumer thread, it determines the identifier of the processed target shipment data contained in the consumption confirmation message, deletes the target shipment data from the message queue, and pushes the next set of shipment data to be processed to the consumer thread.

7. A material delivery data processing device, characterized in that: The device comprises: A receiving module, used for receiving the shipping data in parallel through multiple receiving threads, and storing the shipping data in a message queue; A screening module, used for obtaining a target number of to-be-processed shipment data from the message queue, and screening out target shipment data with different vehicle information from the to-be-processed shipment data; The processing module is used to use multiple processing threads to process the target shipping data in parallel, and after the processing is completed, it feeds back a consumption confirmation message to the message queue, wherein the consumption confirmation message is used to instruct the message queue to delete the target shipping data that has been processed.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.