Human-vehicle integrated management and control system and human-vehicle integrated management and control method

Abstract

The invention discloses a man-vehicle integrated management and control system and a man-vehicle integrated management and control method, and the system divides the supervision of an oil depot into a plurality of oil depot sub-region supervision modules which comprise an intelligent security check module, a self-service warehousing module, an oil payment module and an ex-warehouse module, and each oil depot sub-region is provided with a monitoring device and a sensing device. Collected data are uploaded to a pre-established digital twinborn model, oil depot state monitoring and change trend prediction are carried out, oil depot safety state monitoring and future state prediction are achieved, meanwhile, the intelligent security check module, the self-service warehouse-in module, the oil payment module and the warehouse-out module are matched for supervision processing, and the oil depot safety state monitoring and future state prediction are achieved. Intelligent monitoring and risk early warning can be carried out on the whole oil loading process link, and full-process automatic man-vehicle management and control from tank car warehousing security check to oil loading completion is achieved. The whole operation safety of the oil depot can be improved while manual participation can be reduced.

Description

Integrated Human-Vehicle Management System and Method Technical Field

[0001] This invention relates to the field of personnel and vehicle management technology in oil depots, and particularly to an integrated personnel and vehicle management system and method. Background Technology

[0002] This section is intended to provide background or context for the embodiments of the invention set forth in the claims. The description herein is not an admission that it is prior art simply because it is included in this section.

[0003] Oil depots store large quantities of flammable materials, requiring special attention to fire and explosion prevention to avoid accidents. Therefore, the management of personnel and vehicles at oil depots is an important task involving safety management, personnel management, and vehicle management.

[0004] Existing personnel management at oil depots typically includes entry and exit registration, safety training, and restricted areas. Vehicle management generally includes vehicle registration, engine shutdown, designated parking areas, fire prevention regulations, and personnel verification for various operational procedures. Oil depots employ intelligent access control systems to restrict personnel and vehicles, and camera monitoring of designated areas. However, oil depot operations are heavy and repetitive, with stringent safety checks on vehicles and personnel entering the depot. This necessitates multi-positional collaboration, a high degree of human intervention, and manual data entry of a large amount of business data. Manual processing is inefficient and susceptible to human error. Furthermore, the risk of non-standard operations during oil dispensing remains, and real-time intervention is impossible, posing inherent safety risks to oil depot operations.

[0005] In summary, the current personnel and vehicle management process at oil depots can no longer meet the needs of safe and efficient operation scenarios at oil depots. Summary of the Invention

[0006] This invention provides an integrated human and vehicle management system to achieve full-process human and vehicle management from tanker truck entry security inspection to oil loading completion, reducing manual intervention, improving oil depot operational safety, and lowering oil depot operating costs. The system includes: an oil depot sub-area monitoring module and a central server; the oil depot sub-area monitoring module includes an intelligent security inspection module, a self-service entry module, an oil dispensing module, and an exit module; each oil depot sub-area monitoring module includes monitoring equipment and sensing equipment, and the data collected and processed by the oil depot sub-area monitoring modules is uploaded to the central server.

[0007] A digital twin model of the oil depot is pre-built in the main server. This digital twin model monitors the status of the oil depot and predicts its changing trends based on the data uploaded by the oil depot sub-area monitoring module. When an abnormal status is determined, an abnormal status message is sent to the oil depot sub-area monitoring module. The oil depot status reflects the safety status of the oil depot sub-area. The digital twin model is pre-built using the oil depot's infrastructure data and operational data through 3D modeling software.

[0008] The intelligent safety inspection module is used to: conduct safety training and level assessment for drivers through video courses and virtual reality scenarios; and conduct safety inspections and qualification information verification for drivers and tank trucks through monitoring equipment, sensing equipment and deep learning algorithms.

[0009] The self-service warehousing module is used to: verify warehousing information; when the warehousing information is verified, generate an oil delivery order, send the oil delivery order to the oil payment module, and open the gate; the warehousing information includes the conditions for allowing warehousing; the oil delivery order includes the tanker truck's planned oil delivery information;

[0010] The oil dispensing module is used for: verifying the oil delivery order; when the oil delivery order is verified, controlling the mobile robot to prompt and monitor the oil delivery personnel to complete the oil dispensing operation; displaying the oil dispensing progress information in real time through the monitoring display device; generating an outbound order and sending the outbound order to the outbound module; the outbound order includes the actual oil dispensing information of the tanker truck.

[0011] The outbound module is used to: verify the qualification information of the driver and the tanker truck, and the outbound order; when the verification is successful, the gate is opened.

[0012] This invention provides an integrated personnel and vehicle management method to achieve full-process personnel and vehicle management from tanker truck entry safety inspection to oil loading completion, reducing manual intervention, improving oil depot operational safety, and lowering oil depot operating costs. The method includes:

[0013] Receive data uploaded by the oil depot sub-area monitoring module; the data uploaded by the oil depot sub-area monitoring module includes: messages uploaded by the intelligent safety inspection module confirming the safety inspection and qualification information of the driver and tanker truck; messages uploaded by the self-service entry module indicating the opening of the gate and the oil delivery slip; information uploaded by the oil delivery module regarding the oil delivery personnel's oil delivery operation and progress; and data collected by monitoring equipment and sensing equipment.

[0014] Based on the data uploaded by the oil depot sub-area supervision module, the data collected by the monitoring and sensing equipment, driver identification, tanker identification, and oil pickup personnel identification are displayed and updated in real time in the digital twin model;

[0015] The status of the oil depot is determined based on the preset oil depot safety standards and the real-time display content in the digital twin model;

[0016] When an abnormal status is determined for the oil depot, the abnormal status message will be sent to the oil depot sub-area monitoring module.

[0017] The intelligent model uses real-time displayed content in the digital twin model to predict the changing trend of the oil depot's status; the intelligent model is obtained by training a machine learning model in advance using historical data in the digital twin model.

[0018] This invention also provides an integrated personnel and vehicle management device for controlling the entire process from tanker truck entry safety inspection to oil loading completion, reducing manual intervention, improving oil depot operational safety, and lowering oil depot operating costs. The device includes:

[0019] The data receiving module is used to receive data uploaded by the oil depot sub-area supervision module. The data uploaded by the oil depot sub-area supervision module includes: messages from the intelligent safety inspection module confirming the safety inspection and qualification information of the driver and tanker truck; messages from the self-service warehousing module confirming the opening of the gate and the oil delivery slip; information from the oil delivery module regarding the oil delivery personnel's oil delivery operation and progress; and data collected by monitoring equipment and sensing equipment.

[0020] The digital twin model processing module is used to display and update the data collected by monitoring and sensing devices, driver identification, tanker identification, and oil pickup personnel identification in the digital twin model in real time based on the data uploaded by the oil depot sub-area supervision module.

[0021] The oil depot status judgment and processing module is used to determine the oil depot status based on the preset oil depot safety standards and the real-time content displayed in the digital twin model; when the oil depot status is determined to be abnormal, the abnormal status message is sent to the oil depot sub-area monitoring module.

[0022] The trend prediction module is used to predict the changing trend of the oil depot's status by using the real-time displayed content in the digital twin model through an intelligent model; the intelligent model is pre-trained on a machine learning model using historical data in the digital twin model.

[0023] This invention also provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the above-described integrated human-vehicle control method.

[0024] This invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described integrated human-vehicle control method.

[0025] This invention also provides a computer program product, which includes a computer program that, when executed by a processor, implements the above-described integrated human-vehicle control method.

[0026] The integrated human-vehicle management system in this embodiment of the invention divides the supervision of oil depots into multiple sub-area supervision modules, including an intelligent security inspection module, a self-service entry module, an oil dispensing module, and an exit module. Monitoring and sensing devices are deployed in each sub-area, and the collected data is uploaded to a pre-established digital twin model to monitor the oil depot status and predict its changing trends. This enables monitoring of the oil depot's safety status and prediction of its future status. Simultaneously, in conjunction with the supervision and processing of the intelligent security inspection module, self-service entry module, oil dispensing module, and exit module, intelligent monitoring and risk warnings can be carried out throughout the entire oil dispensing process. This achieves fully automated human-vehicle management from tanker truck entry security inspection to the end of oil filling, reducing manual intervention while improving the overall operational safety of the oil depot and meeting the needs of safe and efficient oil depot operation scenarios.

[0027] The integrated human and vehicle management method in this embodiment of the invention, based on the digital twin model established by the central server and the data uploaded by the monitoring modules of each oil depot sub-area, monitors the status of the oil depot and predicts its changing trends. At the same time, it cooperates with the monitoring and processing of each module, including the intelligent safety inspection module, the self-service warehousing module, the oil dispensing module, and the outbound module. It can intelligently monitor and provide risk warnings throughout the entire oil dispensing process, realizing fully automated human and vehicle management from tanker truck warehousing safety inspection to the end of oil filling. This reduces manual intervention and improves the overall operational safety of the oil depot, meeting the needs of safe and efficient oil depot operation scenarios. Attached Figure Description

[0028] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. In the drawings:

[0029] Figure 1 is a schematic diagram of the integrated human-vehicle control system in an embodiment of the present invention;

[0030] Figure 2 is a specific example of the integrated human-vehicle control system in an embodiment of the present invention;

[0031] Figure 3 is a flowchart illustrating the integrated human-vehicle control method in an embodiment of the present invention;

[0032] Figure 4 is a schematic diagram of the integrated human-vehicle control device in an embodiment of the present invention;

[0033] Figure 5 is a schematic diagram of the computer device in an embodiment of the present invention. Detailed Implementation

[0034] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. Here, the illustrative embodiments of the present invention and their descriptions are used to explain the present invention, but are not intended to limit the present invention.

[0035] The acquisition, transmission, storage, use, and processing of data in this application all comply with the relevant provisions of national laws and regulations.

[0036] With the maturation of technologies such as video analytics, the Internet of Things (IoT), facial recognition, and license plate recognition, the future trend will be towards automation, intelligence, and intensive applications. Current oil depot entry security inspection processes can no longer meet the needs of intelligent operation scenarios. Many processes suffer from heavy workloads, high repetition, and a high degree of manual intervention in highway tanker oil loading, posing certain safety risks. This invention applies intelligent sensing technologies such as intelligent identification, IoT, facial recognition, and license plate recognition, as well as mobile application technologies. Through remote real-time interaction between self-service equipment and cloud servers, it supports fully automated personnel and vehicle management throughout the oil depot highway process, reducing manual intervention, improving oil depot operational safety, lowering operating costs, and supporting further refined management of oil depots.

[0037] This invention provides a complete set of standardized procedures for the management of personnel and vehicles entering oil depots, taking into account the current status and management needs of the road security inspection process. This addresses the needs of integrated personnel and vehicle management in oil depots, improves operational efficiency, optimizes operating costs, and strengthens safety and risk control.

[0038] Figure 1 is a schematic diagram of the integrated human and vehicle management system in an embodiment of the present invention. As shown in Figure 1, the system includes: an oil depot sub-area supervision module 1 and a main server 2; the oil depot sub-area supervision module 1 includes an intelligent security inspection module, a self-service warehousing module, an oil dispensing module, and an outbound module.

[0039] Each oil depot sub-area monitoring module 1 includes monitoring and sensing equipment, such as level sensors for measuring liquid levels under various operating conditions, temperature transmitters for monitoring oil temperature (crucial for ensuring oil quality and safety), flow meters for measuring the flow rate of oil entering and leaving the depot to help track inventory changes, explosion-proof sensors, gas detection sensors, humidity and temperature sensors, explosion-proof cameras, and infrared sensors. Each module is equipped with monitoring and sensing equipment according to actual needs.

[0040] A digital twin model of the oil depot is pre-built in the main server. This digital twin model monitors the status of the oil depot and predicts its changing trends based on the data uploaded by the oil depot sub-area monitoring module. When an abnormal status is determined, an abnormal status message is sent to the oil depot sub-area monitoring module. The status of the oil depot reflects the safety status of the oil depot sub-area. The digital twin model is pre-built using the oil depot's infrastructure data and operational data through 3D modeling software.

[0041] Specifically, the digital twin system identifies the overall status and trends of the oil depot based on the data received from the sensor devices and the data transmitted by each module. For example, it outputs the current safety level of the oil depot and the predicted safety level of the oil depot for a period of time in the future.

[0042] The digital twin model of an oil depot can be established as follows:

[0043] 1. Data Collection. Infrastructure data: such as detailed specifications and location information of equipment like oil storage tanks and pipelines; environmental data: geographical location, climate conditions, etc.; sensor data: real-time data collected by installing various sensing devices; business data such as refueling records, inventory information, and customer behavior; and maintenance records such as equipment repair and maintenance records.

[0044] 2. Model Construction. A 3D model of the oil depot is created using 3D modeling software, including the building structure and equipment layout. Detailed physical models are built for each type of equipment, including its working principles and parameters. Behavioral models of the physical equipment are established using simulation tools. An IoT platform is built to receive and process data from the oil depot sub-area monitoring module, enabling real-time monitoring of the oil depot sub-area.

[0045] 3. Data analysis.

[0046] First, the collected data is integrated to build a database, ready for immediate use.

[0047] Using big data analytics techniques (such as machine learning algorithms) to analyze the collected data enables the monitoring and early warning of oil depots.

[0048] In one embodiment, the master server is specifically used for:

[0049] 1. Based on the data uploaded by the oil depot sub-area monitoring module, the data collected by monitoring and sensing equipment, driver identification, tanker identification, and oil pickup personnel identification are displayed and updated in real time in the digital twin model. Among them, multi-source data from different channels are integrated to form a unified data format, and the data is cleaned and noise-reduced to remove outliers and erroneous data, ensuring the accuracy and reliability of the data.

[0050] 2. Determine the oil depot status based on preset oil depot safety standards and real-time displays in the digital twin model. For example, the oil depot status is determined based on preset oil depot safety standards and real-time displays in the digital twin model. The preset oil depot safety standards include safety thresholds for various indicators in each area. When real-time displays such as speed and distance are within the safety threshold range, the oil depot status is determined to be normal.

[0051] 3. When an abnormal condition is determined in the oil depot, the abnormal condition message is sent to the oil depot sub-area monitoring module. For example, when the tank pressure exceeds the set threshold or the vehicle speed is abnormal, the abnormality message is sent to the area where the abnormal condition occurs for automatic alarm.

[0052] 4. Using an intelligent model, the real-time displayed content in the digital twin model is used to predict the changing trends of the oil depot's status; the intelligent model is pre-trained on a machine learning model using historical data from the digital twin model. The machine learning model can be a time series analysis model or a regression analysis model.

[0053] Taking time series analysis models as an example, historical data such as monitoring data of oil depot sub-regions are used to draw time series graphs, observe trends, seasonality, periodicity and random fluctuations, extract feature data, construct an ARIMA (Autoregressive Integrated Moving Average) model, use feature data to train, test and validate the ARIMA model, optimize model parameters, and obtain a well-trained model.

[0054] In one embodiment, each oil depot sub-area monitoring module includes a voice broadcasting device;

[0055] The main server is also used to: send monitoring and early warning information of the oil depot sub-area to the corresponding voice broadcasting equipment in the oil depot sub-area;

[0056] The specific function of each oil depot sub-area monitoring module is to broadcast monitoring and early warning information and / or abnormal status messages received from the central server via a voice broadcasting device.

[0057] The digital twin system can also intelligently determine whether the behavior of staff members conforms to the safe operation of the oil depot based on video images. When it does not conform to the safe operation of the oil depot, a warning will be issued through the voice broadcast device.

[0058] The digital twin system provides a visual interface, including 3D models, charts, dashboards, etc., and supports user interaction, such as setting library security level threshold alarms.

[0059] The main server can store the acquired data in the cloud. During implementation, the distributed computing capabilities of the cloud can be used for some data processing, such as data classification and cleaning.

[0060] The digital twin model and other intelligent processing models in the main server require continuous improvement. By constantly collecting new data, all models should be updated and optimized to improve their predictive accuracy and reliability. The effectiveness of security controls should be regularly evaluated, and the models adjusted and improved based on actual conditions.

[0061] The intelligent safety inspection module in Figure 1 is used for: providing safety training and level assessment for drivers through video courses and virtual reality scenarios; and conducting safety inspections and qualification information verification for drivers and tank trucks through monitoring equipment, sensing equipment, and deep learning algorithms.

[0062] The intelligent security inspection module is mainly used to verify the driver's identity, provide safety training to the driver, and realize facial recognition through deep learning algorithms, facial recognition, multimodal recognition, privacy protection technology, and edge computing; realize vehicle recognition through adaptive recognition algorithms, deep learning models, license plate color and shape recognition, and real-time processing capabilities; and realize automatic identification of entrance security inspection operations through deep learning and transfer learning, real-time video analysis, automation and intelligence, data mining and pattern recognition.

[0063] In one embodiment, the virtual reality scene is a simulated oil depot environment based on VR / AR technology; the intelligent security inspection module is specifically used for:

[0064] Show oil depot safety videos, conduct oil depot safety tests, and record driver test scores;

[0065] It displays virtual reality scenarios and receives training operation data from drivers within these scenarios. The virtual reality scenarios include the operational procedures, precautions, and emergency drills that drivers need to perform.

[0066] Driver safety ratings are generated based on driver test scores and training operation data.

[0067] In one embodiment, the intelligent security inspection module is specifically used for:

[0068] Receive vehicle video data and driver video data collected by monitoring equipment, and receive vehicle electrostatic oil spill monitoring data collected by sensor equipment;

[0069] Based on deep learning algorithms, vehicle video data, driver video data, and vehicle electrostatic oil spill monitoring data are used to conduct safety checks and qualification verification of drivers and tank trucks.

[0070] In practice, the intelligent security inspection module may include a driver identity authentication module, a video training module, a virtual reality training module, a driver evaluation module, and an entry security inspection module.

[0071] The driver identity authentication module is used to send a safety knowledge training course to drivers after they arrive at the oil depot parking lot and pass facial recognition on the self-service terminal with their ID card.

[0072] The video training module is used to display oil depot safety videos, administer oil depot safety exams, and record driver test scores. For example, drivers first watch a designated training video. After watching, they proceed to the quiz section. The intelligent safety inspection module's processing system randomly selects questions from a question bank to generate corresponding exam questions. Drivers answer the questions and sign off, and the system automatically generates a corresponding answer record. If the driver passes, the system indicates training is complete and the record can be added to the database; if the driver fails, the system indicates training is not passed, and the driver can undergo training and answer questions again until they pass the exam.

[0073] The virtual reality training module is used to display a simulated oil depot environment based on VR / AR technology and to receive training operation data from drivers in the simulated oil depot environment. The simulated oil depot environment includes the operation procedures, precautions, and emergency drills that drivers need to perform.

[0074] The driver evaluation module generates a driver safety rating based on information recorded by the video learning module and the virtual reality training module. The video training module and the virtual reality training module can receive driver evaluations and update the training content accordingly.

[0075] The warehouse security inspection module is used to achieve facial recognition through deep learning algorithms and facial recognition; to achieve vehicle recognition through adaptive recognition algorithms, deep learning models, license plate color and shape recognition, and real-time processing capabilities; and to achieve automatic identification of entrance security inspection operations through deep learning and transfer learning, real-time video analysis, automation and intelligence, data mining and pattern recognition.

[0076] After training, the driver drives the vehicle to the designated security check area, connects the electrostatic oil spill monitoring equipment to the vehicle, and begins the entry security check process. The system automatically identifies the driver's identity and license plate information using a facial recognition panel and license plate recognition camera. Based on the automatically recognized ID number and license plate number, the intelligent security check module's processing system automatically verifies the driver's and vehicle's basic information (e.g., whether they have been trained, whether they are on a risk list) and relevant document information (e.g., whether the documents are complete, whether the documents are valid) to ensure compliance with relevant requirements. If the requirements are not met, the intelligent security check module's processing system automatically provides a voice prompt, and the vehicle is not allowed to enter the warehouse if the security check fails. If the requirements are met, electrostatic oil spill monitoring is performed. If the monitoring fails, the vehicle is not allowed to enter the warehouse. If the monitoring passes, the intelligent security check module's processing system performs a comprehensive security check for entry based on the set comprehensive security check items through intelligent video analysis.

[0077] The intelligent security inspection process of the intelligent security inspection module's processing system is as follows:

[0078] 1) Video capture of personnel / vehicle information;

[0079] 2) Intelligent recognition of people / vehicles;

[0080] 3) Personnel / vehicle model selection;

[0081] 4) Personnel / vehicle analysis, mainly including wearing safety helmets as required, wearing anti-static work clothes, shoes and other labor protection clothing, whether the vehicle helmet is closed and effective, whether the explosion-proof mark on the tank is clear, whether the vehicle is in good condition, whether the vehicle valves are intact and leak-free, and whether the vehicle valves are closed.

[0082] 5) Personnel / vehicle anomaly monitoring: If an anomaly is detected, the security check will fail and the vehicle will not be allowed to enter the warehouse. If no anomaly is detected, the comprehensive security check will pass and the process will end after all items have been checked.

[0083] The self-service warehousing module in Figure 1 is used to: verify warehousing information; when the warehousing information is verified, generate an oil delivery order, send the oil delivery order to the oil payment module, and open the gate; the warehousing information includes the conditions for allowing warehousing; the oil delivery order includes the tanker truck's planned oil delivery information.

[0084] In one embodiment, the self-service entry module includes an access control unit; the access control unit is specifically used to: read the entry information in the all-in-one card, obtain the planned entry information for the day from the main server; verify the entry information in the all-in-one card using the planned entry information; when the entry information in the all-in-one card passes the verification, generate a fuel delivery slip, send the fuel delivery slip to the fuel payment module, and open the gate.

[0085] During implementation, personnel picking up oil swipe their smart card at the access control system. The system reads the relevant entry and pickup information from the smart card to determine whether the vehicle is allowed to enter. If no entry information is found, entry is not permitted. If the relevant entry information meets the criteria, the system automatically generates a pickup slip when the access control is swiped (including pickup plan number, tank number, oil product number, planned pickup quantity, pickup unit, vehicle information, pickup deadline, delivery crane position, and delivery tank). At the same time, the pickup slip information is sent to the delivery module, and the gate is opened, allowing the vehicle to enter smoothly.

[0086] The oil dispensing module in Figure 1 is used for: verifying the oil delivery order; when the oil delivery order is verified, controlling the mobile robot to prompt and monitor the oil delivery personnel to complete the oil dispensing operation; displaying the oil dispensing progress information in real time through the monitoring display device; generating an outbound order and sending the outbound order to the outbound module; the outbound order includes the actual oil dispensing information of the tanker truck.

[0087] In one embodiment, the refueling module is specifically used for:

[0088] The mobile robot (oil-filling assistant) is controlled to prompt and monitor the oil-receiving personnel to complete the following oil-filling operations. If any abnormal operation occurs or any one or any combination of the following oil-filling operations are omitted, the mobile robot will issue an alarm:

[0089] The staff were notified that the tanker truck had been parked at the designated loading position.

[0090] Place anti-slip blocks on the vehicle body;

[0091] Touching the body eliminates static electricity;

[0092] Insert the car key into the key manager;

[0093] Disconnect the oil spill static electricity plug from the vehicle body;

[0094] Explosion-proof barrier gate lowering arm;

[0095] Connect the gas phase loading arm and the liquid phase loading arm;

[0096] Combustible gas, gas phase flow rate, and overflow prevention status are normal;

[0097] Pay for fuel by card;

[0098] Return the liquid phase loading arm and the gas phase loading arm to their original positions.

[0099] Return the oil spill static electricity plug to its original position;

[0100] Retrieve the car key; system enters standby mode.

[0101] The barrier gate is raised, and the anti-slip bollard returns to its original position.

[0102] Dock at the designated location and secure with a lead seal.

[0103] The oil dispensing module may include an oil extraction processing module and an oil dispensing monitoring module.

[0104] After the card is swiped, the oil dispensing module checks whether the oil dispensing information read from the card is consistent with the oil dispensing information received from the previous oil dispensing slip. If the oil dispensing information is consistent, oil can be dispensed normally. At the same time, the online density meter on the loading arm measures the oil dispensing density in real time.

[0105] Oil Dispensing Monitoring Module: Displays oil dispensing information in real time, including tank number, oil product number, vehicle information, oil dispensing crane position, oil dispensing tank, flow rate, planned quantity, quantity dispensed, and quantity not yet dispensed.

[0106] Once the oil delivery is completed, the oil delivery monitoring module automatically generates an outbound slip (including the oil delivery plan number, tank number, oil product number, planned oil delivery quantity, delivery unit, vehicle information, delivery deadline, delivery crane position, delivery tank, actual oil delivery quantity, and delivery time), and pushes the outbound information to the mobile terminal of the oil delivery personnel. For example, the integrated human and vehicle management system provides a user APP, on which users can view oil delivery management information related to themselves.

[0107] The assistant transmits all monitoring data to the central server for analysis.

[0108] The digital twin system of the central server analyzes abnormal behaviors of drivers during refueling operations through deep learning, work behavior recognition, real-time video analysis, and anomaly monitoring. It then notifies the voice broadcasting device of the refueling module to record the driver's violation and issue a warning.

[0109] The outbound module in Figure 1 is used to: verify the qualification information of the driver and the tanker truck, and the outbound order; when the verification is successful, the gate is opened.

[0110] The outbound module is specifically used to determine whether the vehicle is allowed to leave the warehouse after the oil is delivered and the personnel picking up the oil drive the vehicle out by swiping their card. If the vehicle is allowed to leave the warehouse, the gate is opened and the vehicle leaves the warehouse smoothly.

[0111] In one embodiment, each oil depot sub-area monitoring module has a user access interface that displays the data collected and processed by the oil depot sub-area monitoring module.

[0112] All modules involved in this invention embodiment are independently developed based on a B / S architecture, and can be deployed on a cloud server, allowing users to access and operate them through a web browser. The automated system of a single-point warehouse interacts in real time with the management functions and operational processes deployed on the cloud server via a dedicated enterprise line. Based on the intelligent construction standards for oil depots, related subsystems such as intelligent security inspection modules, self-service warehousing modules, oil dispensing modules, and outbound modules are integrated and consolidated to achieve integrated operation of personnel and vehicle management.

[0113] Figure 2 is a specific example of the integrated human-vehicle management system in this embodiment of the invention. As shown in Figure 2, it illustrates the process of oil depot safety management through the cooperation of the intelligent security inspection module, self-service entry module, fuel dispensing module, and exit module. The intelligent security inspection module performs self-service training, self-service examination, intelligent driver case, intelligent vehicle case, and comprehensive case. Then, in the self-service entry module, card swiping for entry and automatic scheduling are performed. Next, in the fuel dispensing module, a mobile robot is controlled to prompt and monitor the fuel dispensing personnel to complete the fuel dispensing operation. Throughout this process, a digital twin model is used to continuously analyze violation videos and record violations. Finally, the exit module allows for card swiping for exit.

[0114] This invention also provides a method for integrated human-vehicle management, as described in the following embodiments. The implementation of this method can be found in the implementation of the central server in the integrated human-vehicle management system; details that are repeated will not be repeated here.

[0115] Figure 3 is a flowchart illustrating the integrated human-vehicle management method in an embodiment of the present invention. As shown in Figure 3, the integrated human-vehicle management method includes:

[0116] Step 301: Receive data uploaded by the oil depot sub-area monitoring module; the data uploaded by the oil depot sub-area monitoring module includes: messages uploaded by the intelligent safety inspection module confirming the safety inspection and qualification information of the driver and tanker truck; messages uploaded by the self-service warehousing module confirming the opening of the gate and the oil delivery slip; information uploaded by the oil delivery module regarding the oil delivery personnel's oil delivery operation and progress; and data collected by monitoring equipment and sensor equipment.

[0117] Step 302: Based on the data uploaded by the oil depot sub-area monitoring module, display and update the data collected by the monitoring and sensing devices, driver identification, tanker identification, and oil pickup personnel identification in the digital twin model in real time;

[0118] Step 303: Determine the status of the oil depot based on the preset oil depot safety standards and the real-time display content in the digital twin model;

[0119] Step 304: When it is determined that the oil depot is in an abnormal state, the abnormal state message is sent to the oil depot sub-area monitoring module;

[0120] Step 305: Using an intelligent model, the real-time displayed content in the digital twin model is used to predict the changing trend of the oil depot's status; the intelligent model is obtained in advance by training a machine learning model using historical data in the digital twin model.

[0121] As shown in Figure 3, the integrated human and vehicle management method in this embodiment of the invention, based on the digital twin model established by the central server and the data uploaded by the monitoring modules of each oil depot sub-area, monitors the status of the oil depot and predicts its changing trends. At the same time, it cooperates with the monitoring and processing of each module, including the intelligent safety inspection module, the self-service warehousing module, the oil dispensing module, and the outbound module. This enables intelligent monitoring and risk warning throughout the entire oil dispensing process, achieving fully automated human and vehicle management from tanker truck warehousing safety inspection to the end of oil filling. This reduces manual intervention while improving the overall operational safety of the oil depot and meets the needs of safe and efficient oil depot operation scenarios.

[0122] In one embodiment, the method includes: sending monitoring and early warning information of the oil depot sub-area to the corresponding voice broadcasting device of the oil depot sub-area.

[0123] This invention also provides an integrated human-vehicle management device, as described in the following embodiments. Since the principle by which this device solves the problem is similar to that of the integrated human-vehicle management method, the implementation of this device can refer to the implementation of the integrated human-vehicle management method; repeated details will not be elaborated further.

[0124] Figure 4 is a schematic diagram of the integrated human-vehicle control device in an embodiment of the present invention. As shown in Figure 4, the integrated human-vehicle control device 400 includes:

[0125] The data receiving module 401 is used to receive data uploaded by the oil depot sub-area supervision module; the data uploaded by the oil depot sub-area supervision module includes: messages uploaded by the intelligent safety inspection module regarding the safety inspection of drivers and tank trucks and the confirmation of their qualification information; messages uploaded by the self-service warehousing module regarding the opening of the gate and the oil delivery slip; information uploaded by the oil delivery module regarding the oil delivery personnel's oil delivery operation information and oil delivery progress information; and data collected by monitoring equipment and sensing equipment.

[0126] The digital twin model processing module 402 is used to display and update the data collected by the monitoring equipment and sensing equipment, driver identification, tanker identification, and oil delivery personnel identification in the digital twin model in real time based on the data uploaded by the oil depot sub-area supervision module.

[0127] The oil depot status judgment and processing module 403 is used to determine the oil depot status based on the preset oil depot safety standards and the real-time content displayed in the digital twin model; when the oil depot status is determined to be abnormal, the abnormal status message is sent to the oil depot sub-area supervision module.

[0128] The trend prediction module 404 is used to predict the changing trend of the oil depot's status using a smart model and real-time displayed content in a digital twin model; the smart model is pre-trained using historical data from the digital twin model to train a machine learning model.

[0129] In one embodiment, the device 400 includes a communication module for transmitting monitoring and early warning information of the oil depot sub-area to the corresponding voice broadcasting device of the oil depot sub-area.

[0130] Figure 5 is a schematic diagram of a computer device in an embodiment of the present invention. As shown in Figure 5, the present invention also provides a computer device 500, including a processor 501, a memory 502, and a computer program 503 stored in the memory 502 and executable on the processor 501. When the processor 501 executes the computer program 503, it implements the above-mentioned integrated human-vehicle management method.

[0131] This invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described integrated human-vehicle control method.

[0132] This invention also provides a computer program product, which includes a computer program that, when executed by a processor, implements the above-described integrated human-vehicle control method.

[0133] The integrated human-vehicle management system in this embodiment of the invention divides the supervision of oil depots into multiple sub-area supervision modules, including an intelligent security inspection module, a self-service entry module, an oil dispensing module, and an exit module. Monitoring and sensing devices are deployed in each sub-area, and the collected data is uploaded to a pre-established digital twin model to monitor the oil depot status and predict its changing trends. This enables monitoring of the oil depot's safety status and prediction of its future status. Simultaneously, in conjunction with the supervision and processing of the intelligent security inspection module, self-service entry module, oil dispensing module, and exit module, intelligent monitoring and risk warnings can be carried out throughout the entire oil dispensing process. This achieves fully automated human-vehicle management from tanker truck entry security inspection to the end of oil filling, reducing manual intervention while improving the overall operational safety of the oil depot and meeting the needs of safe and efficient oil depot operation scenarios.

[0134] The integrated human and vehicle management method in this embodiment of the invention, based on the digital twin model established by the central server and the data uploaded by the monitoring modules of each oil depot sub-area, monitors the status of the oil depot and predicts its changing trends. At the same time, it cooperates with the monitoring and processing of each module, including the intelligent safety inspection module, the self-service warehousing module, the oil dispensing module, and the outbound module. It can intelligently monitor and provide risk warnings throughout the entire oil dispensing process, realizing fully automated human and vehicle management from tanker truck warehousing safety inspection to the end of oil filling. This reduces manual intervention and improves the overall operational safety of the oil depot, meeting the needs of safe and efficient oil depot operation scenarios.

[0135] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0136] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.

[0137] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.

[0138] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0139] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above descriptions are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A human-vehicle integrated management and control system, characterized in that, include: The system comprises a sub-area monitoring module for the oil depot and a central server. The sub-area monitoring module includes an intelligent security inspection module, a self-service warehousing module, an oil dispensing module, and an outbound module. Each sub-area monitoring module includes monitoring and sensing equipment. Data collected and processed by the sub-area monitoring modules is uploaded to the central server. The central server pre-establishes a digital twin model of the oil depot. This digital twin model monitors the oil depot's status and predicts trends based on the data uploaded by the sub-area monitoring modules. When an abnormality is detected in the oil depot's status, an abnormality message is sent to the sub-area monitoring modules. The status of the oil depot reflects the safety status of the oil depot sub-area; The digital twin model is pre-built using the oil depot's infrastructure and operational data through 3D modeling software. The intelligent safety inspection module is used to: provide safety training and level assessment for drivers through video courses and virtual reality scenarios; and conduct safety checks and qualification verification for drivers and tank trucks using monitoring equipment, sensors, and deep learning algorithms. The self-service entry module is used to: verify entry information; when the entry information passes verification, generate an oil delivery slip and send it to the payment module to open the gate; the entry information includes the conditions for permitted entry; the oil delivery slip includes the tank truck's planned oil delivery information. The payment module is used to: verify the oil delivery slip; when the oil delivery slip passes verification, control a mobile robot to prompt and monitor the oil delivery personnel to complete the payment operation; display the payment progress information in real time through monitoring equipment; generate an exit slip and send it to the exit module; the exit slip includes the actual oil delivery information of the tank truck; and the exit module is used to: verify the driver's and tank truck's qualification information and the exit slip. Once the verification is successful, the barrier gate will be opened.

2. The integrated human-vehicle control system as described in claim 1, characterized in that, The main server is specifically used to: display and update in real time the data collected by monitoring and sensing devices, driver identification, tanker identification, and oil pickup personnel identification in the digital twin model based on the data uploaded by the oil depot sub-area supervision module; The status of the oil depot is determined based on the preset oil depot safety standards and the real-time content displayed in the digital twin model; when the oil depot status is determined to be abnormal, the abnormal status message is sent to the oil depot sub-area monitoring module. The intelligent model uses real-time displayed content in the digital twin model to predict the changing trend of the oil depot's status; the intelligent model is obtained by training a machine learning model in advance using historical data in the digital twin model.

3. The integrated human-vehicle control system as described in claim 2, characterized in that, Each oil depot sub-area monitoring module includes a voice broadcast device; the main server is also used to: send monitoring and early warning information of the oil depot sub-area to the corresponding voice broadcast device of the oil depot sub-area; each oil depot sub-area monitoring module is specifically used to: broadcast the monitoring and early warning information and / or abnormal status messages sent by the main server through the voice broadcast device.

4. The integrated human-vehicle control system as described in claim 1, characterized in that, The virtual reality scene is a simulated oil depot environment based on VR / AR technology; the intelligent safety inspection module is specifically used for: displaying oil depot safety videos and conducting oil depot safety exams, recording driver exam scores; displaying the virtual reality scene and receiving driver training operation data in the virtual reality scene, which includes the operation procedures, precautions, and emergency drills that drivers need to perform; and generating driver safety ratings based on driver exam scores and training operation data.

5. The integrated human-vehicle control system as described in claim 1, characterized in that, The intelligent safety inspection module is specifically used to: receive vehicle video data and driver video data collected by monitoring equipment, and receive vehicle electrostatic oil spill monitoring data collected by sensor equipment; based on deep learning algorithms, it uses vehicle video data, driver video data, and vehicle electrostatic oil spill monitoring data to conduct safety inspections and qualification information verification of drivers and tank trucks.

6. The integrated human-vehicle control system as described in claim 1, characterized in that, The self-service warehouse entry module includes an access control unit; the access control unit is specifically used to: read the warehouse entry information in the all-in-one card, obtain the planned warehouse entry information for the day from the main server; verify the warehouse entry information in the all-in-one card using the planned warehouse entry information; when the warehouse entry information in the all-in-one card passes the verification, generate a delivery slip, send the delivery slip to the payment module, and open the gate.

7. The integrated human-vehicle control system as described in claim 1, characterized in that, The oil dispensing module is specifically used to: control the mobile robot to prompt and monitor the oil delivery personnel to complete the following oil dispensing operations. If any abnormal operation occurs or any one or any combination of the following oil dispensing operations are missed, the mobile robot will issue an alarm: prompting the oil delivery personnel that the tanker truck has stopped at the designated loading arm position; placing the anti-slip block on the vehicle body; touching to eliminate static electricity on the human body; inserting the vehicle key into the key manager; removing the overflow static electricity plug and connecting it to the vehicle body; lowering the explosion-proof barrier arm; connecting the gas phase loading arm and the liquid phase loading arm; ensuring that the combustible gas, gas phase flow rate, and overflow prevention status are normal; swiping the card to dispense oil; returning the liquid phase loading arm and the gas phase loading arm to their positions; returning the overflow static electricity plug to its position; retrieving the vehicle key and activating the system standby; raising the barrier arm and returning the anti-slip block to its position; and parking at the designated position and binding the lead seal.

8. The integrated human-vehicle control system as described in claim 1, characterized in that, Each oil depot sub-area monitoring module has a user access interface, which displays the data collected and processed by the oil depot sub-area monitoring module.

9. A method for integrated management and control of people and vehicles, characterized in that, The method is applied to the main server described in any one of claims 1 to 8. This integrated human-vehicle management method includes: receiving data uploaded by the oil depot sub-area monitoring module; the data uploaded by the oil depot sub-area monitoring module includes: messages from the intelligent safety inspection module confirming the safety checks and qualification information of drivers and tank trucks; messages from the self-service entry module indicating the opening of the gate and the oil delivery slip; information from the oil delivery module regarding the oil delivery personnel's delivery operation and progress; and data collected by monitoring and sensing devices; based on the data uploaded by the oil depot sub-area monitoring module, displaying and updating the data collected by monitoring and sensing devices, driver identification, tank truck identification, and oil delivery personnel identification in a digital twin model in real time; determining the oil depot status based on preset oil depot safety standards and the real-time content displayed in the digital twin model; when an abnormal oil depot status is determined, sending an abnormal status message to the oil depot sub-area monitoring module; and predicting the changing trend of the oil depot status using the real-time content displayed in the digital twin model through an intelligent model; the intelligent model is pre-trained using historical data from the digital twin model to train a machine learning model.

10. The integrated human-vehicle management method as described in claim 9, characterized in that, Also includes: The monitoring and early warning information of the oil depot sub-area is sent to the corresponding voice broadcasting equipment in the oil depot sub-area.

11. A human-vehicle integrated control device, characterized in that, The device is applied to the main server as described in any one of claims 1 to 8. This integrated human-vehicle management device includes: a data receiving module for receiving data uploaded by the oil depot sub-area monitoring module; the data uploaded by the oil depot sub-area monitoring module includes: messages from the intelligent safety inspection module confirming the safety checks and qualification information of the driver and tanker truck; messages from the self-service entry module indicating the opening of the gate and the oil delivery slip; information from the oil delivery module regarding the oil delivery personnel's delivery operation and progress; and data collected by monitoring and sensing devices; and a digital twin model processing module for processing data uploaded by the oil depot sub-area monitoring module. The data processing module displays and updates data collected by monitoring and sensing equipment, driver identification, tanker identification, and oil delivery personnel identification in real time within the digital twin model. The oil depot status judgment module determines the oil depot status based on preset oil depot safety standards and the real-time content displayed in the digital twin model. When an abnormal oil depot status is determined, an abnormal status message is sent to the oil depot sub-area monitoring module. The trend prediction module uses an intelligent model to predict the changing trends of the oil depot status based on the real-time content displayed in the digital twin model. This intelligent model is pre-trained using historical data from the digital twin model to train a machine learning model.

12. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the human-vehicle integrated management and control method according to any one of claims 9 to 10.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the human-vehicle integrated management and control method according to any one of claims 9 to 10.

14. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the human-vehicle integrated management and control method according to any one of claims 9 to 10.

Images