Unmanned transport vehicle monitoring method and system, terminal and storage medium

By combining sensor monitoring and image recognition technology, obstacles in unmanned transport vehicles are identified and environmental obstacles are eliminated, which solves the problem of speed abnormalities caused by environmental obstacles in the prior art, and improves the accuracy of monitoring results.

CN119068430APending Publication Date: 2024-12-03SD STEEL RIZHAO CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411278778.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-12
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The existing unmanned transport vehicle monitoring methods cannot accurately distinguish speed abnormalities caused by environmental obstacles, resulting in inaccurate monitoring results.

Method used

By obtaining the usage time of the unmanned transport vehicle and the number of historical failures, generating a monitoring cycle, collecting operating status data, combining image recognition technology to identify obstacles from monitoring videos, and matching the obstacle time of the obstacle with abnormal detection results, write Detect logs to eliminate exceptions caused by environmental obstructions.

Benefits of technology

The accuracy of the monitoring results of unmanned transport vehicles has been improved, and the multi-dimensional analysis of the detection data is performed by expanding the detection range of the sensor, further improving the monitoring accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119068430A_ABST
    Figure CN119068430A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of vehicle monitoring, and particularly provides an unmanned transport vehicle monitoring method and system, a terminal and a storage medium, and the method comprises the steps: obtaining the use time and the historical fault frequency of an unmanned transport vehicle, and generating a monitoring period based on the use time and the historical fault frequency; acquiring operation state data of the unmanned transport vehicle based on the monitoring period, and generating an anomaly detection result based on the operation state data; acquiring a monitoring video based on the abnormal detection result, tracking the unmanned transport vehicle from the monitoring video by using an image recognition technology, and recognizing an obstacle of the unmanned transport vehicle; and matching the obstruction time of the obstacle with the corresponding abnormal time in the abnormal detection result, and writing the matching result into a detection log of the unmanned transport vehicle. According to the invention, sensor monitoring and monitoring videos are combined, the abnormity of the unmanned transport vehicle caused by environmental obstruction is eliminated, the accuracy of the monitoring result is improved, in addition, multi-dimensional analysis is carried out on the detection data, and the monitoring accuracy of the unmanned transport vehicle is further improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of vehicle monitoring, and in particular relates to a method, system, terminal and storage medium for monitoring an unmanned transport vehicle. Background Art

[0002] With the advancement of industrial automation technology, the application of unmanned transport vehicles in modern industrial production is becoming increasingly popular. The operating status of unmanned transport vehicles directly affects production efficiency and safety. Therefore, real-time monitoring and intelligent control of the operating status of unmanned transport vehicles has become particularly important.

[0003] The relevant monitoring method includes using sensors to detect the running speed of the unmanned transport vehicle. Once the speed of the unmanned transport vehicle performing the task is too slow or returns to zero, it is determined that the unmanned transport vehicle has an abnormality. This monitoring method cannot eliminate speed abnormalities caused by environmental obstacles. Therefore, the monitoring results are not accurate enough. Summary of the invention

[0004] In view of the above-mentioned deficiencies in the prior art, the present invention provides an unmanned transport vehicle monitoring method, system, terminal and storage medium to solve the above-mentioned technical problems.

[0005] In a first aspect, the present invention provides a method for monitoring an unmanned transport vehicle, comprising: Obtaining the usage time and the number of historical failures of the unmanned transport vehicle, and generating a monitoring cycle based on the usage time and the number of historical failures; Collecting the operating status data of the unmanned transport vehicle based on the monitoring period, and generating an abnormality detection result based on the operating status data; Acquire a surveillance video based on the abnormality detection result, track the unmanned transport vehicle from the surveillance video using image recognition technology, and identify obstacles to the unmanned transport vehicle; The blocking time of the obstacle is matched with the corresponding abnormal time in the abnormal detection result, and the matching result is written into the detection log of the unmanned transport vehicle.

[0006] In an optional implementation, obtaining the usage time and the number of historical failures of the unmanned transport vehicle, and generating a monitoring cycle based on the usage time and the number of historical failures, includes: Set up basic monitoring cycle; Count the number of historical failures in the detection log of the unmanned transport vehicle; Retrieving the usage time of the unmanned transport vehicle from the unmanned transport vehicle management database based on the license plate number of the unmanned transport vehicle; Based on the preset weights, a weighted sum of the usage time and the number of historical failures is calculated, and the weighted sum is converted into a proportional coefficient, wherein the weighted sum is in inverse proportion to the proportional coefficient; The product of the basic monitoring period and the proportional coefficient is calculated to obtain the monitoring period.

[0007] In an optional implementation, collecting the operating status data of the unmanned transport vehicle based on the monitoring period, and generating an abnormality detection result based on the operating status data include: Collecting operating status data of the unmanned transport vehicle based on the monitoring period, the operating status data including load, speed, acceleration and driving power; Determine whether the speed reaches a speed threshold, and if the speed does not reach the speed threshold, verify the relationship between the speed and the acceleration; The proportional coefficient between acceleration and driving power is calculated to determine whether the proportional coefficient reaches a preset first threshold value. If the proportional coefficient reaches the first threshold value, the driving efficiency is confirmed to be normal; if the proportional coefficient does not reach the first threshold value, the driving efficiency is confirmed to be abnormal.

[0008] In an optional embodiment, obtaining a surveillance video based on the abnormality detection result, tracking the unmanned transport vehicle from the surveillance video using image recognition technology, and identifying obstacles to the unmanned transport vehicle include: Obtaining a mission route of the unmanned transport vehicle from the dispatch center, and obtaining an image acquisition device corresponding to the mission route; Acquire surveillance video from a corresponding image acquisition device; Using a target recognition algorithm to identify the unmanned transport vehicle from the surveillance video, and using a license plate recognition algorithm to extract the license plate of the unmanned transport vehicle; Based on the license plate of the unmanned transport vehicle corresponding to the abnormal detection result, a partial image of the unmanned transport vehicle having the same license plate is retrieved from the corresponding image frame; Obstacles are identified from the partial picture using image recognition technology, and if obstacles exist, the shooting time of the image frame is saved as the obstruction time.

[0009] In an optional implementation, matching the obstruction time of the obstacle with the corresponding abnormal time in the abnormal detection result, and writing the matching result into the detection log of the unmanned transport vehicle includes: If the obstruction time matches the corresponding abnormal time, writing the abnormal event caused by the obstacle into the detection log; If the blocking time does not match the corresponding abnormal time, a fault event is written in the detection log.

[0010] In a second aspect, the present invention provides an unmanned transport vehicle monitoring system, comprising: A cycle generation module, used to obtain the usage time and historical failure number of the unmanned transport vehicle, and generate a monitoring cycle based on the usage time and historical failure number; A state detection module, used to collect the operation state data of the unmanned transport vehicle based on the monitoring period, and generate an abnormality detection result based on the operation state data; An image recognition module, used to obtain a surveillance video based on the abnormality detection result, track the unmanned transport vehicle from the surveillance video using image recognition technology, and identify obstacles to the unmanned transport vehicle; The log recording module is used to match the blocking time of the obstacle with the corresponding abnormal time in the abnormal detection result, and write the matching result into the detection log of the unmanned transport vehicle.

[0011] In an optional implementation, the cycle generation module includes: Basic setting unit, used to set the basic monitoring cycle; A historical statistics unit, used to count the number of historical failures in the detection log of the unmanned transport vehicle; A data retrieval unit, used to retrieve the use time of the unmanned transport vehicle from the unmanned transport vehicle management database based on the license plate number of the unmanned transport vehicle; A coefficient generating unit, for calculating a weighted sum of the usage time and the number of historical failures based on a preset weight, and converting the weighted sum into a proportional coefficient, wherein the weighted sum is in an inversely proportional relationship to the proportional coefficient; The cycle calculation unit is used to calculate the product of the basic monitoring cycle and the proportional coefficient to obtain the monitoring cycle.

[0012] In an optional implementation, the state detection module includes: A state collection unit, used to collect the operation state data of the unmanned transport vehicle based on the monitoring period, wherein the operation state data includes load, speed, acceleration and driving power; A speed determination unit, used to determine whether the speed reaches a speed threshold, and if the speed does not reach the speed threshold, to verify the relationship between the speed and the acceleration; The efficiency verification unit is used to calculate the proportional coefficient of acceleration and driving power, and determine whether the proportional coefficient reaches a preset first threshold value. If the proportional coefficient reaches the first threshold value, it is confirmed that the driving efficiency is normal; if the proportional coefficient does not reach the first threshold value, it is confirmed that the driving efficiency is abnormal.

[0013] In a third aspect, a terminal is provided, including: processor, memory, wherein: The memory is used to store computer programs. The processor is used to call and run the computer program from the memory, so that the terminal executes the above-mentioned terminal method.

[0014] According to a fourth aspect, a computer storage medium is provided, wherein the computer-readable storage medium stores instructions, and when the instructions are executed on a computer, the computer executes the methods described in the above aspects.

[0015] The beneficial effect of the present invention lies in that the unmanned transport vehicle monitoring method, system, terminal and storage medium provided by the present invention, combined with sensor monitoring and surveillance video, eliminate the abnormalities of the unmanned transport vehicle caused by environmental obstacles and improve the accuracy of the monitoring results. In addition, by expanding the detection range of the sensor and performing multi-dimensional analysis of the detection data, the monitoring accuracy of the unmanned transport vehicle is further improved.

[0016] In addition, the invention has a reliable design principle, a simple structure and a very broad application prospect. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 is a schematic flow chart of a method according to an embodiment of the present invention.

[0019] Figure 2 is a schematic block diagram of a system according to an embodiment of the present invention.

[0020] Figure 3 A schematic diagram of the structure of a terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0021] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0022] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art of the present invention. The terms used in the specification of the present invention herein are only for the purpose of describing specific embodiments and are not intended to limit the present invention.

[0023] The unmanned transport vehicle monitoring method provided in the embodiment of the present invention is executed by a computer device, and accordingly, the unmanned transport vehicle monitoring system runs in the computer device.

[0024] Figure 1 is a schematic flow chart of a method according to an embodiment of the present invention. Figure 1 The execution subject may be an unmanned transport vehicle monitoring system. According to different requirements, the order of the steps in the flow chart may be changed, and some may be omitted.

[0025] like Figure 1 As shown, the method includes: Step 110, obtaining the usage time and the number of historical failures of the unmanned transport vehicle, and generating a monitoring cycle based on the usage time and the number of historical failures; Step 120, collecting the operating status data of the unmanned transport vehicle based on the monitoring period, and generating an abnormality detection result based on the operating status data; Step 130, acquiring a surveillance video based on the abnormality detection result, tracking the unmanned transport vehicle from the surveillance video using image recognition technology, and identifying obstacles to the unmanned transport vehicle; Step 140: Match the blocking time of the obstacle with the corresponding abnormal time in the abnormal detection result, and write the matching result into the detection log of the unmanned transport vehicle.

[0026] To facilitate understanding of the present invention, the unmanned transport vehicle monitoring method provided by the present invention is further described below based on the principle of the unmanned transport vehicle monitoring method of the present invention and in combination with the process of monitoring and managing the unmanned transport vehicle in the embodiment.

[0027] Specifically, the unmanned transport vehicle monitoring method includes: S1. Obtain the usage time and historical failure count of the unmanned transport vehicle, and generate a monitoring cycle based on the usage time and historical failure count.

[0028] A basic monitoring cycle is set; the number of historical failures in the detection log of the unmanned transport vehicle is counted; the use time of the unmanned transport vehicle is retrieved from the unmanned transport vehicle management database based on the license plate number of the unmanned transport vehicle; based on the pre-set weight, a weighted sum of the use time and the number of historical failures is calculated, and the weighted sum is converted into a proportional coefficient, and the weighted sum is in inverse proportion to the proportional coefficient; the product of the basic monitoring cycle and the proportional coefficient is calculated to obtain the monitoring cycle.

[0029] Specifically include: Usage time: Through the unmanned transport vehicle management database, the total operating time of each unmanned transport vehicle since its activation or the cumulative usage time in the recent period can be accurately obtained based on the license plate number.

[0030] Historical failure count: Statistics on the failure records of each unmanned transport vehicle in the past period of time (such as the past year), including detailed information such as failure type, occurrence time, and resolution time.

[0031] Different weight coefficients are set for usage time and number of historical failures according to business needs and the importance of the unmanned transport vehicle. For example, for unmanned transport vehicles that are used frequently, the weight of usage time can be appropriately increased; for unmanned transport vehicles that frequently fail, the weight of number of historical failures should be increased accordingly.

[0032] When calculating the weighted sum, the usage time and the number of historical failures are multiplied by their corresponding weights respectively, and then the two are added together.

[0033] The weighted sum is converted into a proportional coefficient, using an inverse proportional relationship, that is, the higher the weighted sum (representing the worse vehicle condition), the smaller the proportional coefficient, and the monitoring period should be shortened accordingly.

[0034] The basic monitoring period is multiplied by the calculated proportionality factor to obtain the specific monitoring period for each unmanned transport vehicle. For example, if the proportionality factor is 0.5, the monitoring period is shortened to half of the original period.

[0035] S2. Collecting the operating status data of the unmanned transport vehicle based on the monitoring period, and generating an abnormality detection result based on the operating status data.

[0036] Based on the monitoring period, the operating status data of the unmanned transport vehicle is collected, and the operating status data includes load, speed, acceleration and driving power; it is determined whether the speed reaches a speed threshold, and if the speed does not reach the speed threshold, the relationship between speed and acceleration is verified; the proportional coefficient of acceleration and driving power is calculated, and it is determined whether the proportional coefficient reaches a preset first threshold, and if the proportional coefficient reaches the first threshold, it is confirmed that the driving efficiency is normal, and if the proportional coefficient does not reach the first threshold, it is confirmed that the driving efficiency is abnormal.

[0037] The method for setting the first threshold includes: Obtain the historical operation data of the unmanned transport vehicle, which includes load, speed, acceleration and driving power. Divide the load level in advance, classify the historical data by load level, and divide the operation data with the same load level into the same group. Fit the acceleration and driving power in the group to obtain the fitting function of acceleration and driving power, and set the first threshold based on the fitting function. Since the first threshold obtained for each data group may be different, a corresponding relationship between the load level and the first threshold is established.

[0038] Specifically, the following steps are included: (1) Operation status data collection: According to the set monitoring cycle, key parameters such as load, speed, acceleration and driving power of the unmanned transport vehicle are collected in real time through sensors or data interfaces.

[0039] (2) Speed ​​verification and drive efficiency evaluation: If the speed does not reach the preset speed threshold, further check the relationship between acceleration and speed to ensure that the unmanned transport vehicle is not in an abnormal deceleration state.

[0040] By calculating the proportional coefficient of acceleration and driving power and comparing it with a preset first threshold (a threshold optimized based on the load level), it is evaluated whether the driving efficiency is normal.

[0041] S3. Acquire a surveillance video based on the abnormality detection result, use image recognition technology to track the unmanned transport vehicle from the surveillance video, and identify obstacles to the unmanned transport vehicle.

[0042] Obtain a mission route of an unmanned transport vehicle from a dispatch center, and obtain an image acquisition device corresponding to the mission route; obtain a surveillance video from the corresponding image acquisition device; use a target recognition algorithm to identify the unmanned transport vehicle from the surveillance video, and use a license plate recognition algorithm to extract the license plate of the unmanned transport vehicle; based on the license plate of the unmanned transport vehicle corresponding to the abnormal detection result, retrieve a partial picture of the unmanned transport vehicle with the same license plate from the corresponding image frame; use image recognition technology to identify obstacles from the partial picture, and if there are obstacles, save the shooting time of the image frame as the obstruction time.

[0043] Specifically, the following steps are included: (1) Docking of the mission route and the image acquisition device: According to the mission route of the unmanned transport vehicle, plan and configure image acquisition devices (such as cameras) along the way in advance to ensure that there are no blind spots in monitoring.

[0044] (2) Video acquisition and target recognition: The real-time location information of the unmanned transport vehicle is obtained from the dispatch center, and the video stream acquisition of the corresponding image acquisition device is triggered.

[0045] Using advanced image processing and machine learning algorithms, unmanned transport vehicles and their license plates can be accurately identified from video streams.

[0046] (3) Local image capture and obstacle detection: According to the license plate information in the anomaly detection results, a partial picture of the unmanned transport vehicle containing the license plate is automatically captured in the surveillance video.

[0047] Apply image recognition technology (such as deep learning models) to analyze local images and identify possible obstacles (such as pedestrians, other vehicles, obstacles, potholes, etc.).

[0048] S4. Match the blocking time of the obstacle with the corresponding abnormal time in the abnormal detection result, and write the matching result into the detection log of the unmanned transport vehicle.

[0049] If the obstruction time matches the corresponding abnormal time, an abnormal event caused by the obstacle is written in the detection log; if the obstruction time does not match the corresponding abnormal time, a fault event is written in the detection log.

[0050] The specific steps include: The obstacle blocking time is accurately matched with the abnormal time in the abnormal detection result. If the time matches, it is judged that the abnormality is caused by the obstacle, otherwise it is regarded as an internal fault event.

[0051] The detection log of the unmanned transport vehicle records detailed information on abnormal events or failure events caused by obstacles, including the time, location, type of abnormality, and handling suggestions.

[0052] For abnormalities caused by obstacles, the alarm system can be automatically triggered to notify relevant personnel to deal with them in time; for internal faults, the corresponding maintenance process will be triggered according to the type of fault.

[0053] In some embodiments, the unmanned transport vehicle monitoring system may include a plurality of functional modules composed of computer program segments. The computer programs of the various program segments in the unmanned transport vehicle monitoring system may be stored in a memory of a computer device and executed by at least one processor to perform (see Figure 1 Description) Unmanned transport vehicle monitoring function.

[0054] In this embodiment, the unmanned transport vehicle monitoring system can be divided into multiple functional modules according to the functions it performs, such as Figure 2 As shown. The functional modules of the system 200 may include: a cycle generation module 210, a state detection module 220, an image recognition module 230, and a log recording module 240. The module referred to in the present invention refers to a series of computer program segments that can be executed by at least one processor and can complete fixed functions, which are stored in a memory. In this embodiment, the functions of each module will be described in detail in subsequent embodiments.

[0055] A cycle generation module, used to obtain the usage time and historical failure number of the unmanned transport vehicle, and generate a monitoring cycle based on the usage time and historical failure number; A state detection module, used to collect the operation state data of the unmanned transport vehicle based on the monitoring period, and generate an abnormality detection result based on the operation state data; An image recognition module, used to obtain a surveillance video based on the abnormality detection result, track the unmanned transport vehicle from the surveillance video using image recognition technology, and identify obstacles to the unmanned transport vehicle; The log recording module is used to match the blocking time of the obstacle with the corresponding abnormal time in the abnormal detection result, and write the matching result into the detection log of the unmanned transport vehicle.

[0056] Optionally, as an embodiment of the present invention, the period generation module includes: Basic setting unit, used to set the basic monitoring cycle; A historical statistics unit, used to count the number of historical failures in the detection log of the unmanned transport vehicle; A data retrieval unit, used to retrieve the use time of the unmanned transport vehicle from the unmanned transport vehicle management database based on the license plate number of the unmanned transport vehicle; A coefficient generating unit, for calculating a weighted sum of the usage time and the number of historical failures based on a preset weight, and converting the weighted sum into a proportional coefficient, wherein the weighted sum is in an inversely proportional relationship to the proportional coefficient; The cycle calculation unit is used to calculate the product of the basic monitoring cycle and the proportional coefficient to obtain the monitoring cycle.

[0057] Optionally, as an embodiment of the present invention, the state detection module includes: A state collection unit, used to collect the operation state data of the unmanned transport vehicle based on the monitoring period, wherein the operation state data includes load, speed, acceleration and driving power; A speed determination unit, used to determine whether the speed reaches a speed threshold, and if the speed does not reach the speed threshold, to verify the relationship between the speed and the acceleration; The efficiency verification unit is used to calculate the proportional coefficient of acceleration and driving power, and determine whether the proportional coefficient reaches a preset first threshold value. If the proportional coefficient reaches the first threshold value, it is confirmed that the driving efficiency is normal; if the proportional coefficient does not reach the first threshold value, it is confirmed that the driving efficiency is abnormal.

[0058] Figure 3 The present invention provides a schematic diagram of the structure of a terminal 300 provided in an embodiment of the present invention. The terminal 300 can be used to execute the unmanned transport vehicle monitoring method provided in an embodiment of the present invention.

[0059] The terminal 300 may include: a processor 310, a memory 320 and a communication unit 330. These components communicate via one or more buses. Those skilled in the art will appreciate that the server structure shown in the figure does not limit the present invention, and it may be a bus structure or a star structure, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0060] The memory 320 can be used to store the execution instructions of the processor 310, and the memory 320 can be implemented by any type of volatile or non-volatile storage terminal or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. When the execution instructions in the memory 320 are executed by the processor 310, the terminal 300 can perform some or all of the steps in the following method embodiments.

[0061] The processor 310 is the control center of the storage terminal, and uses various interfaces and lines to connect various parts of the entire electronic terminal. It runs or executes software programs and / or modules stored in the memory 320, and calls data stored in the memory to perform various functions of the electronic terminal and / or process data. The processor can be composed of an integrated circuit (IC), for example, it can be composed of a single packaged IC, or it can be composed of multiple packaged ICs with the same or different functions. For example, the processor 310 can only include a central processing unit (CPU). In the embodiment of the present invention, the CPU can be a single computing core or multiple computing cores.

[0062] The communication unit 330 is used to establish a communication channel so that the storage terminal can communicate with other terminals, receive user data sent by other terminals or send user data to other terminals.

[0063] The present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).

[0064] Therefore, the present invention combines sensor monitoring and surveillance video to eliminate unmanned transport vehicle anomalies caused by environmental obstacles and improve the accuracy of monitoring results. In addition, by expanding the detection range of the sensor and performing multi-dimensional analysis of the detection data, the monitoring accuracy of the unmanned transport vehicle is further improved. The technical effects that can be achieved by this embodiment can be found in the description above and will not be repeated here.

[0065] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention, in essence or in other words, the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, and other media that can store program codes, including several instructions for enabling a computer terminal (which can be a personal computer, a server, or a second terminal, a network terminal, etc.) to execute all or part of the steps of the methods described in each embodiment of the present invention.

[0066] In this specification, the same or similar parts between the various embodiments can be referred to each other. In particular, for the terminal embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiment.

[0067] In the several embodiments provided by the present invention, it should be understood that the disclosed systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of systems or modules, which can be electrical, mechanical or other forms.

[0068] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0069] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

[0070] Although the present invention has been described in detail with reference to the accompanying drawings and in combination with the preferred embodiments, the present invention is not limited thereto. Without departing from the spirit and essence of the present invention, a person of ordinary skill in the art may make various equivalent modifications or substitutions to the embodiments of the present invention, and these modifications or substitutions shall be within the scope of the present invention. Any person of ordinary skill in the art may easily think of changes or substitutions within the technical scope disclosed by the present invention, and these shall be within the scope of protection of the present invention.

Claims

1. A method for monitoring an unmanned transport vehicle, It is characterized in that include: Obtaining the usage time and the number of historical failures of the unmanned transport vehicle, and generating a monitoring cycle based on the usage time and the number of historical failures; Collecting the operating status data of the unmanned transport vehicle based on the monitoring period, and generating an abnormality detection result based on the operating status data; Acquire a surveillance video based on the abnormality detection result, track the unmanned transport vehicle from the surveillance video using image recognition technology, and identify obstacles to the unmanned transport vehicle; The blocking time of the obstacle is matched with the corresponding abnormal time in the abnormal detection result, and the matching result is written into the detection log of the unmanned transport vehicle.

2. The method according to claim 1, It is characterized in that Obtaining the usage time and the number of historical failures of the unmanned transport vehicle, and generating a monitoring cycle based on the usage time and the number of historical failures, including: Set up basic monitoring cycle; Count the number of historical failures in the detection log of the unmanned transport vehicle; Retrieving the usage time of the unmanned transport vehicle from the unmanned transport vehicle management database based on the license plate number of the unmanned transport vehicle; Based on the preset weights, a weighted sum of the usage time and the number of historical failures is calculated, and the weighted sum is converted into a proportional coefficient, wherein the weighted sum is in inverse proportion to the proportional coefficient; The product of the basic monitoring period and the proportional coefficient is calculated to obtain the monitoring period.

3. The method according to claim 1, It is characterized in that Collecting the operating status data of the unmanned transport vehicle based on the monitoring period, and generating an abnormality detection result based on the operating status data, including: Collecting operating status data of the unmanned transport vehicle based on the monitoring period, the operating status data including load, speed, acceleration and driving power; Determine whether the speed reaches a speed threshold, and if the speed does not reach the speed threshold, verify the relationship between the speed and the acceleration; The proportional coefficient between acceleration and driving power is calculated to determine whether the proportional coefficient reaches a preset first threshold value. If the proportional coefficient reaches the first threshold value, the driving efficiency is confirmed to be normal; if the proportional coefficient does not reach the first threshold value, the driving efficiency is confirmed to be abnormal.

4. The method according to claim 3, It is characterized in that Acquiring a surveillance video based on the abnormality detection result, tracking the unmanned transport vehicle from the surveillance video using image recognition technology, and identifying obstacles to the unmanned transport vehicle, including: Obtaining a mission route of the unmanned transport vehicle from the dispatch center, and obtaining an image acquisition device corresponding to the mission route; Acquire surveillance video from a corresponding image acquisition device; Using a target recognition algorithm to identify the unmanned transport vehicle from the surveillance video, and using a license plate recognition algorithm to extract the license plate of the unmanned transport vehicle; Based on the license plate of the unmanned transport vehicle corresponding to the abnormal detection result, a partial image of the unmanned transport vehicle having the same license plate is retrieved from the corresponding image frame; Obstacles are identified from the partial picture using image recognition technology, and if obstacles exist, the shooting time of the image frame is saved as the obstruction time.

5. The method according to claim 1, It is characterized in that Matching the obstruction time of the obstacle with the corresponding abnormal time in the abnormal detection result, and writing the matching result into the detection log of the unmanned transport vehicle, including: If the obstruction time matches the corresponding abnormal time, writing the abnormal event caused by the obstacle into the detection log; If the blocking time does not match the corresponding abnormal time, a fault event is written in the detection log.

6. An unmanned transport vehicle monitoring system, It is characterized in that include: A cycle generation module, used to obtain the usage time and historical failure number of the unmanned transport vehicle, and generate a monitoring cycle based on the usage time and historical failure number; A state detection module, used to collect the operation state data of the unmanned transport vehicle based on the monitoring period, and generate an abnormality detection result based on the operation state data; An image recognition module, used to obtain a surveillance video based on the abnormality detection result, track the unmanned transport vehicle from the surveillance video using image recognition technology, and identify obstacles to the unmanned transport vehicle; The log recording module is used to match the blocking time of the obstacle with the corresponding abnormal time in the abnormal detection result, and write the matching result into the detection log of the unmanned transport vehicle.

7. The system according to claim 6, It is characterized in that The cycle generation module comprises: Basic setting unit, used to set the basic monitoring cycle; A historical statistics unit, used to count the number of historical failures in the detection log of the unmanned transport vehicle; A data retrieval unit, used to retrieve the use time of the unmanned transport vehicle from the unmanned transport vehicle management database based on the license plate number of the unmanned transport vehicle; A coefficient generating unit, for calculating a weighted sum of the usage time and the number of historical failures based on a preset weight, and converting the weighted sum into a proportional coefficient, wherein the weighted sum is in an inversely proportional relationship to the proportional coefficient; The cycle calculation unit is used to calculate the product of the basic monitoring cycle and the proportional coefficient to obtain the monitoring cycle.

8. The system according to claim 6, It is characterized in that The state detection module comprises: A state collection unit, used to collect the operation state data of the unmanned transport vehicle based on the monitoring period, wherein the operation state data includes load, speed, acceleration and driving power; A speed determination unit, used to determine whether the speed reaches a speed threshold, and if the speed does not reach the speed threshold, to verify the relationship between the speed and the acceleration; The efficiency verification unit is used to calculate the proportional coefficient of acceleration and driving power, and determine whether the proportional coefficient reaches a preset first threshold value. If the proportional coefficient reaches the first threshold value, it is confirmed that the driving efficiency is normal; if the proportional coefficient does not reach the first threshold value, it is confirmed that the driving efficiency is abnormal.

9. A terminal, It is characterized in that include: A memory, used for storing an unmanned transport vehicle monitoring program; A processor is used to implement the steps of the unmanned transport vehicle monitoring method as described in any one of claims 1 to 5 when executing the unmanned transport vehicle monitoring program.

10. A computer-readable storage medium storing a computer program, It is characterized in that The readable storage medium stores an unmanned transport vehicle monitoring program, and when the unmanned transport vehicle monitoring program is executed by the processor, the steps of the unmanned transport vehicle monitoring method according to any one of claims 1 to 5 are implemented.