Vehicle operation state monitoring method and device, electronic equipment and computer medium

Abstract

The invention provides an application vehicle operation state monitoring method and device, electronic equipment and a computer medium, and relates to the technical field of vehicle operation detection. According to the specific implementation scheme, the method comprises the steps of obtaining a monitoring video in a grain depot park in response to the situation that positioning information of a target vehicle cannot be received; based on the monitoring video, determining appearance information of the target vehicle in the grain depot park; based on the appearance information and the operation planning trajectory of the target vehicle, determining calculation operation information of the target vehicle at each operation node; and adjusting and calculating the operation information based on the Internet of Things state information of the target vehicle at each operation node to obtain actual operation information of the target vehicle at each operation node. According to the embodiment, the management efficiency of the actual operation information of the target vehicle is improved, and the operation and maintenance cost is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle operation status monitoring, and in particular to a vehicle operation status monitoring method and device, an electronic device, and a computer-readable storage medium. Background Art

[0002] At present, the dynamic tracking information of vehicle operations is mainly obtained based on the signals emitted by the Internet of Things devices on the vehicle. This method of obtaining has certain requirements on the environment. If there is no relevant signal or the relevant Internet of Things devices are damaged, the accuracy of the dynamic tracking information of the vehicle operation will be affected.

[0003] The information disclosed in this background technology section is only intended to enhance the understanding of the overall background of the disclosure and should not be regarded as an acknowledgement or any form of suggestion that the information constitutes the prior art already known to a person skilled in the art. Summary of the invention

[0004] The present disclosure provides a vehicle operation status monitoring method and device, an electronic device, and a computer-readable storage medium.

[0005] According to a first aspect, a vehicle operation status monitoring method is provided, the method comprising: in response to an inability to receive positioning information of a target vehicle, obtaining a monitoring video in a grain storage park; based on the monitoring video, determining the appearance information of the target vehicle in the grain storage park; based on the appearance information and the operation planning trajectory of the target vehicle, determining the calculation operation information of the target vehicle at each operation node; based on the Internet of Things status information of the target vehicle at each operation node, adjusting the calculation operation information to obtain the actual operation information of the target vehicle at each operation node.

[0006] According to the second aspect, a vehicle operation status monitoring device is provided, which includes: an acquisition unit, configured to acquire a monitoring video in a grain storage park in response to an inability to receive positioning information of a target vehicle; a determination unit, configured to determine the appearance information of the target vehicle in the grain storage park based on the monitoring video; a calculation unit, configured to determine the calculation operation information of the target vehicle at each operation node based on the appearance information and the operation planning trajectory of the target vehicle; an adjustment unit, configured to adjust the calculation operation information based on the Internet of Things status information of the target vehicle at each operation node, and obtain the actual operation information of the target vehicle at each operation node.

[0007] According to a third aspect, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in any implementation manner of the first aspect.

[0008] According to a fourth aspect, a non-transitory computer-readable storage medium storing computer instructions is provided, where the computer instructions are used to cause a computer to execute the method described in any implementation of the first aspect.

[0009] The vehicle operation status monitoring method and device provided by the embodiment of the present disclosure first obtains the monitoring video in the grain depot park in response to the inability to receive the positioning information of the target vehicle; secondly, based on the monitoring video, the appearance information of the target vehicle in the grain depot park is determined; then, based on the appearance information and the operation planning trajectory of the target vehicle, the calculation operation information of the target vehicle at each operation node is determined; finally, based on the Internet of Things status information of the target vehicle at each operation node, the calculation operation information is adjusted to obtain the actual operation information of the target vehicle at each operation node. Thus, by obtaining the monitoring video of the grain depot park, the vehicle appearance information is located; by the Internet of Things status information of the target vehicle at each operation node, the calculation operation information is adjusted to obtain the actual operation information of the target vehicle at each operation node, and the actual monitoring of the target vehicle operation status is realized by relying on the existing equipment in the grain depot park. While complying with information security, the installation cost of the vehicle positioning equipment is saved, the operation and maintenance cost is reduced, and the accuracy of the actual operation monitoring of the target vehicle is improved.

[0010] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure. Figure 1 is a flow chart of an embodiment of a vehicle operation status monitoring method according to the present disclosure; Figure 2 is a structural schematic diagram of an embodiment of a vehicle operation status monitoring device according to the present disclosure; Figure 3 It is a block diagram of an electronic device used to implement the vehicle operation status monitoring method of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0012] Unless explicitly stated otherwise, throughout the specification and claims, the term “comprise” or variations such as “include” or “comprising”, etc., will be understood to include the stated elements or components but not to exclude other elements or components.

[0013] The technical solution of the present disclosure is described below by means of specific embodiments. It should be understood that one or more steps mentioned in the present disclosure do not exclude the existence of other methods and steps before and after the combination step, or other methods and steps may be inserted between these explicitly mentioned steps. It should also be understood that these examples are only used to illustrate the present disclosure and are not used to limit the scope of the present disclosure. Unless otherwise specified, the numbering of each method step is only for the purpose of identifying each method step, and does not limit the order of arrangement of each method or limit the scope of implementation of the present disclosure. Changes or adjustments in their relative relationships can also be regarded as the scope of implementation of the present disclosure without substantial changes in the technical content.

[0014] The sources of the raw materials and instruments used in the examples are not particularly limited and can be purchased from the market or prepared according to conventional methods known to those skilled in the art.

[0015] Existing grain depots include state-owned grain depots and private grain depots. For state-owned grain depots, vehicle positioning signals are generally shielded for information security reasons. At the same time, when vehicles are running within the park, in order to facilitate the reasonable control of vehicle operations, high-precision park positioning data is required, but the implementation cost of obtaining park positioning data is also high.

[0016] For private grain depots, it is generally not required to shield vehicle positioning information. However, the positioning signals of grain depot vehicles are sometimes interrupted within the grain depot park, which may lead to incomplete monitoring of the vehicle's trajectory and actual operating status information. Therefore, when traditional vehicle operating status monitoring mainly relies on vehicle positioning information, it is no longer possible to perform comprehensive operating status monitoring of the vehicle when entering the vehicle's positioning signal blind spot.

[0017] In view of the above defects, the present disclosure proposes a vehicle operation status monitoring method, which determines the appearance information of the target vehicle in the park through monitoring video, and then determines the calculation operation information of the target vehicle at each operation node according to the operation planning trajectory of the target vehicle, and then combines the Internet of Things status information of each operation node to obtain the actual operation information of the target vehicle at each operation node, thereby improving the comprehensiveness and reliability of monitoring the actual operation information of the vehicle. Figure 1 A process 100 of an embodiment of a vehicle operation status monitoring method according to the present disclosure is shown. The vehicle operation status monitoring method comprises the following steps: Step 101, in response to failure to receive positioning information of a target vehicle, obtaining surveillance video in a grain storage park.

[0018] In this embodiment, the positioning information of the vehicle is the specific location output by the vehicle. The target vehicle is the currently monitored operating vehicle entering the grain storage park. The grain storage park is equipped with multiple operating nodes, and each operating node has corresponding functions. For example, some operating nodes are vehicle weighing nodes, some operating nodes are vehicle inspection nodes, and some operating nodes are vehicle grain loading and unloading nodes. The operating vehicles will operate in the grain storage park and perform operations at their corresponding operating nodes.

[0019] In this embodiment, for some grain storage parks with equipment that shields vehicle positioning signals, the execution entity on which the vehicle operation status monitoring method runs cannot receive the positioning information of the target vehicle; or for private grain storages, if the vehicle drives into the blind spot of the positioning signal, the position of the target vehicle cannot be located at this time, and the monitoring of the target vehicle is lost.

[0020] In this embodiment, in order to facilitate the control of the operation of vehicles at various work points in the grain depot park, a large number of monitoring devices with output video surveillance are generally deployed in the grain depot park, and gates are set in the corresponding areas of each node. After the vehicle enters the park, the vehicle will be informed of the operation plan. For this purpose, the actual operation information of the vehicle at each operation node in the grain depot park can be analyzed based on the vehicle's monitoring video and the Internet of Things status information of the gates at each node.

[0021] In this embodiment, the monitoring video is the monitoring information of each area of ​​the grain storage park. Through the monitoring video, the defense area can be detected and monitored, the on-site images can be displayed and recorded in real time, and the historical images can be retrieved and displayed. Since the target vehicle is operating in the grain storage park, there must be an image of the target vehicle in the monitoring video.

[0022] Step 102, based on the surveillance video, determine the presence information of the target vehicle in the grain storage park.

[0023] In this embodiment, the appearance information is information such as the time and location of the target vehicle at a certain location in the grain depot park. The appearance information of the target vehicle can be determined by monitoring the image of the target vehicle in the video screen and the image of the scenery around the target vehicle.

[0024] Optionally, the target appearance information may also be located by monitoring the image of the target vehicle in the video and the position of the video device monitoring the video.

[0025] In this embodiment, based on the surveillance video, the appearance information of the target vehicle in the grain depot park can be analyzed from the video information. The analysis of the surveillance video can be realized manually, and the target vehicle is manually searched and judged in the surveillance video, and the earliest time and park location of the target vehicle in the surveillance video are used as the appearance information. It can also be analyzed and found from the surveillance video by intelligent software supporting video analysis to find the target vehicle and the appearance information of the vehicle in the grain depot park. It can also be analyzed and found from the surveillance video by other means to find the target vehicle and the appearance information of the vehicle in the grain depot park.

[0026] In this embodiment, the above step 102 includes: performing target detection on the monitoring video to determine the image frame where the target vehicle first appears; determining the time when the target vehicle first appears by the time recorded in the image frame; and determining the position where the target vehicle first appears by the scenery around the target vehicle in the image frame. The image frame where the target vehicle appears this time can be identified as the target vehicle by the main features such as the license plate number, vehicle brand, vehicle model, and color of the target vehicle. For example: the license plate number is XXXXXXXX, the vehicle brand is XXX, the vehicle model is XXX-XX, the color is red, etc. The appearance information is the time, space, features, and node location information when the vehicle appears. For example: entry time 10:00, weighing area, covered with canvas, weighing node, leaving time 10:05.

[0027] Optionally, the above step 102 may also include: identifying the main features of the vehicle in the surveillance video through artificial intelligence technology to determine the target vehicle, and after determining the target vehicle, identifying the appearance information of the target vehicle in the grain storage park. In this way, the system has a high degree of intelligence, can reduce manual participation, and is more efficient and convenient.

[0028] Optionally, the above step 102 may also include: searching for the target vehicle by the main features of the target vehicle in the surveillance video through video analysis technology, and after searching for the target vehicle, identifying the appearance information of the target vehicle in the grain storage park, so that the system has a high degree of automation, efficiency and convenience.

[0029] Step 103, based on the occurrence information and the operation planning trajectory of the target vehicle, determine the calculation operation information of the target vehicle at each operation node.

[0030] In this embodiment, the operation node is a node defined in the grain depot park according to the operation management process and links of the grain depot, and each node has corresponding functions, such as: entry, grain inspection, weighing, unloading, unloaded weighing, settlement, exit, etc. The operation information is calculated based on the appearance information of the target vehicle and the operation planning trajectory of the target vehicle, and the operation information of the target vehicle at each operation node is calculated. Compared with the actual operation node of the target vehicle and the operation information at the actual operation node, the calculated operation information has inaccuracy.

[0031] In this embodiment, the operation planning trajectory of the target vehicle is an operation trajectory pre-set for the target vehicle. The operation trajectory is a line obtained by sequentially connecting the operation nodes that the target vehicle needs to pass through. For example, when the target vehicle is a grain loading vehicle, its operation planning trajectory is to first enter a weighing node for weighing, then pass through a granary node to load grain, then enter a secondary weighing node for weighing, and finally pass through an exit node to exit.

[0032] Step 104, based on the IoT status information of the target vehicle at each operation node, the operation information is adjusted and calculated to obtain the actual operation information of the target vehicle at each operation node.

[0033] In this embodiment, the actual operation information is the real operation information of the target vehicle at each operation node in the grain depot park, and the IoT status information refers to the IoT status information of the IoT devices (such as gates) at each operation node in the grain depot park. According to the IoT status information of the target vehicle at each operation node and the calculation operation information corresponding to the corresponding node, a comprehensive analysis is performed to adjust the calculation operation information accordingly, and the final operation information is used as the actual operation information of the node.

[0034] In this embodiment, the IoT device can be a gate, a conveyor, a weighing machine, etc. The IoT status information can include the opening and closing information of the IoT device. Through the IoT device IoT status information, the operation time of the target vehicle at each operation node can be enriched, wherein the enrichment process is the supplementation and confirmation of other IoT information in addition to the monitoring video. For example, when a vehicle is weighed, in addition to the video, the opening and closing of the gate can accurately determine when the target vehicle is weighed and when it is unweighed.

[0035] The vehicle operation status monitoring method provided by the embodiment of the present disclosure first obtains the monitoring video in the grain depot park in response to the inability to receive the positioning information of the target vehicle; secondly, based on the monitoring video, the appearance information of the target vehicle in the grain depot park is determined; then, based on the appearance information and the operation planning trajectory of the target vehicle, the calculation operation information of the target vehicle at each operation node is determined; finally, based on the Internet of Things status information of the target vehicle at each operation node, the calculation operation information is adjusted to obtain the actual operation information of the target vehicle at each operation node. Thus, by obtaining the monitoring video of the grain depot park, the vehicle appearance information is located; by the Internet of Things status information of the target vehicle at each operation node, the calculation operation information is adjusted to obtain the actual operation information of the target vehicle at each operation node, and the actual monitoring of the target vehicle operation status is realized by relying on the existing equipment in the grain depot park. While complying with information security, the installation cost of the vehicle positioning equipment is saved, the operation and maintenance cost is reduced, and the accuracy of the actual operation monitoring of the target vehicle is improved.

[0036] Optionally, since the positioning information of the target vehicle cannot be received, the vehicle tracking can be achieved through the positioning equipment in the park, such as WIFI (Wireless Fidelity) network equipment, UWB (Ultra Wideband, wireless carrier communication technology) equipment, but the relevant positioning equipment needs to be installed at the corresponding tracking position. Specifically, before adjusting and calculating the operation information based on the IoT status information of the target vehicle at each operation node to obtain the actual operation information of the target vehicle at each operation node, the above-mentioned vehicle operation status monitoring method also includes: judging whether the positioning information of the target vehicle by the positioning equipment in the grain depot park can be received; in response to the judgment result that the positioning information of the target vehicle by the positioning equipment in the grain depot park can be obtained, based on the positioning information of the target vehicle by the positioning equipment in the grain depot park and the IoT status information of each operation node, adjusting and calculating the operation information to obtain the actual operation information of the target vehicle at each operation node.

[0037] In some embodiments of the present disclosure, before determining the calculated operation information of the target vehicle at each operation node based on the appearance information and the operation planning trajectory of the target vehicle, the method also includes: obtaining Internet of Things status information of the barrier gate in response to a monitoring video including a video of an entrance with a barrier gate in a grain storage park; adjusting the appearance information based on the Internet of Things status information of the barrier gate to obtain new appearance information; and replacing the appearance information with the new appearance information.

[0038] The vehicle operation status monitoring method provided in this embodiment includes: in response to failure to receive positioning information of the target vehicle, obtaining a monitoring video in a grain storage park; Based on the monitoring video, the appearance information of the target vehicle in the grain storage park is determined; in response to the monitoring video including the video of the entrance of the grain storage park with a gate, the Internet of Things status information of the gate is obtained; based on the Internet of Things status information of the gate, the appearance information is adjusted to obtain new appearance information; the appearance information is replaced by the new appearance information; based on the appearance information and the operation planning trajectory of the target vehicle, the calculation operation information of the target vehicle at each operation node is determined; based on the Internet of Things status information of the target vehicle at each operation node, the calculation operation information is adjusted to obtain the actual operation information of the target vehicle at each operation node.

[0039] In this embodiment, the IoT status information of the barrier includes: the location information of the barrier, the time when the object passes through the barrier, and the attribute information of the object. When the target vehicle passes through the entrance, the barrier at the entrance will obtain the IoT status information of the target vehicle, and the IoT status information of the target vehicle includes: the vehicle license plate (attribute information of the object), the time when the object passes through the barrier, and the location of the barrier.

[0040] In this embodiment, the monitoring video is a video that can be used to retrieve video information and play back the video. The IoT status information of the barrier can be obtained through the signal sent by the barrier. If the target vehicle is at the same location, the IoT status information of the barrier can be used to adjust the appearance information of the target vehicle, and the adjusted target vehicle appearance information can be used as the final target vehicle appearance information.

[0041] The vehicle operation status monitoring method provided by this optional implementation method, when there is a gate at the entrance of the grain storage park, can adjust the information displayed through the Internet of Things status information of the gate, so that the target vehicle can have information recorded when entering the entrance, providing reliable guarantee for the entire calculation operation information.

[0042] In some embodiments of the present disclosure, the above-mentioned vehicle operation status monitoring method also includes: in response to receiving the positioning information of the target vehicle, obtaining the Internet of Things status information of the target vehicle at each operation node; based on the positioning information and the Internet of Things status information, determining the actual operation information of the target vehicle at each operation node.

[0043] In this embodiment, for some grain storage parks that can send vehicle positioning information, when the target vehicle is running in the grain storage park, the positioning information of the target vehicle can be collected in real time. Since the accuracy of the positioning information of different vehicles is different, the accuracy of the actual operation information of each vehicle is also different. In order to more accurately determine the actual operation information of the target vehicle, the positioning information is combined with the Internet of Things status information to jointly determine the actual operation information of the target vehicle, which can maximize the accuracy of the actual operation information of the target vehicle.

[0044] In this embodiment, the above-mentioned determination of the actual operation information of the target vehicle at each operation node based on the positioning information and the Internet of Things status information includes: for the data under the same operation node in the positioning information and the Internet of Things status information, detecting whether the data of the two are the same, if the data of the two are the same, obtaining the actual operation information of the target vehicle at the operation node through the positioning information or the Internet of Things status information; if one of the data of the two is correct, obtaining the actual operation information of the target vehicle at the operation node based on the data of the other; if the data of the two are different, obtaining the actual operation information of the target vehicle at the operation node based on the Internet of Things status information.

[0045] The vehicle operation status monitoring method provided in this embodiment determines the actual operation information of the target vehicle based on the positioning information and the Internet of Things status information when the positioning information of the target vehicle can be received, thereby providing a reliable means for obtaining the actual operation information of the vehicle.

[0046] In some optional implementations of the present disclosure, the above-mentioned positioning information includes: positioning time and positioning position, and the Internet of Things status information includes: networking time and operation status. Based on the positioning information and the Internet of Things status information, determining the actual operation information of the target vehicle at each operation node includes: judging whether the positioning time is the same as the networking time; in response to judging that the positioning time is the same as the networking time, detecting whether the position of the current operation node is within a set distance range of the positioning position; in response to the position of the current operation node being within a set distance range of the positioning position, determining the actual operation information of the target vehicle at the current operation node based on the positioning time and the operation status.

[0047] In this optional implementation, the positioning position is the specific position of the target vehicle at the positioning time, the networking time is the network time of the IoT device that sends the IoT status information, and the operating status is the working status of the target vehicle under the current IoT device (such as a barrier).

[0048] In this optional implementation, the set distance range is a range value set for vehicle positioning and IoT devices. The specific value of the set distance range can be set based on development requirements. For example, the distance range is set to 0.5~1m.

[0049] In this optional implementation, when the position of the current operating node is within the set distance range of the positioning position, the positioning time and the operating status can be combined together as the actual operating information of the current operating point of the target vehicle.

[0050] This optional implementation provides a method for determining the actual operation information of the target vehicle at each operation node. When the positioning time and the networking time are the same, it detects whether the position of the current operation node is within a set distance range of the positioning position. If it is within the set distance range, the positioning time in the positioning information and the operation status in the Internet of Things status information are used as the actual operation information of the target vehicle at the current operation node, thereby improving the reliability of obtaining the actual operation information.

[0051] Optionally, the above-mentioned determination of the actual operation information of the target vehicle at each operation node based on the positioning information and the Internet of Things status information also includes: when the positioning time is the same as the networking time, and the position of the current operation node is not within the set distance range of the positioning position, it is determined that the positioning information is abnormal, and the networking time and the operation status are combined together as the actual operation information of the current operation node.

[0052] Optionally, the positioning information includes: positioning time and positioning position, and the Internet of Things status information includes: networking time and operation status. The above-mentioned actual operation information of the target vehicle at each operation node determined based on the positioning information and the Internet of Things status information also includes: for each operation node, when the positioning time of the operation node is different from the networking time, the networking time and the operation status are combined together as the actual operation information of the operation node.

[0053] In some optional implementations of the present disclosure, the above-mentioned determination of the appearance information of the target vehicle in the grain storage park based on the surveillance video includes: based on the surveillance video, identifying the license plate information of at least one vehicle and the appearance information of each vehicle; based on the license plate information of at least one vehicle, determining the license plate information of the target vehicle; based on the license plate information of the target vehicle and the appearance information of each vehicle, determining the appearance information of the target vehicle.

[0054] In this optional implementation, the vehicle and the license plate information of the vehicle in the surveillance video can be identified through a video analysis method, the appearance information of the vehicle appearing in the video can be determined, and the target vehicle can be screened among the identified vehicles according to the license plate number of the vehicle to determine the appearance information of the target vehicle.

[0055] In this optional implementation, the vehicles in the surveillance video and the license plate information of the vehicles can be identified through artificial intelligence, the appearance information of the vehicles appearing in the video can be determined, and the target vehicle can be screened among the identified vehicles according to the license plate number of the vehicle to determine the appearance information of the target vehicle.

[0056] In this optional implementation, the vehicle and the vehicle license plate information in the surveillance video can also be identified through other video recognition methods, the appearance information of the vehicle appearing in the video can be determined, and the target vehicle can be screened among the identified vehicles according to the vehicle license plate number to determine the appearance information of the target vehicle.

[0057] This optional implementation method provides for determining the appearance information of a target vehicle in a grain storage park by first identifying the license plate information of at least one vehicle and the appearance information of each vehicle; by obtaining the license plate information of the target vehicle from the vehicle information of at least one vehicle, the appearance information of the target vehicle is determined based on the license plate information of the target vehicle and the appearance information of each vehicle, thereby providing a reliable implementation method for determining the appearance information of the target vehicle.

[0058] Optionally, the above-mentioned determining the appearance information of the target vehicle in the grain storage park based on the surveillance video includes: identifying the license plate information of the target vehicle in the image based on the surveillance video; and determining the appearance information of the target vehicle based on the image where the license plate information of the target vehicle is located.

[0059] In some optional implementations of the present disclosure, the above-mentioned appearance information includes: appearance time and appearance position. Based on the appearance information and the target vehicle's operation planning trajectory, determining the calculation operation information of the target vehicle at each operation node includes: based on the appearance position, determining the target position of the target vehicle at each operation point of the operation planning trajectory; based on the target position and the appearance time, determining the operation time period of the target vehicle at each operation node of the operation planning trajectory, and using each operation time period and the target position of each operation point as the calculation operation information of each operation node.

[0060] In this optional implementation method, the appearance time in the appearance information refers to the time when the target vehicle is actually monitored in the grain depot park, the appearance position in the appearance information is the actual position of the target vehicle in the grain depot park, and the target position is the position point passed by the target vehicle from the appearance position on the operation planning trajectory. Locating the target position by using the appearance position can ensure the accuracy of the target position to a certain extent.

[0061] In this optional implementation, the above-mentioned determination of the operating time period of the target vehicle at each operating node of the operating planning trajectory based on the target position and the appearance time includes: determining the distance from the appearance position to the target position of the adjacent operating node based on the appearance time; determining the arrival time of the target vehicle at the target position of the adjacent operating node based on the average speed of the vehicle; using the time period from the arrival time to the estimated operating duration as the operating time period of the adjacent operating node; continuing to calculate the distance from the target position of the adjacent operating node to the target position of the next operating node, wherein the next operating node is an operating node adjacent to the adjacent operating node; determining the arrival time of the target vehicle to the target position of the next operating node based on the average speed of the vehicle; using the time period from the arrival time to the estimated operating duration as the operating time period of the next operating node; and continuing to calculate the operating time period until the target vehicle reaches the end point of the grain storage park.

[0062] The method for determining the calculation operation information of the target vehicle at each operation node provided by this optional implementation method determines the target position of the target vehicle at each operation point of the operation planning trajectory based on the appearance position; determines the operation time period of the target vehicle at each operation node of the operation planning trajectory based on the target position, the appearance time, and the average speed of the vehicle, and uses each operation time period and the target position of each operation point as the calculation operation information of each operation node, thereby providing a reliable implementation method for obtaining the calculation operation information.

[0063] In some optional implementations of the present disclosure, the above-mentioned Internet of Things status information includes: the device location and the punch-in time when the target vehicle passes the device location, and the calculation operation information includes: the target location and the operation time period. Based on the Internet of Things status information of the target vehicle at each operation node, the calculation operation information is adjusted to obtain the actual operation information of the target vehicle at each operation node, including: detecting whether the device location of the target vehicle at each operation node matches the target location of the operation node in the calculation operation information; in response to detecting that the device location of the target vehicle at each operation node matches the target location of the operation node in the calculation operation information, detecting whether the punch-in time when each operation node passes the device location is less than or equal to the end time of the operation time period of the operation node in the calculation operation information, and is greater than or equal to the initial time of the operation time period of the operation node; in response to detecting that the punch-in time when each operation node passes the device location is less than or equal to the end time of the operation time period of the operation node in the calculation operation information, and is greater than or equal to the initial time of the operation time period of the operation node, the calculation operation information is used as the actual operation information.

[0064] In this optional implementation, the clock-in time is the time when the device that sends the IoT status information detects the target vehicle, for example, the target vehicle is detected by scanning the license plate of the target vehicle.

[0065] In this optional implementation, the initial time of the operation time period is the smallest time in the operation time period, and the end time of the operation time period is the largest time in the operation time period. For example, if the operation time period is 3:20~3:50, the initial time is 3:20 and the end time is 3:50.

[0066] This optional implementation method provides the actual operation information of the target vehicle at each operation node, and detects whether the location of the calculated operation information is consistent with the location in the actual grain depot park by matching the target location in the calculated operation information with the device location in the Internet of Things status information; when the device location of the target vehicle at each operation node matches the target location of the operation node in the calculated operation information, detect whether the clock-in time of each operation node when passing the device location is less than or equal to the end time of the operation time period of the operation node in the calculated operation information, and is greater than or equal to the initial time of the operation time period of the operation node; when it is detected that the clock-in time of each operation node when passing the device location is less than or equal to the end time of the operation time period of the operation node in the calculated operation information, and is greater than or equal to the initial time of the operation time period of the operation node, the calculated operation information is used as the actual operation information, thereby ensuring that the actual operation information is consistent with the actual situation of the grain depot park in terms of location and time, thereby improving the accuracy of the vehicle operation status information.

[0067] Optionally, for some operation nodes in the grain storage park, the above-mentioned IoT status information may also include: the operation status and operation volume of the target vehicle at each punch-in time, etc. For example, for the weighing operation node, the IoT status information may include: the location of the weighing equipment, the punch-in time of the target vehicle, the target vehicle is in an unloaded state, and the weight of the target vehicle. The above-mentioned adjustment of the calculated operation information based on the IoT status information of the target vehicle at each operation node to obtain the actual operation information of the target vehicle at each operation node also includes: after detecting that the punch-in time of each operation node passing through the equipment location is less than or equal to the end time of the operation time period of the operation node in the calculation operation information, and greater than or equal to the initial time of the operation time period of the operation node, the operation status and operation volume of the target vehicle are added to the calculated operation information as the actual operation information.

[0068] Optionally, the above-mentioned adjusting and calculating the operation information based on the IoT status information of the target vehicle at each operation node to obtain the actual operation information of the target vehicle at each operation node also includes: in response to detecting that the device position of the current operation node does not match the target position of the operation node in the calculated operation information, the target position of the operation node is adjusted to the device position.

[0069] Optionally, the above-mentioned adjustment of the calculation operation information based on the Internet of Things status information of the target vehicle at each operation node to obtain the actual operation information of the target vehicle at each operation node also includes: in response to detecting that the punch-in time when the current operation node passes the equipment location is greater than the end time of the operation time period of the operation node in the calculation operation information, or is less than the initial time of the operation time period of the operation node, based on the punch-in time, recalculating the operation time period in the calculation operation information, and using the recalculated calculation information as the actual operation information.

[0070] The above-mentioned recalculation of the operation time period in the calculation operation information based on the punch-in time includes: taking the opening time as the initial time, adding the retrieved average duration of the operation node, and obtaining the recalculated operation time period in the calculation operation information.

[0071] Further references Figure 2 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a vehicle operation status monitoring device, which is similar to Figure 1 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0072] like Figure 2As shown, the vehicle operation status monitoring device 200 provided in this embodiment includes: an acquisition unit 201, a determination unit 202, a calculation unit 203, and an adjustment unit 204. Among them, the acquisition unit 201 can be configured to acquire the monitoring video in the grain depot park in response to the inability to receive the positioning information of the target vehicle. The determination unit 202 can be configured to determine the appearance information of the target vehicle in the grain depot park based on the monitoring video. The calculation unit 203 can be configured to determine the calculation operation information of the target vehicle at each operation node based on the appearance information and the operation planning trajectory of the target vehicle. The adjustment unit 204 can be configured to adjust the calculation operation information based on the Internet of Things status information of the target vehicle at each operation node to obtain the actual operation information of the target vehicle at each operation node.

[0073] In this embodiment, in the vehicle operation status monitoring device 200, the specific processing of the acquisition unit 201, the determination unit 202, the calculation unit 203, and the adjustment unit 204 and the technical effects thereof can be referred to respectively. Figure 1 The relevant descriptions of step 101, step 102, step 103, and step 104 in the corresponding embodiment are not repeated here.

[0074] In some embodiments of the present disclosure, the vehicle operation status monitoring device 200 further includes: an appearance unit (not shown in the figure), which is configured to: obtain the Internet of Things status information of the barrier gate in response to a monitoring video including a video of an entrance of a grain storage park with a barrier gate; adjust the appearance information based on the Internet of Things status information of the barrier gate to obtain new appearance information; and replace the appearance information with the new appearance information.

[0075] In some embodiments of the present disclosure, the above-mentioned vehicle operation status monitoring device 200 also includes: a positioning unit (not shown in the figure), and the above-mentioned positioning unit is configured to: in response to receiving the positioning information of the target vehicle, obtain the Internet of Things status information of the target vehicle at each operation node; based on the positioning information and the Internet of Things status information, determine the actual operation information of the target vehicle at each operation node.

[0076] In some embodiments of the present disclosure, the positioning information includes: positioning time and positioning position, and the Internet of Things status information includes: networking time and operating status. The above-mentioned positioning unit is further configured to: determine whether the positioning time is the same as the networking time; in response to determining that the positioning time is the same as the networking time, detect whether the position of the current operating node is within the set distance range of the positioning position; in response to the position of the current operating node being within the set distance range of the positioning position, determine the actual operating information of the target vehicle at the current operating node based on the positioning time and the operating status.

[0077] In some embodiments of the present disclosure, the above-mentioned determination unit 202 is configured to: identify the license plate information of at least one vehicle and the appearance information of each vehicle based on the surveillance video; determine the license plate information of the target vehicle based on the license plate information of at least one vehicle; determine the appearance information of the target vehicle based on the license plate information of the target vehicle and the appearance information of each vehicle.

[0078] In some embodiments of the present disclosure, the above-mentioned calculation unit 203 is configured to: determine the target position of the target vehicle at each work point of the work planning trajectory based on the appearance position; determine the work time period of the target vehicle at each work node of the work planning trajectory based on the target position, the appearance time, and the average speed of the vehicle, and use each work time period and the target position of each work point as the calculation work information of each work node.

[0079] In some embodiments of the present disclosure, the above-mentioned adjustment unit 204 is configured to: detect whether the equipment position of the target vehicle at each operation node matches the target position of the operation node in the calculation operation information; in response to detecting that the equipment position of the target vehicle at each operation node matches the target position of the operation node in the calculation operation information, detect whether the punch-in time of each operation node when passing the equipment position is less than or equal to the end time of the operation time period of the operation node in the calculation operation information, and is greater than or equal to the initial time of the operation time period of the operation node; in response to detecting that the punch-in time of each operation node when passing the equipment position is less than or equal to the end time of the operation time period of the operation node in the calculation operation information, and is greater than or equal to the initial time of the operation time period of the operation node, the calculation operation information is used as the actual operation information.

[0080] In the vehicle operation status monitoring device provided in the embodiment of the present disclosure, first, the acquisition unit 201 obtains the monitoring video in the grain depot park in response to the inability to receive the positioning information of the target vehicle; secondly, the determination unit 202 determines the appearance information of the target vehicle in the grain depot park based on the monitoring video; then, the calculation unit 203 determines the calculation operation information of the target vehicle at each operation node based on the appearance information and the operation planning trajectory of the target vehicle; finally, the adjustment unit 204 adjusts the calculation operation information based on the Internet of Things status information of the target vehicle at each operation node to obtain the actual operation information of the target vehicle at each operation node. Thus, by acquiring the monitoring video of the grain depot park, the vehicle appearance information is located; by adjusting the calculation operation information through the Internet of Things status information of the target vehicle at each operation node, the actual operation information of the target vehicle at each operation node is obtained, and the actual monitoring of the operation status of the target vehicle is realized by relying on the existing equipment in the grain depot park, while complying with information security, the installation cost of the vehicle positioning equipment is saved, the operation and maintenance cost is reduced, and the accuracy of the actual operation monitoring of the target vehicle is improved.

[0081] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0082] Figure 3 A schematic block diagram of an example electronic device 300 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their modes are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0083] like Figure 3 As shown, the electronic device 300 includes a computing unit 301, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 302 or a computer program loaded from a storage unit 308 into a random access memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the electronic device 300 can also be stored. The computing unit 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.

[0084] A number of components in the electronic device 300 are connected to the I / O interface 305, including: an input unit 306, such as a keyboard, a mouse, etc.; an output unit 307, such as various types of displays, speakers, etc.; a storage unit 308, such as a disk, an optical disk, etc.; and a communication unit 309, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 309 allows the electronic device 300 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0085] The computing unit 301 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 301 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 301 performs the various methods and processes described above, such as the vehicle operation status monitoring method. For example, in some embodiments, the vehicle operation status monitoring method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 308. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 300 via the ROM 302 and / or the communication unit 309. When the computer program is loaded into the RAM 303 and executed by the computing unit 301, one or more steps of the vehicle operation status monitoring method described above may be performed. Alternatively, in other embodiments, the computing unit 301 may be configured to perform the vehicle operation status monitoring method in any other appropriate manner (e.g., by means of firmware).

[0086] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0087] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable vehicle operating status monitoring device, so that when the program code is executed by the processor or controller, the mode / operation specified in the flow chart and / or block diagram is implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0088] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0089] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0090] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0091] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0092] The foregoing description of specific exemplary embodiments of the present disclosure is for the purpose of illustration and demonstration. These descriptions are not intended to limit the present disclosure to the precise form disclosed, and it is clear that many changes and variations can be made based on the above teachings. The purpose of selecting and describing the exemplary embodiments is to explain the specific principles of the present disclosure and its practical application, so that those skilled in the art can realize and utilize various different exemplary embodiments of the present disclosure and various different selections and changes. The scope of the present disclosure is intended to be defined by the claims and their equivalents.

Claims

1. A vehicle operation status monitoring method, characterized in that: The method comprises: In response to failure to receive positioning information of the target vehicle, obtaining surveillance video in the grain storage park; Based on the monitoring video, determining the presence information of the target vehicle in the grain storage park; Determine the computing operation information of the target vehicle at each operation node based on the occurrence information and the operation planning trajectory of the target vehicle; Based on the Internet of Things status information of the target vehicle at each operation node, the calculation operation information is adjusted to obtain the actual operation information of the target vehicle at each operation node.

2. The method according to claim 1, before determining the computing operation information of the target vehicle at each operation node based on the occurrence information and the operation planning trajectory of the target vehicle, the method further comprises: In response to the monitoring video including a video of an entrance of the grain storage park having a gate, obtaining Internet of Things status information of the gate; Based on the IoT status information of the gate, adjusting the appearance information to obtain new appearance information; The occurrence information is replaced with new occurrence information.

3. The method according to claim 1, wherein: The method further comprises: In response to receiving the positioning information of the target vehicle, obtaining the Internet of Things status information of the target vehicle at each operation node; Based on the positioning information and the Internet of Things status information, the actual operation information of the target vehicle at each operation node is determined.

4. The method according to claim 3, wherein: The positioning information includes: positioning time and positioning position, the IoT status information includes: networking time and operation status, and the actual operation information of the target vehicle at each operation node determined based on the positioning information and IoT status information includes: Determining whether the positioning time is the same as the networking time; In response to determining that the positioning time is the same as the networking time, detecting whether the position of the current operating node is within a set distance range of the positioning position; In response to the position of the current operation node being within the set distance range of the positioning position, actual operation information of the target vehicle at the current operation node is determined based on the positioning time and the operation status.

5. The method according to any one of claims 1 to 3, wherein: The determining, based on the monitoring video, the presence information of the target vehicle in the grain storage park includes: Based on the surveillance video, identifying license plate information of at least one vehicle and appearance information of each vehicle; Determining the license plate information of the target vehicle based on the license plate information of the at least one vehicle; Based on the license plate information of the target vehicle and the appearance information of each vehicle, the appearance information of the target vehicle is determined.

6. The method according to any one of claims 1 to 3, wherein: The occurrence information includes: the occurrence time and the occurrence location. The determination of the calculation operation information of the target vehicle at each operation node based on the occurrence information and the operation planning trajectory of the target vehicle includes: Based on the appearance position, determining the target position of the target vehicle at each operation point of the operation planning trajectory; Based on the target position, the appearance time, and the average speed of the target vehicle, the operation time period of the target vehicle at each operation node of the operation planning trajectory is determined, and each operation time period and the target position of each operation point are used as the calculation operation information of each operation node.

7. The method according to any one of claims 1 to 3, wherein: The IoT state information includes: the device location and the punch-in time when the target vehicle passes the device location; the calculation operation information includes: the target location and the operation time period; the calculation operation information is adjusted based on the IoT state information of the target vehicle at each operation node, and the actual operation information of the target vehicle at each operation node is obtained, including: Detecting whether the equipment position of the target vehicle at each operation node matches the target position of the operation node in the calculation operation information; In response to detecting that the device position of the target vehicle at each operation node matches the target position of the operation node in the calculation operation information, detecting whether the clock-in time of each operation node when passing through the device position is less than or equal to the end time of the operation time period of the operation node in the calculation operation information, and greater than or equal to the initial time of the operation time period of the operation node; In response to detecting that the clock-in time of each job node when passing the device location is less than or equal to the initial time of the job time period of the job node in the calculation job information, and greater than or equal to the initial time of the job time period of the job node, the calculation job information is used as the actual job information.

8. A vehicle operation status monitoring device, characterized in that: The device comprises: an acquisition unit, configured to acquire surveillance video in the grain storage park in response to failure to receive positioning information of the target vehicle; A determination unit is configured to determine the presence information of the target vehicle in the grain storage park based on the monitoring video; A computing unit configured to determine computing operation information of the target vehicle at each operation node based on the occurrence information and the operation planning trajectory of the target vehicle; The adjustment unit is configured to adjust the calculated operation information based on the Internet of Things state information of the target vehicle at each operation node to obtain the actual operation information of the target vehicle at each operation node.

9. An electronic device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method according to any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable the computer to execute the method according to any one of claims 1 to 7.

Images