Loading system with visual hopper

Abstract

The invention belongs to the technical field of mobile loading hopper visualization, and particularly provides a hopper visualization loading system, each loading hopper is provided with three cameras, each camera is connected to a storage server, the storage server is connected with a scheduling control terminal, and the scheduling control terminal is connected with a mobile terminal; the storage server stores the video data collected by the camera according to a set naming mode; the scheduling control terminal receives an access request of the mobile terminal, analyzes the access request, establishes connection between the mobile terminal and the storage server based on an analysis result, displays a corresponding video of the storage server on the mobile terminal, and controls the hopper head door to be closed through the remote controller when a user judges that the hopper is full by checking the video in the mobile terminal. Or when the user judges that the loading hopper needs to be moved by checking the video in the mobile terminal, a vehicle moving instruction is sent to the vehicle cab through the remote controller to prompt the driver to move the loading hopper. And when the hopper reaches a full state can be timely and accurately judged.

Description

Technical Field

[0001] The invention relates to the technical field of mobile loading material head visualization, and in particular to a hopper visualization loading system. Background Art

[0002] The mobile loading hopper at the dry bulk terminal is an indispensable device for terminal loading and unloading production. During the use of the loading hopper, personnel need to confirm the loading situation and control the opening and closing of the hopper door through the remote control, and move the vehicle appropriately to make the loading suitable and improve efficiency. Originally, confirmation was made through the display on the hopper. Originally, there was a display, but due to the position of the display, the vehicle could not see the loading situation of the hopper after moving. Later, a display was added after the bracket was extended on the original basis.

[0003] However, due to the harsh on-site environment, the display is easily damaged by vehicles because it is protruding, and due to factors such as sunlight and dust, dust accumulates on the transparent cover and reflects light, making it difficult to see clearly. After the cover is removed, the display is easily damaged due to the rainy and foggy weather in the coastal climate.

[0004] The display needs to be replaced after it is damaged. If there is a problem with the loading hopper in use, it will directly affect the loading efficiency and pose a safety hazard. After damage, the situation in the bucket cannot be seen and it is easy to overflow and spill the material. After spilling the material, it needs to be cleaned up mechanically, which causes additional waste and manpower. In order to eliminate hidden dangers, improve efficiency and save manpower, it is necessary to coordinate maintenance. The loading hopper in use is often difficult to move out. If it is repaired on site, it will affect production and pose a safety hazard. Move the hopper to the maintenance site for replacement, and multiple people are required for replacement. In addition, rain, fog, dust, etc. on site can easily damage the display, causing repeated labor and waste of materials and manpower. Summary of the invention

[0005] Based on the existing problems in video visualization of loading hoppers, the present invention provides a hopper visualization loading system.

[0006] The technical solution of the present invention provides a hopper visualization loading system, each loading hopper is provided with three cameras, each camera is connected to a storage server, the storage server is connected to a dispatching control terminal, and the dispatching control terminal is connected to a mobile terminal; The three cameras installed on each loading hopper include the loading hopper door camera, the loading hopper discharge port camera, and the loading hopper discharge port rear end camera; The storage server stores the video data collected by the camera according to the set naming method. The naming method is based on the video shooting start time and the camera number. The camera number is numbered according to the loading hopper and the camera; each camera number is unique; The dispatch control terminal receives the access request from the mobile terminal, parses the access request, establishes a connection between the mobile terminal and the storage server based on the parsing result, and displays the corresponding video of the storage server on the mobile terminal. When the user determines that the hopper is full by viewing the video in the mobile terminal, the remote control is used to control the hopper head door to close. Or when the user determines that the loading hopper needs to be moved by viewing the video in the mobile terminal, the remote control sends a moving instruction to the vehicle cab to prompt the driver to move the loading hopper.

[0007] As a preferred embodiment of the technical solution of the present invention, the storage server responds to the network access request of the camera and stores the video data collected by the camera in the data isolation area.

[0008] As a preferred embodiment of the technical solution of the present invention, the dispatch control terminal receives a video data access request for a target camera sent by a user through a mobile terminal; The dispatch control terminal parses the access request to obtain the camera number of the target camera, sends a status verification instruction to the target camera, and after receiving a response instruction returned by the target camera based on the status verification instruction, establishes a connection between the mobile terminal and the storage server.

[0009] As a preferred embodiment of the technical solution of the present invention, when the scheduling control terminal does not receive a response instruction returned by the target camera, it sends a confirmation message to the mobile terminal; the confirmation information is that the video to be acquired is a historical video, that is, the target camera is in a non-working state; after receiving the confirmation message returned by the mobile terminal, a connection between the mobile terminal and the storage server is established.

[0010] As a preferred embodiment of the technical solution of the present invention, a running status table is stored in the storage server; after the scheduling control terminal displays the current video data of the target camera on the mobile terminal, the storage server marks the target camera as running in the running status table and records the marking time in the running status table; When the dispatch control terminal does not receive a response instruction returned by the target camera, it notifies the storage server to mark the target camera as non-operating in the operation status table.

[0011] As a preferred embodiment of the technical solution of the present invention, the dispatch control terminal is connected to a user management database, and the user management database records the user's identity information and job information; the access request includes the identity information and camera number of the user using the mobile terminal; After receiving the access request, the dispatch control terminal extracts the user's identity information from the access request, and obtains the user's position information from the user management database based on the identity information; and determines whether the user has the video viewing authority of the target camera based on the position information.

[0012] As a preferred embodiment of the technical solution of the present invention, the system further includes a plurality of processing terminals, wherein the processing terminals are connected to the dispatching control terminal; When the dispatch control terminal detects that the camera starts to collect images, it obtains the processing terminals with idle processing resources, sorts them according to the size of the idle resources according to different algorithms, and updates them to the resource list; Determine the size of resources required to process the video data; In the resource list, select the processing terminal with the fastest required algorithm processing among the processing terminals whose idle processing resources are greater than the set threshold of the required resources as the target processing terminal to establish a connection with the camera. The target processing terminal receives and processes the video data collected by the camera in real time. When it is determined that the loading hopper needs to be moved, the dispatching control terminal sends a moving instruction to the vehicle cab to prompt the driver to move the loading hopper. When it is determined that the hopper is full, the dispatching control terminal controls the hopper head door to close.

[0013] As a preferred embodiment of the technical solution of the present invention, if there is no processing terminal in the resource list whose idle processing resources are greater than the set threshold of the required resources, the processing terminal with the fastest required algorithm processing among the processing terminals with the largest current idle processing resources in the resource list is selected as the first target processing terminal to establish a connection with the camera. The first target processing terminal receives and processes the video data collected by the camera in real time to determine whether it is necessary to move the loading hopper.

[0014] As a preferred embodiment of the technical solution of the present invention, the first target processing terminal receives and processes the video data collected by the camera in real time to determine whether it is necessary to move the setting time of the loading hopper, and then selects the processing terminal with the most currently idle resources in the resource list as the second target processing terminal to establish a connection with the camera. The second target processing terminal receives and processes the video data collected by the camera in real time to determine whether the hopper is full.

[0015] As a preferred embodiment of the technical solution of the present invention, the resource size required for processing the video data of the camera at the historical time is determined based on the camera number as a reference to determine the resource size required for processing the video data.

[0016] It can be seen from the above technical scheme that the present invention has the following advantages: by setting three cameras in each loading hopper, all-round and real-time visual monitoring of the loading process is realized. This design enables the operator to clearly observe the filling status of the hopper and promptly and accurately judge when the hopper is full, thereby effectively avoiding the problem of over-loading or under-loading, and greatly improving the efficiency and accuracy of loading. Visual monitoring reduces the need for operators to directly contact the hopper and materials, and reduces the safety risks caused by improper operation or harsh environment. At the same time, the remote monitoring and remote control functions enable operators to complete their work at a safe distance, further ensuring their personal safety. The storage server stores video data in a unified naming method, which is convenient for subsequent retrieval and management. The dispatching control terminal can respond quickly according to the access request of the mobile terminal to realize the instant transmission and display of video data. This not only improves the efficiency of data processing, but also enables managers to grasp the filling status of each loading hopper in real time, thereby optimizing resource scheduling and reducing waiting time and resource waste. Users can remotely view the video of the loading site through the mobile terminal without going to the site in person, which greatly improves the convenience and flexibility of operation. Avoid the situation where the display cannot be seen clearly and is damaged in harsh environments from the root. At the same time, remote control is achieved by controlling the closing of the hopper head door or sending a vehicle moving instruction, which further simplifies the operation process and improves the user experience.

[0017] In addition, the invention has a reliable design principle, a simple structure and a very broad application prospect. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 is a schematic block diagram of a system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0020] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0021] like Figure 1As shown, an embodiment of the present invention provides a hopper visualization loading system, each loading hopper is provided with three cameras, each camera is connected to a storage server, the storage server is connected to a dispatching control terminal, and the dispatching control terminal is connected to a mobile terminal; The three cameras installed on each loading hopper include the loading hopper door camera, the loading hopper discharge port camera, and the loading hopper discharge port rear end camera; The storage server stores the video data collected by the camera according to the set naming method. The naming method is based on the video shooting start time and the camera number. The camera number is numbered according to the loading hopper and the camera; each camera number is unique; The dispatch control terminal receives the access request from the mobile terminal, parses the access request, establishes a connection between the mobile terminal and the storage server based on the parsing result, and displays the corresponding video of the storage server on the mobile terminal. When the user determines that the hopper is full by viewing the video in the mobile terminal, the remote control is used to control the hopper head door to close. Or when the user determines that the loading hopper needs to be moved by viewing the video in the mobile terminal, the remote control sends a moving instruction to the vehicle cab to prompt the driver to move the loading hopper.

[0022] Users can view the hopper loading video with a mobile terminal and control the loading with a remote control, thus avoiding the situation where the display cannot be seen clearly or is damaged in harsh environments.

[0023] It should be noted that the storage server responds to the camera's network access request and stores the video data collected by the camera in the data isolation area.

[0024] In some embodiments, the dispatch control terminal receives a video data access request for a target camera sent by a user via a mobile terminal; The dispatch control terminal parses the access request to obtain the camera number of the target camera, sends a status verification instruction to the target camera, and after receiving a response instruction returned by the target camera based on the status verification instruction, establishes a connection between the mobile terminal and the storage server.

[0025] The dispatch control terminal continuously monitors network requests from the mobile terminal. When a video data access request for a target camera is received, the request usually contains the camera number that the user wants to access. The dispatch control terminal parses the received access request, mainly to extract the camera number of the target camera. This step usually involves parsing the HTTP request header, request body or URL parameters. According to the camera number obtained by parsing, the dispatch control terminal constructs a status verification instruction. The purpose of this instruction is to initiate a verification request to the target camera to confirm its current status (such as whether it is online, whether it is available, etc.). The dispatch control terminal sends the status verification instruction to the target camera through a network (such as a local area network, a wireless network, etc.). The dispatch control terminal waits for the response instruction returned by the target camera based on the status verification instruction. This response instruction should contain the current status information of the camera. After receiving the response instruction, the dispatch control terminal parses it and verifies the status of the camera. After confirming that the status of the target camera is normal, the dispatch control terminal establishes a connection with the storage server. This connection is used to transmit the video data of the target camera. The dispatch control terminal retrieves the corresponding video data from the storage server according to the camera number and transmits it to the mobile terminal. After receiving the video data, the mobile terminal decodes it and displays it to the user in real time. Users can view the video images of the target camera through the mobile terminal and perform corresponding operations as needed (such as controlling the hopper head door to close, sending vehicle moving instructions, etc.).

[0026] In some embodiments, when the scheduling control terminal does not receive a response instruction returned by the target camera, it sends a confirmation message to the mobile terminal; the confirmation message is that the video to be acquired is a historical video, that is, the target camera is in a non-working state; after receiving the confirmation message returned by the mobile terminal, a connection is established between the mobile terminal and the storage server.

[0027] When the dispatch control terminal does not receive a response instruction returned by the target camera, the dispatch control terminal prepares a confirmation message indicating that the target camera is currently in a non-working state, so only historical videos can be obtained. The confirmation message is sent to the mobile terminal that made the access request through the network. The dispatch control terminal waits for the mobile terminal to respond to the confirmation message. This response is usually a user confirmation that he accepts to view the historical video. Once the response of the mobile terminal is received, the dispatch control terminal needs to verify its validity (such as checking whether it is a response to the corresponding request). After confirming that the response of the mobile terminal is valid, the dispatch control terminal establishes a connection with the storage server. This connection is used to access and transmit the historical video data of the target camera. The dispatch control terminal retrieves the historical video data from the storage server according to the camera number and possible time range (if specified by the user), and transmits the data to the mobile terminal through the connection.

[0028] In some embodiments, a running status table is stored in the storage server; after the scheduling control terminal displays the current video data of the target camera on the mobile terminal, the storage server marks the target camera as running in the running status table and records the marking time in the running status table; When the dispatch control terminal does not receive a response instruction returned by the target camera, it notifies the storage server to mark the target camera as a non-operating state in the operating status table.

[0029] A database table or data structure is defined in the storage server to store the operating status information of each camera. The table should contain at least the following fields: camera number, operating status (such as "operating", "non-operating" or "unknown"), last marked time, etc. If the dispatch control terminal receives a response instruction from the target camera within the preset time and confirms that the camera is in the operating state, it notifies the storage server to update the operating status table, marks the status of the camera as "operating", and records the current time as the last marked time. After that, the dispatch control terminal can obtain video data from the storage server or directly from the camera (if real-time streaming is supported) and display it on the mobile terminal. If the dispatch control terminal does not receive a response instruction from the target camera within the preset time, it believes that the camera is currently in a non-operating state (possibly due to offline, failure, etc.). At this time, the dispatch control terminal should notify the storage server to mark the status of the camera as "non-operating" in the operating status table and record the current time as the last marked time. The storage server should be able to receive a status update request from the dispatch control terminal and update the operating status table according to the request content. After receiving the update request, the storage server modifies the corresponding camera status to the status specified in the request and records the current time as the last marked time. In order to maintain the accuracy of the status information, the scheduling control terminal can periodically send status verification instructions to the camera and update the operation status table in the storage server according to the response results.

[0030] In some embodiments, the dispatch control terminal is connected to a user management database, which records the identity information and job information of the user; the access request includes the identity information and camera number of the user using the mobile terminal; After receiving the access request, the dispatch control terminal extracts the user's identity information from the access request, and obtains the user's position information from the user management database based on the identity information; and determines whether the user has the video viewing authority of the target camera based on the position information.

[0031] In some embodiments, the system further comprises a plurality of processing terminals, wherein the processing terminals are connected to the dispatch control terminal; When the dispatch control terminal detects that the camera starts to collect images, it obtains the processing terminals with idle processing resources, sorts them according to the size of the idle resources according to different algorithms, and updates them to the resource list; Determine the size of resources required to process the video data; In the resource list, select the processing terminal with the fastest required algorithm processing among the processing terminals whose idle processing resources are greater than the set threshold of the required resources as the target processing terminal to establish a connection with the camera. The target processing terminal receives and processes the video data collected by the camera in real time. When it is determined that the loading hopper needs to be moved, the dispatching control terminal sends a moving instruction to the vehicle cab to prompt the driver to move the loading hopper. When it is determined that the hopper is full, the dispatching control terminal controls the hopper head door to close.

[0032] Connection between processing terminal and dispatching control terminal: All processing terminals establish connection with dispatching control terminal through network (such as local area network, wireless network, etc.) to ensure that they can receive instructions and data from dispatching control terminal in real time. Dispatching control terminal continuously monitors the status of each camera, including whether to start collecting images. This is usually achieved through status verification signal or heartbeat packet sent by the camera. When the camera starts collecting images, the dispatching control terminal obtains the idle processing resource information of all current processing terminals. This information may include CPU usage, memory idle amount, network bandwidth, etc. According to the size of idle resources, the dispatching control terminal sorts the processing terminals according to different algorithms (such as fastest completion time algorithm, shortest job priority algorithm, etc.) and updates them to the resource list. The selection of sorting algorithm should be determined according to system requirements and resource characteristics. According to the characteristics of video data collected by the camera (such as resolution, frame rate, encoding format, etc.), the dispatching control terminal determines the size of resources required to process the video data. In the resource list, the dispatching control terminal selects the processing terminal whose idle processing resources are greater than the required resource setting threshold and whose required algorithm processes the fastest as the target processing terminal. The dispatch control terminal establishes a connection with the target processing terminal and transmits the video data collected by the camera to the target processing terminal in real time for processing. After receiving the video data, the target processing terminal performs real-time processing and analysis. When it is determined that the loading hopper needs to be moved (such as based on object recognition and position judgment in the video), the target processing terminal is ready to send a vehicle moving instruction. The target processing terminal sends a vehicle moving instruction to the vehicle cab through the dispatch control terminal. This instruction may contain information such as the direction, distance, and speed of movement, so that the driver can move the loading hopper according to the instruction. When the video analysis results show that the hopper is full, the target processing terminal also sends a control instruction to the control system of the hopper head door through the dispatch control terminal to close it to complete the loading process.

[0033] In some embodiments, if there is no processing terminal in the resource list whose idle processing resources are greater than the set threshold of the required resources, the processing terminal with the largest current idle processing resources in the resource list and the fastest required algorithm processing is selected as the first target processing terminal to establish a connection with the camera. The first target processing terminal receives and processes the video data collected by the camera in real time to determine whether the loading hopper needs to be moved.

[0034] The first target processing terminal receives and processes the video data collected by the camera in real time to determine whether it is necessary to move the loading hopper for a set time, and then selects the processing terminal with the most currently idle resources in the resource list as the second target processing terminal to establish a connection with the camera. The second target processing terminal receives and processes the video data collected by the camera in real time to determine whether the hopper is full.

[0035] The dispatch control terminal traverses the resource list and selects the processing terminal with the largest current idle processing resources. If there are multiple processing terminals, the processing terminal with the fastest required algorithm processing is further selected from the selected processing terminals as the first target processing terminal. The dispatch control terminal establishes a connection with the first target processing terminal and transmits the video data collected by the camera to the first target processing terminal in real time for processing. The first target processing terminal receives and processes the video data in real time, and determines whether the loading hopper needs to be moved according to the preset logic. If necessary, the dispatch control terminal sends a vehicle moving instruction to the vehicle cab. After the first target processing terminal starts processing the video data, the system sets a specific time threshold (such as a few minutes or hours, determined according to actual needs). When the set time arrives, the dispatch control terminal evaluates the idle resource status of the processing terminals in the resource list again. The processing terminal with the most current idle resources is selected from the resource list as the second target processing terminal. If there are multiple processing terminals with the same idle resources, they are also sorted according to the required algorithm processing speed and the fastest processing terminal is selected. The dispatch control terminal establishes a connection with the second target processing terminal and transmits the video data collected by the camera (which may be new data or data before continuing to be transmitted) to the second target processing terminal in real time for processing. The second target processing terminal receives and processes the video data in real time, but its main task at this time is to determine whether the hopper is full. When it is determined that the hopper is full, a control instruction is sent to the control system of the hopper head door through the dispatching control terminal to close it.

[0036] It should be noted that the resource size required for processing the video data of the camera at a historical time is determined based on the camera number as a reference to determine the resource size required for processing the video data.

[0037] Although the present invention has been described in detail with reference to the accompanying drawings and in combination with the preferred embodiments, the present invention is not limited thereto. Without departing from the spirit and essence of the present invention, a person of ordinary skill in the art may make various equivalent modifications or substitutions to the embodiments of the present invention, and these modifications or substitutions shall be within the scope of the present invention. Any person of ordinary skill in the art may easily think of changes or substitutions within the technical scope disclosed by the present invention, and these shall be within the scope of protection of the present invention.

Claims

1. A hopper visual loading system, characterized in that: It includes a storage server, each loading hopper is provided with three cameras, each camera is connected to the storage server, the storage server is connected to a dispatching control terminal, and the dispatching control terminal is connected to a mobile terminal; The three cameras installed on each loading hopper include the loading hopper door camera, the loading hopper discharge port camera, and the loading hopper discharge port rear end camera; The storage server stores the video data collected by the camera according to the set naming method. The naming method is based on the video shooting start time and the camera number. The camera number is numbered according to the loading hopper and the camera; each camera number is unique; The dispatch control terminal receives the access request from the mobile terminal, parses the access request, establishes a connection between the mobile terminal and the storage server based on the parsing result, and displays the corresponding video of the storage server on the mobile terminal. When the user determines that the hopper is full by viewing the video in the mobile terminal, the remote control is used to control the hopper head door to close. Or when the user determines that the loading hopper needs to be moved by viewing the video in the mobile terminal, the remote control sends a moving instruction to the vehicle cab to prompt the driver to move the loading hopper.

2. The hopper visualization loading system according to claim 1 is characterized in that: The storage server responds to the camera's network access request and stores the video data collected by the camera in the data isolation area.

3. The hopper visualization loading system according to claim 2 is characterized in that: The dispatch control terminal receives a video data access request for a target camera sent by a user via a mobile terminal; The dispatch control terminal parses the access request to obtain the camera number of the target camera, sends a status verification instruction to the target camera, and after receiving a response instruction returned by the target camera based on the status verification instruction, establishes a connection between the mobile terminal and the storage server.

4. The hopper visualization loading system according to claim 3 is characterized in that: When the dispatch control terminal does not receive a response instruction returned by the target camera, it sends a confirmation message to the mobile terminal; the confirmation message is that the video to be obtained is a historical video, that is, the target camera is in a non-working state; after receiving the confirmation message returned by the mobile terminal, a connection between the mobile terminal and the storage server is established.

5. The hopper visualization loading system according to claim 4 is characterized in that: The storage server stores an operation status table; after the dispatch control terminal displays the current video data of the target camera on the mobile terminal, the storage server marks the target camera as being in operation status in the operation status table and records the marking time in the operation status table; When the dispatch control terminal does not receive a response instruction returned by the target camera, it notifies the storage server to mark the target camera as non-operating in the operation status table.

6. The hopper visualization loading system according to claim 5, characterized in that: The dispatch control terminal is connected to a user management database, which records the user's identity information and job information; the access request includes the identity information and camera number of the user using the mobile terminal; After receiving the access request, the dispatch control terminal extracts the user's identity information from the access request, and obtains the user's position information from the user management database based on the identity information; Determine whether the user has the video viewing permission of the target camera based on the job information.

7. The hopper visualization loading system according to claim 6, characterized in that: The system also includes a number of processing terminals, which are connected to the dispatching control terminal; When the dispatch control terminal detects that the camera starts to collect images, it obtains the processing terminals with idle processing resources, sorts them according to the size of the idle resources according to different algorithms, and updates them to the resource list; Determine the size of resources required to process the video data; In the resource list, select the processing terminal with the fastest required algorithm processing among the processing terminals whose idle processing resources are greater than the set threshold of the required resources as the target processing terminal to establish a connection with the camera. The target processing terminal receives and processes the video data collected by the camera in real time. When it is determined that the loading hopper needs to be moved, the dispatching control terminal sends a moving instruction to the vehicle cab to prompt the driver to move the loading hopper. When it is determined that the hopper is full, the dispatching control terminal controls the hopper head door to close.

8. The hopper visualization loading system according to claim 7, characterized in that: If there is no processing terminal in the resource list whose idle processing resources are greater than the set threshold of the required resources, the processing terminal with the largest current idle processing resources in the resource list and the fastest required algorithm processing is selected as the first target processing terminal to establish a connection with the camera. The first target processing terminal receives and processes the video data collected by the camera in real time to determine whether the loading hopper needs to be moved.

9. The hopper visualization loading system according to claim 8, characterized in that: The first target processing terminal receives and processes the video data collected by the camera in real time to determine whether it is necessary to move the loading hopper for a set time, and then selects the processing terminal with the most currently idle resources in the resource list as the second target processing terminal to establish a connection with the camera. The second target processing terminal receives and processes the video data collected by the camera in real time to determine whether the hopper is full.

10. The hopper visualization loading system according to claim 9, characterized in that: The resource size required for processing the video data of the camera at the historical time is determined based on the camera number, and the resource size required for processing the video data is determined as a reference.

Images