Unmanned monitoring system for logistics centers
An integrated system with AI analysis of image and sensor data rapidly identifies and addresses causes of cargo collapses and equipment malfunctions in logistics bases, enhancing efficiency and safety.
Patent Information
- Application Number
- JP2023222117
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-12-28
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2043-12-28
AI Technical Summary
Existing systems at automated logistics bases struggle to accurately and promptly identify the cause of cargo collapses and equipment malfunctions, leading to inefficiencies and potential accidents, as they rely on image and video data that require time to analyze and lack immediate cause determination.
An integrated system comprising a cloud server, web server, camera equipment, sensor equipment, and judgment functions, utilizing artificial intelligence to analyze images and sensor data in real-time to determine the cause of accidents and provide immediate countermeasures.
Enables rapid identification of accident causes, reducing downtime and preventing future occurrences by providing immediate responses and data accumulation for continuous improvement.
Smart Images

Figure 0007576879000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an unmanned monitoring system for logistics bases, such as receiving, warehousing, and sorting operations at logistics bases. [Background technology]
[0002] At logistics centers that have been automated using AGVs (Automated Guided Vehicles), if luggage falls or conveyor belts or other equipment stops during receiving, storing, sorting, etc., it is important to obtain images, videos, and other information from cameras and sensors and use the information to make improvements. If a load shift occurs, it is necessary to find out the cause of the shift, and it is not enough to just report the images, videos, and sensor data of the results. Simply acquiring images and videos will take time to identify the cause. In addition, storing images and videos requires a large amount of storage. For example, there may be cases where the failure of a string cutting machine to cut a string fails to be detected, resulting in equipment stoppage or cargo collapse in the next process, or where cargo collapse cannot be detected during AGV transport or while the film winding machine is in operation, resulting in incorrect shipment or the stoppage of other equipment. There may also be cases where the cause is in a location other than the stoppage or error detection, such as when a damaged part of a cardboard box comes into contact with the AGV in the AGV area, causing it to stop.
[0003] As described above, the work times and work locations at automated logistics centers are diverse, and even if the location where the cargo collapse occurred can be found using images and videos, the cause of the cargo collapse may not necessarily be located at the location where it occurred. In some cases, cargo collapse occurs at the location where it occurred due to a shift in the cargo prior to the location where it occurred. Even if improvements are made to the location where it occurred, it may not be a fundamental solution. In other words, it is important to determine the cause of the cargo shift and to identify the location where the cause occurred. In addition, instantaneous determination of the cause is necessary not only to prevent cargo shifting, but also to prevent man-made accidents and arson.
[0004] In the above technical fields, Patent Document 1 discloses a technology for sorting luggage more efficiently and accurately. Patent Document 2 discloses a luggage sorting system, a luggage sorting method, an information processing device, and a control technology thereof. Patent Document 3 discloses a sorting station where luggage or its storage containers are transferred efficiently and accurately, and an item collection and delivery system incorporating the sorting station. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2023-143182 A [Patent Document 2] JP 2023-143180 A [Patent Document 3] Patent No. 7358690 Summary of the Invention [Problem to be solved by the invention]
[0006] However, while the technology described in the above document can achieve efficiency and accuracy in sorting, it is difficult to prevent accidents caused by multiple factors. Essentially, a system should be constructed with the aim of preventing recurrence of accidents and restoring work in the shortest possible time by accurately determining the cause of the accident. By combining it with other sensors, such as a dashcam, or by inputting images and videos from a camera with an app and data from sensors into artificial intelligence, it becomes possible to determine the cause of an accident, pinpoint the area where the accident occurred, shorten recovery times, and make efficient improvements. Therefore, it is necessary to build an integrated system that includes a cloud server, a web server, camera equipment, sensor equipment, judgment functions, and the ability to instantly judge and confirm the cause of an accident and provide instructions on how to improve using various terminals.
[0007] An object of the present invention is to provide a technique for solving the above-mentioned problems. [Means for solving the problem]
[0008] Cloud servers, web servers, camera equipment, sensor equipment, judgment functions, and various terminals are operated through an integrated system. The convenience of cloud servers is optional, and the installation of web servers will be adapted to the number and continuity of work sites. Cameras and sensors will be installed at any appropriate location within the logistics center. The judgment function will consist of video and image recognition, artificial intelligence, etc. The various terminals are portable information terminals that are operated by administrators, remote monitors, workers, etc. Effect of the Invention
[0009] The system embodying this invention can instantly identify the cause of accidents, including not only accidents that occur during receiving, warehousing, and sorting operations at logistics centers, but also accidents caused by human error and malfunctions in transport equipment, allowing for recovery from accidents in the shortest possible time. In addition, by accumulating a large amount of data on the causes of accidents, it becomes possible to find areas for improvement and improve facilities. [Brief description of the drawings]
[0010] [Figure 1] Schematic diagram of the system of the present invention [Diagram 2] Flowchart of the present invention [Diagram 3] Example of a facility network configuration diagram according to the first embodiment [Figure 4] Comparison of the wireless communication standard LoRaWAN in the first embodiment [Diagram 5] Comparison table of the wireless communication standard LoRaWAN in the first embodiment [Figure 6] Example of a surveillance camera according to the first embodiment [Figure 7] Example of sensor network configuration according to the first embodiment [Figure 8] Examples of sensors in the first embodiment DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] The configuration of the present invention will be described below with reference to the attached drawings. In Fig. 1, 1 is a facility such as a logistics center, 2 is a web server, 3 is a camera with an application, 4 is a temperature / humidity / acceleration / illuminance sensor, 5 is an artificial intelligence, 6 is a database, 7 is a cloud server, 8 is an administrator terminal device, and 9 is a remote monitor / worker terminal device. A web server 2, a camera 2 with a built-in app, and temperature, humidity, acceleration, and illuminance sensors 3 are installed in a logistics center or other facility 1, and images, videos, and sensor data relating to accidents such as equipment breakdowns and cargo collapse from each work point during receiving, storing, sorting, and other operations within the logistics center or other facility are transmitted to the web server 2. The WEB server 2 transmits the accident information to the cloud server 7, which inputs the accident information to the artificial intelligence 5 and at the same time transmits the accident information to the manager terminal device 8 and the remote monitor / worker terminal device 9. The WEB server 2 transmits and inputs the above accident information to the artificial intelligence 5 in the cloud server 7, thereby analyzing and determining the cause of the accident, creating countermeasures, and transmitting them as a countermeasure report or the like to the manager terminal device 8 and the remote monitor / worker terminal device 9. The artificial intelligence 5 stores the accident circumstances and causes in a database 6 for future learning purposes.
[0012] The camera with built-in app 2 and the temperature / humidity / acceleration / illuminance sensor 3 are equipped with means for transmitting accident data, the web server 2 is equipped with means for transmitting the accident information transmitted from the camera with built-in app 2 and the temperature / humidity / acceleration / illuminance sensor 3 to an administrator terminal device 8, a remote monitor / worker terminal device 9 and a cloud server 7, the cloud server 7 is equipped with a database 6 for storing programs such as an artificial intelligence 5 that operates the system and related information and data, the artificial intelligence 5 is equipped with a function for determining the cause of the accident and formulating countermeasures by means for calculation, search, collation, output, display, storage and other processing for executing the programs that operate the system, and the cloud server 7 is equipped with means for user authentication of the administrator terminal device 8 and the remote monitor / worker terminal device 9 and for transmitting accident information.
[0013] The logistics center or other facility 1 may be indoors or outdoors, and may be located in multiple locations. The web server 2 may be located close to or remote from the logistics center or other facility 1. The cloud server 7 is used depending on the characteristics of the data to be stored and whether or not it is connected to other external systems. The app-embedded camera 2 and the temperature, humidity, acceleration and illuminance sensors 3 are installed in appropriate locations in the facility 1 such as a logistics center depending on the object of monitoring and the content of management. The manager terminal device 8 and the remote monitor / worker terminal device 9 have different functions depending on whether they are a manager or a remote monitor / worker, and the level of accessible information and data.
[0014] The camera with built-in app 2 has the same function as a dashcam and constantly records video. The video is kept for several hours and then overwritten. If an abnormal image is detected, the application built into the camera determines that an accident has occurred, extracts video from any time before or after the accident, and sends the video data and accident information such as camera position information to the WEB server 2.
[0015] The temperature / humidity / acceleration / illuminance sensors 3 constantly detect the temperature, humidity, vibrations caused by earthquakes, etc. at the locations where they are installed, and if an abnormal value occurs, it transmits the abnormal value and the sensor information to the web server 2.
[0016] When the WEB server 2 receives abnormal data from the app-embedded camera 2 and the temperature / humidity / acceleration / illuminance sensor 3, it creates an accident report etc. using the extracted accident data and sends emails, SMS etc. to the manager terminal device 8 and the remote monitor / worker terminal devices 9. At the same time, it sends the accident data to the cloud server 7.
[0017] The cloud server 7 inputs the received accident data into the artificial intelligence 5, which then performs an accident cause analysis and identifies the cause of the accident. After identifying the cause of the accident, the artificial intelligence 5 formulates accident response measures, creates a response report, etc., and sends emails, SMS, etc. to the manager terminal device 8 and the remote monitor / worker terminal device 9.
[0018] The manager, remote monitor, and worker improve the cause of the accident in the facility 1 such as a logistics center based on the accident report etc. received from the WEB server 2 and the accident countermeasure report etc. received from the cloud server 7, and promote the spread of processes during receiving, storing, sorting, etc.
[0019] <Embodiment 1> [Wireless communication] Facilities such as logistics centers have many obstacles and complicated machinery. The conditions within these facilities require the construction of a large-scale network that enables long-distance communication while minimizing data and power consumption, and in this invention, LoRaWAN (Long Range Wide Area Network), which can connect many devices, is selected and used. Figure 4 shows a comparison diagram between LoRaWAN and other wireless communication standards. Figure 5 shows a performance comparison table between LoRaWAN and other wireless communication standards. However, the wireless communication standard used in the present invention is not limited to LoRaWAN.
[0020] [camera] An example of a camera used in the system of the present invention is shown in FIG. 6. The camera used is Vieueka (manufactured by Panasonic). Vieueka is an IoT camera with a built-in CPU, and the image analysis app in the camera works with the artificial intelligence of the cloud server, enabling rapid analysis of minimal data. However, the camera used in the present invention is not limited to Vieueka. Since a large number of cameras can be connected via a LoRaWAN gateway, it is preferable to position the cameras so that there are as few blind spots as possible.
[0021] [sensor] Examples of a temperature and humidity sensor, an acceleration sensor, and an illuminance sensor are shown in Fig. 7. As shown in Fig. 8, each sensor is connected to a LoRaWAN gateway and transmits data to a cloud server via a router.
[0022] The present invention aims to determine the cause of accidents during receiving, warehousing, and sorting operations based on abnormal data from cameras and sensors, and to recover from the accidents, but the determination data is not limited to abnormal data from cameras and sensors. There are many devices in a logistics center, such as AGVs (Automated Guided Vehicles), belt conveyors, string cutters, seismometers, and fire alarms, and it is possible to incorporate stop signals and abnormal signals from these devices into the system and build a comprehensive logistics center unmanned monitoring system.
[0023] The following explanation is based on generalized terminology examples. The manager terminal device 8 and the remote monitor / worker terminal device 9 are preferably mobile terminals, and may be any type such as a smartphone. The terminal devices and cloud server 7 have means (functions) for transmitting and receiving the relevant information (hereinafter including various data). For example, they mutually transmit and receive information to check matters that need to be confirmed, such as the personal authentication and authority of the person carrying the terminal (manager, worker, etc.). The artificial intelligence 5 is configured and operated by currently mainstream deep learning type artificial intelligence, but is not limited to this function and configuration. The artificial intelligence 5 analyzes the cause of sorting accidents by learning abnormal data, creates countermeasure reports, etc., and transmits them to each terminal device from the cloud server 7. [Industrial Applicability]
[0024] The present invention is an effective system for detecting abnormalities and analyzing the causes of cargo shifting at automated logistics centers, regardless of whether they are manned or unmanned, but it can also be used for purposes other than logistics centers. For example, it can be effectively used for anomaly detection and anomaly cause analysis in product assembly and manufacturing lines, food manufacturing lines, unmanned stores, etc. [Explanation of symbols]
[0025] 1. Logistics bases and other facilities 2. Web Server 3. In-app Camera 4 Temperature, humidity, acceleration and illuminance sensors 5. Artificial Intelligence 6 Database 7. Cloud Server 8. Administrator Terminal Device 9 Remote monitor / worker terminal device
Claims
1. An unmanned logistics hub monitoring system for work accidents at a logistics hub, comprising: A terminal operated by a person in charge of the logistics center and a remote monitor / operator; A camera installed at the logistics center; A sensor installed at the logistics center; A web server that receives images or videos from the camera and information from the sensor; A database for storing said information; An artificial intelligence that analyzes the cause of the accident from the information; and A cloud server communicably connected to the terminal; and The camera includes: A function of recording the facilities of the logistics base as videos or images; A function of overwriting the video several hours later if the accident does not occur; An application function of transmitting accident video information including a video of several seconds before and after the occurrence of the accident to the WEB server when the accident occurs; With The sensor comprises: A function of detecting accident detection information regarding the accident at the logistics base; a function of transmitting the accident detection information to the WEB server when the accident occurs; With The artificial intelligence is A function of identifying an accident location from the accident video information and the accident detection information transmitted to the WEB server; A function of analyzing the cause of the accident from the accident location and identifying the location corresponding to the cause of the accident; a function of storing the accident video information and the accident detection information in the database; A function of learning the accumulated accident video information and the accident detection information; With The cloud server includes: an authentication unit for identifying authentication information of the person in charge, the remote monitor, and the worker; A function of transmitting the accident video information, the accident detection information, and abnormality cause information indicating the cause of the accident to the person in charge, the remote monitor, and the worker by the authentication unit; With The terminal includes: a receiving unit that receives the accident video information, the accident detection information, and the abnormality cause information from the cloud server; a display unit that displays the accident video information, the accident detection information, and the abnormality cause information; a transmission unit that transmits the authentication information of the person in charge, the remote monitor, and the worker to the cloud server; With The accident detection information is Vibration information regarding vibrations of the facility at the logistics center; and Information on at least one of the temperature, humidity, illuminance, sound, and carbon dioxide concentration of the logistics center; Including, An unmanned monitoring system for logistics bases.
2. The accident detection information is An abnormal value of the vibration of the equipment; and At least one abnormal value among the temperature, the humidity, the illuminance, the sound, and the carbon dioxide concentration at the logistics base; Including, 2. The unmanned logistics base monitoring system according to claim 1.
3. The artificial intelligence generates accident response information regarding a response to the accident at the logistics center based on the accident detection information detected by the sensor.
2. The unmanned logistics base monitoring system according to claim 1.
Citation Information
Patent Citations
Method and device for editing of recorded picture
JP1990016891A
System / Method for risk management in emergency mode and maintenance monitoring management in building or the like and digital filing system thereof
JP2002074562A
Accident information sharing system
JP2022091509A
Distribution system
JP2022148935A
Package sorting system, package sorting method, information processing device, and method for controlling the same
JP2023143180A
