Vehicle-mounted device, analysis device, and analysis system

The on-vehicle device with image analysis and battery management capabilities addresses the lack of event-specific recording in forklifts, enhancing safety and efficiency by detecting and recording critical cargo handling events and managing battery life.

JP7613843B2Active Publication Date: 2025-01-15YAZAKI ENERGY SYSTEM CORP
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2020075582
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-04-21
Publication Date
2025-01-15
Estimated Expiration
2040-04-21

AI Technical Summary

Technical Problem

Existing drive recorders on forklifts do not effectively record events specific to cargo handling vehicles, such as double operation of the cargo holding mechanism while the vehicle is running, limiting the ability to capture dangerous behaviors unique to these vehicles.

Method used

An on-vehicle device equipped with a monitoring unit, camera, and image analysis capabilities to detect and record events like double operation, cargo presence/absence, and shaking, triggered by specific conditions, without relying on additional sensors, and a system to analyze and manage battery status for efficient operation.

Benefits of technology

Enables detection and recording of critical events in cargo handling vehicles, supports safe driving and efficient operation, extends battery life, and provides data analysis for improved management and safety protocols.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007613843000001
    Figure 0007613843000001
  • Figure 0007613843000002
    Figure 0007613843000002
  • Figure 0007613843000003
    Figure 0007613843000003
Patent Text Reader

Abstract

To provide an on-vehicle device capable of recording the occurrence of an event or a change in a state peculiar to a load handling vehicle as a trigger and an analysis device and an analysis system using records thereof.SOLUTION: An on-vehicle device monitors a conveyance state of a load (S1). When at least any one of double operation of a forklift, presence / absence of a load, falling of the load, and shaking of the load in a width direction of the forklift is detected (Yes at S2), a trigger for recording information is generated (S3).SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an in-vehicle device, an analysis device, and an analysis system. [Background technology]

[0002] Technologies for supporting safe driving of forklifts have been proposed (for example, Patent Documents 1 to 5). In addition, commercial vehicles such as trucks, taxis, and buses are equipped with on-board devices such as drive recorders, which are used to support safe driving. Drive recorders collect image data (video data) captured by an on-board camera and record the collected image data in a recording medium such as an internal memory or a memory card. Drive recorders are also installed in forklifts to record accident situations and the like during cargo transport. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-156641 A [Patent Document 2] JP 2019-199331 A [Patent Document 3] JP 2020-7059 A [Patent Document 4] JP 2020-15571 A [Patent Document 5] JP 2019-185515 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, although the drive recorders mounted on forklifts record video when triggered by a certain level of impact, sudden acceleration, sudden braking, sharp turns, etc., the types of triggers are the same as those of drive recorders mounted on trucks and other vehicles. For this reason, it was not possible to record video when triggered by the occurrence of dangerous behavior specific to loading vehicles such as forklifts, such as the double operation of raising and lowering the claws while the vehicle is moving.

[0005] The present invention has been made in consideration of the above-mentioned circumstances, and its purpose is to provide an on-board device that can perform recording triggered by the occurrence of an event or change in state specific to a loading vehicle, as well as an analysis device and analysis system that utilizes this recording. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the in-vehicle device, the analysis device, and the analysis system according to the present invention include the following features (1) to ( 11 ) is its feature. (1) An on-board device that is mounted on a cargo handling vehicle having a cargo holding section capable of holding cargo, and records information representing a situation in the vicinity of the cargo handling vehicle when a predetermined condition is satisfied, comprising: A monitoring unit that monitors the transportation status of the luggage; a trigger generating unit that generates a trigger for recording the information when the monitoring unit detects at least one of a double operation on the cargo handling vehicle and a drop of the cargo; A recording unit that records, as the information, at least an image showing a situation in the vicinity of the loading vehicle; A camera mounted on the cargo handling vehicle for capturing an image of a scene in front of the cargo handling vehicle, the scene including at least a part of the baggage holding section; Equipped with 、 The monitoring unit includes an image analysis unit that analyzes an image captured by the camera to detect at least one of a double operation on the cargo handling vehicle and a drop of the cargo. Onboard equipment. ( 2 ) An on-board device that is mounted on a cargo handling vehicle having a cargo holding section capable of holding cargo, and records information representing a situation in the vicinity of the cargo handling vehicle when a predetermined condition is satisfied, A monitoring unit that monitors the transportation status of the luggage; a trigger generating unit that generates a trigger for recording the information when the monitoring unit detects at least one of a double operation on the cargo handling vehicle, the presence or absence of the luggage, the dropping of the luggage, and the swinging of the luggage in the width direction of the cargo handling vehicle; and A recording unit that records, as the information, at least an image showing a situation in the vicinity of the loading vehicle; a camera mounted on the cargo handling vehicle for capturing an image of a scene in front of the cargo handling vehicle, the scene including at least a part of the baggage holding section; The monitoring unit includes an image analysis unit that analyzes an image captured by the camera to detect at least one of a double operation on the cargo handling vehicle, the presence or absence of the luggage, the falling of the luggage, and the swaying of the luggage in the width direction of the cargo handling vehicle, The image analysis unit a baggage detection unit that analyzes an area in the image that includes at least a part of the baggage holding unit as a baggage detection range and detects the area of ​​the baggage, Detecting the presence or absence of the luggage depending on whether the luggage detection unit detects the area of ​​the luggage, When it is detected that the luggage is present, if it is detected that at least a part of the luggage area is missing, the falling of the luggage is detected. Onboard equipment. ( 3 The luggage holding section is liftable and lowerable, The image analysis unit a travel detection unit that detects whether the loading vehicle is traveling by analyzing a part of an area in the image that is separated from the baggage detection area as a travel detection area, Detecting whether the luggage support is raised or lowered based on a change in a position or size of the luggage area in the image; When the cargo handling vehicle is traveling and the baggage holding section is raised or lowered, Detect the work the above( 2 ) An in-vehicle device as described above. ( 4) An on-board device that is mounted on a cargo handling vehicle having a cargo holding section capable of holding cargo, and records information representing a situation in the vicinity of the cargo handling vehicle when a predetermined condition is satisfied, A monitoring unit that monitors the transportation status of the luggage; a trigger generating unit that generates a trigger for recording the information when the monitoring unit detects at least one of a double operation on the cargo handling vehicle, the presence or absence of the luggage, the dropping of the luggage, and the swinging of the luggage in the width direction of the cargo handling vehicle; and A recording unit that records, as the information, at least an image showing a situation in the vicinity of the loading vehicle; Equipped with The luggage holding section is liftable and lowerable, The monitoring unit is an operation signal acquisition unit that acquires an operation signal indicating an operation performed on the loading vehicle; The double operation is detected when an operation signal indicating that the cargo handling vehicle is traveling and an operation signal indicating that the baggage holding unit has been raised or lowered are acquired. Onboard equipment. ( 5 ) a battery monitoring unit that monitors the voltage status of the battery of the cargo handling vehicle; an operation monitoring unit that monitors the operation status of the loading vehicle; a determination unit that determines whether the battery satisfies a predetermined condition based on the voltage status and the operation status; The above (1) to ( 4 ) The vehicle-mounted device according to any one of the preceding claims. ( 6 ) Above (1)~( 4 A trigger information collection unit that collects trigger information related to the occurrence of the trigger from the vehicle-mounted device according to any one of the above. an analysis unit that performs an analysis regarding the operation of the cargo handling vehicle based on the trigger information of the trigger that occurs within a predetermined period; an output unit for outputting the analysis result; An analysis device comprising: ( 7 ) the above( 5a battery information collecting unit that collects battery information indicating the voltage status and the operating status from the vehicle-mounted device described in a prediction unit that generates prediction information regarding replacement of the battery based on the battery information within a predetermined period; an output unit that outputs the prediction information; An analysis device comprising: ( 8 ) the above( 6 An analysis device according to the present invention a receiving device that receives the analysis result from the analysis device; An analysis system comprising: ( 9 ) the above( 7 ) An in-vehicle device and an analysis device according to the present invention; a receiving device that receives the prediction information from the analysis device; An analysis system comprising: ( 10 In the analysis device, The trigger information collection unit collects the trigger information from a plurality of the on-board devices mounted on a plurality of cargo handling vehicles, The analysis unit generates at least one of an instruction manual, an analysis report, a ranking, a heat map, and a near-miss map regarding the operation of the cargo handling vehicle as the analysis result based on the collected trigger information. the above( 8 ) The analysis system described in the above. ( 11 In the analysis device, The battery information collection unit collects the battery information from a plurality of the on-board devices mounted on each of a plurality of cargo handling vehicles, The prediction unit generates the prediction information based on the collected battery information. the above( 9 ) The analysis system described in the above.

[0007] According to the vehicle-mounted device having the above-mentioned configuration (1), a dual operation of raising and lowering the baggage holding unit while the loading vehicle is traveling can be performed. orThe system can detect events or changes in conditions specific to cargo handling vehicles, such as cargo falling, and record images and other information that show the situation. This allows the manager of the cargo handling vehicle to easily grasp the dangerous behavior and operating status of the cargo handling vehicle, thereby enabling safe driving support and efficient operation support.

[0008] Furthermore, the above( 1 According to the in-vehicle device having the above configuration, a trigger can be generated by image analysis.

[0009] the above( 2 According to the in-vehicle device having the configuration of (1), it is possible to detect baggage by image analysis of a limited area in an image without increasing the processing load. Also, it is possible to detect the presence or absence of baggage and the falling of baggage without using a sensor or the like for detecting the presence or absence of baggage.

[0010] the above( 3 According to the in-vehicle device having the above configuration, it is possible to detect whether the loading vehicle is traveling or not by image analysis of a limited area in the image without increasing the processing load. Also, it is possible to detect double operation by detecting the lifting and lowering of the luggage holding part without using signals on the vehicle side.

[0011] the above( 4 According to the in-vehicle device having the above configuration, double operation can be detected without image analysis.

[0012] the above( 5 According to the on-board device having the above configuration, when it is determined that the power consumption falls below a predetermined value, for example, based on the operating time and battery voltage of the cargo handling vehicle, it is possible to prompt the appropriate battery management. Therefore, the appropriate battery management is useful for extending the battery life and reducing the number of battery replacements.

[0013] the above( 6 ) configuration analysis device and the above ( 8)According to the analysis system of the above configuration, the analysis results on the operation of the cargo handling vehicle based on the trigger information collected by the on-board device are output, so that the manager of the cargo handling vehicle can easily grasp the dangerous behavior and operating status of the cargo handling vehicle. Therefore, it is possible to support safe driving and efficient operation.

[0014] the above( 7 ) configuration analysis device and the above ( 9 According to the analysis system of the configuration of , the information of the battery replacement time predicted based on the voltage state and the operating state is output. Therefore, the administrator can efficiently manage the battery, for example, by improving the timing and frequency of charging.

[0015] the above( 10 According to an analysis system having the above configuration, information collected from on-board units of multiple clients who operate loading and unloading vehicles is accumulated and analyzed, enabling the service provider operating the analysis device to provide more specialized advice and suggestions regarding safe driving and efficient operation. Effect of the Invention

[0016] According to the present invention, it is possible to make a record triggered by the occurrence of an event or a change in state specific to a cargo handling vehicle, and to perform an analysis using this record.

[0017] The present invention has been briefly described above. Furthermore, the details of the present invention will be further clarified by reading the following description of the embodiment of the present invention (hereinafter, referred to as "embodiment") with reference to the accompanying drawings. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a diagram showing the configuration of an analysis system according to one embodiment of the present invention. [Diagram 2] FIG. 2 is a side view showing an example of the appearance of a forklift truck and a load during operation. [Diagram 3] FIG. 3 is a side view showing a typical example of the relationship between the camera and the forklift. [Figure 4] FIG. 4 is a flowchart showing an example of the operation of the vehicle-mounted device. [Diagram 5] FIG. 5 is a flowchart showing an example of the operation of the vehicle-mounted device. [Figure 6] FIG. 6 is a diagram showing an example of image analysis. [Figure 7] FIG. 7 is a flowchart showing an example of the operation of the vehicle-mounted device. [Figure 8] FIG. 8 is a diagram for explaining an example of an analysis request from a server. [Figure 9] FIG. 9 is a diagram illustrating an example of an analysis result by the server. [Figure 10] FIG. 10 is a diagram showing an example of an analysis result by the server. [Figure 11] FIG. 11 is a diagram showing an example of an analysis result by the server. [Figure 12] FIG. 12 is a diagram showing an example of an analysis result by the server. [Figure 13] FIG. 13 is a diagram showing an example of an analysis result by the server. [Figure 14] FIG. 14 is a diagram showing an example of an analysis result by the server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Specific embodiments of the present invention will be described below with reference to the accompanying drawings.

[0020] <System configuration> The configuration of an analysis system 1 according to an embodiment of the present invention is shown in Fig. 1. The analysis system shown in Fig. 1 is mainly used for driving assistance when operating a cargo handling vehicle such as a forklift to transport cargo.

[0021] The analysis system 1 shown in FIG. 1 includes, as equipment on the customer side, an on-board device 10 used while mounted on each loading vehicle, and an office PC 30 installed in a specified office to manage each loading vehicle, worker, work content, etc. The analysis system 1 also includes, as equipment on the analysis service provider side, a server 80 that performs analysis based on various data collected from the on-board device 10 and transmits the analysis results to the office PC 30. The analysis system 1 includes a plurality of office PCs 30 and a plurality of on-board devices 10 installed in the offices of a plurality of customers. As will be described in detail later, the on-board device 10 of this embodiment has a function to monitor the transportation status (operation status) of the loading vehicle in addition to a normal drive recorder function, and is useful for safe driving and efficient operation. The on-board device 10 also has a battery management function that is useful for extending the battery life and reducing the number of battery replacements.

[0022] The vehicle-mounted device 10 and the office PC 30 do not need to be connected via a network. In that case, the vehicle-mounted device 10 is configured to read a memory card 65 that holds data recorded in the vehicle-mounted device 10.

[0023] The office PC 30 is composed of a general-purpose computer device installed in an office, and manages information such as the operating status of loading and unloading vehicles and information on specific locations where collision accidents are likely to occur. In the example of FIG. 1, data communication between the vehicle-mounted device 10 and the office PC 30 is relayed by a base station 71, a server 80 (analysis device), and a network 70. Wireless communication between the base station 71 and the vehicle-mounted device 10 may be performed using a mobile communication network (mobile line network) such as LTE (Long Term Evolution) / 4G (4th Generation) or a wireless LAN (Local Area Network), either of which can be selectively used. The network 70 is a network (packet communication network) such as the Internet, and relays data communication between the office PC 30 and the server 80.

[0024] The vehicle-mounted device 10 includes various interfaces (I / F) 12A, 12B, 13, 14, 16, 19, and 29 to enable input or output of various signals. The speed I / F 12A has a function for inputting a vehicle speed pulse signal output from a vehicle speed sensor 51 mounted on the vehicle side. The engine rotation I / F 12B has a function for inputting an engine rotation pulse signal output from the vehicle side. The external input I / F 13 is used for inputting various external signals, and has a function for inputting a battery voltage value output from a battery voltmeter 53, an operation signal indicating the lifting and lowering operation of the load holding portion (claws) of the forklift, etc.

[0025] The sensor input I / F 14 is used to input signals from various sensors. In the example of FIG. 1, a G sensor 28 and a gyro sensor 52 are connected to the sensor input I / F 14. The G sensor 28 detects the magnitude of acceleration in various directions applied to the vehicle on which the vehicle-mounted device 10 is mounted. Based on the output of the G sensor 28, the control unit 11 detects sudden deceleration and sudden acceleration of the forklift 90. The gyro sensor 52 detects the rotational angular velocity around each of the pitch axis, yaw axis, and roll axis of the forklift 90 on which the vehicle-mounted device 10 is mounted, and can output signals indicating changes in each of the pitch angle, yaw angle, and roll angle. Based on the output of the gyro sensor 52 and the G sensor 28, the control unit 11 detects a sudden turn of the forklift 90.

[0026] The analog input I / F 29 is used for inputting various analog signals. A battery voltage value output by a battery voltmeter 53 may be input to the analog input I / F 29. The control unit 11 monitors the battery voltage status based on the output of the battery voltmeter 53. In addition, the output of a thermometer that measures the temperature inside and outside the premises may be input to the analog input I / F 29. The control unit 11 can use the output of the thermometer, for example, to manage the physical condition of the driver (detect abnormalities). The camera I / F 16 has a function for connecting the cameras 23A and 23B. That is, the camera I / F 16 has a function for taking in the video signals output by the cameras 23A and 23B, respectively, and converting them into predetermined digital image data suitable for computer processing.

[0027] The audio I / F 19 has a function of generating a predetermined audio signal that can be used for audio alerts, etc.

[0028] The control unit 11, which realizes the main functions of the vehicle-mounted device 10, is composed of electronic circuits mainly including a processor of a microcomputer (CPU). This microcomputer realizes the control functions of the vehicle-mounted device 10, which will be described later, by executing programs previously stored in the non-volatile memory 26A or the like.

[0029] The above-mentioned interfaces 12A, 12B, 13, 14, 16, and 29 are connected to the input of the control unit 11. In addition, a speaker 20 is connected to the output of the control unit 11 via an audio I / F 19.

[0030] In addition, the beacon receiving unit 15, the recording unit 17, the display unit 27, the power supply unit 25, the communication unit 24, the non-volatile memory 26A, the volatile memory 26B, the card I / F 18, the RTC unit 21, the switch input unit 22, and the GPS receiving unit 9 are connected to the control unit 11.

[0031] The beacon receiving unit 15 receives radio waves from beacons located within a predetermined range via the antenna 15a. Beacons include driver beacons, fixed beacons, and mobile beacons. The driver beacon is, for example, a card-type beacon carried by the driver, and emits a beacon signal including the driver ID. When a driver carrying the driver beacon approaches the vehicle-mounted device 10 (for example, sits in the driver's seat), the control unit 11 automatically recognizes the driver ID and identifies the driver. In other words, when the driver carries the driver beacon in which his / her driver ID is stored and gets into the driver's seat, the vehicle-mounted device 10 recognizes the driver ID, making it possible to manage data for each person without making the driver perform a specific operation.

[0032] The fixed beacons are fixedly placed at predetermined positions within the premises and are used to obtain information indicating the current position of the forklift 90. The fixed beacons emit a beacon signal including identification information that specifies the position where they are placed. The mobile beacons are beacons carried by people other than the driver and are used to detect when a person approaches the forklift 90. The mobile beacons emit a beacon signal including identification information that specifies an individual, such as a driver ID or worker ID. In addition to the beacons, positioning may be performed based on a signal received by the GPS receiver 9, which will be described later, in order to obtain information on the current position.

[0033] The recording unit 17 is used to automatically record image data of images output by the cameras 23A and 23B, for example, and hold the data for a certain period of time. The display unit 27 can be used to display visible information such as characters necessary for operating the vehicle-mounted device 10, and information calling attention to driving operations so that the driver can visually recognize the information.

[0034] The power supply unit 25 generates stable power supply based on power supply supplied from the vehicle side, and supplies the generated power supply to each circuit in the vehicle-mounted device 10 including the control unit 11 . The communication unit 24 provides a wireless communication function for data communication between the vehicle-mounted device 10 and the base station 71 .

[0035] The non-volatile memory 26A is made up of a semiconductor memory, and previously stores programs executable by the microcomputer of the control unit 11, various constant data required for control, tables, and the like. The volatile memory 26B is used to temporarily store data generated by the control unit 11 during processing.

[0036] A memory card 65 carried by the driver is removably connected to the card I / F 18. The control unit 11 can read data from the memory card 65 attached to the card I / F 18, and can also write various data generated by the control unit 11 to the memory card 65 via the card I / F 18.

[0037] The RTC (real time clock) unit 21 is configured with an integrated circuit having a clock function. That is, the RTC unit 21 can generate information on the current time and grasp the elapsed time. The switch input unit 22 is used to input signals representing the states of various switches necessary for operating the vehicle-mounted device 10 .

[0038] The GPS receiver 9 receives radio waves from multiple GPS (Global Positioning System) satellites via an antenna 9a. Based on the multiple received signals received by the GPS receiver 9, position information indicating the current position of the forklift 90 can be calculated and obtained. In addition, the movement of the forklift 90 can be detected using the position information based on the signals received by the GPS receiver 9.

[0039] The office PC 30 is a PC that runs on a general-purpose operating system. The office PC 30 can be used as a management device for grasping and managing the driving conditions, including dangerous behavior of cargo handling vehicles, and the operating conditions. The office PC 30 has a control unit (CPU) 31, a communication unit 32, a display unit 33, a memory unit 34, a card I / F 35, an operation unit 36, an output unit 37, an audio I / F 38, and an external I / F 48.

[0040] The control unit 31 comprehensively controls each unit of the office PC 30. The communication unit 32 is capable of communicating with a server 80 via a network . The display unit 33 can display various information that can be used for managing the operation of each cargo handling vehicle. The memory unit 34 can acquire and manage data generated by the on-board device 10 mounted on each cargo handling vehicle.

[0041] A memory card 65 is attached to the card I / F 35 so as to be freely insertable and removable. The card I / F 35 is used to input various data recorded in the vehicle-mounted device 10 from the memory card 65. The operation unit 36 ​​has a keyboard, mouse, etc., and accepts operations by the administrator of the office PC 30. The output unit 37 outputs various data. A microphone 41 and a speaker 42 are connected to the audio I / F 38. The administrator can also make audio calls using the microphone 41 and the speaker 42.

[0042] External storage devices (not shown), such as an operation data database (DB) and a hazard map database (DB), can be connected to the external I / F 48. The hazard map DB can hold data indicating dangerous behavior (near misses) and locations where accidents have occurred caused by cargo handling vehicles such as forklifts.

[0043] The server 80 has a control unit (CPU) 81, a communication unit 82, and a storage unit 83, and functions as an analysis device. The communication unit 82 communicates with the vehicle-mounted device 10 via the base station 71. The communication unit 82 may also communicate with the office PC 30 via the network 70. The storage unit 83 is a memory capable of storing various data, and stores the operation data transmitted from the vehicle-mounted device 10. The storage unit 83 may also store the operation data transmitted from the office PC 30. The control unit 81 comprehensively controls each unit of the server 80. The server 80 receives the operation data of each forklift 90 transmitted from the multiple office PCs 30 at the communication unit 82 and stores the data in the storage unit 83. The control unit 81 then analyzes the behavior of each forklift 90 by analyzing the received operation data. The analysis method will be described in detail later. Each analysis result (various reports, near-miss data, etc.) is stored in the storage unit 83, and is transmitted to each office PC 30 by the communication unit 82. Furthermore, the control unit 81 of the server 80 generates prediction information regarding battery replacement based on the battery information received from the office PC 30, which indicates the voltage status and operating status of the battery of the forklift 90. This prediction information is stored in the storage unit 83, and is transmitted to the office PC 30 by the communication unit 82.

[0044] <Examples of cargo handling vehicles> An example of the appearance of a forklift in operation and a load is shown in Figure 2. In Figure 2, the left side represents the forward direction of the forklift, the right side represents the backward direction, and the direction perpendicular to the paper surface represents the width direction of the forklift (the left and right direction relative to the forward direction of the forklift).

[0045] As shown in FIG. 2, the forklift 90 has a plurality of (two in this embodiment) claws 91 and a backrest 92 that protrude long in front of the driver's seat. The claws 91 and the backrest 92 are supported by the mast 93 in a state in which they can be raised and lowered in the vertical direction along the mast 93. The forklift 90 can drive the positions of the claws 91 and the backrest 92 in the vertical direction by driving a predetermined lifting mechanism. The forklift 90 is also provided with a drive mechanism that changes the inclination angle of the mast 93 that supports the claws 91 and the backrest 92, and can adjust the tilt angles of the claws 91 and the backrest 92. The forklift 90 also has a head guard 94 that covers the upper part of the driver's seat.

[0046] Meanwhile, various cargo 100 to be transported by the forklift 90 are generally stored in a state in which they are placed on a pallet 110, which is a platform arranged on the ground 98. Therefore, when actually transporting the cargo 100, the forklift 90 advances toward the pallet 110 with the claws 91 lowered as shown in FIG. 2, so that the claws 91 pass through the inside of the pallet 110. When the forklift 90 lifts the claws 91 upward in this state, the cargo 100 placed on the pallet 110 can be lifted together with the pallet 110. Then, by moving the forklift 90 with the cargo 100 and the pallet 110 lifted, the cargo 100 and the pallet 110 can be transported.

[0047] Incidentally, when driving the forklift 90, the driver is prohibited from performing the double operation of raising and lowering the claws 91 while driving in order to prevent accidents, and is also required to constantly be aware of the state of the claws 91. The vehicle-mounted device 10 has a function of detecting this double operation, the presence or absence of a load held by the claws 91, the falling of the load, and the swaying of the load in the width direction of the forklift 90 (hereinafter also simply referred to as "load swaying").

[0048] <Camera mounting position and shooting range> FIG. 3 shows a typical example of the relationship between a camera 23A for capturing images of the driver and a camera 23B for capturing images of the forklift 90 and the forklift 90. As shown in FIG.

[0049] In the example shown in FIG. 3, the camera 23A built into the vehicle-mounted device 10 is attached in front of the head guard 94, and the shooting direction is adjusted to face a direction inclined downward by about 45 degrees with respect to the horizontal direction. That is, the area of ​​the shooting range 23a shown in FIG. 3 becomes the shooting target, so the driver of the forklift 90 can be photographed by the camera 23A. Also, in the example shown in FIG. 3, the camera 23B is installed on the upper part of the mast 93, and the shooting direction is adjusted to face a direction inclined downward by about 45 degrees with respect to the horizontal direction. That is, the area of ​​the shooting range 23b shown in FIG. 3 becomes the shooting target, so the claws 91 of the forklift 90, the pallet 110 being transported, and the baggage 100 can be photographed by the camera 23B. It is desirable that the shooting range 23b of the camera 23B is set to a wide range of, for example, about 120 degrees so that the baggage 100 and the pallet 110 can be photographed simultaneously in almost the entire area.

[0050] <Example of operation of the in-vehicle device> An example of the operation of the vehicle-mounted device 10 shown in Fig. 1 is shown in Fig. 4. The vehicle-mounted device 10 is mounted on the forklift 90 shown in Figs. 2 and 3, and the control unit 11 performs the operation shown in Fig. 4 in conjunction with each functional unit of the vehicle-mounted device 10. The control unit 11 has a function of monitoring the transport status of the luggage, and a trigger generation function of generating a trigger for recording information such as an image showing the situation near the forklift 90 when the transport status satisfies a predetermined condition. Fig. 4 shows the operation of recording information showing the operating status of the forklift 90 (presence or absence of luggage) and the situation near the forklift 90 when dangerous behavior (double operation, dropped luggage, swinging luggage) occurs.

[0051] When a driver carrying a driver beacon is authenticated, the vehicle-mounted device 10 starts the operation shown in Fig. 4. The vehicle-mounted device 10 monitors the transportation status of the luggage (the luggage 100 and the pallet 110) based on inputs from the speed I / F 12A, the engine speed I / F 12B, the external input I / F 13, the sensor input I / F 14, and the camera I / F 16 (step S1). The process of S1 will be described in detail later.

[0052] The vehicle-mounted device 10 monitors the transportation status until it detects at least one of the following: double operation, the presence or absence of a load, a load drop, and the swaying of the load in the width direction of the forklift 90, and when it detects (YES in S2), it generates a trigger (S3). The vehicle-mounted device 10 temporarily records, as trigger information in the recording unit 17, a trigger type indicating whether the occurred event is double operation, the presence or absence of a load, a load drop, or the swaying of the load, the time when the event occurred, and the position information of the forklift 90 (host vehicle) at the time when the event occurred. The trigger information may be recorded in the memory card 65 or in the volatile memory 26B.

[0053] Next, the vehicle-mounted device 10 records the image (video) data showing the situation near the forklift 90 captured by the camera 23B around the time when the event occurred, and the vehicle data such as the vehicle speed based on the input signals from various I / Fs, in association with the trigger information (S4). The data recorded in the processes of S3 and S4 may be collectively referred to as trigger information. The trigger information recorded in the processes of S3 and S4 may be transmitted to the server 80 by wireless communication. In addition, for example, when the driving situation including the image data captured by the cameras 23A and 23B is transmitted to the server 80 in real time, the vehicle-mounted device 10 may transmit only the trigger information recorded in the process of S3 to the server 80. In addition, even if the driver does not have a driver beacon, the vehicle-mounted device 10 can start the above-mentioned operation, but when the driver authentication is performed, it becomes possible to record and manage the trigger information for each driver.

[0054] <Trigger detection by image analysis> The operation of the vehicle-mounted device 10 performing trigger detection by image analysis will be described with reference to Fig. 5 and Fig. 6. Fig. 5 shows details of the monitoring process (S1) of the luggage transportation status shown in Fig. 4, and shows the operation of the vehicle-mounted device 10 analyzing the image captured by the camera 23B to detect the presence or absence of luggage, the presence or absence of double operation, the dropping of luggage, and the shaking of luggage. Fig. 6 shows one frame (image 201) of the image captured by the camera 23B.

[0055] The vehicle-mounted device 10 analyzes the travel detection range 201a in the image 201 (S21). The travel detection range 201a is set in two regions near the left and right ends at the top of the image 201, as shown in FIG. 6. The vehicle-mounted device 10 detects whether the forklift 90 is traveling or not based on changes that appear in both of the travel detection ranges 201a in a plurality of consecutive frames of the image 201. By observing changes in the two travel detection ranges 201a on the left and right, it is possible to prevent erroneous detection due to the inclusion of a moving object in the image, etc. When the vehicle-mounted device 10 detects that the forklift 90 is traveling (Yes in S22), it proceeds to the process of S23.

[0056] Next, the vehicle-mounted device 10 analyzes the baggage detection ranges 201b-1 to 201b-3 in the image 201 (S23). The baggage detection ranges 201b-1, 201b-2, and 201b-3 are set in a predetermined area in the image 201 that includes at least a part of the claw 91. In the image 201, the baggage detection ranges 201b-1, 201b-2, and 201b-3 are set from the tip side of the claw 91 to the backrest 92 side. The vehicle-mounted device 10 recognizes a pattern corresponding to a baggage (baggage 100 or pallet 110) in each of the baggage detection ranges 201b-1 to 201b-3. Based on the recognition result, the vehicle-mounted device 10 identifies whether or not a baggage is present on the claw 91, that is, the presence or absence of a baggage. Here, the area in the image 201 occupied by the recognized baggage is referred to as the baggage area. If there is no baggage area in any of the baggage detection ranges 201b-1 to 201b-3 (No in S24), the vehicle-mounted device 10 detects the absence of baggage (S25). If at least a part of the baggage area is in at least one of the baggage detection ranges 201b-1 to 201b-3 (Yes in S24), the vehicle-mounted device 10 detects the presence of baggage (S26).

[0057] When the vehicle-mounted device 10 detects the presence of luggage, it judges whether a part of the luggage area is missing or the position or size of the luggage area has changed (S27). When neither missing nor changed, the vehicle-mounted device 10 detects double operation, dropped luggage, and no swinging of luggage (S28). When a part of the luggage area is missing, the vehicle-mounted device 10 detects that luggage has fallen due to collapse or the like (S29). When the position or size of the luggage area on the image 201 has changed from that in the image of the previous frame, and the size has changed (YES in S30), the vehicle-mounted device 10 detects that double operation has occurred (S31). Since a change in the size of the luggage area on the image 201 means a change in the distance between the camera 23B fixed to the mast 93 and the luggage, the vehicle-mounted device 10 detects that the claw 91 has been raised and lowered while traveling, that is, that double operation has occurred. On the other hand, if the size of the area of ​​the luggage on the image 201 does not change, that is, if the size of the area of ​​the luggage on the image 201 does not change and the position in the left-right direction (width direction of the forklift 90) of the image 201 changes (NO in S30), the vehicle-mounted device 10 proceeds to the process of S32. Since the position of the area of ​​the luggage in the width direction of the forklift 90 has changed in S32, the vehicle-mounted device 10 detects the swing of the luggage in the width direction of the forklift 90 (S32). Note that in the process shown in FIG. 5, the vehicle-mounted device 10 detects the presence of a luggage (S26) and then detects the presence of a double operation (S31), but the presence of a double operation may be detected without detecting the presence or absence of luggage. For example, when the vehicle-mounted device 10 detects that the forklift 90 is traveling, it detects the area of ​​the claw 91 in the image 201, and when the size of the area of ​​the claw 91 changes, it can detect the presence of the claw 91 rising and lowering, that is, the presence of a double operation.

[0058] <Trigger detection by operation signal> 7, the operation of the vehicle-mounted device 10 to detect a trigger (double operation) by an operation signal will be described. The vehicle-mounted device 10 acquires operation signals input from the speed I / F 12A, the engine speed I / F 12B, the external input I / F 13, and the sensor input I / F 14 (S41). When the vehicle-mounted device 10 detects an operation signal indicating that the forklift 90 is traveling (Yes in S42), it proceeds to the process of S43.

[0059] When the vehicle-mounted device 10 does not detect an operation signal indicating the raising and lowering of the claw 91 (No in S43), it detects that there is no double operation (S44). When the vehicle-mounted device 10 detects an operation signal indicating the raising and lowering of the claw 91 (Yes in S43), it detects that there is a double operation (S45). In this way, the vehicle-mounted device 10 can detect a double operation without performing image analysis.

[0060] As described above, the presence or absence of double operation can be detected by either the image analysis shown in Fig. 5 or the analysis based on the operation signal shown in Fig. 7. Note that, to detect whether the forklift 90 is traveling or not, analysis based on the signal (GPS signal) received by the GPS receiver 9 can be used instead of the image analysis and analysis based on the operation signal described above. Also, the presence or absence of double operation may be detected by using at least two of the image analysis, the analysis based on the operation signal, and the analysis based on the GPS signal.

[0061] 5 and 7, when a double operation, the presence or absence of luggage, the dropping of luggage, or the shaking of luggage is detected (S25, S26, S29, S31, S32, S45), a trigger is generated and the trigger information is recorded (S3, S4) as shown in FIG. 4. The trigger information is transmitted to the server 80.

[0062] <Server analysis> The server 80 that has received the trigger information accumulates the trigger information in a database 85. The control unit 81 of the server 80 refers to the database 85 and performs an analysis of the operation of the forklift 90 based on the trigger information of the trigger that has occurred within a predetermined period. The analysis by the server 80 is performed based on information accumulated in the database 85 regarding the operation of one forklift 90 for one day or multiple days, and / or the operation of multiple forklifts 90 for one day or multiple days. The server 80 makes the analysis results available to the office PC 30 via the network 70 in response to a request from the office PC 30. Examples of the analysis results include an instruction manual, an analysis report, a ranking, a heat map, and a near-miss map regarding the operation of the forklift 90.

[0063] 8 shows an example of an input screen (screen 202) for the office PC 30 to request the server 80 to issue an instruction manual. The screen 202 includes an area 202a for specifying a vehicle, an area 202b for specifying a crew member (driver), areas 202c and 202d for specifying a date and time range, and an operation button 202e for sending a request. The manager requests the server 80 to issue an instruction manual by specifying a vehicle or a crew member and a date and time range and operating the operation button 202e. Note that a manager who wishes to perform an analysis other than the instruction manual can request another analysis, such as an analysis report, by inputting the necessary information in the office PC 30 in the same manner as in the example of FIG. 8 and sending it to the server 80.

[0064] In response to a request, the server 80 refers to various information such as trigger information stored in the database 85 to create an instruction manual for safe driving and efficient operation. The server 80 can create the instruction manual based on information on image analysis performed by the vehicle-mounted device 10, driver authentication information when boarding the vehicle using a beacon, human approach detection information (approach warning information) using a beacon, input information from the G sensor 28 and the gyro sensor 52, battery management information (to be described later), and analysis information based on an operation signal. The server 80 makes the created instruction manual viewable on the office PC 30 via the network 70. The server 80 may also transmit the created instruction manual to the office PC 30 in the form of an e-mail or the like addressed to a manager or the like.

[0065] FIG. 9 is an example of a screen (screen 203) showing an analysis report on the operation status of a crew member in one day. The server 80 creates the analysis report based on information on the image analysis performed by the vehicle-mounted device 10, crew member authentication information when boarding the vehicle using a beacon, human approach detection information using a beacon, input information from the G sensor 28 and the gyro sensor 52, battery management information (to be described later), and analysis information using an operation signal. The screen 203 displays the name of the crew member, the vehicle number of the forklift 90 driven, the driving time, etc., and includes an area 203a showing the driving status, and an area 203b showing the content of the dangerous behavior (trigger type). The screen 203 displays, as the driving status, a time 203a1 when the presence of a load was detected and a time 203a2 when the absence of a load was detected, with a distinction made between them, and displays the calculated loading rate. The screen 203 also displays a safety score calculated based on the occurrence frequency of the dangerous behavior, etc. The screen 203 also displays advice on safe driving and efficient operation, such as "It would be better to brake gently." The server 80 makes the created analysis report available for viewing on the office PC 30 via the network 70. The server 80 can also create an analysis report for each vehicle. The manager can use the analysis report to give specific advice to the driver for safe driving and efficient operation.

[0066] FIG. 10 is an example of a screen showing an evaluation (driving evaluation) of the driving of the forklift 90. FIG. 10(a) is an example of a screen (screen 204) showing the transition of the driving evaluation score of the target crew member and the average score of all crew members over one month. FIG. 10(b) is an example of a screen (screen 205) showing the driving evaluation score of each crew member over one month (1st to 5th in the illustrated example) and the ranking of all crew members. The server 80 creates a driving evaluation based on information on the image analysis performed by the vehicle-mounted device 10, crew member authentication information at the time of boarding by the beacon, human approach detection information by the beacon, input information from the G sensor 28 and the gyro sensor 52, and analysis information by the operation signal. The server 80 makes the created driving evaluation viewable on the office PC 30 via the network 70. The manager can use the driving evaluation to instruct the crew members, which helps to improve the crew members' awareness of safe driving.

[0067] FIG. 11 is an example of a screen (screen 206) showing a near-miss map, which shows the locations of near-miss behaviors that occurred in a period (year / month, etc.) specified by the administrator. The vehicle-mounted device 10 detects events such as sudden acceleration, sudden deceleration, and sudden turning, as well as double operation, approaching people, dropping of luggage, and swinging of luggage as near-miss behaviors (dangerous behaviors), and data on these events is stored in the database 85 of the server 80 as trigger information. The server 80 creates a near-miss map based on information on the image analysis performed by the vehicle-mounted device 10, information on the detection of approaching people by the beacon, input information from the G sensor 28 and the gyro sensor 52, and analysis information by the operation signal. The screen 206 shows the arrangement of the fixed beacons 301 on a map of the premises where the forklift 90 operates, and includes marks M1 and M2. The marks M1 and M2 are displayed at the locations where near-miss behaviors occurred in a manner (for example, color, shade, shape, etc.) according to the frequency of occurrence. The server 80 makes the created near-miss map available for viewing on the office PC 30 via the network 70. The near-miss map can visualize the locations and frequency of near-miss behaviors. Therefore, managers can use the near-miss map to identify dangerous locations and take measures to prevent accidents.

[0068] FIG. 12 is an example of a screen (screen 207) showing a heat map, which indicates the degree of congestion of vehicles (forklifts 90) in a period (year / month, etc.) specified by the administrator. The server 80 creates a heat map based on vehicle position information collected by each vehicle-mounted device 10 mounted on a plurality of forklifts 90. The screen 207 shows the arrangement of fixed beacons 301 on a map of the premises where the forklifts 90 operate, and includes a plurality of circle marks C1 to C5. The circle marks C1 to C5 are displayed in different modes (e.g., colors, shading, etc.) according to the degree of congestion of the vehicles (very high, high, normal, comfortable, almost empty, etc.). The sizes of the circle marks C1 to C5 roughly indicate the range in which the vehicles are congested. The server 80 makes the created heat map viewable on the office PC 30 via the network 70. The heat map visually indicates the locations where the vehicles (forklifts 90) are in high / low operation. This allows managers to use heat maps to improve the layout of their premises and manage forklift routes.

[0069] <Battery management> Battery management will be described with reference to Figs. 13 and 14. The vehicle-mounted device 10 monitors the operation status (operation time) of the forklift 90 and the output (voltage status) of the battery voltmeter 53, and transmits this information (battery information) to the server 80. The server 80 accumulates the received battery information in a database 85. The server 80 transmits battery information (voltage status) of one or more forklifts 90 to the office PC 30, and can notify the battery voltage drop. Fig. 13 is an example of a screen (screen 208) showing the battery voltage value of the forklift 90, which shows the battery voltage values ​​of multiple forklifts 90, and highlights 208a vehicles whose voltage value is below a specified value. The server 80 judges, for example, whether the power consumption is below a specified value based on the operation time and the battery voltage, and when it is judged to be below the specified value, highlights 208a. This makes it possible to encourage the manager to perform appropriate battery management. Therefore, appropriate battery management is useful for extending the battery life and reducing the number of battery replacements.

[0070] Furthermore, the server 80 generates prediction information regarding the timing of battery replacement based on the battery information of the multiple forklifts 90 accumulated in the database 85, and makes the information available for viewing on the office PC 30. FIG. 14 is an example of a screen (screen 209) showing the battery replacement review results for multiple forklifts 90. The screen 209 includes an area 209a showing the vehicle number, an area 209b showing the operation time (operation status), and an area 209c showing the voltage drop (voltage value dropped due to operation). The screen 209 also includes an area 209d showing the electricity consumption (electricity consumption rate, mileage per kWh) and an area 209e showing the replacement prediction (prediction information, period until the time when the battery replacement is predicted to be necessary). In the screen 209, vehicles with electricity consumption below a specified value are highlighted 209f.

[0071] The server 80 outputs information on the predicted battery replacement timing based on the voltage status and the operating status. This allows the administrator to efficiently manage the battery, for example, by improving the timing and frequency of charging. In addition, the service provider who operates the server 80 can use the battery information accumulated in the database 85 to propose a new management method for using the battery more efficiently.

[0072] As described above, the vehicle-mounted device 10, the server 80, and the analysis system 1 of the present embodiment can perform recording triggered by an event specific to a loading vehicle such as a forklift 90. For example, when a double operation of raising and lowering the claws 91 while the forklift 90 is traveling, the presence or absence of a load, the drop of a load, or the shaking of a load is detected, a trigger is generated and an image showing the situation near the forklift 90 can be recorded. Therefore, the manager can easily grasp the dangerous behavior and operating status of the forklift 90. Therefore, safe driving support and efficient operation support are possible. In addition, battery management based on the operating time and battery voltage of the forklift 90 is possible, which is useful for extending the battery life and reducing the number of battery replacements through appropriate battery management.

[0073] Furthermore, according to this embodiment, by accumulating information collected from the vehicle-mounted devices 10 of multiple customers who operate forklifts and analyzing the information, the service provider who operates the server 80 can provide more specialized advice and suggestions regarding safe driving and efficient operation.

[0074] The present invention is not limited to the above-described embodiment, and can be modified, improved, etc. as appropriate. The material, shape, size, numerical value, form, number, location, etc. of each component in the above-described embodiment are arbitrary and not limited as long as they can achieve the present invention. In the above embodiment, an example was shown in which the server 80 functions as an analysis device, but the office PC 30 may execute part or all of the processing performed by the analysis device.

[0075] In addition, for example, the vehicle-mounted device 10 can detect changes in the driver's physical condition by analyzing images of the driver while riding the forklift and notify the driver of any abnormalities, which is useful for managing the driver's health in freezing / refrigerating, high-temperature environments, etc.

[0076] Furthermore, the service provider may provide the analyzed and acquired data to an external specialist, such as a facility layout improvement consultant or a health care consultant. Collaboration between the service provider and the external specialist makes it possible to provide a high-value-added service to the customer.

[0077] Here, the features of the vehicle-mounted device, the analysis device, and the analysis system according to the above-described embodiments of the present invention will be briefly summarized and listed in the following [1] to

[12] . [1] An on-board device (10) that is mounted on a cargo handling vehicle (forklift 90) having a cargo holding portion (claw 91) capable of holding cargo, and records information representing a situation in the vicinity of the cargo handling vehicle when a predetermined condition is satisfied, A monitoring unit (control unit 11, S1) that monitors the transportation status of the luggage; a trigger generating unit (control unit 11, S3) that generates a trigger for recording the information when the monitoring unit detects at least one of a double operation on the cargo handling vehicle, the presence or absence of the cargo, the dropping of the cargo, and the swinging of the cargo in the width direction of the cargo handling vehicle; An in-vehicle device (10) comprising: [2] A camera (23B) is mounted on the loading vehicle and captures a scene in front of the loading vehicle including at least a part of the baggage holding section; The monitoring unit includes an image analysis unit (S21 to S26) that analyzes the image captured by the camera to detect at least one of a double operation on the cargo handling vehicle, the presence or absence of the baggage, the dropping of the baggage, and the swinging of the baggage in the width direction of the cargo handling vehicle. The vehicle-mounted device described in [1] above. [3] The image analysis unit is a baggage detection unit (S23, S24) that analyzes an area in the image that includes at least a part of the baggage holding unit as a baggage detection range and detects the area of ​​the baggage, The presence or absence of the luggage is detected depending on whether the luggage detection unit detects the area of ​​the luggage (S25, S26). When it is detected that the luggage is present, if it is detected that at least a part of the luggage area is missing, it is detected that the luggage has fallen (S27, S29). The vehicle-mounted device described in [2] above. [4] The luggage holding section is liftable and lowerable; The image analysis unit a travel detection unit (S21, S22) that analyzes a part of an area in the image that is separated from the baggage detection area as a travel detection area and detects whether the loading vehicle is traveling or not, detecting whether the luggage holding unit is raised or lowered based on a change in the position or size of the luggage area in the image (S27); When the cargo handling vehicle is traveling and the baggage holding unit is raised or lowered, the double operation is detected (S30). The vehicle-mounted device described in [3] above. [5] The luggage holding section is liftable and lowerable; The monitoring unit is An operation signal acquisition unit (S41) that acquires an operation signal indicating an operation performed on the loading vehicle, When an operation signal indicating that the cargo handling vehicle is traveling and an operation signal indicating that the baggage holding unit has been raised or lowered are acquired, the double operation is detected (S43, S45). The vehicle-mounted device described in [1] above. [6] A battery monitoring unit (control unit 11) that monitors the voltage status of the battery of the loading vehicle; An operation monitoring unit (control unit 11) that monitors the operation status of the loading vehicle; A determination unit (control unit 11) that determines whether the battery satisfies a predetermined condition based on the voltage status and the operating status; The vehicle-mounted device according to any one of the above [1] to [5], [7] A trigger information collection unit (control unit 81) for collecting trigger information relating to the occurrence of the trigger from the vehicle-mounted device according to any one of [1] to [5] above; An analysis unit (control unit 81) that performs an analysis regarding the operation of the cargo handling vehicle based on the trigger information of the trigger that occurs within a predetermined period of time; an output unit (communication unit 82) that outputs the analysis result; An analysis device (server 80) comprising: [8] A battery information collection unit (control unit 81) for collecting battery information indicating the voltage status and the operating status from the vehicle-mounted device described in [6] above; A prediction unit (control unit 81) that generates prediction information regarding replacement of the battery based on the battery information within a predetermined period of time; an output unit (communication unit 82) that outputs the prediction information; An analysis device (server 80) comprising: [9] An in-vehicle device according to any one of [1] to [5] above, The analysis device according to [7] above; a receiving device (office PC 30) that receives the analysis result from the analysis device; An analysis system (1) comprising:

[10] The vehicle-mounted device according to [6] above, The analysis device according to [8] above; A receiving device (office PC 30) that receives the prediction information from the analysis device; An analysis system (1) comprising:

[11] In the analysis device, The trigger information collection unit collects the trigger information from a plurality of the on-board devices mounted on a plurality of cargo handling vehicles, The analysis unit generates at least one of an instruction manual, an analysis report, a ranking, a heat map, and a near-miss map regarding the operation of the cargo handling vehicle as the analysis result based on the collected trigger information. The analysis system described in [9] above.

[12] In the analysis device, The battery information collection unit collects the battery information from a plurality of the on-board devices mounted on each of a plurality of cargo handling vehicles, The prediction unit generates the prediction information based on the collected battery information. The analysis system according to

[10] above. [Explanation of symbols]

[0078] 1 Analysis system 10 Onboard equipment 11, 31, 81 Control unit (CPU) 15 Beacon receiver 17 Recording Section 23A, 23B Camera 24, 32, 82 Communications Department 25 Power supply section 26A non-volatile memory 26B Volatile memory 28 G Sensor 30 Office PC 51 Vehicle speed sensor 52 Gyro sensor 53 Battery voltmeter 65 Memory Card 71 Base station 80 Servers 85 Database 90 Forklift 91 Nails 92 Backrest 93 Mast 94 Head Guard 100 Baggage 110 Palettes 301 Fixed Beacon

Claims

1. An on-board device that is mounted on a cargo handling vehicle having a luggage holding section capable of holding luggage, and records information representing a situation in the vicinity of the cargo handling vehicle when a predetermined condition is satisfied, A monitoring unit that monitors the transportation status of the luggage; a trigger generating unit that generates a trigger for recording the information when the monitoring unit detects at least one of a double operation on the cargo handling vehicle and a drop of the cargo; A recording unit that records, as the information, at least an image showing a situation in the vicinity of the loading vehicle; A camera mounted on the cargo handling vehicle for capturing an image of a scene in front of the cargo handling vehicle, the scene including at least a part of the baggage holding section; Equipped with The monitoring unit includes an image analysis unit that analyzes an image captured by the camera to detect at least one of a double operation on the cargo handling vehicle and a drop of the cargo. Onboard equipment.

2. An on-board device that is mounted on a cargo handling vehicle having a luggage holding section capable of holding luggage, and records information representing a situation in the vicinity of the cargo handling vehicle when a predetermined condition is satisfied, A monitoring unit that monitors the transportation status of the luggage; a trigger generating unit that generates a trigger for recording the information when the monitoring unit detects at least one of a double operation on the cargo handling vehicle, the presence or absence of the luggage, the dropping of the luggage, and the swinging of the luggage in the width direction of the cargo handling vehicle; and A recording unit that records, as the information, at least an image showing a situation in the vicinity of the loading vehicle; a camera mounted on the cargo handling vehicle for capturing an image of a scene in front of the cargo handling vehicle, the scene including at least a part of the baggage holding section; The monitoring unit includes an image analysis unit that analyzes an image captured by the camera to detect at least one of a double operation on the cargo handling vehicle, the presence or absence of the luggage, the falling of the luggage, and the swaying of the luggage in the width direction of the cargo handling vehicle, The image analysis unit a baggage detection unit that analyzes an area in the image that includes at least a part of the baggage holding unit as a baggage detection range and detects the area of ​​the baggage, Detecting the presence or absence of the luggage depending on whether the luggage detection unit detects the area of ​​the luggage, When it is detected that the luggage is present, if it is detected that at least a part of the luggage area is missing, the falling of the luggage is detected. Onboard equipment.

3. The luggage holding section is liftable and lowerable, The image analysis unit a travel detection unit that detects whether the loading vehicle is traveling by analyzing a part of an area in the image that is separated from the baggage detection area as a travel detection area, Detecting whether the luggage holding unit is raised or lowered based on a change in a position or size of the luggage area in the image; When the loading vehicle is traveling and the baggage holding unit is raised or lowered, the double operation is detected. The vehicle-mounted device according to claim 2.

4. An on-board device that is mounted on a cargo handling vehicle having a luggage holding section capable of holding luggage, and records information representing a situation in the vicinity of the cargo handling vehicle when a predetermined condition is satisfied, A monitoring unit that monitors the transportation status of the luggage; a trigger generating unit that generates a trigger for recording the information when the monitoring unit detects at least one of a double operation on the cargo handling vehicle, the presence or absence of the luggage, the dropping of the luggage, and the swinging of the luggage in the width direction of the cargo handling vehicle; and A recording unit that records, as the information, at least an image showing a situation in the vicinity of the loading vehicle; Equipped with The luggage holding section is liftable and lowerable, The monitoring unit is an operation signal acquisition unit that acquires an operation signal indicating an operation performed on the loading vehicle; The double operation is detected when an operation signal indicating that the cargo handling vehicle is traveling and an operation signal indicating that the baggage holding unit has been raised or lowered are acquired. Onboard equipment.

5. a battery monitoring unit that monitors a voltage state of the battery of the loading vehicle; an operation monitoring unit that monitors the operation status of the loading vehicle; a determination unit that determines whether the battery satisfies a predetermined condition based on the voltage status and the operation status; The vehicle-mounted device according to any one of claims 1 to 4, further comprising:

6. A trigger information collection unit that collects trigger information related to the occurrence of the trigger from the vehicle-mounted device according to any one of claims 1 to 4; an analysis unit that performs an analysis regarding the operation of the cargo handling vehicle based on the trigger information of the trigger that occurs within a predetermined period; an output unit for outputting the analysis result; An analysis device comprising:

7. a battery information collecting unit that collects battery information indicating the voltage status and the operating status from the vehicle-mounted device according to claim 5; a prediction unit that generates prediction information regarding replacement of the battery based on the battery information within a predetermined period; an output unit that outputs the prediction information; An analysis device comprising:

8. The analysis device according to claim 6 ; a receiving device that receives the analysis result from the analysis device; An analysis system comprising:

9. The vehicle-mounted device and the analysis device according to claim 7 , a receiving device that receives the prediction information from the analysis device; An analysis system comprising:

10. In the analysis device, The trigger information collection unit collects the trigger information from a plurality of the on-board devices mounted on a plurality of cargo handling vehicles, The analysis unit generates at least one of an instruction manual, an analysis report, a ranking, a heat map, and a near-miss map regarding the operation of the cargo handling vehicle as the analysis result based on the collected trigger information. The analysis system according to claim 8.

11. In the analysis device, The battery information collection unit collects the battery information from a plurality of the on-board devices mounted on each of a plurality of cargo handling vehicles, The prediction unit generates the prediction information based on the collected battery information. The analysis system according to claim 9 .

Citation Information

Patent Citations

  • Battery control system for automobile

    JP2003264906A

  • Safety operation device, safety operation method, and safety operation control system of transport apparatus

    JP2007308227A

  • Information processing system

    JP2019003512A

  • Image processing device for fork lift and control program

    JP2019156641A

  • Traffic line estimation apparatus, traffic line estimation method, and computer program

    JP2019185515A