Video management device and video management program for industrial vehicles

Abstract

To provide a video management system and a video management program for industrial vehicles that can easily accommodate various specification changes. [Solution] A video management device for industrial vehicles includes a control unit and a real-time communication control unit. The control unit runs a web application for centralized management of multiple industrial vehicles to launch the video management system. The real-time communication control unit receives camera images sent from the industrial vehicles via a communication processing unit, relays the received camera images to a user terminal via the communication processing unit, and displays the camera images as video on a screen of the video management system displayed on a web browser on the user terminal.

Description

[Technical Field]

[0001] The present disclosure relates to a video management device and a video management program for an industrial vehicle. [Background technology]

[0002] Industrial vehicles such as forklifts are increasingly being fitted with drive recorders, various sensors, and other equipment for the purpose of managing driving conditions, etc. The images recorded in these drive recorders and the information collected by the sensors can be used to prevent accidents before they occur, and to investigate the causes of accidents in the event that an accident does occur. In recent years, a management system has been proposed in which drive recorder images collected by multiple industrial vehicles such as forklifts are collectively managed in a database, and the images collectively managed in the database can be searched. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2023-021978 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional video management systems for industrial vehicles are often developed using complex programming languages ​​such as C. While programming languages ​​make it possible to develop complex systems, they can be expensive to develop. Furthermore, video management systems created using programming languages ​​often require the installation of dedicated applications when they are introduced. This makes it difficult to respond to various specification changes, such as those in industrial vehicles.

[0005] Furthermore, when transmitting sensor data and camera images collected by industrial vehicles to a management server via the Internet, advanced network settings are required, such as opening router ports and configuring NAT (Network Address Translation) settings to traverse NAT. These network settings are often complex and require specialized knowledge.

[0006] The embodiments provide a video management device and a video management program for industrial vehicles that can easily accommodate various specification changes and do not require users to perform complex network settings. [Means for solving the problem]

[0007] A video management device according to one embodiment includes a control unit and a real-time communication control unit. The control unit executes a web application for centralized management of multiple industrial vehicles to launch the video management system. The real-time communication control unit receives camera images transmitted from the industrial vehicles via a communication processing unit, relays the received camera images to a user terminal via the communication processing unit, and displays the camera images as video on a screen of the video management system displayed on a web browser of the user terminal. Implement P2P (peer to peer) communication between industrial vehicles and user terminals . [Effects of the Invention]

[0008] In the embodiments, a video management system and a video management program for industrial vehicles are provided that can easily accommodate various specification changes and do not require the user to perform complex network settings. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a video management system for an industrial vehicle according to an embodiment. [Figure 2] FIG. 2 is an external view showing the configuration of a forklift as an example of an industrial vehicle. [Figure 3] FIG. 3 is a block diagram illustrating an example of a hardware configuration of the management server. [Figure 4] FIG. 4 is a block diagram illustrating a hardware configuration of an example of a user terminal. [Figure 5] FIG. 5 is a functional block diagram particularly relating to information processing of an industrial vehicle as an example of an industrial vehicle. [Figure 6] FIG. 6 is a functional block diagram of the management server. [Figure 7] FIG. 7 is a functional block diagram of the user terminal. [Figure 8] FIG. 8 is a flowchart showing the operation of a forklift as an industrial vehicle. [Figure 9] FIG. 9 is a flowchart showing the operation of the management server. [Figure 10] FIG. 10 is a flowchart showing the operation of the user terminal. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment will be described with reference to the drawings. FIG. 1 is a diagram showing the configuration of an example of a video management system for industrial vehicles according to an embodiment. The video management system 1 is a video management system that supports the centralized management of multiple industrial vehicles. The video management system 1 has an industrial vehicle 2 and a management server 3. The industrial vehicle 2 can communicate with the management server 3 via a network 5. Furthermore, the management server 3 can communicate with a user terminal 4 via the network 5. The network 5 is, for example, the Internet. Of course, the network 5 is not limited to the Internet and may be a local network.

[0011] The industrial vehicle 2 is a vehicle used for industrial purposes. The industrial vehicle 2 is, for example, a forklift, although it is not limited thereto. As will be described later, the industrial vehicle 2 is equipped with a camera and a sensor, and can transmit camera images obtained by the camera and sensor data collected by the sensor to an external device. The industrial vehicle 2 can transmit the camera images and sensor data to the management server 3 by wireless communication via, for example, an access point 5a. In the embodiment, the camera images and sensor data from multiple industrial vehicles 2 can be collectively managed in the management server 3. In FIG. 1, the number of industrial vehicles 2 is three. The number of industrial vehicles 2 is not limited to three. The number of industrial vehicles 2 may be one or more.

[0012] The management server 3, which serves as a video management device for industrial vehicles, collectively manages camera images and sensor data transmitted from the industrial vehicles 2. Furthermore, the management server 3 also operates as a signaling server and a STUN (Session Traversal Utilities for NAT) / TURN (Traversal Using Relays around NAT) server during P2P (peer to peer) communication between the industrial vehicles 2 and user terminals 4. Under the control of the management server 3, real-time communication between the industrial vehicles 2 and user terminals 4 is realized.

[0013] The user terminal 4 is a terminal device with a browser function, such as, but not limited to, a personal computer (PC), a smartphone, or a tablet terminal. The user terminal 4 can display the vehicle state of the industrial vehicle 2 based on sensor data of the industrial vehicle 2 and a moving image of, for example, the front of the industrial vehicle 2 based on a camera image.

[0014] Fig. 2 is an external view showing the configuration of a forklift as an example of an industrial vehicle 2. The industrial vehicle 2 shown in Fig. 2 is a counter-type forklift. However, the forklift according to the embodiment is not limited to the counter-type. In other words, the forklift according to the embodiment may be a reach-type forklift or the like.

[0015] The forklift as an industrial vehicle 2 shown in Fig. 2 has a vehicle body 210. A mast 211 is attached to the front of the vehicle body 210. Forks 212 are attached to the mast 211. The forks 212 are raised and lowered along the mast 211 by operation of a worker who is the driver of the industrial vehicle 2. In addition, a counterweight 213 is provided at the rear of the vehicle body 210. The counterweight 213 is provided to balance the forks 212 with a load when the load is placed on them.

[0016] A seat 214 is also attached to the vehicle body 210. A steering wheel 215 is provided in front of the seat 214. A worker sitting in the seat 214 can operate the steering wheel 215. Four support pillars 216 are provided on the vehicle body 210 so as to surround the seat 214. A display 217 is attached to one of the four support pillars 216, for example, the one in front of the seat 214. Various information related to the industrial vehicle 2 can be displayed on the display 217.

[0017] A head guard 218 is provided on the top of the four support columns 216. The head guard 218 is a guard member for protecting the head of a worker seated in the seat 214. Forklift accessories such as a camera 219, an acceleration sensor 220, a gyro sensor 221, a GPS (Global Positioning System) receiver 222, and a wireless transceiver 223 may be attached to the head guard 218. The camera 219 is provided to capture, for example, an image in front of the vehicle body 210. Camera images captured by the camera 219 are recorded as moving images in a drive recorder (not shown). The camera images captured by the camera 219 may also be transmitted to the management server 3 via the wireless transceiver 223. The acceleration sensor 220 is, for example, a three-axis (X, Y, Z) acceleration sensor that detects accelerations along each axis occurring in the vehicle body 210. The gyro sensor 221 detects, for example, angular velocities around the X, Y, and Z axes. The GPS receiver 222 receives radio waves from a base station (not shown) to collect position information of the industrial vehicle 2. The sensor data collected by the acceleration sensor 220, the gyro sensor 221, and the GPS receiver 222 may be associated with camera images acquired by the camera 219 and recorded in a drive recorder (not shown). Alternatively, the sensor data collected by the acceleration sensor 220, the gyro sensor 221, and the GPS receiver 222 may be transmitted to the management server 3 via a wireless transceiver 223. The wireless transceiver 223 is a device that enables the industrial vehicle 2 to communicate wirelessly with the management server 3.

[0018] 3 is a block diagram showing an example of the hardware configuration of the management server 3. The management server 3 may be a computer having, as hardware, a processor 301, a memory 302, a storage 303, an input interface 304, a display 305, and a communication device 306. The management server 3 may also be configured as a cloud.

[0019] The processor 301 is a processor that controls the overall operation of the management server 3. The processor 301 controls various processes in the management server 3 by executing, for example, a video management program 3031 stored in the storage 303. The processor 301 is, for example, a CPU. The processor 301 may be an MPU, a GPU, an ASIC, an FPGA, or the like. The processor 301 may be a single CPU or the like, or may be multiple CPUs or the like.

[0020] The memory 302 includes a ROM and a RAM. The ROM is a non-volatile memory. The ROM stores a startup program for the computer that constitutes the management server 3. The RAM is a volatile memory. The RAM is used as a working memory for processing by the processor 301, for example.

[0021] The storage 303 is a storage such as a hard disk drive or a solid state drive. The storage 303 stores various programs executed by the processor 301, such as an operating system (OS) and a video management program 3031. The video management program 3031 is a program for video management and is configured as a web application. The video management program 3031 is executed by the processor 301 of the management server 3, which functions as a web server. Execution of the video management program 3031 causes the processor 301 to execute a function of storing camera images and sensor data transmitted from the industrial vehicles 2 in the storage 303 in association with the IDs of the industrial vehicles 2, a function of detecting abnormal events in each industrial vehicle 2 from the camera images and sensor data managed in the storage 303, and a real-time video display function of displaying camera images transmitted from the industrial vehicles 2 in real time on the video management system screen displayed in the web browser of the user terminal 4. These functions may each be realized by a different web application. The real-time video display function can be realized by a program that causes the management server 3 to function as a signaling server and a STUN / TURN server. Therefore, the user of the user terminal 4 does not need to perform complicated network settings when using the video management system.

[0022] The storage 303 can also operate as an online storage that manages online the camera images 3032 and sensor data 3033 transmitted from the industrial vehicle 2. The camera images 3032 and sensor data 3033 stored in the storage 303 can be viewed on a video management system screen displayed on the web browser of the display 305 or the web browser of the user terminal 4. Alternatively, the camera images 3032 and sensor data 3033 stored in the storage 303 can be viewed by being downloaded by the user terminal 4.

[0023] The input interface 304 is an input device such as a touch panel, a keyboard, or a mouse. The input interface 304 accepts operations from an operator of the management server 3. The content of the operations accepted via the input interface 304 is interpreted by the processor 301. The processor 301 can perform various types of data processing, such as displaying, on the screen of the video management system in response to the operator's operations, an image of, for example, the front of the industrial vehicle 2 based on a camera image 3032 and the vehicle status of the industrial vehicle 2 based on sensor data 3033.

[0024] The display 305 is a display device such as a liquid crystal display, an organic EL display, etc. The display 305 displays various types of information, including the display of a web browser.

[0025] The communication device 306 is a communication device that enables the management server 3 to communicate with external devices via the network 5. The communication device 306 may be a communication device for wired communication or a communication device for wireless communication.

[0026] 4 is a block diagram showing an example of the hardware configuration of the user terminal 4. The user terminal 4 may be a computer having, as hardware, a processor 401, a memory 402, a storage 403, an input interface 404, a display 405, and a communication device 406.

[0027] The processor 401 is a processor that controls the overall operation of the user terminal 4. The processor 301 is, for example, a CPU. The processor 401 may be an MPU, a GPU, an ASIC, an FPGA, or the like. The processor 401 may be a single CPU or the like, or may be multiple CPUs or the like.

[0028] The memory 402 includes a ROM and a RAM. The ROM is a non-volatile memory. The ROM stores a startup program for the computer that constitutes the user terminal 4. The RAM is a volatile memory. The RAM is used as a working memory for processing by the processor 401, for example.

[0029] The storage 403 is, for example, a storage such as a semiconductor memory, a hard disk drive, or a solid state drive. The storage 403 stores various programs executed by the processor 401, such as an operating system (OS) and various application programs. The application programs stored in the storage 403 include a browser application program. In addition, the storage 403 can store camera images and sensor data downloaded from the management server 3.

[0030] The input interface 404 is an input device such as a touch panel, a keyboard, or a mouse. The input interface 404 accepts operations by the user of the user terminal 4. The content of the operations accepted via the input interface 404 is interpreted by the processor 401. The processor 401 can perform various types of data processing, such as displaying, on a screen of the video management system displayed on a web browser in response to a user operation, an image of, for example, the front of the industrial vehicle 2 based on a camera image and the vehicle status of the industrial vehicle 2 based on sensor data.

[0031] The display 405 is a display device such as a liquid crystal display, an organic EL display, etc. The display 405 displays various types of information, including the display of a web browser.

[0032] The communication device 406 is a communication device that enables the user terminal 4 to communicate with external devices via the network 5. The communication device 406 may be a communication device for wired communication or a communication device for wireless communication.

[0033] 5 is a functional block diagram particularly relating to information processing of the industrial vehicle 2. The industrial vehicle 2 has, as functions relating to information processing, a sensor unit 2001, a camera unit 2002, an abnormality detection unit 2003, an image acquisition unit 2004, a recording unit 2005, a real-time communication processing unit 2006, a non-real-time communication processing unit 2007, and a control unit 2008. Here, the functions of the abnormality detection unit 2003, the image acquisition unit 2004, and the control unit 2008 can be realized by a program executed by a processor provided in an internal circuit of the industrial vehicle 2. Furthermore, solid lines in FIG. 5 indicate the flow of data, and dashed lines in FIG. 5 indicate the flow of control instructions.

[0034] 2, detects information related to various vehicle conditions of the industrial vehicle 2. The sensor unit 2001 detects the condition of the industrial vehicle 2, for example, periodically, and outputs sensor data including the detection results to the abnormality detection unit 2003. The sensors included in the sensor unit 2001 are not limited to the acceleration sensor 220, gyro sensor 221, and GPS receiver 222. The sensor group may also include sensors such as a magnetic sensor, a temperature sensor, and a humidity sensor.

[0035] 2 and captures images of, for example, the front of the industrial vehicle 2. The camera unit 2002 captures images at, for example, a constant frame rate and outputs the camera images obtained by the capture to the image acquisition unit 2004. The camera included in the camera unit 2002 is not limited to the camera 219 that captures images of the front of the industrial vehicle 2. The camera included in the camera unit 2002 may also include a camera that captures images of the rear, side, etc. of the industrial vehicle 2.

[0036] The abnormality detection unit 2003 determines whether or not an abnormal event has occurred in the industrial vehicle 2 from the sensor data acquired by the sensor unit 2001. An abnormal event in the industrial vehicle 2 is, for example, an abnormal event with respect to the safe operation of the industrial vehicle 2. An abnormal event in the industrial vehicle 2 includes, for example, an abnormality in the vehicle itself, such as abnormal vibration, voltage abnormality, or temperature abnormality in the industrial vehicle 2, and an abnormality caused by an operation error of the industrial vehicle 2 or a worker, such as the route of the industrial vehicle 2 deviating from the expected route or multiple industrial vehicles 2 being too close to each other. When the abnormality detection unit 2003 detects an abnormal event in the industrial vehicle 2, it notifies the image acquisition unit 2004 of this. Furthermore, the abnormality detection unit 2003 records the sensor data acquired by the sensor unit 2001 in the recording unit 2005. The abnormality detection unit 2003 may record the sensor data in the recording unit 2005 only when it detects an abnormality in the industrial vehicle 2.

[0037] The image acquisition unit 2004 acquires camera images from the camera unit 2002. Then, the image acquisition unit 2004 records the acquired camera images in the recording unit 2005. Furthermore, the image acquisition unit 2004 transfers the camera images acquired from the camera unit 2002 to the real-time communication processing unit 2006 in response to a control instruction from the control unit 2008.

[0038] The recording unit 2005 is, for example, a drive recorder, and can record the sensor data acquired by the abnormality detection unit 2003 and the camera images acquired by the image acquisition unit 2004. The control unit 2008 can refer to the sensor data and camera images recorded in the recording unit 2005.

[0039] The real-time communication processing unit 2006 includes the wireless transceiver 223 shown in FIG. 2 and performs processing for P2P real-time communication between the industrial vehicle 2 and the user terminal 4 via the network 5. For example, when a camera image is transferred from the image acquisition unit 2004, the real-time communication processing unit 2006 transmits the camera image to the user terminal 4 under the control of the management server 3. The non-real-time communication processing unit 2007 includes the wireless transceiver 223 shown in FIG. 2 and performs processing for non-real-time communication between the industrial vehicle 2 and the management server 3 via the network 5. For example, when the non-real-time communication processing unit 2007 receives a control instruction or a setting instruction from the management server 3, the non-real-time communication processing unit 2007 transfers the received control instruction or setting instruction to the control unit 2008. Furthermore, when sensor data and camera images are transferred from the control unit 2008, the non-real-time communication processing unit 2007 transmits the sensor data and camera images to the management server 3.

[0040] The control unit 2008 controls the industrial vehicle 2. For example, the control unit 2008 issues control instructions to the anomaly detection unit 2003 to acquire sensor data, issues control instructions to the image acquisition unit 2004 to record camera images in the recording unit 2005 or transfer them to the real-time communication processing unit 2006, and issues control instructions to the non-real-time communication processing unit 2007 to associate the sensor data and camera images recorded in the recording unit 2005 with the ID of the industrial vehicle 2 and transmit them to the management server 3.

[0041] Fig. 6 is a functional block diagram of the management server 3. The management server 3 has a communication processing unit 3001, an information acquisition unit 3002, a recording unit 3003, a display unit 3004, a real-time communication control unit 3005, and a control unit 3006. Here, the functions of the information acquisition unit 3002, the real-time communication control unit 3005, and the control unit 3006 can be realized by a video management program 3031. Furthermore, the solid lines in Fig. 6 indicate the flow of data, and the dashed lines in Fig. 6 indicate the flow of control instructions.

[0042] The communication processing unit 3001 includes the communication device 306 shown in Fig. 3 and performs processing for communication between the management server 3 and the industrial vehicle 2 via the network 5. For example, the communication processing unit 3001 transmits control instructions or setting instructions to the industrial vehicle 2. When the communication processing unit 3001 acquires sensor data and camera images, it transfers the received sensor data and camera images to the information acquisition unit 3002. Furthermore, during real-time communication between the industrial vehicle 2 and the user terminal 4 via the network 5, the communication processing unit 3001 performs communication between the industrial vehicle 2 and the user terminal 4 that is necessary for operation as a signaling server and a STUN / TURN server.

[0043] The information acquisition unit 3002 acquires the sensor data and camera images received by the communication processing unit 3001 , and records the acquired sensor data and camera images in the recording unit 3003 .

[0044] 3, and records the sensor data and camera images acquired by the information acquisition unit 3002 in association with the ID of the industrial vehicle 2. The sensor data and camera images recorded in the recording unit 3003 can be downloaded to the user terminal 4. The sensor data and camera images may be associated with the ID of a worker instead of or in addition to the ID of the industrial vehicle 2.

[0045] The display unit 3004 includes the display 305 shown in Fig. 3 and displays various images. The display unit 3004 may be omitted.

[0046] The control unit 3006 controls the management server 3. For example, the control unit 3006 executes the video management program 3031 as a web application to launch the video management system and display the video management system screen on a web browser. Furthermore, the control unit 3006 receives operational instructions from an operator on the video management system screen and displays the vehicle status of the industrial vehicle 2 based on sensor data recorded in the recording unit 3003 and video images of, for example, the front of the industrial vehicle 2 based on camera images in a viewable manner. Furthermore, the control unit 3006 monitors and evaluates the operating status of the industrial vehicle 2 based on the sensor data and camera images recorded in the recording unit 3003. For example, if an abnormal event occurs in the industrial vehicle 2, the control unit 3006 transmits a control instruction corresponding to the abnormal event to the industrial vehicle 2 using the communication processing unit 3001. Additionally, the control unit 3006 may evaluate the driving technique of each worker for the industrial vehicle 2 based on, for example, the low number of abnormal events.

[0047] The real-time communication control unit 3005 controls real-time communication between the industrial vehicle 2 and the user terminal 4 via the network 5. For example, the real-time communication control unit 3005 controls as a signaling server that performs session management during communication between the industrial vehicle 2 and the user terminal 4. The real-time communication control unit 3005 also controls as a STUN server that receives an inquiry about an IP address from the industrial vehicle 2 or the user terminal 4 and notifies the corresponding device of the IP address. The real-time communication control unit 3005 also controls as a TURN server that relays data transferred from the industrial vehicle 2 or the user terminal 4 to the other party.

[0048] Fig. 7 is a functional block diagram of the user terminal 4. The user terminal 4 has a real-time communication processing unit 4001, a non-real-time communication processing unit 4002, a display unit 4003, a recording unit 4004, and a control unit 4005. Here, the function of the control unit 4005 can be realized by a program stored in the storage 403. Also, solid lines in Fig. 7 indicate the flow of data, and dashed lines in Fig. 7 indicate the flow of control instructions.

[0049] The real-time communication processing unit 4001 includes the communication device 406 shown in FIG. 4 and performs processing for P2P real-time communication between the user terminal 4 and the industrial vehicle 2 via the network 5. For example, when a camera image is received from the industrial vehicle 2, the real-time communication processing unit 4001 transfers the camera image to the control unit 4005. The non-real-time communication processing unit 4002 includes the communication device 406 shown in FIG. 4 and performs processing for non-real-time communication between the industrial vehicle 2 and the management server 3 via the network 5. For example, when sensor data and camera images are downloaded from the management server 3, the non-real-time communication processing unit 4002 transfers the sensor data and camera images to the control unit 4005.

[0050] 4 and displays various images. The recording unit 4004 includes the storage 403 shown in FIG. 4 and records the sensor data and camera images downloaded from the management server 3.

[0051] The control unit 4005 controls the user terminal 4. For example, the control unit 4005 displays the camera images transferred from the real-time communication processing unit 4001 on the screen of the video management system displayed on the web browser displayed on the display unit 4003. Furthermore, the control unit 4005 records the sensor data and camera images downloaded from the non-real-time communication processing unit 4002 in the recording unit 4004.

[0052] Next, the operation of the video management system 1 will be described. Fig. 8 is a flowchart showing the operation of a forklift as an industrial vehicle 2. Here, Fig. 8 shows the processing of sensor data and camera images in the forklift. In reality, the forklift may perform travel control of the vehicle body 210 when an accelerator pedal (not shown) is depressed, for example, but this is omitted from Fig. 8.

[0053] In step S1, the control unit 2008 instructs the anomaly detection unit 2003 to acquire sensor data. The control unit 2008 also instructs the image acquisition unit 2004 to acquire camera images. The intervals at which the sensor data is acquired and the intervals at which the camera images are acquired may be fixed intervals, or may be intervals set by a setting instruction from the management server 3.

[0054] In step S2, the abnormality detection unit 2003 determines whether or not an abnormal event has been detected from the sensor data. If it is determined in step S2 that an abnormal event has been detected, the process proceeds to step S3. If it is not determined in step S2 that an abnormal event has been detected, the process proceeds to step S5.

[0055] In step S3, the abnormality detection unit 2003 records the sensor data acquired when the abnormal event is detected in the recording unit 2005. The abnormality detection unit 2003 also notifies the image acquisition unit 2004 that the abnormal event has been detected. In response to this, the image acquisition unit 2004 records in the recording unit 2005 the camera image acquired when the abnormal event was detected.

[0056] In step S4, the control unit 2008 associates the sensor data and camera images recorded in the recording unit 2005 when the abnormal event was detected with the ID of the industrial vehicle 2 and transmits them to the management server 3 via the non-real-time communication processing unit 2007.

[0057] In step S5, the image acquisition unit 2004 determines whether or not the setting is for real-time transmission of camera images. The setting for real-time transmission can be made based on a setting instruction from the control unit 2008, which is based on a setting instruction from the management server 3, for example. If it is determined in step S5 that the setting is for real-time transmission of camera images, the process proceeds to step S6. If it is not determined in step S5 that the setting is for real-time transmission of camera images, the process returns to step S1.

[0058] In step S6, the image acquisition unit 2004 transmits the acquired camera image to the user terminal 4 via the real-time communication processing unit 2006. Then, the process returns to step S1. As described above, the real-time communication processing unit 2006 may perform P2P communication with the user terminal 4 via the management server 3. The real-time communication processing unit 2006 may transmit sensor data to the user terminal 4 in addition to the camera image.

[0059] 8, only when an abnormal event is detected, the sensor data and the camera image are recorded in the recording unit 2005. However, the sensor data and the camera image may be recorded in the recording unit 2005 regardless of whether an abnormal event is detected or not. Furthermore, the sensor data and the camera image may also be transmitted to the management server 3 regardless of whether an abnormal event is detected or not.

[0060] 9 is a flowchart showing the operation of the management server 3. In step S101, the information acquisition unit 3002 determines whether or not sensor data and camera images have been acquired from the communication processing unit 3001. If it is determined in step S101 that sensor data and camera images have been acquired, the process proceeds to step S102. If it is determined in step S101 that sensor data and camera images have not been acquired, the process proceeds to step S103.

[0061] In step S102, the information acquisition unit 3002 associates the sensor data and the camera image with the ID of the industrial vehicle 2 and records them in the recording unit 3003. Thereafter, the process proceeds to step S103.

[0062] In step S103, the control unit 3006 determines whether or not to display the sensor data and / or camera images on the display unit 3004. For example, when a display request for any of the sensor data and / or camera images recorded in the recording unit 3003 is received from the operator of the management server 3 by operation on the screen of the video management system displayed on the display unit 3004, the control unit 3006 determines that the sensor data and / or camera images are to be displayed on the display unit 3004. If it is determined in step S103 that the sensor data and / or camera images are to be displayed on the display unit 3004, the process proceeds to step S104. If it is not determined in step S103 that the sensor data and / or camera images are to be displayed on the display unit 3004, the process proceeds to step S105.

[0063] In step S104, the control unit 3006 reads out the specified sensor data and / or camera images from the recording unit 3003, and displays the read sensor data and / or camera images on the screen of the video management system displayed in the web browser. Then, the process proceeds to step S105.

[0064] In step S105, the control unit 3006 determines whether to send a control instruction or a setting instruction to the industrial vehicle 2. For example, when a request for a control instruction or a setting instruction for one of the industrial vehicles 2 is received from an operator of the management server 3 through an operation on the screen of the video management system displayed on the display unit 3004, or when an abnormal event is detected from sensor data, it is determined that a control instruction or a setting instruction is to be sent to the industrial vehicle 2. Control instructions include instructions to send sensor data and camera images from the industrial vehicle 2, instructions to forcibly stop the industrial vehicle 2, etc. Setting instructions include instructions for the interval at which sensor data and camera images are acquired, etc. If it is determined in step S105 that a control instruction or a setting instruction is to be sent to the industrial vehicle 2, the process proceeds to step S106. If it is not determined in step S105 that a control instruction or a setting instruction is to be sent to the industrial vehicle 2, the process proceeds to step S107.

[0065] In step S106, the control unit 3006 transmits a control instruction or a setting instruction to the industrial vehicle 2 via the communication processing unit 3001. Thereafter, the process proceeds to step S107.

[0066] In step S107, the control unit 3006 determines whether a download request for sensor data or camera images has been made. For example, if a user requests the download of any sensor data or camera images by operating a web browser displayed on the display unit 4003 of the user terminal 4, it is determined that a download request for sensor data or camera images has been made. If it is determined in step S107 that a download request for sensor data or camera images has been made, the process proceeds to step S108. If it is not determined in step S107 that a download request for sensor data or camera images has been made, the process proceeds to step S109.

[0067] In step S108, the control unit 3006 causes the communication processing unit 3001 to transmit the designated sensor data or camera image to the user terminal 4. After that, the process proceeds to step S109.

[0068] In step S109, the real-time communication control unit 3005 determines whether or not to perform real-time data transmission between the industrial vehicle 2 and the user terminal 4. In step S109, when data is transmitted using a real-time communication protocol from the real-time communication processing unit of either the industrial vehicle 2 or the user terminal 4, it is determined that real-time data transmission between the industrial vehicle 2 and the user terminal 4 will be performed. If it is determined in step S109 that real-time data transmission between the industrial vehicle 2 and the user terminal 4 will be performed, the process proceeds to step S110. If it is not determined in step S109 that real-time data transmission between the industrial vehicle 2 and the user terminal 4 will be performed, the process returns to step S101.

[0069] In step S110, the real-time communication control unit 3005 relays data transmitted from either the industrial vehicle 2 or the user terminal 4 to the other. After that, the process returns to step S101.

[0070] 10 is a flowchart showing the operation of the user terminal 4. In step S201, the control unit 4005 determines whether or not sensor data and camera images have been received from the real-time communication processing unit 4001. If it is determined in step S201 that sensor data and camera images have been received, the process proceeds to step S202. If it is not determined in step S201 that sensor data and camera images have been received, the process proceeds to step S203.

[0071] In step S202, the control unit 4005 displays, on the screen of the video management system displayed on the web browser, the vehicle status of the industrial vehicle 2 based on the sensor data received via the real-time communication processing unit 4001 and a video image of, for example, the front of the industrial vehicle 2 based on the camera image. Thereafter, the process proceeds to step S203.

[0072] In step S203, the control unit 4005 determines whether or not to transmit a setting instruction. For example, if a user issues a setting instruction regarding the interval at which camera images are acquired, etc., by operating the screen of the video management system displayed on the display unit 4003, it is determined that the setting instruction is to be transmitted. If it is determined in step S203 that the setting instruction is to be transmitted, the process proceeds to step S204. If it is not determined in step S203 that the setting instruction is to be transmitted, the process proceeds to step S205.

[0073] In step S204, the control unit 4005 causes the non-real-time communication processing unit 4002 to transmit a setting instruction to the management server 3. Thereafter, the process proceeds to step S205.

[0074] In step S205, the control unit 4005 determines whether or not to display the sensor data and / or camera images on the display unit 4003. For example, when a display request for any of the sensor data and / or camera images recorded in the recording unit 3003 of the management server 3 is received by an operation on the screen of the video management system displayed on the display unit 4003, it is determined that the sensor data and / or camera images are to be displayed on the display unit 4003. If it is determined in step S205 that the sensor data and / or camera images are to be displayed on the display unit 4003, the process proceeds to step S206. If it is not determined in step S205 that the sensor data and / or camera images are to be displayed on the display unit 4003, the process returns to step S201.

[0075] In step S206, the control unit 4005 transmits a download request for the specified sensor data and / or camera image to the management server 3. Then, the control unit 4005 causes the display unit 4003 to display the vehicle state of the industrial vehicle 2 based on the sensor data received from the management server 3 and / or a moving image of, for example, the front of the industrial vehicle 2 based on the camera image, and records it in the recording unit 4004. Thereafter, the processing returns to step S201.

[0076] As described above, in the embodiment, the video management program in the management server 3 is configured as a web application that runs on a web browser. Therefore, the video management system in the embodiment can operate without being affected by the specifications of the industrial vehicle 2 and the user terminal 4. Therefore, the video management system in the embodiment can easily respond to various specification changes, such as changes in the specifications of the industrial vehicle. It is expected that the development cost of a video management system for industrial vehicles using a web application will be lower than that of a video management system developed using a complex programming language such as C.

[0077] The video management program also includes a web application for causing the management server 3 to function as a signaling server and a STUN / TURN server. This allows the industrial vehicle 2 and the user terminal 4 to perform real-time P2P communication via a network 5 such as the Internet. Furthermore, the user of the user terminal 4 only needs to install a web browser on the user terminal 4, and does not need to perform complex network settings.

[0078] Furthermore, because the video management system operates using a web application, there is no need to install a special application on the user terminal 4. In other words, the user of the user terminal 4 can view camera images acquired by the industrial vehicle 2 as video images on a web browser.

[0079] The present invention is not limited to the above-described embodiments, and various modifications can be made in the implementation stage without departing from the spirit of the invention. Furthermore, the embodiments may be implemented in appropriate combinations, in which case the combined effects can be obtained. Furthermore, the above-described embodiments include various inventions, and various inventions can be extracted by combining selected elements from the disclosed elements. For example, if the problem can be solved and the desired effect can be obtained even if some elements are deleted from all elements shown in the embodiments, the configuration from which these elements are deleted can be extracted as an invention. [Explanation of symbols]

[0080] 1 Video management system, 2 Industrial vehicle, 3 Management server, 4 User terminal, 5 Network, 5a Access point, 2001 Sensor unit, 2002 Camera unit, 2003 Anomaly detection unit, 2004 Image acquisition unit, 2005 Recording unit, 2006 Real-time communication processing unit, 2007 Real-time communication processing unit, 2008 Control unit, 3001 Communication processing unit, 3002 Information acquisition unit, 3003 Recording unit, 3004 Display unit, 3005 Real-time communication control unit, 3006 Control unit, 4001 Real-time communication processing unit, 4002 Non-real-time communication processing unit, 4003 Display unit, 4004 Recording unit, 4005 Control unit.

Claims

1. a control unit that executes a web application for collectively managing a plurality of industrial vehicles to launch a video management system; a real-time communication control unit that performs P2P (peer to peer) communication between the industrial vehicle and the user terminal, receiving camera images transmitted from the industrial vehicle by a communication processing unit, relaying the received camera images to a user terminal by the communication processing unit, and displaying the camera images as moving images on a screen of the video management system displayed on a web browser of the user terminal; and A video management device for an industrial vehicle having the same.

2. The real-time communication control unit further receives sensor data, which is a detection result of the vehicle condition of the industrial vehicle, transmitted from the industrial vehicle by the communication processing unit, relays the received sensor data to a user terminal by the communication processing unit, and displays the vehicle condition of the industrial vehicle based on the sensor data on a screen of the video management system displayed on a web browser of the user terminal. The video management device for an industrial vehicle according to claim 1.

3. a recording unit that records the camera image received by the communication processing unit, The video management device for an industrial vehicle according to claim 1.

4. The industrial vehicle is a forklift. The video management device for an industrial vehicle according to claim 1.

5. Executing a web application for centralized management of a plurality of industrial vehicles to launch a video management system; receiving camera images transmitted from the industrial vehicle, relaying the received camera images to a user terminal, and displaying the camera images as moving images on a screen of the video management system displayed on a web browser of the user terminal; and implementing P2P (peer to peer) communication between the industrial vehicle and the user terminal. A video management program for an industrial vehicle for causing a processor of a video management device to execute the above.

Images