Conveying system

Abstract

To prevent an operator who operates a manned conveyance vehicle from falling asleep by using an unmanned flying body, in a conveyance system including the manned conveyance vehicle and the unmanned flying body.SOLUTION: A conveyance system S includes a manned conveyance vehicle 1 and an unmanned flying body 2. The unmanned flying body 2 includes: an imaging part 25 for imaging a face of an operator O who is operating the manned conveyance vehicle 1; and a warning part 26 for giving a warning to the operator O who is operating the manned conveyance vehicle 1 based on the drowsiness degree using a drowsiness determination part 35 for determining the drowsiness degree of the operator O. The drowsiness determination part 35 includes: a learning model generation part 41 for performing machine learning from teacher data 46 collected in a collection part 40, and for generating and storing a learning model by machine learning; an acquisition part 45 for acquiring feature data of the face of the operator O by predetermined time; a prediction part 42 for acquiring the drowsiness degree from the learning model; and a determination part 43 for determining whether to give a warning to the operator O.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to a transportation system including a manned transport vehicle and an unmanned aerial vehicle.

Background Art

[0002] A manned transport vehicle (for example, a forklift) used inside facilities such as factories and warehouses is configured to travel and operate by an operator boarding and operating it. Further, the forklift is configured to perform a loading / unloading operation for loading and unloading goods using forks.

[0003] And there is known a transportation system configured to guide a manned transport vehicle operated by an operator using an unmanned aerial vehicle capable of hovering in the air (see Patent Document 1, etc.).

[0004] In the transportation system, the unmanned aerial vehicle includes a projector that projects a guidance image onto the road surface. The guidance image shows, for example, an arrow indicating a specific direction and is projected onto the road surface in front of the manned transport vehicle. Thereby, an operator operating the manned transport vehicle is configured to be guided to the loading / unloading position by checking the guidance image.

[0005] By the way, in the conventional transportation system, there is a problem that it is impossible to prevent an operator operating the manned transport vehicle from falling asleep.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0007] Therefore, the problem that the present invention aims to solve is to provide a transport system that includes a manned transport vehicle and an unmanned aerial vehicle, which can prevent the operator operating the manned transport vehicle from falling asleep using the unmanned aerial vehicle. [Means for solving the problem]

[0008] To solve the above problems, the transport system according to the present invention is a transport system comprising a manned transport vehicle and an unmanned aerial vehicle, wherein the unmanned aerial vehicle includes a shooting unit that photographs the face of an operator operating the manned transport vehicle, and a sleepiness determination unit that determines the degree of sleepiness of the operator and provides an alarm unit that alerts the operator operating the manned transport vehicle based on the degree of sleepiness. The sleepiness determination unit includes a collection unit that collects feature data relating to the characteristics of a human face and training data based on the relationship between the degree of sleepiness relating to a human face, a learning model generation unit that performs machine learning from the training data collected by the collection unit and generates and stores a learning model by machine learning, an acquisition unit that acquires the current face feature data of the operator at predetermined intervals using the shooting unit, a prediction unit that inputs the current face feature data of the operator acquired from the acquisition unit into the learning model generated by the learning model generation unit to acquire the degree of sleepiness from the learning model, and a decision unit that determines whether to alert the operator based on the degree of sleepiness acquired by the prediction unit.

[0009] Preferably, the alarm unit alerts the operator and those around the manned transport vehicle when the level of drowsiness exceeds a predetermined level.

[0010] Furthermore, it is desirable that the alarm unit emits sound, light, and / or a combination thereof as an alarm.

[0011] Furthermore, the unmanned aerial vehicle may be equipped with a projection unit that projects images onto the walkway, and the alarm unit may project an alarm image from the projection unit to alert the area around the manned transport vehicle.

[0012] Furthermore, the unmanned aerial vehicle may be configured to travel along a taxiway used to guide the movement of a manned transport vehicle. [Effects of the Invention]

[0013] The transport system according to the present invention is a transport system comprising a manned transport vehicle and an unmanned aerial vehicle, wherein the unmanned aerial vehicle can effectively prevent the operator of the manned transport vehicle from falling asleep. [Brief explanation of the drawing]

[0014] [Figure 1] A perspective view showing the transport system. [Figure 2] A side view showing the transport system. [Figure 3] A plan view showing the transport system. [Figure 4] A block diagram showing the transport system. [Figure 5] A block diagram showing the configuration of the drowsiness detection unit. [Figure 6] A flowchart illustrating the control procedure for preventing drowsiness. [Modes for carrying out the invention]

[0015] Hereinafter, embodiments of the transport system according to the present invention will be described based on the drawings.

[0016] The configuration of the transport system will be explained based on Figures 1 to 5.

[0017] As shown in Figures 1 to 4, the transport system S includes a manned transport vehicle 1 that is ridden and operated by an operator O. The manned transport vehicle 1 is configured to move and operate when the operator O is riding on it and operating it. In this embodiment, the manned transport vehicle 1 is a counterbalanced forklift, and is configured so that the vehicle body can move and the forks can be raised and lowered when the operator O is riding on it and operating it.

[0018] The conveying system S includes a plurality of shelves R installed in facilities such as factories and warehouses. The shelf R has a plurality of stepped portions in the height direction and is configured to store the load L at a predetermined position of the stepped portion. The manned transporter 1 performs a loading / unloading operation by loading and unloading the load L at a predetermined position of the shelf R. The shelves R are arranged at intervals of a predetermined width so that the manned transporter 1 can travel and perform loading / unloading operations, and a passage P is formed between each shelf R (FIGS. 1 and 3).

[0019] The conveying system S includes an unmanned aerial vehicle 2 that can stop in the air. The unmanned aerial vehicle 2 is called a drone and is configured to fly to a predetermined aerial stop position by the rotation of rotors provided at the tip ends of a plurality of arms and to be able to hover at the predetermined aerial stop position.

[0020] The conveying system S includes a management device 3 for controlling the unmanned aerial vehicle 2 (FIG. 4). The management device 3 includes a storage unit 30. The storage unit 30 stores a map M constituted by the shelves R and passages P installed in the facility, the loads L arranged in the facility, and the like.

[0021] Furthermore, the storage unit 30 stores the loading / unloading task T performed by the manned transporter 1 as a loading / unloading schedule J. That is, the loading / unloading schedule J is set with a plurality of loading / unloading tasks T such as a task T1 of unloading the load L from a predetermined place of a predetermined shelf R, a task T2 of loading the load L at a predetermined place of a predetermined shelf R, a task T3 of loading the load L at the shipping place, and a task T4 of unloading the load L from the receiving place in a predetermined order. The loading / unloading task T includes the position information of the load L and the loading / unloading (unloading or loading) information for the load L.

[0022] The management device 3 includes a loading / unloading instruction unit 34, and the loading / unloading instruction unit 34 is configured to display the loading / unloading task T of the loading / unloading schedule J transmitted from the storage unit 30 on a display unit 11 provided in the driver's seat of the manned transporter 1.

[0023] The display unit 11 is, for example, a touch panel display. The cargo handling instruction unit 34 displays the cargo handling task T that the manned transport vehicle 1 should perform on the display unit 11. The operator O operates the manned transport vehicle 1 to perform cargo handling according to the cargo handling task T displayed on the display unit 11. When the cargo handling task T is completed, the operator O presses the end button displayed on the display unit 11, and an end signal is sent to the cargo handling instruction unit 34. Upon receiving the end signal, the cargo handling instruction unit 34 is configured to display the next cargo handling task T that the manned transport vehicle 1 should perform on the display unit 11.

[0024] The manned transport vehicle 1 is equipped with a position detection unit 10. The position detection unit 10 consists of a laser sensor, a GPS sensor, an electromagnetic induction sensor, etc. The position detection unit 10 is configured to detect the vehicle position D1 of the manned transport vehicle 1.

[0025] The management device 3 includes a guideway generation unit 31. Based on the vehicle position D1 information of the manned transport vehicle 1 transmitted from the position detection unit 10, the facility map M transmitted from the storage unit 30, and the cargo handling task T of the cargo handling schedule J transmitted from the storage unit 30, the guideway generation unit 31 generates a virtual guideway 4 between the vehicle position D1 and the cargo handling position D2 of the manned transport vehicle 1. The cargo handling position D2 is the position on the passage P where the manned transport vehicle 1 picks up and places cargo in the cargo handling task T (Figure 3).

[0026] As shown in Figure 3, the guideway generation unit 31 is configured to generate a virtual guideway 4 that connects, for example, a vehicle position D1 and a cargo handling position D2 on a passage P. The guideway 4 is set, for example, to minimize the travel distance of the manned transport vehicle 1. In this embodiment, as shown in Figure 3, the guideway 4 is composed of a first straight section 41, a bend 40, and a second straight section 42.

[0027] The unmanned aerial vehicle 2 is equipped with a position detection unit 20. The position detection unit 20 consists of a GPS sensor, a gyro sensor, an ultrasonic sensor, a laser sensor, a barometric pressure sensor, a compass, an accelerometer, etc., and can detect the position of the unmanned aerial vehicle 2.

[0028] The unmanned aerial vehicle 2 is equipped with a flight control unit 21. The flight control unit 21 is configured to control the rotation of the rotor blades. Based on the detection results of the position detection unit 20 and the control of the flight control unit 21, the unmanned aerial vehicle 2 can fly to a predetermined aerial stopping position on the taxiway 4 and hover at the aerial stopping position.

[0029] The position determination unit 32 is further configured to determine the aerial hovering position for the unmanned aerial vehicle 2 on the taxiway 4. The position determination unit 32 is configured to hover at a position on the taxiway 4 that is a certain distance away from the vehicle position D1 of the manned transport vehicle 1 in the forward direction of the manned transport vehicle 1. Therefore, as the manned transport vehicle 1 approaches the unmanned aerial vehicle 2, the unmanned aerial vehicle 2 moves away from the manned transport vehicle 1, so that the distance between the manned transport vehicle 1 and the unmanned aerial vehicle 2 remains constant.

[0030] The unmanned aerial vehicle 2 is equipped with a memory unit 22. The memory unit 22 stores guidance images 200. The guidance images 200 consist of, for example, arrows for guiding the manned transport vehicle 1 to the loading / unloading position D2, and the direction of the arrows is configured to differ depending on the loading / unloading position D2 (Figures 1 and 3).

[0031] The unmanned aerial vehicle 2 is equipped with a projection unit 23. The projection unit 23 is composed of, for example, a projector, and can project guidance images 200 stored in the memory unit 22 onto the corridor P of the facility (Figures 1 to 3).

[0032] The control device 3 includes a projection instruction unit 33. The projection instruction unit 33 is configured to determine the guidance image 200 to be projected onto the road surface P according to the taxiway 4 from the taxiway generation unit 31 and the position of the unmanned aircraft 2 determined by the position detection unit 20, and to send a projection instruction to the projection unit 23 of the unmanned aircraft 2.

[0033] Operator O can visually observe the guidance image 200 projected onto the passage P, drive the manned transport vehicle 1 along the guidance image 200 to the loading / unloading position D2, and operate the manned transport vehicle 1 according to the loading / unloading task T displayed on the display unit 11 to perform loading / unloading operations on the cargo L.

[0034] The unmanned aerial vehicle 2 is equipped with an imaging unit 25 having a CCD image sensor, a CMOS image sensor, etc. The imaging unit 25 is configured to continuously photograph the face of the operator O who is driving the manned transport vehicle 1, by driving the imaging direction so that it is always facing the operator O, based on the position of the manned transport vehicle 1 from the position detection unit 10 and the position of the unmanned aerial vehicle 2 from the position detection unit 20.

[0035] Furthermore, the control device 3 includes a drowsiness determination unit 35. The drowsiness determination unit 35 is configured to determine the degree of drowsiness of operator O (for example, levels 1 to 5) based on the facial image data of operator O acquired by the imaging unit 25.

[0036] If we adopt NEDO's evaluation method, drowsiness level 1 is "doesn't seem sleepy at all," drowsiness level 2 is "seems a little sleepy," drowsiness level 3 is "seems sleepy," drowsiness level 4 is "seems quite sleepy," and drowsiness level 5 is "seems very sleepy."

[0037] As shown in Figure 5, the drowsiness detection unit 35 includes a collection unit 40 for collecting training data 46. The training data 46 includes feature data D relating to the characteristics of a human face. In this embodiment, the feature data D relating to various human facial features includes eye opening C1, number of eyelid openings and closings C2, gaze movement C3, mouth opening C4, head up and down movement C5, and number of yawns C6.

[0038] The drowsiness detection unit 35 includes a learning model generation unit 41 that performs machine learning on the training data 46 collected by the collection unit 40 and generates and stores a learning model through machine learning. In this embodiment, the learning model generation unit 41 performs supervised learning. In supervised learning, a large amount of training data 46, that is, pairs of input data ID and output data OD, is input to the learning model generation unit 41.

[0039] The input data ID includes eye opening degree C1, number of eyelid openings and closings C2, gaze movement C3, mouth opening degree C4, head up and down movement C5, and number of yawns C6. The output data OD represents the degree of sleepiness. The input data ID is evaluated to indicate the sleepiness level of operator O, and a numerical parameter (level) from 1 to 5 is set.

[0040] A high numerical parameter (level) indicating the degree of drowsiness, that is, a high degree of drowsiness in operator O, is determined to occur when, for example, (1) the degree of eye opening C1 is lower than the pre-stored degree of eye opening, (2) the number of times the eyelids are opened and closed C2 is less than the pre-stored number of times the eyelids are opened and closed, (3) the amount of gaze movement C3 is less than the amount of gaze movement pre-stored, (4) the degree of mouth opening C4 is higher than the pre-stored degree of mouth opening, (5) the up-and-down movement of the head C5 is greater than the pre-stored up-and-down movement of the head, or (6) the number of yawns C6 is greater than the pre-stored number of yawns. The drowsiness determination unit 35 determines the degree of drowsiness in operator O based on the numerical parameters (1) to (6) above.

[0041] The degree of drowsiness may be set using any of the following numerical parameters: (1) eye opening degree C1, (2) number of eyelid openings and closings C2, (3) amount of gaze movement C3, (4) mouth opening degree C4, (5) head up and down movement C5, or (6) number of yawns C6, or it may be set using numerical parameters weighted by a weighting coefficient.

[0042] In fact, the degree of drowsiness of operator O is often easily discernible through the state and movements of operator O's eyes, eyelids, mouth, etc. Therefore, it can be inferred that there is a certain correlation or relationship between (1) the degree of eye opening C1, (2) the number of times the eyelids are opened and closed C2, (3) the amount of gaze movement C3, (4) the degree of mouth opening C4, (5) the up and down movement of the head C5, and (6) the number of times yawning C6, and the degree of drowsiness of operator O.

[0043] The learning model generation unit 41 uses a general machine learning algorithm such as a neural network. The learning model generation unit 41 performs machine learning using the correlated input data ID and output data OD as training data 46 to generate a model (learning model) that estimates output from input, that is, a model that outputs the degree of sleepiness when input data ID is input.

[0044] The drowsiness detection unit 35 includes an acquisition unit 45 that acquires the current input data ID at predetermined intervals. As described above, the input data ID consists of (1) eye opening degree C1, (2) number of eyelid opening and closing cycles C2, (3) gaze movement amount C3, (4) mouth opening degree C4, (5) head up and down movement C5, and (6) number of yawns C6. The acquisition unit 45 is configured to acquire the input data ID based on the face image data of operator O obtained by the imaging unit 25 using known image analysis techniques. The input data ID is acquired at predetermined intervals (e.g., every second).

[0045] The drowsiness determination unit 35 includes a prediction unit 42 that predicts numerical parameters indicating the degree of drowsiness of operator O by applying the learning model generated by the learning model generation unit 41 to the current input data ID acquired from the acquisition unit 45.

[0046] The drowsiness detection unit 35 includes a decision unit 43, which determines whether to issue an alarm to operator O based on the output data OD predicted by the prediction unit 42, and outputs a decision signal to the alarm unit 26.

[0047] The drowsiness determination unit 35 determines that there is no drowsiness at level 1, and that there is drowsiness at levels 2 to 5.

[0048] The unmanned aerial vehicle 2 is equipped with an alarm unit 26. The alarm unit 26 is configured to alert the operator O and workers around the manned transport vehicle 1 based on a determination from the drowsiness detection unit 35.

[0049] The alarm unit 26 may consist of an acoustic device and be configured to emit a sound as an alarm. The volume of the sound may be adjusted according to the degree of drowsiness. Furthermore, the alarm unit 26 may consist of a lighting device and be configured to emit light as an alarm. The intensity of the light may be configured to change according to the degree of drowsiness. Furthermore, the alarm unit 26 may consist of a water discharge device and be configured to emit water as an alarm. The strength of the water may be adjusted according to the degree of drowsiness.

[0050] Based on Figure 6, the control procedure for preventing drowsiness will be explained. Note that, to avoid repetition, parts already explained will be omitted.

[0051] The drowsiness detection unit 35 collects training data 46 using the collection unit 40 (step S1). Then, the learning model generation unit 41 performs machine learning on the training data 46 collected by the collection unit 40 in step S1, and generates and stores a learning model through machine learning (step S2).

[0052] The drowsiness detection unit 35 acquires the image data of operator O's face, captured by the imaging unit 25, at predetermined intervals using the acquisition unit 45 as the current input data ID (step S3).

[0053] The drowsiness determination unit 35 predicts the degree of drowsiness by operator O by applying the learning model generated in step S2 to the current input data ID acquired in step S3 using the prediction unit 42 (step S4).

[0054] The drowsiness determination unit 35 determines the degree of drowsiness of operator O based on the output data OD predicted in step S4 by the determination unit 43, and determines whether or not drowsiness is present (step S5). If the drowsiness determination unit 35 determines that the degree of drowsiness is level 1, it is determined that there is no drowsiness. If the drowsiness determination unit 35 determines that the degree of drowsiness is levels 2 to 5, it is determined that there is drowsiness.

[0055] If the determination unit 43 determines that operator O is not sleepy (level 1), the process returns to step S1, where the imaging unit 25 of the unmanned aerial vehicle 2 photographs the face of operator O of the manned transport vehicle 1, and the acquisition unit 45 acquires the face image data. If the determination unit 43 determines that operator O is sleepy (levels 2-5), it determines which level of sleepiness from levels 2 to 5 it is (step S6).

[0056] In the case of drowsiness levels 2 and 3, operator O is determined to be in a light drowsiness state, and since there is a high probability that operator O will wake up if an alarm is directed at operator O, an alarm is issued only to operator O (step S7). In the case of drowsiness levels 4 and 5, operator O is determined to be in a deep drowsiness state, and since there is a low probability that operator O will wake up even if an alarm is directed at operator O, an alarm is issued not only to operator O but also to workers around the manned transport vehicle 1 (step S8).

[0057] If the alarm unit 26 consists of an acoustic device, the acoustic device is equipped with a directional sound generating unit, and when alarming only the operator O, the sound is emitted locally towards the operator O, and when alarming not only the operator O but also workers around the manned transport vehicle 1, the sound is emitted over a wide area towards the operator O.

[0058] Furthermore, if the alarm unit 26 consists of a lighting device, the lighting device is equipped with a directional light-emitting unit. When alarming only the operator O, light is emitted locally towards the operator O. When alarming not only the operator O but also workers around the manned transport vehicle 1, light is emitted over a wide area towards the operator O. The lighting device may also alarm by flashing light.

[0059] Furthermore, if the alarm unit 26 consists of a water spraying device, the water spraying device is equipped with a directional water jet. When an alarm is to be issued only to operator O, water is sprayed locally towards operator O. When an alarm is to be issued to workers around the manned transport vehicle 1 in addition to operator O, water is sprayed over a wide area towards operator O.

[0060] Furthermore, the alarm unit 26 may use the projection unit 25 to display a large alarm image (for example, an alarm message such as "The operator of this forklift is asleep! Please be careful!") in the passageway P around the manned transport vehicle 1, thereby alerting workers around the manned transport vehicle 1 that the operator O operating the manned transport vehicle 1 is asleep.

[0061] Then, the drowsiness prevention control in steps S1 to S8 is repeatedly performed to sequentially determine and alert whether operator O is falling asleep.

[0062] Although preferred embodiments of the present invention have been described above, the configuration of the present invention is not limited to these embodiments. For example, it can be modified as follows.

[0063] In the above embodiment, the unmanned aerial vehicle 2 is configured to travel along a taxiway 4 for guiding the movement of the manned transport vehicle 1. However, it may also be configured to photograph the operator O of the manned transport vehicle 1 at any time and along any route without traveling along the taxiway 4.

[0064] In the above embodiment, the drowsiness determination unit 35 may be configured to determine the degree of drowsiness based on the angle of operator O's head, facial expression, changes in eyelid opening and closing, etc. Alternatively, the drowsiness determination unit 35 may be configured to store a facial image of operator O when not drowsy, and to determine the degree of drowsiness by comparing this stored facial image of operator O with the facial image of operator O acquired by the imaging unit 25.

[0065] In the above embodiment, the alarm unit 26 is composed of an acoustic device, a lighting device, or a water spraying device, but these may be selectively combined, or all of them may be provided in the unmanned aerial vehicle 2.

[0066] In the above embodiment, the unmanned aerial vehicle 2 is configured to project a guidance image 200 onto the passage P so that the taxiway 4 can be recognized visually by the operator O. However, it may also be equipped with a sound generating unit (not shown) that emits sounds such as voice, buzzer, or chime, so that the taxiway 4 can be recognized auditorily by the operator O. The sound generating unit is configured to emit voices such as, for example, "Turn left 15m ahead," "Your destination is 30m ahead," or "There is an obstacle ahead. Please be careful."

[0067] The effects of the present invention will be explained.

[0068] In a transport system S comprising a manned transport vehicle 1 and an unmanned aerial vehicle 2, the unmanned aerial vehicle 2 includes a camera unit 25 that photographs the face of the operator O operating the manned transport vehicle 1, and a sleepiness determination unit 35 that determines the degree of sleepiness of the operator O, and an alarm unit 26 that alerts the operator O operating the manned transport vehicle 1 based on the degree of sleepiness. The drowsiness determination unit 35 includes a collection unit 40 that collects feature data related to the characteristics of a human face and training data 46 based on the relationship between the characteristics of a human face and the degree of drowsiness related to a human face; a learning model generation unit 41 that performs machine learning on the training data 46 collected by the collection unit 40 and generates and stores a learning model by machine learning; an acquisition unit 45 that uses an imaging unit 25 to acquire the current facial feature data of operator O at predetermined intervals; a prediction unit 42 that inputs the current facial feature data of operator O acquired from the acquisition unit into the learning model generated by the learning model generation unit 41 to acquire the degree of drowsiness from the learning model; and a decision unit 43 that determines whether to issue an alarm to operator O based on the degree of drowsiness acquired by the prediction unit 42.

[0069] Therefore, by equipping the unmanned aerial vehicle 2 with a camera unit 25 and taking photographs from outside the manned transport vehicle 1, it is not necessary to equip each manned transport vehicle 1 with a camera unit 25, and the configuration for photographing the operator O can be minimized. In addition, since the operator O does not know when the unmanned aerial vehicle 2 will fly in, it is expected that the operator O will operate the manned transport vehicle 1 with a sense of tension. Furthermore, the drowsiness detection unit 35 determines the degree of drowsiness of the operator O, and if the operator O falls asleep, an alarm can be issued to wake the operator O. Moreover, by using a learning model generated by machine learning, the degree of drowsiness of the operator O can be determined more accurately.

[0070] Furthermore, it is desirable that the alarm unit 26 alerts the area around the manned transport vehicle 1 in addition to the operator O when the level of drowsiness exceeds a predetermined level.

[0071] If operator O's level of drowsiness exceeds a predetermined level, operator O may not wake up even if an alarm is issued. Therefore, by issuing an alarm to workers around the manned transport vehicle 1, it is possible to prevent workers from colliding with the manned transport vehicle 1 operated by the sleeping operator O.

[0072] Furthermore, the alarm unit 26 is designed to emit sound, light, and / or a combination thereof as an alarm. In this way, the alarm unit 26 can reliably and quickly wake up the sleeping operator O by emitting sound, light, and water.

[0073] Furthermore, the unmanned aerial vehicle 2 may be equipped with a projection unit 23 that projects an image onto the passage P, and the alarm unit 26 may project an alarm image from the projection unit 23 to alert the area around the manned transport vehicle 1. In this way, the projection unit 23 projects an alarm image, which directly and effectively alerts workers around the manned transport vehicle 1 that the operator O of the manned transport vehicle 1 is dozing off.

[0074] Furthermore, the unmanned aerial vehicle 2 is configured to travel along a taxiway 4 that guides the manned transport vehicle 1.

[0075] Therefore, the unmanned aerial vehicle 2 guiding the manned transport vehicle 1 can sequentially and accurately capture images of the operator O's face. Based on this, the drowsiness detection unit 35 can determine the degree of drowsiness of the operator O, and if the operator O falls asleep, it can quickly issue an alarm to wake the operator O. [Explanation of symbols]

[0076] S Conveyor System O Operator 1 Manned guided vehicle 2 Unmanned aircraft 4 Taxiway 23 Projection section 25 Photography Department 26 Alarm section 35 Sleepiness detection unit 40 Collection Department 41 Learning Model Generation Unit 42 Prediction Section 43 Decision Section 45 Acquisition Department 46 Training data ID Input Data OD output data

Claims

1. In a transport system equipped with a manned transport vehicle and an unmanned aerial vehicle, A manned transport vehicle operated by an operator, An unmanned aerial vehicle having a camera unit for photographing the operator's face, a warning unit for alerting the operator, and a projection unit for projecting guidance images onto the road surface, and capable of hovering in the air, A control device for controlling the aforementioned unmanned aerial vehicle, A guide path generation unit generates a guide path between the vehicle position and the cargo handling position of the manned transport vehicle, A position determination unit that determines the position on the aforementioned taxiway where the unmanned aircraft will hover in mid-air, A projection instruction unit determines the guidance image to be projected onto the road surface according to the position of the taxiway and the unmanned aircraft, and sends instructions to the projection unit. The system includes a sleepiness determination unit that determines the degree of sleepiness of the operator, The aforementioned drowsiness detection unit, A data collection unit collects feature data related to the characteristics of human faces and training data based on the relationship between the degree of sleepiness of the said human faces, A learning model generation unit performs machine learning on the training data collected by the collection unit, and generates and stores a learning model using the machine learning. The aforementioned imaging unit acquires the facial feature data of the operator at the present time at predetermined intervals, and the acquisition unit A prediction unit obtains the current level of sleepiness of the operator from the learning model by inputting the current facial feature data of the operator obtained from the acquisition unit into the learning model generated by the learning model generation unit, The system includes a determination unit that determines whether the alarm unit will issue an alarm to the operator based on the degree of drowsiness acquired by the prediction unit. A transport system characterized by the following features.

2. The alarm unit, when the level of drowsiness is above a predetermined level, will issue an alarm not only to the operator but also to those around the manned transport vehicle. The transport system according to feature 1.

3. The alarm unit emits sound, light, and water, or a combination thereof, as the alarm. The transport system according to feature 1.

4. The alarm unit is configured to project an alarm image from the projection unit to sound an alarm around the manned transport vehicle. The transport system according to feature 2.

Images