Cargo handling vehicle and control method thereof

Abstract

To enable information concerning a cargo-handling vehicle to be notified to a person other than an operator who operates a fork lift.SOLUTION: A cargo-handling vehicle 1, which an operator O gets on, comprises a projecting part 2 that projects an image 200 for notifying information I concerning the cargo-handling vehicle 1, and a projection determining part 4 that determines whether the image 200 should be projected on either of a road surface P and a wall surface W, on the basis of visibility of the operator O. The cargo-handling vehicle 1 further comprises a photographing part 3 that photographs the road surface P and the wall surface W, and the projecting determining part 4 obtains and determines a photographed image by the photographing part 3.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a cargo handling vehicle on which an operator rides and a control method thereof. [Background technology]

[0002] In general, a forklift, which is a cargo handling vehicle, is configured so that an operator rides on the forklift to drive the vehicle and operate the forks. A monitor device is provided in the driver's seat where the operator rides, and information related to the forklift is displayed on the monitor device (Patent Document 1, etc.). Information related to the forklift, such as information on fork operation, information on the light illumination status, information on the cargo to be handled, and information on the brake status, is displayed on the monitor device.

[0003] By the way, the operator can learn information about the forklift by checking the display on the monitor device, but if people other than the operator operating the forklift, such as workers working around the forklift or operators of other forklifts, could also learn information about the forklift, they would be able to understand the fork operation and avoid danger, or let the operator know if the lights have been forgotten to be turned off or the brakes applied. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 7-242400 Summary of the Invention [Problem to be solved by the invention]

[0005] Therefore, an object of the present invention is to provide a loading vehicle and a control method thereof that can provide information about the loading vehicle to people other than the operator operating the forklift. [Means for solving the problem]

[0006] In order to solve the above problems, the loading vehicle of the present invention is a loading vehicle on which an operator rides, and is equipped with a projection unit that projects an image to notify information about the loading vehicle, and a projection determination unit that determines whether the image will be projected onto the road surface or a wall surface based on the operator's visibility.

[0007] The loading vehicle further includes an image capturing unit for capturing images of the road surface and the wall surface, and the projection determination unit preferably acquires and determines the image captured by the image capturing unit.

[0008] Preferably, the projection determination unit includes a collection unit that collects teacher data based on a relationship between color data related to the color of the captured image and illuminance data related to the illuminance, and a visibility score indicating the visibility of the image by the operator. Furthermore, the projection determination unit includes a learning model generation unit that performs machine learning from the teacher data collected in the collection unit and generates and stores a learning model by machine learning, an acquisition unit that acquires current color data and illuminance data at predetermined time intervals, a prediction unit that acquires a visibility score from the learning model by inputting the current color data and illuminance data acquired from the acquisition unit into the learning model generated by the learning model generation unit, and a determination unit that determines whether the image is to be projected onto a road surface or a wall surface based on the visibility score acquired by the prediction unit.

[0009] The method for controlling a loading vehicle according to the present invention is a method for controlling a loading vehicle on which an operator rides, the loading vehicle having a projection unit that projects an image for notifying the operator of information related to the loading vehicle, and includes a projection determination step of determining whether the image is to be projected onto a road surface or a wall surface based on visibility of the operator.

[0010] It is preferable that the control method further includes an imaging step of imaging the road surface and the wall surface, and the projection determination step is determined by acquiring an image captured in the imaging step.

[0011] Preferably, the control method further includes a collection step of collecting teacher data based on a relationship between color data related to the color and illuminance data related to the illuminance of the captured image and a visibility score indicating the visibility of the image by the operator. The control method also includes a learning model generation step of performing machine learning from the teacher data collected in the collection step and generating and storing a learning model by machine learning, an acquisition step of acquiring current color data and illuminance data at predetermined time intervals, a prediction step of acquiring a visibility score from the learning model by inputting the current color data and illuminance data acquired in the acquisition step into the learning model generated in the learning model generation step, and a determination step of determining whether the image is to be projected onto a road surface or a wall surface based on the visibility score acquired in the prediction step. Effect of the Invention

[0012] By being equipped with the above-mentioned configuration, the loading vehicle and control method thereof of the present invention can inform information about the loading vehicle to persons other than the operator operating the forklift, and the projection determination unit can clearly project an image expressing information about the loading vehicle by determining whether to project onto the road surface or a wall surface based on the operator's visibility. [Brief description of the drawings]

[0013] [Figure 1] FIG. 2 is a side view for explaining a forklift. [Diagram 2] FIG. 2 is a block diagram for explaining a configuration of a forklift. [Diagram 3] 10 is a block diagram for explaining a configuration of a projection determination unit. FIG. [Figure 4] FIG. 11 is a flowchart illustrating a control method of the projection determination unit. [Diagram 5] FIG. 11 is a plan view for explaining an image projected from a forklift. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A loading vehicle and a control method thereof according to the present invention will now be described with reference to the drawings.

[0015] As shown in Fig. 1, in this embodiment, the cargo handling vehicle 1 is a counterweight type forklift 1. The forklift 1 is configured to be operated by an operator O who rides on the forklift 1. In this embodiment, the forklift 1 is configured to be operated by the operator O to travel the vehicle body and raise and lower the forks.

[0016] 1 and 2, the forklift 1 includes a projection unit 2. The projection unit 2 is configured to project an image 200 for notifying information I related to the forklift 1 to an operator O and people in the vicinity.

[0017] The information I on the forklift 1 includes, for example, information on fork operation, information on the light illumination state, information on the cargo being handled, information on the brake state, information on the operation lever state, etc. The forklift 1 is equipped with an information acquisition unit 6 that acquires the information I. The information acquisition unit 6 is configured to acquire these operations and states, etc., from a lift device that raises and lowers the forks, the lights, the brakes, a load sensor on the forks, etc.

[0018] As shown in Figure 5(A), for example, while the forks of forklift 1 are rising, image 200 indicating that the forks are rising is projected from projection unit 2, and as shown in Figure 5(B), if the weight of the load lifted by the forks of forklift 1 exceeds the allowable load, image 200 indicating that the load is overloaded is projected from projection unit 2, so that information I regarding the forklift can be communicated to people other than operator O of forklift 1, such as operator O riding on forklift 1, workers working around forklift 1, and operators riding on other forklifts.

[0019] The operator O of the forklift 1 can quickly and appropriately grasp the state and position of the forks by recognizing that the forks of the forklift 1 are rising and the current position of the forks. Also, by recognizing that the forks of the forklift 1 are rising and the current position of the forks, people other than the operator O of the forklift 1 can be alerted when working or walking.

[0020] In this way, by making the operator O of the forklift 1 recognize that the load lifted by the forklift 1 is overloaded, the amount of load can be adjusted so that the load is not overloaded. Also, by informing people other than the operator O of the forklift 1 that the forklift 1 is transporting an overloaded load, the other people can warn the operator O or report it to a manager or supervisor.

[0021] As shown in FIG. 5, the image 200 is projected onto the road surface P in front of and behind the forklift 1, but it may also be projected onto the side of the forklift 1, etc.

[0022] 1 and 2, the forklift 1 is equipped with an imaging unit 3 that captures images of a road surface P and a wall surface W. The imaging unit 3 may be, for example, a camera having a CCD sensor, a CMOS sensor, an image processor, or the like, and is configured to acquire captured images. The forklift 1 travels on the horizontal road surface P. The wall surface W is provided in the vertical direction and may include walls within a facility or the outer surfaces of luggage stored on a shelf, and may be any vertical surface onto which the image 200 can be projected.

[0023] The forklift 1 includes a control unit 5. The control unit 5 is connected to the information acquisition unit 6 and the projection unit 2, and selects an image 200 to be projected from the information I acquired by the information acquisition unit 6, and the selected image 200 is projected by the projection unit 2. For example, while the forks are ascending and descending, the image 200 representing the forks ascending and descending is selected, while the lights are forgotten to be turned off, the image 200 representing the lights being forgotten to be turned off is selected, and while an overloaded load is being transported by the forks, the image 200 representing the overload is selected.

[0024] The control unit 5 also includes a projection determination unit 4 that determines whether the image 200 is to be projected onto the road surface P or onto the wall surface W. The projection determination unit 4 is configured to determine whether the image 200 is to be projected onto the road surface P or onto the wall surface W, based on the visibility of the operator O. This allows the image 200 to be projected clearly.

[0025] 3, the projection determination unit 4 includes a collection unit 40 that collects teacher data 46. The teacher data 46 includes color data D1 related to the color of the captured image and illuminance data D2 related to the illuminance of the captured image. The color data D1 related to the color of the captured image is the color C1 of the road surface P and the color C2 of the wall surface W. Furthermore, the illuminance data D2 related to the illuminance of the captured image is the illuminance C3 of the road surface P and the illuminance C4 of the wall surface W.

[0026] The projection determination unit 4 includes a learning model generation unit 41 that performs machine learning from the teacher data 46 collected by the collection unit 40 and generates and stores a learning model by machine learning. The learning model generation unit 41 of this embodiment performs supervised learning. In supervised learning, a large amount of teacher data 46, that is, pairs of input data ID and output data OD, are input to the learning model generation unit 41.

[0027] The input data ID includes a color C1 of the road surface P, a color C2 of the wall surface W, an illuminance C3 of the road surface P, and an illuminance C4 of the wall surface W. The output data OD is a visibility score. The input data ID is evaluated as a visibility score indicating whether the image 200 projected onto the road surface P or onto the wall surface W has better visibility for the operator O, and a numerical parameter ranging from 0 to 10 is set.

[0028] Examples of cases where the numerical parameter of the visibility score is high, i.e., the visibility of the image 200 by the operator O is determined to be high, are (1) a predetermined percentage or more of the color C1 of the road surface P is the same color as the pre-stored color of the road surface P, (2) the illuminance C3 of the road surface P is a predetermined illuminance or more, (3) a predetermined percentage or more of the color C2 of the wall surface W is the same color as the pre-stored color of the wall surface W, and (4) the illuminance C4 of the wall surface W is a predetermined illuminance or more. The projection determination unit 4 determines whether to project the image 200 onto the road surface P or the wall surface W, based on the above numerical parameters (1) and (2) related to the road surface P and the above numerical parameters (3) and (4) related to the wall surface W.

[0029] The visibility score may be set by any one of the numerical parameters: (1) the color C1 of the road surface P, (2) the illuminance C3 of the road surface P, (3) the color C2 of the wall surface W, or (4) the illuminance C4 of the wall surface W, or may be set by a weighted average of the numerical parameters using a weighting coefficient.

[0030] In fact, regarding the visibility of the image 200 by the operator O, when most of the colors of the road surface P and the wall surface W are the same as the original colors and the illuminance is high, the operator O can easily see the projected image 200. Therefore, it can be inferred that there is a certain relationship, such as a correlation, between (1) the color C1 of the road surface P, (2) the illuminance C3 of the road surface P, (3) the color C2 of the wall surface W, and (4) the illuminance C4 of the wall surface W and the visibility of the operator O.

[0031] The learning model generation unit 41 uses a machine learning algorithm such as a general neural network. The learning model generation unit 41 performs machine learning using correlated input data ID and output data OD as teacher data 46 to generate a model (learning model) that estimates an output from an input, that is, a model that outputs a fall possibility score when an input data ID is input.

[0032] The projection determination unit 4 includes an acquisition unit 45 that acquires the current input data ID at predetermined time intervals. As described above, the input data ID is (1) the color C1 of the road surface P, (2) the illuminance C3 of the road surface P, (3) the color C2 of the wall surface W, and (4) the illuminance C4 of the wall surface W. The acquisition unit 45 is configured to acquire the input data ID based on the image captured by the imaging unit 3. The input data ID is acquired at predetermined time intervals (for example, every minute).

[0033] The projection determination unit 4 includes a prediction unit 42 that predicts whether the image 200 projected onto the road surface P or onto the wall surface W will be more visible to the operator O by applying the learning model generated by the learning model generation unit 41 to the current input data ID acquired from the acquisition unit 45.

[0034] The projection determination unit 4 includes a determination unit 43, which determines whether the image 200 is to be projected onto the road surface P or onto the wall surface W based on the output data OD predicted by the prediction unit 42, and outputs a determination signal to the projection unit 2. The projection unit 2 is configured to be rotatable, and is configured to project the image 200 onto the road surface P or onto the wall surface W based on the determination signal from the projection determination unit 4.

[0035] 4, the projection determination unit 4 executes the following control method. Note that to avoid duplication, parts that have already been explained will be omitted.

[0036] The collecting unit 40 collects teacher data 46 (collection step: S1). Then, the learning model generating unit 41 performs machine learning from the teacher data 46 collected by the collecting unit 40 in the collection step S1, and generates and stores a learning model by machine learning (learning model generating step: S2). The acquiring unit 45 acquires the current input data ID at predetermined time intervals (acquisition step: S3).

[0037] The prediction unit 42 predicts the visibility of the image 200 by the operator O by applying the learning model generated in the learning model generation step S2 to the current input data ID acquired in the acquisition step S3 (prediction step: S4). The decision unit 43 decides whether the image 200 is to be projected onto the road surface P or the wall surface W based on the output data OD predicted in the prediction step S4, and outputs a decision signal to the projection unit 2 (decision step: S5).

[0038] Although the preferred embodiments of the present invention have been described above, the configuration of the present invention is not limited to these embodiments. For example, the shooting decision unit 4 may be configured to determine whether the illuminance of the road surface P or the wall surface W is higher based on, for example, the illuminance results from illuminance sensors attached to the road surface P and the wall surface W, rather than on the image captured by the shooting unit 3, and to determine whether the image is to be projected onto the road surface P or the wall surface W. Furthermore, the cargo handling vehicle 1 is not limited to a counterweight forklift, but may be a reach forklift, a side forklift, an order picking truck, a towing vehicle, or the like.

[0039] The effects of this embodiment will be described. By projecting an image 200 representing information I about the loading vehicle 1 onto the road surface P or wall surface W, the information I about the loading vehicle 1 can be communicated to people other than the operator O of the loading vehicle 1, such as the operator O who is on board and operating the loading vehicle 1, workers working around the loading vehicle 1, and operators O on board other loading vehicles 1. The projection determination unit 4 determines whether to project the image 200 onto the road surface P or the wall surface W based on the visibility of the operator O, so that the image 200 can be projected clearly. This makes it easier for the operator O who is on board and operating the cargo handling vehicle 1, workers working around the cargo handling vehicle 1, and operators O on other cargo handling vehicles 1 to view the image 200. [Explanation of symbols]

[0040] 1. Forklift (cargo handling vehicle) 2 Projection section 3. Photography Department 4 Projection determining section 5. Control section 40 Collection Department 41 Learning model generation unit 42 Prediction Department 43 Decision Section 45 Acquisition Department 46 Teacher Data 200 images P road surface W wall O Operator ID Input Data OD Output Data

Claims

1. A loading vehicle on which an operator rides, A projection unit that projects an image for notifying information about the loading vehicle; a projection determination unit that determines whether the image is to be projected onto a road surface or a wall surface based on the visibility of the operator; An imaging unit that images the road surface and the wall surface, The projection unit is configured to project an image representing the lifting and lowering of the forks while the forks of the loading vehicle are lifting and lowering, to project an image representing the lights being forgotten to be turned off while the lights of the loading vehicle are forgotten to be turned off, and to project an image representing overloading while an overloaded load is being transported by the forks, The projection determination unit is Acquire an image captured by the imaging unit; a collection unit that collects teacher data based on a relationship between color data related to a color of the captured image and illuminance data related to an illuminance of the captured image, and a visibility score that indicates visibility of the image by the operator; a learning model generation unit that performs machine learning on the teacher data collected by the collection unit, and generates and stores a learning model by the machine learning; an acquisition unit that acquires the current color data and the current illuminance data at predetermined time intervals; a prediction unit that acquires the visibility score from the learning model by inputting the current color data and the current illuminance data acquired from the acquisition unit into the learning model generated by the learning model generation unit; a determination unit that determines whether the image is to be projected onto the road surface or onto a wall surface based on the visibility score obtained by the prediction unit. A loading vehicle characterized by:

2. A method for controlling a loading vehicle on which an operator rides, comprising: The loading vehicle is a projection unit that projects an image for notifying the operator of information related to the loading vehicle; The projection unit is configured to project an image representing the lifting and lowering of the forks while the forks of the loading vehicle are lifting and lowering, to project an image representing the lights being forgotten to be turned off while the lights of the loading vehicle are forgotten to be turned off, and to project an image representing overloading while an overloaded load is being transported by the forks, The method for controlling the loading vehicle includes: An imaging step of imaging a road surface and a wall surface; a projection determination step of acquiring an image captured by the photographing step and determining whether the image is to be projected onto the road surface or the wall surface based on visibility of the operator; Further, a collection step of collecting teacher data based on a relationship between color data related to a color of the captured image and illuminance data related to an illuminance of the captured image, and a visibility score indicating visibility of the image by the operator; a learning model generation step of performing machine learning from the teacher data collected in the collection step, and generating and storing a learning model by the machine learning; an acquisition step of acquiring the current color data and the current illuminance data at predetermined time intervals; a prediction step of acquiring the visibility score from the learning model by inputting the current color data and the current illuminance data acquired in the acquisition step into the learning model generated in the learning model generation step; and a determining step of determining whether the image is to be projected onto the road surface or onto a wall surface based on the visibility score obtained by the predicting step. A method for controlling a loading vehicle comprising:

Images