Video recorder and vehicle information processor
The recording device addresses power supply delays and multiple camera feed management by remaining powered on during vehicle system off-states, ensuring continuous recording and streamlined data handling.
Patent Information
- Application Number
- JP2024151250
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-03
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2039-03-25
AI Technical Summary
Existing recording devices in vehicles, such as forklifts, experience delays in starting recording due to power supply delays when the main switch is turned on and off frequently, leading to significant gaps in recorded video data, and managing multiple camera feeds is cumbersome.
The recording device remains powered on even when the vehicle's electrical system is not operating, allowing immediate recording upon request, and includes features to manage and synchronize video data from multiple cameras.
This solution minimizes gaps in recorded data and simplifies the handling of multiple camera feeds by ensuring immediate recording and efficient data management, providing valuable accident analysis information.
Smart Images

Figure 2024167371000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a recording device, a vehicle information processing device, and the like. [Background technology]
[0002] There are known recording devices such as driver recorders that are mounted on vehicles and record the surroundings of the vehicle while it is moving. Generally, such recording devices receive power from the vehicle and record while a switch for starting and stopping the power supply to the vehicle's electrical system (hereinafter referred to as a main switch) is on. When the main switch is turned off, the power supply from the vehicle to the recording device is stopped and recording is also stopped. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-132298 A Summary of the Invention [Problem to be solved by the invention]
[0004] In a work vehicle such as a forklift, the main switch may be frequently switched on and off as the driver gets in and out of the vehicle. In a general recording device, after the main switch of the vehicle is turned on and power supply is started, a delay time occurs before recording actually starts. For this reason, recording is not performed during the period from when the main switch is turned on until the delay time has elapsed. If the main switch is frequently turned on and off, the accumulated time during which recording is not performed becomes long.
[0005] For example, when loading and unloading with a forklift, after loading the cargo in the loading area, the driver needs to get off the driver's seat to check that the cargo is properly loaded in the loading area. When getting off the driver's seat, it is recommended to turn off the main switch of the forklift for safety. In a conventional recording device, when the main switch of the forklift is turned off and the power supply to the recording device is stopped, the recording is also stopped. For example, if the delay time from when the power supply is started to when the recording starts is about 10 seconds, if the main switch is turned on for about 30 seconds, followed by a state in which the main switch is turned off, the recording will only be for about 20 seconds out of the 30 seconds that the main switch is turned on.
[0006] There are cases where multiple cameras are installed in one vehicle and multiple video data are recorded by the multiple cameras. Although it is possible to play back the multiple video data in a time-synchronized manner using a playback device, it is cumbersome to associate and handle multiple video files in which the video data captured by the multiple cameras are respectively stored.
[0007] It is an object of the present invention to provide a recording device or the like that can prevent the cumulative time during which no recording is performed from increasing even if the power supply to the vehicle's electrical system is frequently started and stopped. Another object of the present invention is to provide a vehicle information processing device or the like that can easily handle video files that store video data captured by multiple cameras.
[0008] The purpose of the present invention is not limited to this, and the applicant intends to obtain rights for configurations that aim to obtain effects from parts of the configurations disclosed in this specification and drawings, etc., through divisional applications, amendments, etc. For example, this specification discloses a problem in which the part described as "can be" in this specification is read as "the problem is to be." The problems are described as independent, and the applicant intends to obtain rights for the configurations for solving these problems alone through divisional applications, amendments, etc. Even if the problem is implicitly understood from the description in the specification, the applicant intends to include part of the configurations described in this specification in the scope of the patent claim by amendment or divisional application. Problems that combine these independent problems are also disclosed. [Means for solving the problem]
[0009] (1) The recording device may be mounted on a vehicle and used to detect a first state in which no power is supplied to the vehicle's electrical system or the vehicle is stopped operating, and may remain powered on even after detecting the first state.
[0010] If the recording device is turned on when the supply of power to the vehicle's electrical system starts or when the vehicle starts operating, the time that elapses before recording starts is long because various preparatory processes are performed before recording can start, such as charging the capacitor, initializing data, etc. In contrast, in this recording device, the power-on state continues even after the vehicle enters the first state, so if a recording request is made while the power-on state is maintained, recording can start in a short time.
[0011] An example of a vehicle on which a recording device is mounted is a forklift, which is a cargo handling vehicle equipped with a cargo handling claw (fork) on the body that can be raised, lowered, and tilted. Examples of forklifts on which a recording device is mounted are an electric forklift (battery forklift), an internal combustion engine forklift, and an internal combustion engine / electric forklift. In an internal combustion engine forklift, the power required for the vehicle to travel, the tilting operation of the mast, and the lifting and lowering operation of the fork is provided by the output from the internal combustion engine. The power of the battery mounted on the internal combustion engine forklift is used for a starter motor for starting the internal combustion engine, sensors, an electronic control unit for the internal combustion engine, lighting, and the like. In contrast, in an electric forklift, the power required for the vehicle to travel, the tilting operation of the mast, and the lifting and lowering operation of the fork is provided by the output power from the battery mounted on the forklift. For this reason, the capacity of the battery mounted on the electric forklift is sufficiently larger than the capacity of the battery mounted on the internal combustion engine forklift.
[0012] When the vehicle is an electric forklift, the electrical system of the vehicle includes an electronic control unit, a traveling motor, various sensors, lighting, etc. The state in which no power is supplied to the electrical system of the vehicle may include, for example, a state in which the vehicle does not travel or the forks do not rise or fall even when the control lever is operated. The state in which power is supplied to the electrical system of the vehicle may include a state in which the vehicle can travel and the forks can be raised or lowered by operating the control lever.
[0013] When the vehicle is an internal combustion engine forklift, the vehicle's electrical system includes an electronic control unit, a starter motor, various sensors, lighting fixtures, etc. The state in which power is not supplied to the vehicle's electrical system may include, for example, a state in which the vehicle does not travel or the forks do not rise or fall even when the control lever is operated, and a state in which the engine does not start. The state in which power is supplied to the vehicle's electrical system may include a state in which the starter motor can be operated by operating a start key to start the engine. With the engine started, the vehicle can travel and the forks can be raised or lowered by operating the control lever. The state in which power is supplied to the vehicle's electrical system corresponds, for example, to a state in which the accessory switch of a normal engine vehicle is turned on.
[0014] The state in which the vehicle is not operating may include, for example, a state in which neither the forks are being raised or lowered, nor the vehicle is traveling.
[0015] The power-on state after the recording device detects that the vehicle has entered the first state may be a state in which power is supplied from the vehicle battery and recording can be started immediately as needed. The state in which recording can be started immediately may be, for example, a state in which a process of temporarily storing video data acquired by a camera in a ring buffer is being executed, but a process of writing from the ring buffer to a non-volatile memory such as a removable recording medium is not being executed. Another state in which recording can be started immediately may be, for example, a state in which a process of reading video data from a camera is being executed, but a process of writing to the ring buffer is not being executed.
[0016] It is preferable to continue recording during the period when the power is on after the recording device detects that the vehicle has entered the first state. The driver can record the cargo confirmation work performed while the vehicle is in the first state after getting off the forklift. If an accident occurs during this confirmation work, the video captured during the confirmation work will be useful information for identifying the cause of the accident. If the vehicle on which the recording device is mounted is an electric forklift, the vehicle is equipped with a large-capacity battery. Therefore, even if the vehicle receives power directly from the battery of the vehicle during the period when the vehicle is in the first state, the impact on the power consumption of the battery mounted on the vehicle is small. Furthermore, in a workshop where an electric forklift is introduced, it is possible to charge the battery on the spot. Therefore, the process of receiving power from the battery mounted on the vehicle and continuing recording during the period when the vehicle is in the first state can be easily realized, especially in an electric forklift. Therefore, it is particularly preferable to mount the recording device on an electric forklift and receive power from the battery of the electric forklift.
[0017] (2) The vehicle may be equipped with a switching means that supplies power to an electrical system when turned on and stops the supply of power to the electrical system when turned off, and the first state may be a recording device in which the switching means of the vehicle is turned off.
[0018] Even in the first state where the switching means of the vehicle is turned off, if the power is on for a certain period of time, the delay time from the time when a request to start recording is made until the start of recording can be made shorter than during the power off state. This switching means corresponds to, for example, an accessory switch (ACC switch) of a general engine vehicle.
[0019] The recording device may have a function to start recording when it detects that the switching means of the vehicle is turned on. If the switching means is turned on while the power is on, recording can be started with a short delay. This makes it possible to shorten the period during which video data is missing.
[0020] When it is detected that the switching means has been turned off, the power should be kept on and recording should be stopped, thereby preventing the storage area for recording video data from being wasted by video data of low importance.
[0021] (3) It is preferable that the recording device be connected to a terminal that supplies power from the battery of the vehicle to an external device, regardless of whether the switching means is on or off.
[0022] The recording device can receive power from the vehicle's battery without being equipped with a large-capacity battery. A power source that can extract power from the vehicle's battery regardless of whether the switching means is on or off is generally called a +B power source. In contrast, a power source that can extract power only when the switching means is on is called an accessory power source (ACC power source). The recording device can determine whether the switching means is on or off depending on whether or not there is a supply of power from the ACC power source.
[0023] (4) The recording device may further include an acceleration sensor that detects acceleration occurring in the vehicle, and may determine whether or not the vehicle is stopped based on the measurement results of the acceleration sensor.
[0024] It is preferable to determine that the vehicle is stopped when no acceleration is occurring to the vehicle, i.e., when only gravity and normal force are acting on the vehicle. Even in such a state, by continuing to turn on the power of the recording device, recording can be started immediately when it is detected that the vehicle has received some kind of impact. This video data is useful information for identifying the cause of the impact.
[0025] (5) It is preferable that duration information specifying the time for which the power-on state continues after it is detected that the first state has been reached is stored in the recording device, and that the power is turned off after the period specified by the duration information has elapsed from the time when it is detected that the first state has been reached.
[0026] If a request to start recording is made before the period specified by the duration information has elapsed, recording can be started with a short delay. Also, after the period specified by the duration information has elapsed, power consumption can be reduced by turning off the power.
[0027] The duration information may be stored in a removable recording medium attached to the recording device, and the recording device may read the duration information from the removable recording medium.
[0028] After the recording device detects that the vehicle has entered the first state, the recording device may continue recording until the period specified by the duration information has elapsed. In particular, when the medium for recording the video data has sufficient storage capacity, it is advisable to continue recording in this manner. This makes it possible to preserve video information that is useful for analyzing the cause of an accident or abnormality that occurs after the vehicle has entered the first state.
[0029] The duration information may be specified by the amount of time that has elapsed since it was detected that the vehicle entered the first state. Until a specified period of time has elapsed since the driver turned off the main switch, the vehicle can be kept in a state in which recording can be started immediately or in which recording continues.
[0030] Alternatively, the duration information may be specified as the time to end the power-on state. For example, the end time of working hours at the workshop where the vehicle is operating (e.g., 7 p.m.) may be specified as the duration information. In this case, the recording device is maintained in a state in which it can immediately start recording or in which it continues recording during working hours. The recording device may be equipped with a clock that shows the current time. The power for this clock may be supplied from the vehicle's +B power supply or an internal battery.
[0031] The recording device should have a function to specify the start time of the period during which the power-on state will continue. The recording device should have a function to enter a power-on state at the specified start time. In this case, when the driver turns on the main switch after the specified start time, recording can start immediately with a short delay. This start time should be set to the start time of working hours at the workshop where the vehicle is operated (e.g., 8:00 a.m.).
[0032] The recording device may have a function of continuing recording from the time when the first state is detected until the first duration has elapsed, not recording until the second duration, which is longer than the first duration, elapses, maintaining the power-on state, and turning off the power when the second duration has elapsed. This makes it possible to preserve video data that is likely to contain highly important information immediately after the vehicle enters the first state. By stopping recording when the second duration has elapsed, it is possible to save storage space for video data.
[0033] It is advisable to have a function for turning off the power to the recording device during the period from the end time specified as the duration information to the start time of the next day. In this case, it is also advisable to keep the current time clock running.
[0034] (6) It is preferable that the power consumption during the period in which the power remains on after it is detected that the recording device has entered the first state is less than the power consumption during recording.
[0035] It is possible to reduce power consumption during the period when the power is turned on. For example, power consumption can be reduced by having a function that executes a process of reading video data from a camera but does not execute a process of writing to a ring buffer. Alternatively, power consumption can be reduced by having a function that executes a process of reading video data from a camera and a process of writing to a ring buffer but does not execute a process of recording video data to a non-volatile memory such as a removable recording medium.
[0036] (7) Furthermore, it is preferable that the recording device has a function of detecting whether or not the driver of the vehicle is seated in the driver's seat, records while the driver is seated in the driver's seat, stops recording when it detects that the driver is not seated, and continues to remain powered on.
[0037] When it is detected that the driver is not seated, the recording is stopped, but since the power remains on, when a request to start recording is made, recording can be started with a short delay. Whether the driver is seated or not can be determined by analyzing an image captured by a camera that photographs the driver's seat.
[0038] When stopping recording due to the detection that the driver is not seated, the recording device should have a function of continuing recording for a certain period from the time when it detects that the driver is not seated and stopping recording when the certain period has passed. In this way, the recorded images can be used to investigate the cause of accidents or abnormalities that occur within the certain period after the driver leaves the driver's seat.
[0039] The recording device may have a function of continuing recording until a certain time has elapsed since it was detected that the driver is not seated, and stopping recording at the time when the certain time has elapsed. Alternatively, the recording device may have a function of stopping recording when the distance from the vehicle to the driver exceeds a judgment threshold. The recording device may have a function of resuming recording or continuing recording when it detects that the driver is seated.
[0040] The recording device may include a camera that captures the surroundings of the vehicle. This camera may be a hemispherical camera that is mounted facing downward. If the vehicle is a forklift, the angle of view of this camera may include the range in which the work of checking whether the cargo is properly loaded during loading and unloading work is performed. In addition, a camera that captures the rear of the vehicle may be provided. This makes it possible to determine whether the driver or other people are present behind the vehicle.
[0041] The criteria for determining whether to continue the power-on state may include the distance from the vehicle to the driver. Alternatively, the criteria may include whether a person is detected near the vehicle. The recording device may have a function to continue recording when the driver or another person is detected near the vehicle. The video data acquired at this time is useful information for investigating the cause of an accident if an accident occurs to a person near the vehicle. As a criterion for determining whether a person is near the vehicle, a determination threshold value for the distance from the vehicle to a person may be stored in the recording device.
[0042] (8) The vehicle is used in a work area where multiple reference marks are installed; It is preferable that the recording device further has a function of analyzing an image in which the reference mark is captured to determine the speed of the vehicle.
[0043] Since the vehicle speed is calculated from the information acquired by the recording device, the vehicle speed can be calculated without installing a dedicated sensor for detecting the vehicle speed. In order to calculate the vehicle speed, a reference mark is photographed by a stereo camera, the distance from the obtained image to the reference mark is measured, and the vehicle speed is calculated from the change in distance over time. It is determined whether a common reference mark is captured in the images captured by the two cameras mounted on the vehicle, and if the common reference mark is captured, the distance is calculated from the two images captured by the two cameras. For example, the two cameras may be a semi-spherical camera installed in front of the driver's seat and a wide-angle camera that captures the area behind the driver's seat.
[0044] The distance to the reference mark can be calculated from the size of the image of the reference mark, whose size is known. The vehicle speed can be calculated from the change in this distance over time. As a reference mark, a shape whose reference length does not change regardless of the direction from which it is viewed, such as a circle or a sphere, can be used as long as the distance is constant. Lighting fixtures attached to the ceiling of a warehouse can be used as a reference mark. Multiple lighting fixtures can be installed at equal intervals, and the interval between the lighting fixtures can be used as the reference length.
[0045] In addition, the vehicle's position can be obtained using a GPS receiver installed in the vehicle, and the vehicle speed can be obtained from the change in this position over time. To obtain the vehicle speed, a Doppler sensor can be installed in the vehicle. Alternatively, a sensor that detects the rotation speed of the tires can be installed. A distance measuring device that uses light, called LIDAR, can be installed in the vehicle. When LIDAR is installed in the vehicle, a map of the work area in which the vehicle operates can be created by scanning with a laser light for distance measurement.
[0046] (9) Furthermore, the recording device may have a function of photographing the floor or ground around the vehicle, detecting the optical flow of the photographed floor or ground, and calculating the speed of the vehicle based on the detection result.
[0047] The relative speed of the vehicle with respect to the floor or ground can be obtained. Not only the translational movement of the vehicle, but also the rotational speed of the rotational movement can be calculated. For example, if the distance from the camera to the floor is known and the optical flow (the number of pixels moved in a certain time) of the feature points of the floor is known, the relative speed of the camera with respect to the floor can be obtained. It is a good idea to arrange reference marks in a row and use the reference marks as feature points of the optical flow.
[0048] In particular, it is advisable to install a camera (e.g., a wide-angle camera) that shoots downward from the ceiling side of the forklift and shoots the forklift body, the driver, and the floor or ground around the body. When the forklift moves relative to the floor or ground, the direction and speed of movement can be obtained from the optical flow of the texture of the floor or ground around the forklift (patterns of asphalt or concrete, pebbles, tape, cardboard placed nearby, etc.).
[0049] A forklift can only rotate while remaining in the same place, without translational movement. For example, when a forklift rotates, an arc-shaped optical flow is obtained with the axis of rotation as the center. The camera should be installed so that the center of rotation during this rotation coincides with the center of the camera image. If the center of the camera image does not coincide with the center of rotation, it is recommended to provide a function for substantially matching the image center with the center of rotation by performing calibration. When a hemispherical camera is used as the camera, it is also recommended to install the camera in a similar manner. By installing the camera in this manner, the rotation of the forklift can be easily detected.
[0050] If the aspect ratio of the camera image is not 1:1, for example when using a general camera with a rectangular shooting area, it is advisable to install the camera so that the front-to-back direction of the forklift corresponds to the lengthwise direction (long side direction) of the shooting area, and the left-to-right direction corresponds to the widthwise direction (short side direction) of the shooting area.
[0051] For example, when turning left while moving forward, the velocity vector on the right side of the forklift is greater than the velocity vector on the left side. It is recommended that the video data viewer has a function to display the optical flow itself with an arrow or the like, and to display the speed of each part of the vehicle, such as the left side and right side, as a numerical value.
[0052] The optical flow of feature points on the floor or ground, objects placed on the floor or ground, etc., is opposite to the direction of movement of the forklift. For example, the optical flow may be displayed as an arrow or the like that allows distinction between the start point and the end point, and the start point and the end point may be in the opposite direction to the optical flow. When displayed in this manner, the movement direction of the forklift can be intuitively grasped by looking at the arrow or the like displayed on the display screen. In particular, it is preferable to display the position where the sides of the outer shape of the forklift body in a planar view intersect with each other as the start point of the arrow. For example, when the outer shape of the forklift body is displayed as an approximately rectangular shape, it is preferable to set the four vertices of the rectangle as the start points of the arrow.
[0053] Since people, handles, operating levers, etc. are also captured in the range where the inside of the forklift is captured, the viewer should have a function to detect the optical flow of the person's movement. The viewer should have a function to recognize the movement of people, etc., separately from the optical flow of the forklift itself. For example, it is preferable to distinguish and recognize the arrows indicating the movement of the person from the arrows indicating the movement of the forklift. For example, it is preferable to represent the movement of the person with a green arrow and the movement of the forklift with a blue arrow. The optical flow of the person's movement can be used, for example, to determine whether the operation is normal, whether the person is pointing and taking a roll call by turning his or her head, etc.
[0054] It is advisable for the recording device to have the functionality to synthesize the optical flow and calculate the average speed of the forklift.
[0055] If there are moving objects such as people or automated guided vehicles (AGVs) around the forklift, optical flow will occur partially in the video. It is preferable to have a function to exclude such partially occurring optical flow from the target for speed calculation. In other words, it is preferable to calculate the vehicle speed by assuming that optical flow that occurs only in a part of the periphery of the forklift is not generated by the movement of the forklift.
[0056] When playing back a video in a viewer, it is preferable to display optical flows that occur only in a certain area separately from optical flows due to the movement of a forklift. For example, it is preferable to display arrows indicating optical flows that occur only in a certain area and arrows indicating optical flows due to the movement of a forklift in different colors. In this way, it is possible to easily recognize the movement of a person moving near the forklift. For example, it is preferable to have a function to display the movement of the forklift with a blue arrow and the optical flows that occur only in a part of the image around the forklift with a red arrow as the movement of a person moving around the forklift.
[0057] The video viewer may be realized by a personal computer application program (PC app), a smartphone application program (smartphone app), or the like. Alternatively, a display device may be provided on a recording device mounted on the forklift, and the recording device may have a viewer function. Furthermore, a function may be provided that uses optical flow to issue an alarm for abnormalities in the movement of the forklift, abnormalities in the operation or driver, or the presence of people around the forklift that are dangerous. Abnormalities in the movement of the forklift may be detected by, for example, whether the magnitude of the translation speed or rotation speed calculated from the optical flow corresponding to the movement of the forklift is abnormal. Abnormalities in the operation or driver may be detected by, for example, judging whether the driver is following driving rules such as pointing and calling the roll call.
[0058] The area surrounding the forklift can be divided into a nearby area (first area) where people, etc. do not enter during normal operation, and a slightly more distant area (an area of the surrounding area farther than the first area) where people, etc. may enter, and the optical flow within the first area can be used as the optical flow that serves as the basis for calculating the forklift's moving speed.
[0059] (10) The vehicle is a forklift equipped with a mast with a variable inclination angle and forks that move up and down along the mast, It is preferable that the recording device be equipped with a marker camera attached to capture images of multiple markers on the mast, and further have a function of analyzing images containing the multiple markers to determine the inclination angle of the mast.
[0060] If the forks are not horizontal when transferring a load, it may lead to an accident such as the load falling off. The position of the forks can be changed by changing the inclination angle of the mast to which the forks are attached so that they can be raised and lowered. In this recording device, it is possible to determine whether the position of the forks is normal or not by determining the inclination angle of the mast. By attaching multiple markers to the mast and detecting the positions of the markers in the image, it is possible to easily obtain information regarding the inclination angle of the mast. The driver can safely transfer the load by confirming that the inclination angle of the mast with respect to the horizontal plane is a right angle, i.e., that the forks are horizontal. Since the camera is attached to the vehicle body and not to movable parts such as the mast or the forks, damage to the camera during operation can be suppressed.
[0061] It is recommended that the recording device has a function to obtain the lifting speed of the forks from the optical flow of the markers attached to the forks by attaching markers to the forks. The marker camera should be installed in a position where it can capture the mast from the side. For example, the marker camera that captures the left mast should be attached to a support pillar on the right side of the vehicle body.
[0062] (11) A main unit including an electronic circuit board, a housing that houses the electronic circuit board, and a lid that closes an opening of the housing; A camera and a first cable that electrically connects the camera and the main unit; It is preferable that the recording device has the above-mentioned features.
[0063] The main unit can be attached in a location different from that of the camera, and conversely, the camera can be attached in a desired location depending on the range to be photographed, without being restricted by the location of the main unit.
[0064] (12) The housing is provided with an opening for a media, The main unit includes: a media mounting section for mounting a removable recording medium through the media opening; a waterproof cover having a waterproof structure for closing the media opening; a security cover having a structure that covers the media opening on the outside of the waterproof cover and can be opened and closed using a corresponding specific tool; It is preferable that the recording device has the above-mentioned features.
[0065] This provides the excellent effect of ensuring waterproofing of the media opening and reducing the vulnerability of the removable recording medium to theft. For example, an SD card may be used as the removable recording medium. The "specific tool" refers to a tool other than a general Phillips screwdriver or flathead screwdriver. For example, the security cover may be fixed with a Torx screw, and a Torx screwdriver may be used as the specific tool.
[0066] The waterproof lid may be a packing made of an elastic material such as rubber. For example, a circumferential groove may be formed on the inner peripheral surface of the media opening, and the waterproof lid may be attached by fitting the outer peripheral portion of the waterproof lid into this groove.
[0067] It is preferable to provide a long hole in the security cover, pass a special screw such as a Torx screw through the long hole, and slide the security cover in the longitudinal direction of the long hole to close the media opening, and then tighten the security cover to fix it to the housing. It is preferable to configure the security cover so that the security cover can be freely rotated around the special screw by loosening the special screw and sliding the security cover. With the security cover rotated to open the media opening, it becomes possible to insert and remove a removable recording medium. Since the media opening can be opened simply by loosening the special screw, it is possible to prevent the security cover from falling off.
[0068] It is preferable that the user can decide whether or not to attach the security cover. When using the recording device in an environment where security is not a consideration, the user can select not to use the security cover.
[0069] The security cover may be a flat plate bent into an L-shape. The flat plate portion on one side of the bend may cover the media opening, and the other flat plate portion may be fixed by screwing to a surface of the housing perpendicular to the surface of the housing on which the media opening is provided. Depending on the location where the main unit is attached to the forklift, it may be difficult to access the surface on which the media opening is provided. In such a case, the security cover can be easily fixed by accessing the surface perpendicular to the surface on which the media opening is provided.
[0070] When the waterproof lid is attached to the media opening, the waterproof lid may be provided with a convex handle that protrudes outward from the opening surface of the media opening. An opening may be provided in the security lid, and the handle may protrude outward through the opening in the security lid. The waterproof lid and the security lid may be configured so that they are not easily separated due to the elasticity of the waterproof lid. Even when the screws that secure the security lid are removed, the security lid is supported by the housing via the waterproof lid, so that the security lid can be prevented from falling off.
[0071] The removable recording medium should be inserted into the housing to a depth that allows it to be pushed in with the pad of a thumb. For example, when the removable recording medium is inserted into the media opening, it should protrude about 0.4 mm from the opening surface of the media opening, and the removable recording medium should be pushed in with the pad of a thumb to complete the installation.
[0072] (13) The recording device may be such that a driven part driven by the electronic circuit board is attached to the lid, a second cable electrically connects the electronic circuit board and the driven part, and a string connects the housing and the lid, and the second cable is maintained in a slack state when the lid is moved away from the housing until the string becomes taut.
[0073] Even if the lid is removed and moved away from the housing, the second cable is not subjected to a large tension, so damage such as breakage of the second cable can be suppressed. The driven part is, for example, a speaker. When there is no room to attach a speaker to the housing, it is good to attach the speaker to the lid. In addition, the housing is generally attached to the vehicle body with the lid facing a large space so that the lid can be easily removed. When the speaker is attached to the lid, the speaker faces a large space, ensuring good sound radiation characteristics.
[0074] It is advisable to provide a cable clamp on the cover, fix one end of a relatively thick cable with this clamp, connect the other end to the case, and connect the speaker and the thick cable with a relatively thin cable. If the thick cable has sufficient mechanical strength, the string may be omitted. In this case, the thick cable electrically connects the speaker to the circuit on the case, and also prevents the cover from falling off.
[0075] (14) The main unit may include a partition member separating a space for accommodating the electronic circuit board from a space for accommodating a battery that serves as a power source for a clock provided on the electronic circuit board, the electronic circuit board being equipped with a battery connector connected to the battery, and the recording device may be configured such that, when the lid is open, the electronic circuit board is positioned at the rear side of the partition member and the space for accommodating the battery is positioned at the front side of the partition member.
[0076] The battery can be easily replaced while keeping the electronic circuit board in a difficult-to-access state. Usually, the electronic circuit board is kept in a state where it is not easily accessible to the user. For this reason, if the battery is fixed directly to the electronic circuit board, the user cannot replace the battery. When the battery runs out and needs to be replaced, it is necessary to contact the maintenance personnel of the device or to take the main unit to the device maintenance department. In this recording device, the user can replace the battery by himself while keeping the electronic circuit board in a difficult-to-access state. This improves convenience for the user.
[0077] For example, even if a user opens a lid that covers the opening of the housing, the partition member may prevent the user from seeing any part of the electronic circuit board other than the battery connector.
[0078] A recess for accommodating the battery may be provided in the partition member, and the battery may be accommodated in the recess. A structure in which a plurality of electronic circuit boards are stacked may be adopted, with relatively tall components mounted on the lower boards, and only relatively short components mounted on the top board. With such a configuration, an arrangement may be adopted that reduces the difference in height between the bottom of the battery recess and the surface of the top board on which the battery connector is mounted. By adopting this arrangement, the effect is obtained that the user can easily access the battery connector, compared to an arrangement in which the battery connector is provided at a deep position.
[0079] It is also advisable to mount the fuse on the electronic circuit board and adopt a structure that allows the user to access the fuse mounting area, for example by drilling a hole in the inner case of the fuse mounting area and allowing the user to replace the fuse using a tool with a fine tip, such as needle-nose pliers.
[0080] (15) The housing is provided with an opening for a cable and a spare hole having a waterproof structure, A plurality of connectors for connecting to cables are provided in the housing, The tube is attached to the housing so that the inside and outside spaces of the housing are connected through the cable opening and the internal space of the tube, the attachment point of the tube is made waterproof, and a cable connected to some of the connectors is pulled out from inside the housing to the outside through the cable opening and the internal space of the tube.
[0081] A cable can be inserted into the housing through the cable opening and the space inside the tube, and then connected to the connector. The number of cables to be connected varies depending on whether or not various optional functions of the recording device are used. If the number of cables to be connected increases, the cables can be pulled out through the spare hole. Pulling out the cables from two places on the housing has the effect of making it easier to route the cables inside the housing. Since the spare hole is waterproof, the waterproofing of the housing can be maintained even when the cables are not pulled out through the spare hole.
[0082] The spare hole may be a waterproof knock hole. Alternatively, the spare hole may be an opening and a waterproof packing that closes the opening. When a high-strength material is used for the housing in which it is difficult to form a knock hole, it is effective to form the spare hole by using an opening and a packing.
[0083] The tube is preferably made of an elastic material such as silicone. By tightening the tube with a tightening string, tie wrap, or the like while the cable is passed through it, it is possible to prevent water from entering the housing. If the cross-sectional area of the tube is large, it becomes difficult to prevent water from entering. If the cable is pulled out from the housing in two places and two tubes are arranged, the cross-section of each tube can be made small. Therefore, even if the number of cables is increased, it is not difficult to prevent water from entering.
[0084] If there are only a few cables, it is better to leave the spare holes covered and not open, which will maintain sufficient waterproofing.
[0085] It is a good idea to separate the wireless LAN module from the main unit and connect the main unit and wireless LAN module with a cable. If the wireless LAN module is placed in the main unit, the main unit and wireless LAN antenna must be connected with an antenna cable. Making the antenna cable thinner increases attenuation, and in order to suppress the attenuation, a more expensive antenna cable must be used. The main unit and LAN module can be connected with a cheaper USB cable than an antenna cable, which allows costs to be reduced.
[0086] It is advisable to indicate the name of the cable to be connected to each of the multiple connectors in the housing near the connectors. For example, it is advisable to attach a sticker with the name near the connector. This allows the user to easily identify the connector to which the cable should be connected.
[0087] (16) It is preferable that the camera be a recording device provided with both a clamping mechanism for clamping the first cable and a hole for fixing the first cable with a tie wrap.
[0088] The thickness of the first cable that connects the camera and main unit varies depending on the model of forklift it is installed on. If a thin cable is used as the first cable, it is recommended to clamp the first cable with the clamp mechanism. If the first cable is too thick to be clamped with the clamp mechanism, it is recommended to fix the first cable with a tie wrap in the tie wrap hole.
[0089] The clamp mechanism may be formed of resin that is integrally molded with the housing, and may be configured to clamp the first cable by elastically deforming the resin. When the first cable is fixed using a tie wrap, the resin clamp mechanism may be cut out and removed from the housing.
[0090] (17) A function for acquiring multiple video files of videos taken by multiple cameras mounted on a vehicle; A function for specifying the start and end points at which a video should be cut out; A function to extract videos from multiple video files from a specified start point to an end point, and to generate and save a single video file that can be viewed simultaneously by synchronizing the extracted videos on the time axis. It is preferable that the vehicle information processing device is provided with the above.
[0091] By simply playing one video file, the user can view content substantially similar to that of playing multiple video files without having to perform the complicated procedure of playing multiple video files in a synchronized manner. The vehicle information processing device should have a function for specifying the start and end points at which the video should be cut out while playing one of the multiple video files. This makes it easy to set the start and end points of the single video file to be generated. For example, a single video file made up of multiple video files is convenient for use in education by bringing it into an educational setting.
[0092] The multiple video files and the combined single video file may be, for example, an avi file. These video files may be video-based compressed files. The video of the combined single video file may be a single screen in which the videos of the multiple video files are arranged. For example, the video may be in a picture-in-picture format, a side-by-side format, a matrix format, or the like.
[0093] Since multiple video files are created during recording, you can freely decide how to combine them into a single video file. For example, you can display particularly important footage large on the screen, and less important footage small. You can decide which video file contains the most important footage when you create a single video file.
[0094] (18) A function to specify a region within a video file consisting of a circular image taken with a 360-degree camera; and The function to extract the specified area and generate a video file consisting of a rectangular image. The vehicle information processing device may further include:
[0095] A video file consisting of rectangular images can be played using a general video playback program. It is preferable to have a function for specifying an area to be expanded into a normal rectangular image while playing a video captured by a 360-degree camera using a program capable of playing the video. For example, it is preferable to have a function for specifying an area currently displayed on the screen as an area to be expanded into a rectangular image while playing a video file captured by a 360-degree camera. It is preferable to have a function for saving a video file consisting of rectangular images as an avi file.
[0096] If a vehicle is equipped with multiple cameras, one of which is a 360-degree camera, it is preferable for the vehicle to have a function for generating a single video file using the function (17) above, based on a video file consisting of a rectangular image generated by expanding a portion of the image in the video file captured by the 360-degree camera and video files captured by the other cameras.
[0097] (19) creating a map of a work site where the vehicle is operating based on information acquired from the work site; A function of detecting that a situation equivalent to a near-miss incident has occurred with respect to a vehicle operating in the workplace; A function for creating a near-miss map that associates the map with the location where the near-miss case occurred; The vehicle information processing device may further include:
[0098] Near-miss maps provide useful information for reducing accidents in the workplace. For example, LIDAR can be used to create the map. The occurrence of situations that correspond to near-miss cases can be detected from the measurement results of acceleration sensors, gyro sensors, etc. mounted on vehicles. In addition, the occurrence of situations that correspond to near-miss cases can be detected by image analysis of video information acquired by a camera mounted on a vehicle.
[0099] The location information of the location where the near-miss incident occurred can be obtained, for example, from a GPS receiver installed in the vehicle. The location on the near-miss map can be associated with latitude and longitude information.
[0100] (20) A function of acquiring, from a vehicle equipped with a switching means that supplies power to an electric system by turning on the switching means and stops the supply of power to the electric system by turning off the switching means, information on the time during which the switching means is turned on; It is preferable that the vehicle information processing device further comprises a function of issuing an alarm based on an accumulated time for which the switching means is turned on.
[0101] If the vehicle is an electric forklift, the remaining life of the vehicle battery can be predicted from the accumulated time that the switching means is turned on. The user can predict the time to replace the vehicle battery from the alarm that is issued. In addition, the user can obtain the excellent effect of being able to collectively manage a plurality of electric forklifts to be managed by one vehicle information collection device.
[0102] The time information when the switching means is turned on may be acquired from the in-vehicle device via a removable recording medium (e.g., an SD card). The in-vehicle device may have a function of recording the time when the switching means is turned on and off, and vehicle identification information (vehicle ID) on the removable recording medium. In addition, the in-vehicle device and the vehicle information processing device may have a data communication function via a wireless LAN, and the vehicle information processing device may acquire the time information when the switching means is turned on from the in-vehicle device via the wireless LAN.
[0103] The alarm may be issued, for example, when the accumulated time exceeds a predetermined percentage (50%, 80%, 90%, etc.) of the operating life of the vehicle battery, or may be issued every time a certain period of time, for example, 1000 hours, has elapsed.
[0104] (21) A function for acquiring vehicle information from multiple types of vehicles; A function to display different vehicle information on the display device depending on the type of vehicle. The vehicle information processing device may further include:
[0105] It is possible to collect information from different types of vehicles such as automobiles and forklifts in a common vehicle information processing device, and display information appropriate to the type of vehicle. For example, for automobiles, it is advisable to display GPS information (date and time information, location information, speed information, etc.), acceleration information acquired by an acceleration sensor, blinker operation information, speed pulse information, etc. For forklifts, it is advisable to display GPS information, acceleration information acquired by an acceleration sensor, angular velocity information acquired by a gyro sensor, etc.
[0106] The vehicle type may be recorded in a removable recording medium by the in-vehicle device, and read out by the vehicle information processing device from the removable recording medium.
[0107] (22) The vehicle information processing device may further include a function of reading the version of firmware from a removable recording medium that is attached to an on-board device installed in a vehicle and records the version of the firmware of the on-board device, and if a newer version of firmware exists, storing the newer version of firmware in the removable recording medium.
[0108] A user can obtain a new version of firmware for an in-vehicle device without judging whether a new version of the firmware has been released. The in-vehicle device should have a function of reading the version of firmware stored in a removable recording medium attached thereto, and if a newer version of firmware than the current firmware version is stored in the removable recording medium, reading the firmware from the removable recording medium and updating the firmware. When the in-vehicle device has this function, it is possible to obtain an effect that the user can always operate the in-vehicle device with a new version of firmware without having to take the trouble of updating firmware. The in-vehicle device should have a function of erasing the firmware from the removable recording medium after reading the firmware from the removable recording medium.
[0109] The in-vehicle device may have a function not to update the firmware when a removable recording medium in which firmware compatible with a different model is written is installed, and may have a function to update the firmware even when a removable recording medium that was installed in an in-vehicle device of a different vehicle is newly installed, as long as the model of the in-vehicle device is the same.
[0110] It is preferable to provide a program that causes a computer to execute the functions of the vehicle information processing device described in (17) to (22) above.
[0111] The inventions shown in (1) to (22) above are intended to be acquired as independent configurations. In particular, the invention in (11) should be configured without other configurations such as (1). The inventions in (1) to (22) can be arbitrarily combined. For example, the invention in (1) may be configured by adding at least a part of the configuration of at least one of the inventions in (2) to (16). In particular, the invention in (1) may be configured by adding at least a part of the configuration of at least one of the inventions in (2) to (16). In addition, the invention in (11) may be configured by including a configuration described in another section. In addition, the invention in (17) may be configured by adding at least a part of the configuration of at least one of the inventions in (18) to (22). In particular, the invention in (17) may be configured by adding at least a part of the configuration of at least one of the inventions in (18) to (22). In addition, any configuration may be extracted from the inventions shown in (1) to (22) and the extracted configurations may be combined. The applicant of this application intends to obtain rights to the inventions including these configurations. Effect of the Invention
[0112] Since the power remains on even after the vehicle enters the first state, if the recording device is turned on when power supply to the vehicle's electrical system begins or when the vehicle starts operating, the time that elapses before recording starts will be long because various preparatory processes must be performed before recording can begin, such as charging the capacitor, initializing data, etc. In contrast, with this recording device, if a recording request is made while the power remains on, recording can begin in a short time.
[0113] The effects of the invention of this application are not limited to this, and effects obtained from the configuration disclosed in the specification and drawings, etc. are also disclosed, and the intention is to obtain rights to the configuration that achieves the effects by divisional applications, amendments, etc. For example, in this specification, the phrase "can" is a description that clearly indicates the effect that is achieved, and there are also parts that show the effect even without the phrase "can." Also, there are effects that can be understood from the configuration even without such a description. [Brief description of the drawings]
[0114] [Figure 1] FIG. 1A is a schematic side view of an electric forklift, which is an example of a vehicle equipped with a recording device according to a first embodiment, and FIG. 1B is a block diagram of the recording device according to the first embodiment. [Diagram 2] 2A to 2C are a top view, a front view, and a bottom view, respectively, of the recorder according to the first embodiment when a relatively thick cable is connected to the camera. [Diagram 3] 3A to 3D are respectively a left side view, a front view, a right side view, and a back view of the recorder according to the first embodiment when a relatively thick cable is connected to the camera. [Figure 4] 4A to 4C are a top view, a front view, and a bottom view, respectively, of the recorder according to the first embodiment in which a relatively thin cable is connected to the camera. [Diagram 5] 5A to 5D are respectively a left side view, a front view, a right side view, and a back view of the recorder according to the first embodiment when a relatively thin cable is connected to the camera. [Figure 6] 6A to 6F are a top view, a left side view, a front view, a right side view, a bottom view, and a rear view, respectively, of the GPS receiver of the recording device according to the first embodiment. [Figure 7] 7A to 7E are respectively a top view, a left side view, a front view, a right side view, a bottom view, and a rear view of the main unit of the recorder according to the first embodiment. [Figure 8]FIG. 8 is a front view of the main unit with the lid (FIG. 7C) removed. [Figure 9] FIG. 9A is a perspective view of the main unit with the lid (FIG. 7C) removed, and FIG. 9B is a perspective view of the main unit with a cable connected to the connector of the main unit and the lid (FIG. 7C) removed. [Figure 10] 10A and 10B are perspective views showing the main unit with the media opening closed and open. [Figure 11] 11A and 11B are perspective views of a modified main unit with its media opening closed. [Figure 12] FIG. 12 is a perspective view of the main unit with the cover removed from the housing. [Figure 13] FIG. 13A is a perspective view of a connection portion between the housing and the string, and FIG. 13B is a perspective view of a connection portion between the lid and the string. [Figure 14] FIG. 14A is a front view of the reference mark installed in the work area, and FIG. 14B is a plan view of the work area. [Figure 15] FIG. 15 is a schematic diagram showing an example of an image captured by a camera. [Figure 16] FIG. 16A is a schematic side view of a forklift, and FIG. 16B is a diagram showing the relative positional relationship between a marker and a marker camera. [Figure 17] FIG. 17 is a block diagram of a vehicle information processing device according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0115] [First Example] A recording apparatus according to a first embodiment will be described with reference to FIGS. 1A to 12. 1A is a schematic side view of an electric forklift, which is an example of a vehicle equipped with a recording device according to the first embodiment. A mast 21 is attached to the front of the body of the forklift 20, and forks 22 are raised and lowered along the mast 21 by operation of the driver. In addition, the mast 21 tilts forward and backward by operation of the driver.
[0116] The forklift 20 is provided with a steering wheel 25, a main switch 26, an operating lever 27, and pedals 28. The recording device mounted on the forklift includes a main unit 41, a camera 42, a GPS receiver 43, an acceleration sensor 44, a gyro sensor 45, and a wireless LAN module 46. The main unit 41 and the camera 42 are attached to, for example, the head guard 23 of the forklift 20. The GPS receiver 43, the acceleration sensor 44, the gyro sensor 45, and the wireless LAN module 46 are attached to, for example, the support pillar 24 of the head guard 23.
[0117] 1B is a block diagram of the recording device 40 according to the first embodiment. The main unit 41 includes a processing unit 61, a storage unit 62, an SD card reader 63, and a speaker 64. The storage unit 62 stores computer programs that enable the processing unit 61 to realize various functions. The processing unit 61 includes a microcomputer, and realizes various functions by executing the programs stored in the storage unit 62.
[0118] When the main switch 26 of the forklift 20 is turned on, power is supplied to the electrical system of the forklift 20, such as the electronic control unit, the travel motor, various sensors, lighting fixtures, etc. When power is supplied to the electrical system of the vehicle, the driver can operate the control lever 27 and pedals 28 to travel and raise and lower the forks 22. In addition, DC power is supplied from the switch-linked power terminal 30 to the recording device 40.
[0119] Conversely, when the main switch 26 is turned off, no power is supplied to the electrical system of the forklift 20, and for example, the forklift will not travel or the forks 22 will not be raised or lowered even if the control lever 27 or pedal 28 is operated. No DC power is supplied from the switch-linked power supply terminal 30 to the recording device 40. Note that DC power is constantly supplied from the battery of the forklift 20 to the recording device 40 from the +B terminal 29, regardless of whether the main switch 26 is on or off.
[0120] The processing unit 61 has a function of constantly recording the video captured by the camera 42 on an SD card attached to the SD card reader 63. Furthermore, when it is determined that some kind of impact has been applied to the forklift 20 (an event has occurred) based on the measurement results of the acceleration sensor 44 and the gyro sensor 45, it has a function of recording the video for a predetermined period including the time when the impact was applied separately from the constant recording.
[0121] The processing unit 61 further has an internal real-time clock, and corrects the time of the real-time clock based on the current time information obtained from the GPS receiver 43. It also has a function of recording the current location information obtained from the GPS receiver 43 together with the video onto an SD card. The wireless LAN module 46 performs data communication with the server of the management center via wireless LAN.
[0122] The processing unit 61 detects that the main switch 26 has been turned off and the power supply from the switch-linked power supply terminal 30 has stopped. Even after it is detected that the power supply from the switch-linked power supply terminal 30 has stopped, the recording device 40 continues to receive power from the +B terminal 29 and remains powered on until a predetermined time has elapsed. This predetermined time is specified by the duration information stored in the SD card.
[0123] In the power-on state after main switch 26 is turned off, processing unit 61 reads image data from camera 42 and writes the read image data to a ring buffer in processing unit 61, but does not record (record) on the SD card. Therefore, the power consumption of recording device 40 during the period in which recording device 40 continues to be powered on after main switch 26 is turned off is less than the power consumption during recording.
[0124] When the recording device 40 detects that the main switch 26 of the forklift 20 has been turned on by the start of the supply of power from the switch-interlocking power terminal 30, the recording device 40 starts recording image data onto the SD card.
[0125] Next, the excellent effects of the first embodiment will be described. When the main switch 26 is turned off, the power of the recording device 40 is also turned off, and when the main switch 26 is turned on, the power of the recording device 40 is turned on, and when recording is started with the main switch 26 being turned on, various preparatory processes, such as charging the capacitor and initializing the data, are performed, so that the time that elapses until the start of recording becomes long. In contrast, in the first embodiment, the power of the recording device 40 continues to be on even after the main switch 26 of the forklift 20 is turned off, and image data is written to the ring buffer. Therefore, if a recording request is made during this period, for example, when the main switch 26 is turned on, recording to the SD card can be started immediately after a short time has elapsed. This makes it possible to shorten the period during which video data is missing.
[0126] In the first embodiment, since the vehicle on which the recording device 40 is mounted is an electric forklift, the forklift 20 is equipped with a large-capacity battery. Therefore, even if power is directly supplied from the battery of the forklift 20 via the +B terminal 29 while the main switch 26 is turned off, the impact on the power consumption of the battery mounted on the forklift 20 is small. Furthermore, in a workplace where an electric forklift is used, charging can be performed on the spot. Therefore, the process of receiving power from the battery mounted on the forklift 20 and continuing recording while the main switch 26 is turned off can be easily realized, particularly in an electric forklift.
[0127] In the first embodiment, the wireless LAN module 46 and the main unit 41 are connected by a USB cable. When the wireless LAN module is housed in the main unit, the main unit and the wireless LAN antenna must be connected by an antenna cable. If the antenna cable is made thin, attenuation increases, and in order to suppress the attenuation, a high-cost antenna cable must be used. In contrast, in the first embodiment, the wireless LAN module 46 is separate from the main unit 41, and the two are connected by a USB cable, which is cheaper than the antenna cable, so costs can be reduced.
[0128] Next, a modification of the first embodiment will be described with respect to the above-mentioned functions. In the first embodiment, after the main switch 26 of the forklift 20 is turned off, while the power of the recording device 40 is on, recording to the SD card is stopped, but in this modified example, recording to the SD card is continued. This makes it possible to record, for example, the operator turning off the main switch 26 and getting off the forklift 20 to check the load. If an accident occurs during this check, the video captured during the check provides useful information for identifying the cause of the accident.
[0129] In contrast, in the first embodiment, since recording is stopped when it is detected that the main switch 26 has been turned off, it is possible to prevent the memory area of the SD card from being consumed by video data of low importance when the main switch is off. Whether or not to stop recording should be determined based on the necessity of the video after the main switch 26 is turned off and the recording capacity of the SD card.
[0130] The recording device 40 according to the first embodiment has a function of keeping the power on even when the main switch 26 is turned off. In addition, the processing unit 61 may have a function of detecting that the forklift 20 has stopped operating, and may have a function of keeping the recording device 40 in a power on state even when the forklift 20 has stopped operating. The state in which the forklift 20 has stopped operating may include, for example, a state in which neither the forks 22 are being raised or lowered, nor the vehicle is traveling. The processing unit 61 may have a function of determining whether the forklift 20 has stopped operating based on the measurement result of the acceleration sensor 44.
[0131] The forklift 20 may be determined to be at a standstill when no acceleration is occurring in the forklift 20, i.e., when only gravity and normal force are acting on the vehicle. Even in such a state, by keeping the power of the recording device 40 turned on, recording can be started immediately upon detection of any impact on the forklift 20. This video data provides useful information for identifying the cause of the impact.
[0132] In the first embodiment, the recording device 40 is mounted on an electric forklift (battery forklift), but it may be mounted on an internal combustion engine forklift, an internal combustion engine / electric forklift, etc. In an internal combustion engine forklift, the power required for the vehicle's travel, the tilting operation of the mast, and the lifting and lowering operation of the forks is provided by the output from the internal combustion engine.
[0133] When the forklift 20 is an internal combustion engine forklift, the electrical system of the forklift 20 includes an electronic control unit, a starter motor, various sensors, lighting fixtures, etc. When the main switch 26 of the forklift 20 is in the OFF state, for example, the operation lever is operated, but the vehicle does not travel, the forks are not raised or lowered, and the engine is not started. When the main switch 26 is in the ON state, the starter motor can be operated by operating the start key, and the engine can be started. When the engine is started, the vehicle can travel and the forks can be raised or lowered by operating the operation lever. The ON state of the main switch 26 corresponds to, for example, the ON state of the accessory switch of a normal engine vehicle.
[0134] The power of the battery mounted on an internal combustion engine forklift is used for a starter motor for starting the internal combustion engine, sensors, an electronic control unit for the internal combustion engine, lighting, etc. When the recording device 40 is mounted on an internal combustion engine forklift, the capacity of the battery of the forklift 20 is not sufficient to continue supplying power to the recording device 40 from the battery of the forklift 20 while the internal combustion engine is stopped. For this reason, it is advisable to mount an auxiliary battery for supplying power to the recording device 40.
[0135] In contrast, in an electric forklift, the power required for the vehicle to travel, the tilting operation of the mast 21, and the raising and lowering operation of the fork 22 is provided by the output power from a battery mounted on the forklift. Therefore, the capacity of the battery mounted on an electric forklift is sufficiently larger than that of a battery mounted on an internal combustion engine forklift. Therefore, when mounting the recording device according to the first embodiment on an electric forklift, there is no need to mount an auxiliary battery other than the battery of the forklift 20.
[0136] In the first embodiment, after the main switch 26 of the forklift 20 is turned off and the recording device 40 is powered on, the video data captured by the camera 42 is temporarily stored in the ring buffer of the processing unit 61, and the process of writing the data from the ring buffer to the SD card is not performed, but it is also possible to read the video data from the camera 42 but not write the data to the ring buffer, for example. This can further reduce power consumption.
[0137] It is preferable that the recording device 40 has a function of continuing recording for a period from when the main switch 26 is turned off until a first duration has elapsed, not recording for a period until a second duration longer than the first duration has elapsed, keeping the power on, and turning off the power when the second duration has elapsed. This makes it possible to preserve video data that is likely to contain highly important information immediately after the main switch 26 is turned off. By stopping recording when the second duration has elapsed, it is possible to save storage space for video data.
[0138] In the first embodiment, the duration information is specified by the time elapsed since the main switch 26 was turned off, but the duration information may also be specified by the time to end the power-on state. For example, the end time (e.g., 7 p.m.) of working hours at the work site where the forklift 20 is operating may be specified as the duration information. In this case, during working hours, the recording device 40 is maintained in a state in which it can immediately start recording or in a state in which it continues recording. The recording device 40 may obtain current time information from a real-time clock. The power for this real-time clock may be supplied from the vehicle's +B power supply or a built-in battery.
[0139] The recording device 40 may have a function for designating the start time of the period during which the power-on state continues. The recording device 40 may have a function for entering a power-on state at the designated start time. In this case, when the driver turns on the main switch 26 after the designated start time, recording can start immediately with a short delay. This start time may be set to the start time of working hours (e.g., 8:00 a.m.) at the workshop where the vehicle is operated.
[0140] It is preferable that the recording device 40 has a function of turning off the power during the period from the end time specified as the duration information to the start time of the next day. In this case, it is also preferable that the real-time clock for the current time is kept running.
[0141] In another variation, the processing unit 61 may have a function to detect whether or not the driver of the forklift 20 is seated in the driver's seat, record while the driver is seated in the driver's seat, and stop recording when it detects that the driver is not seated, and have a function to keep the recording device 40 powered on.
[0142] When it is detected that the driver is not seated, the recording is stopped, but since the power remains on, when a request to start recording is made, recording can be started with a short delay. Whether the driver is seated or not can be determined by installing a camera that takes an image of the driver's seat and analyzing the image captured by this camera.
[0143] The recording device 40 may have a function of continuing recording until a certain time has elapsed since it was detected that the driver is not seated, and stopping recording at the time when the certain time has elapsed, or a function of stopping recording when the distance from the forklift 20 to the driver exceeds a determination threshold. The recording device 40 may have a function of resuming recording or continuing recording when it detects that the driver is seated.
[0144] The recording device 40 may include a camera that captures the surroundings of the vehicle. This camera may be a hemispherical camera that is mounted facing downward. The angle of view of this camera may include the range in which the work of checking whether the cargo is properly loaded during the loading and unloading work is performed. In addition, a camera that captures the rear of the vehicle may be provided. This makes it possible to determine whether the driver or other people are present behind the vehicle.
[0145] The criteria for determining whether or not to continue the power-on state of the recording device 40 may include the distance from the forklift 20 to the driver. Alternatively, the criteria may include whether or not a person is detected near the forklift 20. The recording device 40 may have a function for continuing recording when the driver or another person is detected near the forklift 20. The video data acquired at this time becomes useful information for investigating the cause of an accident if an accident occurs to a person near the forklift 20. As a criterion for determining whether or not a person is near the forklift 20, a determination threshold value for the distance from the forklift 20 to a person may be stored in the recording device.
[0146] [Recording device camera] Next, the camera 42 of the recording device according to the first embodiment will be described with reference to FIGS. 2A to 5D.
[0147] 2A to 2C are top, front, and bottom views of camera 42, respectively, and FIGS. 3A to 3D are left, front, right, and rear views of camera 42, respectively. FIGS. 2B and 3B are the same view. FIGS. 4A to 4C are top, front, and bottom views of camera 42, respectively, and FIGS. 5A to 5D are left, front, right, and rear views of camera 42, respectively. FIGS. 4B and 5B are the same view. Note that FIGS. 4A to 5D show a state in which a thinner cable is connected to camera 42 compared to the state shown in FIGS. 2A to 3D.
[0148] The camera 42 includes a camera case 70, a wide-angle lens 71, and an attachment member 72. The camera case 70 is provided with a clamp mechanism 73 (FIGS. 5A to 5C) and a hole 74 for a tie wrap.
[0149] The camera 42 is attached to the forklift 20 by screwing the mounting member 72 to a component part of the forklift 20. The camera case 70 is rotatable within a certain angle range around one rotation axis relative to the mounting member 72, and can be fixed at any position within the rotatable angle range.
[0150] The thickness of cable 75 connecting camera 42 and main unit 41 varies depending on the model of forklift 20 on which it is mounted. When a relatively thin cable is used as cable 75 (FIGS. 4A to 5D), cable 75 may be clamped by clamp mechanism 73. When cable 75 is too thick to be clamped by clamp mechanism 73 (FIGS. 2A to 3D), cable 75 may be fixed to tie wrap hole 74 with a tie wrap.
[0151] Clamp mechanism 73 may be formed from resin that is molded integrally with camera case 70, and may be configured to clamp cable 75 by elastically deforming the resin. When fixing cable 75 using a tie wrap, clamp mechanism 73 made of resin may be cut out and removed from camera case 70.
[0152] Because the camera 42 and the main unit 41 are connected by the cable 75, the main unit 41 can be attached to a location different from that of the camera 42. Conversely, the camera 42 can be attached to a desired location depending on the range to be photographed, without being restricted by the location of the main unit 41.
[0153] [GPS receiver in recording device] Next, the GPS receiver 43 of the recording device according to the first embodiment will be described with reference to FIGS. 6A to 6F.
[0154] 6A to 6F are respectively a top view, a left side view, a front view, a right side view, a bottom view, and a back view of GPS receiver 43. GPS receiver 43 has a cable for connecting to main unit 41 extending from one surface of a thin rectangular parallelepiped housing.
[0155] [Main unit of recording device] Next, the main unit 41 according to the first embodiment will be described with reference to FIGS. 7A to 12. FIG.
[0156] 7A to 7F are a top view, a left side view, a front view, a right side view, a bottom view, and a rear view of the main unit 41, respectively. The main unit 41 includes a housing 79 and a lid 80. In the front view (FIG. 7C), the dimension in the depth direction of the housing 79 is smaller than the dimensions in the vertical and horizontal directions, and the housing 79 is open toward the front. The depth direction of the housing 79 is referred to as the height direction. The surface facing the open portion is referred to as the bottom surface, and the surfaces rising from the bottom surface are referred to as the side surfaces. The lid 80 covers the open portion of the housing 79.
[0157] A media opening 81 for inserting an SD card is provided on one side of the housing 79 (the side shown in the top view of FIG. 7A). Two cable openings 84, 85 for pulling out cables are provided on the other side of the housing 79 (the side shown in the bottom view of FIG. 7E). Tubes 82, 83 are attached to the cable openings 84, 85, respectively. The space inside the housing 79 is connected to the internal spaces of the tubes 82, 83, respectively, via the cable openings 84, 85. The attachment points of the tubes 82, 83 to the housing 79 are waterproofed.
[0158] The cables are pulled out from inside the housing 79 to the outside through the cable openings 84, 85 and the inside of the tubes 82, 83. In the initial state, one of the cable openings 85 is a knock hole having a waterproof structure and is blocked. When there are only a few cables and the cables can be pulled out from only one cable opening 84, the other cable opening 85 which is a knock hole is not opened and remains blocked in its waterproof structure. When there are many cables and it is difficult to pull out all the cables from only one cable opening 84, the knock hole is opened and the cables are pulled out from the other cable opening 85 as well.
[0159] A hole 99 for passing sound from the speaker is provided in the lid 80. This hole 99 is covered by a waterproof speaker, so that waterproofness is maintained.
[0160] Next, the excellent effects obtained by employing the structures shown in FIGS. 7A to 7F will be described.
[0161] A cable can be inserted into the housing 79 through the cable openings 84, 85 and the internal space of the tubes 82, 83 and connected to the connector. The number of cables to be connected varies depending on whether or not various optional functions of the recording device 40 are used. When the number of cables to be connected increases, the knock holes can be opened and the cables can be pulled out. The configuration in which the cables are pulled out from two places in the housing 79 has the effect of making it easier to route the cables inside the housing 79. Since the knock holes have a waterproof structure, the waterproofness of the housing can be maintained even if the knock holes are not opened.
[0162] The tubes 82, 83 are preferably made of an elastic material such as silicone. The tubes 82, 83 can be tightened with a tightening string, a tie wrap, or the like while the cables are passed through them to prevent water from entering the housing 79. If the cross-sectional area of the tubes 82, 83 is large, it becomes difficult to prevent water from entering. If the cable is pulled out from the housing 79 at two locations and two tubes 82, 83 are arranged, the cross-sectional area of each of the tubes 82, 83 can be made small. Therefore, even if the number of cables is increased, it is not difficult to prevent water from entering. When the number of cables is small, it is preferable to leave the knock holes closed without opening them. This makes it possible to maintain a sufficient waterproof function.
[0163] Instead of using a waterproof knock hole as the spare hole, it is advisable to use an opening and a waterproof packing that covers the opening. When a high-strength material that makes it difficult to open a knock hole is used as the material for the housing 79, it is effective to use a structure in which the spare hole is made of an opening and a packing.
[0164] Fig. 8 is a front view of main unit 41 with lid 80 (Fig. 7C) removed. Fig. 9A is a perspective view of main unit 41 with lid 80 (Fig. 7C) removed, and Fig. 9B is a perspective view of main unit 41 with a cable connected to the connector of main unit 41 and with lid 80 (Fig. 7C) removed.
[0165] A partition member 86 is disposed within the housing 79. The partition member 86 separates the space within the main unit 41 into a space that houses an electronic circuit board and a space that houses a battery that serves as a power source for a clock provided on the electronic circuit board. With the lid 80 (FIG. 7C) open, the electronic circuit board is disposed on the rear side of the partition member 86, and the space that houses the battery 88 is disposed on the front side of the partition member. A battery connector 87 is mounted on the electronic circuit board. With the lid 80 (FIG. 7C) covering the open portion of the housing 79 removed, the partition member 86 prevents the user from seeing any part of the electronic circuit board other than the battery connector 87.
[0166] A recess for accommodating a battery 88 is provided in the partition member 86, and the battery 88 is accommodated in this recess. The battery 88 is connected to a battery connector 87.
[0167] The partition member 86 further divides the space within the main unit 41 into a space 89 on the side where the tubes 82, 83 are attached, and a space 90 on the opposite side. The electronic circuit board is disposed within the space 90. The partition member 86 includes a partition wall that separates one space 89 from the other space 90, and a plurality of connectors 91 are attached to this partition wall. A plurality of cables 92 are introduced into the space 89 through the spaces within the tubes 82, 83 and the cable openings 84, 85, and are connected to these connectors 91.
[0168] Next, an excellent effect obtained by adopting the structure of main unit 41 shown in Figs. 8 to 9B will be described.
[0169] By adopting the structure of the main unit 41 shown in Figs. 8 to 9B, the battery 88 can be easily replaced while maintaining the electronic circuit board in a difficult-to-access state. Usually, the electronic circuit board is maintained in a state in which the user cannot easily access it. For this reason, if the battery is directly fixed to the electronic circuit board, the user cannot replace the battery. When the battery runs out and needs to be replaced, the user must contact the maintenance personnel of the device or take the main unit to the device maintenance department. In the recording device 40 according to the first embodiment, the user can replace the battery 88 by himself while maintaining the electronic circuit board in a difficult-to-access state. This improves convenience for the user.
[0170] Next, modified examples of the structure of main unit 41 shown in Figs. 8 to 9B will be described. It is preferable to adopt a structure in which multiple electronic circuit boards are stacked, with relatively tall components mounted on the lower boards, and only relatively short components mounted on the top board. With such a configuration, it is possible to adopt an arrangement that reduces the difference in height between the bottom of the battery recess and the surface of the top board on which the battery connector 87 is mounted. By adopting this arrangement, it is possible to obtain the effect that the user can easily access the battery connector 87 compared to an arrangement in which the battery connector 87 is provided at a deep position.
[0171] It is also advisable to mount the fuse on the electronic circuit board and adopt a structure that allows the user to access the fuse mounting area, for example by drilling a hole in the inner case of the fuse mounting area and allowing the user to replace the fuse using a tool with a fine tip, such as needle-nose pliers.
[0172] The names of the cables 92 to be connected to each of the connectors 91 in the housing 79 may be written near the connectors 91. For example, a sticker with the name written on it may be attached near the connector 91. This allows the user to easily identify the connector 91 to which the cable 92 should be connected.
[0173] [Media opening of the main unit of the recording device] Next, the media opening 81 of the main unit 41 according to the first embodiment will be described with reference to FIGS. 10A and 10B.
[0174] 10A and 10B are perspective views of the media opening 81 in a closed state and an open state. A media mounting section for mounting an SD card through the media opening 81 is provided on the electronic circuit board. The media opening 81 is doubly covered by a waterproof cover with a waterproof structure and a security cover 93 that covers the media opening on the outside of the waterproof cover. A Torx screw 94 is inserted into a screw hole in the housing 79 through an elongated hole provided in the security cover 93.
[0175] When the Torx screw 94 is loosened, the security cover 93 can be slid along the side of the housing 79 in the longitudinal direction of the long hole and can be rotated around the Torx screw 94. When the security cover 93 is fitted into a stopper 95 provided on the housing 79 and the Torx screw 94 is tightened, the security cover 93 is fixed to the housing 79. When the Torx screw 94 is loosened and the security cover 93 is slid and pulled away from the stopper 95, the security cover 93 can be rotated. When the security cover 93 is rotated, the media opening 81 is exposed.
[0176] The waterproof lid is a packing made of an elastic material such as rubber. A circumferential groove is formed on the inner surface of the media opening 81, and the waterproof lid is attached by fitting the outer periphery of the waterproof lid into this groove. The security cover 93 is rotated to open the media opening 81, and the waterproof lid is removed, allowing the insertion and removal of an SD card.
[0177] Next, the excellent effects obtained by adopting the structure shown in FIGS. 10A and 10B will be described.
[0178] A Torx screwdriver is required to open the security cover 93; it is not possible to open the security cover 93 with a general Phillips or flat head screwdriver. This provides the excellent effect of making the SD card less susceptible to theft. The media opening 81 can be opened simply by loosening the Torx screw 94, preventing the security cover 93 from falling off. Furthermore, the waterproof cover ensures that the media opening 81 is waterproof.
[0179] It is preferable that the user can decide whether or not to attach the security cover 93. When using the recording device 40 in an environment where security is not a consideration, the user can choose not to use the security cover 93.
[0180] The SD card should be inserted deep enough into the housing 79 that it can be pushed in with the pad of your thumb. For example, when the SD card is inserted into the media opening 81, it should protrude about 0.4 mm from the opening surface of the media opening 81, and the installation should be completed by pushing the SD card in with the pad of your thumb.
[0181] Next, another configuration example of the media opening 81 of the main unit 41 according to the first embodiment will be described with reference to Figs. 11A and 11B.
[0182] 11A and 11B are perspective views of the media opening 81 in a closed state. A flat plate bent into an L shape is used as the security cover 93. The flat plate part on one side of the bent part covers the media opening 81, and the other flat plate part is fixed with a Torx screw 94 to the bottom surface perpendicular to the side surface on which the media opening 81 is provided.
[0183] When the waterproof lid is attached to the media opening 81, a convex handle 96 is provided on the waterproof lid which protrudes outward from the opening surface of the media opening 81. An opening is provided in the security lid 93, and this handle 96 protrudes to the outside through the opening of the security lid 93. Due to the elasticity of the waterproof lid, the waterproof lid and the security lid 93 are configured not to be easily separated.
[0184] Next, the excellent effects obtained by adopting the structure of FIGS. 11A and 11B will be described.
[0185] Depending on the location where the main unit 41 is attached to the forklift 20, it may be difficult to access the surface where the media opening 81 is provided. In such cases, the security cover 93 can be easily fixed by accessing the bottom surface that is perpendicular to the side surface where the media opening 81 is provided. Note that it is not necessary for the side surface where the media opening 81 is provided and the bottom surface where the security cover 93 is fixed with the Torx screw 94 to be perpendicular to each other, and similar excellent effects can be obtained even if the two are positioned in an intersecting relationship.
[0186] Even when the Torx screw 94 that secures the security cover 93 is removed, the security cover 93 is supported by the housing 79 via the waterproof cover, so that the security cover 93 can be prevented from falling off.
[0187] [Recording device main unit housing and cover] Next, a configuration relating to the housing 79 and the cover 80 of the main unit 41 of the recorder 40 according to the first embodiment will be described with reference to FIGS.
[0188] 12 is a perspective view of the main unit 41 with the lid 80 removed from the housing 79. The speaker 64 is attached to the lid 80. The speaker 64 is electrically connected to an electronic circuit board in the housing 79 via a cable 98. The housing 79 and the lid 80 are mechanically connected by a string 97. The lengths of the string 97 and the cable 98 are adjusted so that the cable 98 is in a slack state when the lid 80 is moved away from the housing 79 until the string 97 is taut. For example, the string 97 is shorter than the cable 98.
[0189] Next, the excellent effects obtained by adopting the structure shown in FIG. 12 will be described. Even if the lid 80 is removed from the housing 79 and moved away from the housing 79, a large tension is not applied to the cable 98, so damage such as breakage of the cable 98 can be suppressed. When there is not enough space to attach the speaker 64 to the housing 79, it is advisable to attach the speaker 64 to the lid 80. Furthermore, in general, the housing 79 is attached to the vehicle body in a position in which the lid 80 faces a large space so that the lid 80 can be easily removed. When the speaker 64 is attached to the lid 80, the speaker 64 faces a large space, ensuring good sound radiation characteristics.
[0190] As another configuration example, a clamp for the cable 98 may be provided on the lid 80, one end of a relatively thick cable may be fixed by this clamp, the other end may be connected to the housing side, and the speaker 64 and the thick cable may be connected by a relatively thin cable. If the thick cable has sufficient mechanical strength, the string 97 may be omitted. In this case, the thick cable electrically connects the speaker 64 to the circuit on the housing 79 side, and also has the function of preventing the lid 80 from falling off.
[0191] 13A is a perspective view of a connection between the housing 79 and the string 97. A gate-shaped binding part 110 is provided on the inner surface of the housing 79. A hollow silicone rubber string is used as the string 97. The binding part 110 and the string 97 are brought together and bound with a binding band 111, whereby one end of the string 97 is fixed to the housing 79.
[0192] When the gate-shaped binding part 110 is viewed from the front, a step 112 having a height substantially equal to that of the binding part 110 is provided on the rear side of the binding part 110. A setback part 113 is provided at a position of the step 112 corresponding to the binding part 111, in which the step part is set back in a direction away from the binding part 110. If the setback part 113 is not provided, when the binding band 111 is passed through the binding part 110, the tip of the binding band 111 hits the step 112, making the binding work complicated. In this embodiment, since the setback part 113 is provided at the step 112, when the binding band 111 is passed through the binding part 110, the tip of the binding band 111 enters the setback part 113. If the binding band 111 is pushed further in, the tip of the binding band 111 will rise up due to the flexibility of the binding band 111. Therefore, the binding work using the binding band 111 can be easily performed.
[0193] FIG. 13B is a perspective view of the connection between the lid 80 and the string 97. A plate-shaped protrusion 120 is provided on the inner surface of the lid 80. An opening 121 is provided in the plate-shaped protrusion 120. A part of the opening 121 is large enough for the string 97 to pass through with ease, and another part of the opening 121 is narrower than the string 97. When attaching the string 97 to the lid 80, first pass the string 97 through a relatively large part of the opening 121. Then, move the string 97 to the narrower part. At this time, the string 97 is crushed in the thickness direction so as to match the width of the opening 121. A frictional force is generated between the string 97 and the edge of the opening 121 due to the restoring force of the string 97 made of hollow silicone rubber. This frictional force fixes the end of the string 97 to the lid 80. This makes it possible to easily fix the end of the string 97 to the lid 80 without performing work such as tying.
[0194] As the string 97, a string made of a material having sufficient elasticity may be used in addition to a hollow silicone rubber string. Also, the connection structure between the case 79 and the string 97 (FIG. 13A) may be used to connect the cover 80 and the string 97. Conversely, the connection structure between the cover 80 and the string 97 (FIG. 13B) may be used to connect the case 79 and the string 97.
[0195] [Vehicle speed measurement function of the recording device] Next, the vehicle speed measurement function of the recording device according to the first embodiment will be described with reference to Figures 14A and 14B. This vehicle speed measurement function is effective when the forklift 20 equipped with the recording device 40 according to the first embodiment is used in a work site where a reference mark is provided.
[0196] 14A is a front view of a reference mark 50 installed in a work area. The reference mark 50 has a circular outer shape and is divided into four equal sectors with right angles at the center. Adjacent sectors are colored differently.
[0197] 14B is a plan view of the work site. A plurality of aisles 51 along which forklifts 20 travel are defined in the work site. At least one reference mark 50 is provided in front of forklifts 20 traveling along aisles 51. The plurality of reference marks 50 are the same size, and the sizes of the reference marks 50 are stored in advance in storage unit 62 (FIG. 1B) of recording device 40.
[0198] The processing unit 61 of the recording device 40 has a function of analyzing an image in which the reference mark 50 appears, and determining the speed of the forklift 20. For example, the processing unit 61 determines the distance to the reference mark 50 from the size of the reference mark 50 appearing in the image. The speed of the forklift 20 is determined from the change in this distance over time.
[0199] Next, the excellent effects achieved by the functions described with reference to FIGS. 14A and 14B will be described. Since the vehicle speed is obtained from the information acquired by the recording device 40, the vehicle speed can be obtained without mounting a dedicated sensor for detecting the vehicle speed. Since the reference mark 50 has a circular outer shape, the diameter (reference length) of the reference mark 50 can be accurately obtained even if the reference mark 50 is photographed from an oblique direction.
[0200] Next, another example of the configuration of the vehicle speed measurement function will be described. In order to obtain the vehicle speed, the reference mark 50 may be photographed by a stereo camera, the distance from the obtained image to the reference mark 50 may be measured, and the vehicle speed may be obtained from the change in distance over time. It may be determined whether or not a common reference mark 50 is captured in images captured by two cameras mounted on the vehicle, and if the common reference mark 50 is captured, the distance may be calculated from the two images captured by the two cameras. For example, the two cameras may be a semi-spherical camera installed in front of the driver's seat and a wide-angle camera that captures the area behind the driver's seat. In this case, the reference mark 50 may have any shape.
[0201] It is advisable to use lighting fixtures attached to the ceiling of a warehouse as reference marks. It is advisable to install multiple lighting fixtures at equal intervals and use the intervals between the lighting fixtures as a reference length for calculating vehicle speed.
[0202] In addition, the position of the forklift 20 can be obtained using a GPS receiver 43 mounted on the forklift 20, and the vehicle speed can be obtained from the change in the position over time. To obtain the vehicle speed, the forklift 20 can be equipped with a Doppler sensor. Alternatively, a sensor that detects the rotation speed of the tires can be equipped. The forklift 20 can be equipped with a distance measuring device that uses light, called LIDAR. When LIDAR is mounted on the vehicle, a map of the work site where the forklift 20 operates can be created by scanning with a laser light for distance measurement.
[0203] [Function to calculate vehicle speed using optical flow] Next, the function of calculating the vehicle speed using the optical flow will be described with reference to FIG.
[0204] The recording device 40 includes a camera that captures an image of the floor or ground around the forklift 20, and a function of detecting the optical flow of the captured image of the floor or ground and calculating the speed of the forklift 20 based on the detection result.
[0205] 15 is a schematic diagram showing an example of an image 55 captured by a camera. The body and forks 22 of the forklift 20 are captured in the center of the image 55. A floor or ground 56 is captured around the forklift 20.
[0206] This function makes it possible to obtain the relative speed of the forklift 20 with respect to the floor or ground 56. Not only the translational movement of the forklift 20 but also the rotational speed of the rotational movement can be calculated. For example, if the distance from the camera to the floor or ground 56 is known and the optical flow (the number of pixels moved in a certain time) of a feature point of the floor or ground 56 is known, the relative speed of the camera with respect to the floor or ground 56 can be obtained. It is advisable to arrange reference marks in a row and use the reference marks as feature points of the optical flow.
[0207] In particular, it is advisable to provide a camera (e.g., a wide-angle camera) that captures images below head guard 23 of forklift 20 and captures the body of forklift 20, the driver, and the floor or ground 56 around the body. When forklift 20 moves relative to the floor or ground 56, the direction and speed of movement can be obtained from the optical flow of the texture of floor or ground 56 around forklift 20 (patterns of asphalt or concrete, pebbles, tape, cardboard placed in the vicinity, etc.).
[0208] The forklift 20 can only rotate while remaining in the same place without translational movement. For example, when the forklift 20 rotates, an arc-shaped optical flow is obtained with the axis of rotation as the center. The camera should be installed so that the center of rotation during this rotation coincides with the center of the camera image. If the center of the camera image does not coincide with the center of rotation, it is preferable to provide a function for substantially matching the image center with the center of rotation by performing calibration. When a hemispherical camera is used as the camera, the camera should be installed in the same manner. By installing the camera in this manner, the rotation of the forklift 20 can be easily detected.
[0209] If the aspect ratio of the camera image is not 1:1, for example when using a general camera with a rectangular shooting area, it is advisable to install the camera so that the front-to-rear direction of the forklift 20 corresponds to the longitudinal direction (long side direction) of the shooting area, and the left-to-right direction corresponds to the width direction (short side direction) of the shooting area.
[0210] For example, when turning left while moving forward, the velocity vector on the right side is greater than the velocity vector on the left side of the forklift 20. It is preferable that the video data viewer has a function for displaying the optical flow itself with an arrow or the like, and for displaying the speed of each part of the vehicle body, such as the left side and right side, as numerical values.
[0211] The optical flow of the characteristic points of the floor or ground 56, the objects placed on the floor or ground 56, etc., is opposite to the moving direction of the forklift 20. For example, the optical flow may be displayed as an arrow or the like that allows distinction between the start point and the end point, and the start point and the end point may be in the opposite direction to the optical flow. When displayed in this manner, the moving direction of the forklift 20 can be intuitively grasped by looking at the arrow or the like displayed on the display screen. In particular, it is preferable to display the position where the sides of the outer shape of the body of the forklift 20 in a plan view intersect with each other as the starting point of the arrow. For example, when the outer shape of the body of the forklift 20 is displayed as a substantially rectangular shape, it is preferable to set the four vertices of the rectangle as the starting points of the arrow.
[0212] Since people, handles, operating levers, etc. are also captured in the range in which the interior of the forklift 20 is captured, the viewer should have a function to detect the optical flow of the person's movement. The viewer should have a function to recognize the movement of people, etc., separately from the optical flow of the forklift 20 itself. For example, it should be possible to distinguish and recognize the arrows indicating the movement of people from the arrows indicating the movement of the forklift 20. For example, it is possible to represent the movement of people with green arrows and the movement of the forklift 20 with blue arrows. The optical flow of the person's movement can be used, for example, to determine whether the operation is normal, whether the person is turning his / her head to take a pointing call, etc.
[0213] It is preferable that the recording device 40 has a function for calculating the average speed of the forklift 20 by combining the optical flows.
[0214] When there are moving objects such as people or automated guided vehicles (AGVs) around the forklift 20, optical flow will occur partially in the moving image. It is preferable to have a function to exclude such partially occurring optical flow from targets for speed calculation. In other words, it is preferable to perform a process of calculating the vehicle speed assuming that optical flow occurring only in a part of the periphery of the forklift 20 is not generated by the movement of the forklift 20.
[0215] When playing back a video on a viewer, it is preferable to display optical flows that occur only in a certain area separately from optical flows due to the movement of the forklift 20. For example, it is preferable to display arrows indicating optical flows that occur only in a certain area and arrows indicating optical flows due to the movement of the forklift 20 in different colors. In this way, the movement of a person moving near the forklift 20 can be easily recognized. For example, it is preferable to provide a function to display the movement of the forklift 20 with a blue arrow and to display optical flows that occur only in a part of the image around the forklift 20 with a red arrow as the movement of a person moving around the forklift 20.
[0216] The video viewer may be realized by a personal computer application program (PC app), a smartphone application program (smartphone app), or the like. Alternatively, the recording device 40 mounted on the forklift 20 may be provided with a display device, and the recording device 40 may have a viewer function. Furthermore, the forklift 20 may be provided with a function of issuing an alarm using optical flow to notify of abnormalities in the movement of the forklift 20, abnormalities in the operation or driver, or the presence of people around the forklift 20 that is dangerous. Abnormalities in the movement of the forklift 20 may be detected by, for example, whether the magnitude of the translation speed or rotation speed calculated from the optical flow corresponding to the movement of the forklift 20 is abnormal. Abnormalities in the operation or driver may be detected by, for example, determining whether the driver is following driving rules such as pointing and calling the roll call.
[0217] The area surrounding the forklift 20 is divided into a nearby area (first area) where people, etc. do not enter during normal operation, and a slightly more distant area (an area of the surrounding area farther than the first area) where people, etc. may enter, and the optical flow within the first area is used as the optical flow that serves as the basis for calculating the moving speed of the forklift 20.
[0218] [Function to detect the inclination angle of the mast] Next, the function of detecting the tilt angle of the mast of the recording device according to the first embodiment will be described with reference to Figs. 16A and 16B.
[0219] Fig. 16A is a schematic side view of a forklift 20. Forks 22 move up and down along a mast 21 whose tilt angle is variable. A plurality of markers 31 are provided on the mast 21. A marker camera 47 is attached to a support 32 of the head guard 23. The marker camera 47 is attached to the support 32 so that the plurality of markers 31 are within the angle of view. A processing unit 61 (Fig. 1B) of the recording device 40 has a function of analyzing an image in which the plurality of markers 31 are captured to determine the tilt angle of the mast 21.
[0220] 16B is a diagram showing the relative positional relationship between the markers 31 and the marker camera 47. Multiple markers 31 are provided on the mast 21 on the left side of the forklift 20, and the marker camera 47 is attached to the support pillar 32 on the right side. The marker camera 47 is attached to the support pillar 32 in a position facing the left side of the forklift 20, and can capture images of the multiple markers 31.
[0221] Next, the excellent effects obtained by employing the configurations shown in FIGS. 16A and 16B will be described.
[0222] If the fork 22 is not horizontal when transferring a load, it may cause an accident such as the load falling off. The posture of the fork 22 is changed by changing the inclination angle of the mast 21 to which the fork 22 is attached so as to be movable up and down. In the video recorder 40 according to the first embodiment, it is possible to determine whether the posture of the fork 22 is normal or not by obtaining the inclination angle of the mast 21. It is possible to easily obtain information on the inclination angle of the mast 21 by detecting the relative positional relationship in the image of the multiple markers 31 attached to the mast 21. The driver can safely transfer the load by confirming that the inclination angle of the mast 21 with respect to the horizontal plane is a right angle, i.e., that the fork 22 is horizontal. Since the marker camera 47 is attached to the support 32 of the vehicle body, not to the movable parts such as the mast 21 and the fork 22, damage to the marker camera 47 during operation can be suppressed.
[0223] It is preferable that markers 31 are also attached to the forks 22, and the recording device 40 has a function of determining the lifting and lowering speed of the forks 22 from the optical flow of the markers attached to the forks 22.
[0224] [Second Example] Next, a vehicle information processing device according to a second embodiment will be described with reference to FIG. 17 is a block diagram of a vehicle information processing device 100 according to Example 2. The vehicle information processing device 100 processes vehicle information such as video data acquired by a recording device 40 (FIGS. 1A and 1B) mounted on the forklift 20 and recording devices mounted on other vehicles.
[0225] The vehicle information processing device 100 includes a processing device 101, a display 102, a storage device 103, a communication device 104, an SD card reader 105, a pointing device 106, and a keyboard 107. The processing device 101 includes, for example, a microcomputer, and realizes various functions by executing computer programs stored in the storage device 103.
[0226] Furthermore, the processing device 101 displays the processing results on the display 102. Also, information that prompts the user to input commands and data is displayed on the display 102. The communication device 104 performs data communication with the recording device 40 mounted on the vehicle. An SD card on which vehicle information is recorded by the recording device 40 (FIGS. 1A and 1B) is attached to the SD card reader 105, and provides a function of reading vehicle information from the SD card and writing various data to the SD card. The pointing device 106 is operated by the user to move the position of a pointer displayed on the display 102 and to select a button displayed on the display 102. The keyboard 107 is operated by the user to provide a function of inputting commands and data to the processing device 101.
[0227] [Video file generation function] The processing device 101 has a function to acquire multiple video files of videos captured by multiple cameras mounted on a vehicle, a function to specify a start point and an end point from which to extract the video, and a function to extract the video from the specified start point to end point from the multiple video files, and to generate and save a single video file in a form in which the extracted videos can be viewed simultaneously by synchronizing them on the timeline.
[0228] With this function, you can view content that is essentially the same as if you were playing multiple video files, simply by playing a single video file generated by this function, without having to go through the complicated process of playing multiple video files in chronological synchronization.
[0229] The processing device 101 has a function of specifying the start and end points of a video to be cut out while playing one of the multiple video files. This makes it easy to set the start and end points of a single video file to be generated. For example, a single video file made up of multiple video files is convenient for use in education.
[0230] The multiple video files and the combined single video file are, for example, avi files. These video files are also video-based compressed files. The video of the combined single video file is a single screen in which the videos of the multiple video files are arranged. For example, the video may be in a picture-in-picture format, a side-by-side format, a matrix format, or the like.
[0231] Since multiple video files are created during recording, you can freely decide how to combine them into a single video file. For example, in a combined video file, you can display particularly important footage large on the screen and less important footage small. You can decide which video file contains the most important footage when you create the video file.
[0232] [Function to generate rectangular video files from circular images] The processing device 101 has a function of reading a video file consisting of a circular image captured by a 360-degree camera, allowing the user to specify a partial area within the image, and a function of expanding the specified area to generate a video file consisting of a rectangular image.
[0233] A video file consisting of rectangular images can be played back using a general video playback program. The processing device 101 has a function of specifying an area to be expanded into a normal rectangular image while playing back a video captured by a 360-degree camera using a program capable of playing back the video. For example, it may have a function of specifying an area currently displayed on the screen as an area to be expanded into a rectangular image while playing back a video file captured by a 360-degree camera. It may have a function of saving a video file consisting of rectangular images as an avi file.
[0234] If a vehicle is equipped with multiple cameras, one of which is a 360-degree camera, it is preferable for the vehicle to have a function for generating a single video file using a video file generation function based on a video file consisting of a rectangular image generated by expanding a portion of the image in the video file captured by the 360-degree camera and video files captured by the other cameras.
[0235] [Near miss map creation function] The processing device 101 has a function of creating a map of the workshop based on information obtained at the workshop where the vehicle is operating, a function of detecting the occurrence of a situation equivalent to a near-miss incident regarding a vehicle operating in the workshop, and a function of creating a near-miss map that associates the map with the location where the near-miss incident occurred.
[0236] The near-miss map provides useful information for reducing accidents in the workplace. The map is created using, for example, LIDAR. The occurrence of a situation equivalent to a near-miss case is detected by the processing device 101 based on the measurement results of an acceleration sensor, a gyro sensor, etc. mounted on the vehicle. In addition, it is preferable to have a function of detecting the occurrence of a situation equivalent to a near-miss case by performing image analysis on video information acquired by a camera mounted on the vehicle.
[0237] The location information of the location where the near-miss incident occurred is acquired via an SD card by, for example, associating the location information acquired by the GPS receiver 43 mounted on the vehicle with video data and acceleration data and recording it on the SD card. The location on the near-miss map is associated with latitude and longitude information. The processing device 101 identifies the location where the near-miss incident occurred on the near-miss map based on the location information acquired from the GPS receiver 43 and the location information on the near-miss map.
[0238] [Battery remaining life prediction function] The vehicle information acquired from the vehicle includes information on the time during which the switching means is turned on in a vehicle equipped with a switching means that supplies power to the electric system by turning on and stops the supply of power to the electric system by turning off the switching means. The processing device 101 has a function of issuing an alarm based on the accumulated time during which the switching means is turned on.
[0239] If the vehicle is an electric forklift, the remaining life of the vehicle battery can be predicted from the accumulated time that the switching means is turned on. The user can predict the time to replace the vehicle battery from the alarm that is issued. In addition, the user can obtain the excellent effect of being able to collectively manage a plurality of electric forklifts to be managed by one vehicle information collection device.
[0240] The time information when the switching means is turned on may be acquired from an in-vehicle device such as the recording device 40 via an SD card. The in-vehicle device may have a function of recording the time when the switching means is turned on and off, and vehicle identification information (vehicle ID) in an SD card. In addition, the in-vehicle device and the vehicle information processing device may have a data communication function via a wireless LAN, and the vehicle information processing device may acquire the time information when the switching means is turned on from the in-vehicle device via the wireless LAN.
[0241] The alarm may be issued, for example, when the accumulated time exceeds a predetermined percentage (50%, 80%, 90%, etc.) of the operating life of the vehicle battery, or may be issued every time a certain period of time, for example, 1000 hours, has elapsed.
[0242] [Vehicle information display function] The vehicle information processing device 100 has a function of acquiring vehicle information from a plurality of types of vehicles, and a function of displaying on a display device different vehicle information depending on the type of vehicle.
[0243] This function allows information to be collected from different types of vehicles such as automobiles and forklifts in a common vehicle information processing device, and information appropriate to the type of vehicle can be displayed. For example, for automobiles, it is recommended to display GPS information (date and time information, location information, speed information, etc.), acceleration information acquired by an acceleration sensor, blinker operation information, speed pulse information, etc. For forklifts, it is recommended to display GPS information, acceleration information acquired by an acceleration sensor, angular velocity information acquired by a gyro sensor, etc.
[0244] The vehicle type may be recorded in a removable recording medium by the in-vehicle device, and read out by the vehicle information processing device from the removable recording medium.
[0245] [Firmware update function for in-vehicle devices] The on-board device installed in the vehicle records the firmware version of the on-board device in an SD card. The vehicle information processing device 100 has a function of reading the firmware version from the SD card and storing the newer version of firmware in the SD card if a newer version of firmware is available.
[0246] A user can obtain a new version of firmware for an in-vehicle device without having to determine whether a new version of the firmware has been released. The in-vehicle device should have a function to read the version of firmware stored in an installed SD card, and if a newer version of firmware than the current version is stored in the SD card, read the firmware from the SD card and update the firmware. When an in-vehicle device has this function, it has the effect of saving the user the trouble of updating firmware and allowing the in-vehicle device to always operate with a new version of firmware. The in-vehicle device should have a function to erase the firmware from the SD card once it has read the firmware from the SD card.
[0247] The in-vehicle device should have a function that does not update the firmware when an SD card with firmware compatible with a different model is installed, and should also have a function that updates the firmware when an SD card that was installed in an in-vehicle device of a different vehicle is newly installed, as long as the model of the in-vehicle device is the same.
[0248] The scope of the present invention is not limited to the configurations expressly described in the specification, but includes combinations of various aspects of the present invention disclosed herein. The configurations of the present invention for which a patent is sought are specified in the appended claims, but it is the intention of the present inventors to include in the claims any configurations disclosed in this specification that are not currently specified in the claims.
[0249] The present invention is not limited to the configurations described in the above-mentioned embodiments. The components of each of the above-mentioned embodiments and variations may be arbitrarily selected and combined. Any component of each of the embodiments and variations may be arbitrarily combined with any component described in the means for solving the invention or any component that embodies any component described in the means for solving the invention. We intend to obtain rights to these as well through amendments to this application or divisional applications, etc.
[0250] In addition, we intend to obtain rights to the overall design or partial design by filing a conversion application to a design application. The drawings depict the entire device in solid lines, but they include not only the overall design but also partial designs claimed for some parts of the device. For example, it is a drawing that includes some parts of the device as partial designs, regardless of the parts, as well as a drawing that includes some parts of the device as partial designs. A part of the device may be a part of the device, or it may be a part of that part. We intend to obtain rights to not only the overall design, but also partial designs in which any part of the solid line parts of the drawings is drawn as a dashed line part. [Explanation of symbols]
[0251] 20. Forklift 21 Mast 22 Fork 23 Head Guard 24 Posts 25 Steering Wheel 26 Main Switch 27 Operating lever 28 Pedals 29 +B terminal 30 Switch-linked power terminal 31 Marker 32 Pillar 40 Recording Device 41 Main Unit 42 Camera 43 GPS receiver 44 Acceleration Sensor 45 Gyro sensor 46 Wireless LAN Module 47 Marker Camera 50 Reference Mark Aisle 51 55 images 56 Floor or ground 61 Processing section 62 Storage section 63 SD card reader 64 Speakers 70 Camera Case 71 Lens 72 Mounting parts 73 Clamping mechanism 74 Tie wrap hole 75 Cable 79 Case 80 Lid 81 Media opening 82, 83 Tube 84, 85 Cable openings 86 Partitioning material 87 Battery connector 88 Batteries 89, 90 space 91 Connector 92 Cable 93 Security Cover 94 Torx screws 95 Stopper 96 Waterproof lid handle 97 String 98 Cable 99 holes 100 Vehicle information processing device 101 Processing equipment 102 Display 103 Storage device 104 Communication equipment 105 SD card reader 106 Pointing Device 107 Keyboard 110 Binding section 111 Cable tie 112 Steps 113 Retreat 120 Plate-like protrusion 121 Opening
Claims
1. A function of acquiring multiple video files of videos taken by multiple cameras mounted on a vehicle; A function for specifying the start and end points at which a video should be cut out; A function to extract videos from multiple video files from a specified start point to an end point, and to generate and save a single video file in a format in which the extracted videos can be viewed simultaneously by synchronizing them on the time axis. A vehicle information processing device comprising:
2. A function to specify a part of an image from a video file consisting of a circular image taken with a 360-degree camera, A function to generate a video file consisting of a rectangular image by expanding a specified area. The vehicle information processing device according to claim 1 , further comprising:
3. - creating a map of a work site where the vehicle is operating based on information acquired at said work site; A situation equivalent to a near-miss occurred regarding a vehicle operating in the workshop. The ability to detect A function for creating a near-miss map that associates the map with the location where the near-miss case occurred; The vehicle information processing device according to claim 1 or 2, further comprising:
4. A function of acquiring, from a vehicle equipped with a switching means that supplies power to the electrical system by being turned on and stops the supply of power to the electrical system by being turned off, information on the time during which the switching means is turned on; a function of issuing an alarm based on the cumulative time that the switching means is turned on; The vehicle information processing device according to claim 1 , further comprising:
5. A function for acquiring vehicle information from multiple types of vehicles; A function to display different vehicle information on the display device depending on the type of vehicle. The vehicle information processing device according to claim 1 , further comprising:
6. 6. A vehicle information processing device as claimed in any one of claims 1 to 5, further comprising a function of reading a firmware version from a removable recording medium which is attached to an in-vehicle device mounted in a vehicle and records the firmware version of the in-vehicle device, and if a newer version of firmware exists, storing the newer version of firmware in the removable recording medium.
7. 7. A program for causing a computer to realize the functions of the vehicle information processing device according to any one of claims 1 to 6.
Citation Information
Patent Citations
Terminal monitoring device and program thereof
JP2008193491A
On-vehicle electronic apparatus and program
JP2013191215A
Video processing system and video processing method
JP2017005300A
Imaging apparatus, system, and forklift equipped with the system
JP2017132298A
