Weight estimation device

The weight estimation device, using a camera to analyze occupant physique and integrate with the vehicle's weight, addresses the challenge of varying vehicle weights in AEBS, ensuring accurate braking distance determination and prevention of premature stopping.

JP7654325B2Active Publication Date: 2025-04-01DAIHATSU MOTOR CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2021074775
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-04-27
Publication Date
2025-04-01
Estimated Expiration
2041-04-27

AI Technical Summary

Technical Problem

Existing Advanced Emergency Braking Systems (AEBS) in vehicles struggle to accurately determine the braking distance on rain-wet roads due to variations in vehicle weight, which can lead to premature stopping when the actual weight is lighter than assumed.

Method used

A weight estimation device is integrated into the vehicle, equipped with a camera positioned to capture all seats, which estimates the total weight of occupants by analyzing their physique from the images and adds this to the vehicle's known weight to determine the actual total weight.

Benefits of technology

This solution allows for precise estimation of the actual total weight of the vehicle, enabling the AEBS to accurately determine the braking distance and timing, thereby ensuring the vehicle stops at the target position with high accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007654325000001
    Figure 0007654325000001
  • Figure 0007654325000002
    Figure 0007654325000002
Patent Text Reader

Abstract

To provide a weight estimation device capable of estimating actual gross vehicle weight.SOLUTION: A human detection camera 4 is provided at a position that allows for shooting all seats in a cabin 3 of a vehicle 2. A total wight of persons in the cabin 3 is estimated from an image captured by the human detection camera 4. The estimated total weight is added to a known weight of the vehicle 2 and the sum is estimated to be an actual gross weight of the vehicle 2.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a weight estimation device mounted on a vehicle. [Background technology]

[0002] Recently, automobiles and other vehicles have been equipped with AEBS (Advanced Emergency Braking System).

[0003] In the AEBS, a stereo camera captures an image of the front of the vehicle (own vehicle), and when an obstacle is detected in front of the vehicle from the captured image, the distance and relative speed between the obstacle and the vehicle are detected. If there is a high possibility of a collision between the vehicle and the obstacle, the braking distance required to reach a target position in front of the obstacle is calculated from the distance and relative speed between the vehicle and the obstacle, and the timing to apply the brakes and the deceleration and jerk at that timing are set so that the vehicle can be stopped within that braking distance, and the brakes are controlled based on these. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-154813 A Summary of the Invention [Problem to be solved by the invention]

[0005] The braking distance of a vehicle on a road surface wet with rain depends on the total weight of the vehicle, which varies depending on factors such as the number of passengers in the vehicle. In the AEBS, the brake control program is set up so that the vehicle will decelerate sufficiently even when the number of passengers is at its maximum, assuming that the vehicle will travel at its total vehicle weight (the vehicle weight plus the number of passengers x 55 kg). Therefore, when the actual total weight of the vehicle is light, such as when the number of passengers is less than the number of passengers, the vehicle may stop at a position significantly shorter than the target position. If the timing of braking operation is determined taking into account the actual total weight of the vehicle, it is possible to stop the vehicle at the target position, but as a prerequisite, the actual total weight of the vehicle must be estimated.

[0006] An object of the present invention is to provide a weight estimation device capable of estimating the actual total weight of a vehicle. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, the weight estimation device of the present invention includes a camera arranged in a position where it can photograph all seats in the vehicle cabin, a total weight estimation unit that estimates the total weight of people riding in the vehicle cabin from an image photographed by the camera, and a total weight estimation unit that adds up the vehicle weight of the vehicle and the total weight estimated by the total weight estimation unit and estimates the added value as the actual total weight of the vehicle.

[0008] According to this configuration, a camera is disposed in the vehicle cabin at a position where it can capture images of all the seats. The total weight of the people in the cabin is estimated from the images captured by the camera. For example, the people in the cabin are identified by analyzing the images captured by the camera, and the physiques of each person (the area they occupy) are recognized. The total weight of the people in the cabin is estimated by adding up the weights estimated from the physiques of each person. The estimated total weight is then added to the known vehicle weight, and the sum is estimated to be the actual total weight of the vehicle.

[0009] This makes it possible to estimate the actual total weight of the vehicle even if the number of occupants in the vehicle cabin changes or the number of occupants increases or decreases.

[0010] Since it is possible to estimate the actual total weight of the vehicle, by incorporating a weight estimation device into the AEBS, the timing of brake application, etc. can be determined taking into account the actual total weight of the vehicle, allowing the vehicle to be stopped at the target position with high accuracy.

[0011] The camera is not limited in its location as long as it can capture images of all the seats, but it is preferable that the camera is attached to the ceiling of the vehicle interior and located between the front and rear seats. In this location, the camera can capture the entire people sitting in all the seats, so that the physique of each person can be recognized with high accuracy, and the weight of each person can be estimated with high accuracy from the physique of each person. Effect of the Invention

[0012] According to the invention, the actual total weight of the vehicle can be estimated. [Brief description of the drawings]

[0013] [Figure 1] 1 is a block diagram showing a configuration of a collision damage mitigation brake system incorporating a weight estimation device according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a plan view of a vehicle equipped with a collision mitigation braking system, showing the interior of the vehicle through a transparent view. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0015] <Collision mitigation brake system> Fig. 1 is a block diagram showing the configuration of a collision mitigation braking system 1 incorporating a weight estimation device according to one embodiment of the present invention. Fig. 2 is a plan view of a vehicle 2 equipped with the collision mitigation braking system 1, showing the interior of a vehicle compartment 3 in a see-through manner.

[0016] The Autonomous Emergency Braking System (AEBS) 1 is a system for avoiding a collision between the vehicle 2 and an obstacle such as a vehicle ahead or for reducing damage caused by the collision, and has an alarm function that activates an alarm to prompt the driver to take action to avoid the collision before the automatic brake is activated, and a brake function that slows down the vehicle 2 by applying the automatic brake in order to avoid the collision and reduce damage caused by the collision.

[0017] The collision damage mitigation brake system 1 includes a human detection camera 4 that captures an image of the interior of a passenger compartment 3 of a vehicle 2 and a stereo camera 5 that captures an image of the area in front of the vehicle 2 .

[0018] <Human detection camera> The human detection camera 4 is attached to a ceiling 6 in a passenger compartment 3 of a vehicle 2, and is disposed in a position between a front seat 7 and a rear seat 8. The human detection camera 4 includes a camera body 11 and a microcomputer (microcontroller) 12.

[0019] Camera body 11 includes lens 13 and imaging element 14, and lens 13 is disposed facing downward. The angle of view (viewing angle) of lens 13 is within a range of, for example, 120° to 160°, and all of the seats in front seats 7 and rear seats 8 are included in the viewing field. Imaging element 14 captures an image of the viewing field of lens 13 via lens 13.

[0020] Image data captured by the imaging element 14 is input to the microcomputer 12. The microcomputer 12 substantially includes a total body weight estimation unit 15 as a functional processing unit.

[0021] The total weight estimation unit 15 estimates the total weight of people riding in the vehicle compartment 3 from the image captured by the camera body 11 (image data captured by the image sensor 14). Specifically, people riding in the vehicle compartment 3 are identified by analyzing the image captured by the camera body 11. Then, the physique of each identified person (the area occupied by the person) is recognized, a weight is estimated from each person's physique, and the total weight of people riding in the vehicle compartment 3 is estimated by adding up the estimated weights of each person.

[0022] <Stereo camera> The stereo camera 5 is provided in the passenger compartment 3 of the vehicle 2 and is disposed in front of the rearview mirror facing the upper part of the windshield 9 to capture images of the area ahead of the vehicle 2. The stereo camera 5 includes a pair of left and right camera bodies 21L, 21R and a microcomputer 22.

[0023] The camera bodies 21L, 21R are arranged at a distance from each other in the left-right direction, with the lenses 24L, 24R facing the windshield 9. The left camera body 21L is equipped with an imaging element (imager, image sensor) 25L that captures the field of view of the lens 24L through the lens 24L. The right camera body 21R is equipped with an imaging element 25R that captures the field of view of the lens 24R through the lens 24R. The left and right lenses 24L, 24R have the same angle of view (viewing angle), for example, within a range of 120° to 160°.

[0024] Image data captured by the imaging elements 25L and 25R is input to the microcomputer 22. The microcomputer 22 substantially includes a recognition unit 26, a determination unit 27, and an operation unit 28 as functional processing units.

[0025] The recognition unit 26 recognizes an obstacle present in front of the vehicle 2 from a pair of image data input from the image sensors 25L, 25R. Then, the recognition unit 26 extracts a target pixel corresponding to the obstacle from each image captured by the image sensors 25L, 25R, detects the amount of deviation in the position of the target pixel between the pair of images, and calculates the distance from the vehicle 2 to the obstacle using the principle of triangulation.

[0026] The judgment unit 27 judges the possibility of a collision between the vehicle 2 and an obstacle based on the distance and relative speed between the vehicle 2 and the obstacle, and if the possibility of a collision is high, sets the timing for automatic brake activation as well as the deceleration and jerk (jump speed) of the vehicle 2 at that activation timing.

[0027] More specifically, the vehicle 2 is equipped with a vehicle stability control device 31. The vehicle stability control device 31 is an ECU (Electronic Control Unit) equipped with a microcomputer, and is connected to the microcomputer 22 of the stereo camera 5 and other ECUs so as to be capable of two-way communication by a CAN (Controller Area Network) communication protocol. A vehicle speed sensor 32 that detects the vehicle speed of the vehicle 2 is connected to the vehicle stability control device 31. The vehicle speed sensor 32 outputs a pulse signal synchronized with the rotation of a rotating body that rotates as the vehicle 2 travels as a detection signal, and the vehicle stability control device 31 obtains the frequency of the detection signal (pulse signal) from the detection signal of the vehicle speed sensor 32 and converts the frequency into a vehicle speed. The vehicle speed calculated by the vehicle stability control device 31 is used for control by the vehicle stability control device 31 and is also transmitted to the microcomputer 22 of the stereo camera 5.

[0028] The determination unit 27 obtains the relative speed between the vehicle 2 and the obstacle by calculating the change in the distance from the vehicle 2 to the obstacle recognized by the recognition unit 26 over time. The determination unit 27 then calculates the collision prediction time (TTC: Time To Collision) by dividing the distance from the vehicle 2 to the obstacle by the relative speed between the vehicle 2 and the obstacle. If the collision prediction time is less than a predetermined warning criterion, the determination unit 27 determines that there is a possibility of a collision between the vehicle 2 and the obstacle, and activates a warning to prompt the driver (driver) to take action (brake operation, steering operation) to avoid the collision. If the collision prediction time falls below a brake criterion that is shorter than the warning criterion, the determination unit 27 determines that there is a very high possibility of a collision between the vehicle 2 and the obstacle, and decides to activate an automatic brake to avoid the collision and reduce the collision damage.

[0029] The total weight estimated by the function of the total weight estimation unit 15 is input from the microcomputer 12 of the human detection camera 4 to the microcomputer 22 of the stereo camera 5 directly or via a CAN communication network. When the total weight is input from the microcomputer 22 of the stereo camera 5 to the microcomputer 12 of the human detection camera 4, the determination unit 27 calculates the actual total weight of the vehicle 2 by adding the total weight to the vehicle weight of the vehicle 2. When the determination unit 27 determines to activate the automatic brake, it calculates the braking distance required to reach the target position in front of the obstacle from the distance from the vehicle 2 to the obstacle, the relative speed between the vehicle 2 and the obstacle, and the actual total weight of the vehicle 2, and sets the timing to activate the automatic brake as well as the deceleration and jerk at that timing so that the vehicle 2 can be stopped within that braking distance.

[0030] The operation unit 28 outputs an automatic brake control command so that the automatic brake operates at the operation timing set by the judgment unit 27 and the deceleration and jerk set by the judgment unit 27 are obtained.

[0031] The vehicle 2 employs a hydraulic brake system. In addition to the brake actuator 41, the brake system includes a brake pedal, a brake booster, a master cylinder, and brakes provided on each wheel. The brake pedal is located at a position convenient for the driver in the driver's seat to step on it with his / her right foot. When the brake pedal is stepped on, the stepping force input to the brake pedal is transmitted to the brake booster. The brake booster utilizes the negative pressure generated in the engine's intake system, and the stepping force of the brake pedal is amplified by the pressure difference between the negative pressure and the atmospheric pressure. The force amplified by the brake booster is transmitted from the brake booster to the master cylinder, and hydraulic pressure corresponding to the force is generated from the master cylinder. The hydraulic pressure of the master cylinder is transmitted to the brake actuator 41, and hydraulic pressure is supplied from the brake actuator 41 to the wheel cylinders of the brakes provided on each wheel, and the hydraulic pressure applies a braking force to the wheels from each brake. In addition, an electric pump is built into the brake actuator 41, and when the automatic brake is activated, the electric pump is driven by power from the battery, and the hydraulic pressure generated by the electric pump is supplied to each wheel cylinder.

[0032] <Vehicle stability control system> The vehicle stability control device 31 controls a brake actuator 41 included in the brake system of the vehicle 2 and adjusts the braking force applied to each wheel so that the posture of the vehicle 2 is kept stable when braking or turning the vehicle 2. Furthermore, the vehicle stability control device 31 controls the brake actuator 41 according to an automatic brake control command transmitted from the microcomputer 22 so that the automatic brake operates at the operation timing set by the microcomputer 22 (judgment unit 27) and the deceleration and jerk set by the microcomputer 22 are obtained.

[0033] <Action and effect> As described above, the human detection camera 4 is disposed in a position in the passenger compartment 3 of the vehicle 2 where it can capture images of all the seats. The total weight of the people riding in the passenger compartment 3 is estimated from the images captured by the human detection camera 4. The estimated total weight is then added to the known weight of the vehicle 2, and the added value is estimated to be the actual total weight of the vehicle 2. This makes it possible to estimate the actual total weight of the vehicle 2 even if the people riding in the passenger compartment 3 of the vehicle 2 are replaced or the number of passengers increases or decreases.

[0034] Since the actual total weight of the vehicle 2 can be estimated, the collision damage mitigation brake system 1 can determine the timing of brake activation, etc., taking into account the actual total weight of the vehicle 2, and can stop the vehicle 2 at the target position with high accuracy.

[0035] The human detection camera 4 is attached to the ceiling of the vehicle interior 3 and disposed between the front and rear seats in the vehicle interior 3. This arrangement allows the human detection camera 4 to capture the entire people seated in all the seats, so that the physique of each person can be recognized with high accuracy, and the weight of each person can be estimated with high accuracy from the physique of each person.

[0036] <Modification> Although one embodiment of the present invention has been described above, the present invention can be embodied in other forms.

[0037] For example, the total body weight estimated by the microcomputer 12 of the human detection camera 4 may be used for an adaptive cruise control (ACC) function that causes the vehicle 2 to follow the vehicle ahead.

[0038] In addition, when the stereo camera 5 is installed to capture images of the rear of the vehicle 2, the total body weight estimated by the microcomputer 12 of the human detection camera 4 can be used to set the timing of automatic brake activation to avoid a collision between the vehicle 2 and an obstacle behind the vehicle 2 or to reduce damage caused by the collision, as well as the deceleration and jerk of the vehicle 2 at that activation timing.

[0039] The actual total weight of the vehicle 2 is estimated by adding the total weight of people riding in the vehicle compartment 3 to the vehicle weight of the vehicle 2. However, in order to improve the accuracy of estimating the actual total weight of the vehicle 2, objects brought into the vehicle compartment 3, such as luggage, child seats, wheelchairs, bicycles, etc., may be identified from the image captured by the human detection camera 4, the weight of each object may be estimated, and the sum of the estimated weights of each object may be added to the sum of the vehicle weight of the vehicle 2 and the total weight of people riding in the vehicle compartment 3, thereby estimating the actual total weight of the vehicle 2.

[0040] In order to improve the accuracy of estimating the total weight of people riding in the vehicle cabin 3, a weight sensor may be provided on each seat, and the weight of each person detected by the weight sensor may be compared with the weight of each person estimated from an image captured by the human detection camera 4, and, for example, the median value within the overlapping range (AND range) may be estimated to be the weight of each person.

[0041] In addition, the amount of seat belt pull-out in each seat may be detected, and the weight of each person estimated from the amount of seat belt pull-out may be compared with the weight of each person estimated from an image captured by human detection camera 4, and, for example, the median value within their overlapping range (AND range) may be estimated to be the weight of each person.

[0042] In the above embodiment, the actual total weight of the vehicle 2 is estimated by the microcomputer 22 (determination unit 27) of the stereo camera 5. However, the actual total weight of the vehicle 2 may be estimated by the microcomputer 12 of the human detection camera 4. In this case, the microcomputer 12 is an example of a total weight estimation unit. Also, image data captured by the human detection camera 4 may be transmitted to the microcomputer 22 of the stereo camera 5, and the total weight of the people riding in the passenger compartment 3 may be estimated by the microcomputer 22 (determination unit 27), and the estimated total weight may be added to a known vehicle weight, and the added value may be estimated as the actual total weight of the vehicle 2. In this case, the microcomputer 22 is an example of a total weight estimation unit and a total weight estimation unit.

[0043] In addition, various design modifications can be made to the above-described configuration within the scope of the claims. [Explanation of symbols]

[0044] 2: Vehicle 3: Cabin 4: Human detection camera (camera) 6: Ceiling 7: Front seat 8: Back seat 11: Camera body (camera) 12: Microcomputer (weight estimation device, total weight estimation unit) 15: Total weight estimation section 22: Microcomputer (weight estimation device) 27: Judgment section (total weight estimation section)

Claims

1. A camera disposed in a position capable of photographing all seats in the vehicle interior; a total weight estimation unit that estimates a total weight of people riding in the vehicle cabin from the image captured by the camera; a total weight estimation unit that adds up the vehicle weight of the vehicle and the total weight estimated by the total weight estimation unit and estimates the sum as an actual total weight of the vehicle; a weight sensor provided on each seat in the vehicle interior; The total weight estimation unit estimates, for each person seated in a seat in the vehicle cabin, the median value within the overlapping range of the weight range detected by the weight sensor and the weight range estimated from the image captured by the camera as the weight of that person, and estimates the total weight by adding up the estimated weights of each person.

2. A camera arranged in a position capable of photographing all seats in the vehicle interior; a total weight estimation unit that estimates a total weight of people riding in the vehicle cabin from the image captured by the camera; a total weight estimation unit that adds up the vehicle weight of the vehicle and the total weight estimated by the total weight estimation unit and estimates the sum as an actual total weight of the vehicle; a detection unit provided for each seat in the vehicle interior and detecting a seat belt payout amount, The total weight estimation unit estimates, for each person seated in a seat in the vehicle cabin, the median value of the overlapping range of the weight range estimated from the seat belt payout amount detected by the detection unit and the weight range estimated from the image captured by the camera as the weight of that person, and estimates the total weight by adding up the estimated weights of each person.

Citation Information

Patent Citations

  • Braking force control device

    JP2003081075A

  • On-vehicle equipment

    JP2012121525A

  • Driving support device

    JP2013154813A

  • Vehicle control apparatus

    JP2017105224A

  • Brake control device

    JP2020128148A