Vehicle control system

The vehicle control device uses a camera to determine passenger state and adjust vehicle systems for precise control, addressing the limitations of existing systems by enhancing acceleration, deceleration, and comfort, and estimating cruising range.

JP7855454B2Active Publication Date: 2026-05-08AISAN IND CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
AISAN IND CO LTD
Filing Date
2022-08-05
Publication Date
2026-05-08

AI Technical Summary

Technical Problem

Existing vehicle control systems struggle to accurately estimate passenger loading mass and adjust vehicle settings based on passenger state, particularly when the vehicle is moving or passengers are not stationary, and fail to account for individual passenger characteristics.

Method used

A vehicle control device that uses a camera to determine passenger state, including number, gender, age, and body type, and adjusts vehicle systems like propulsion and air conditioning based on these determinations, allowing for precise control regardless of passenger movement or vehicle state.

Benefits of technology

Enables accurate vehicle control by accounting for passenger characteristics, improving acceleration, deceleration, and comfort, and estimating cruising range with enhanced precision.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007855454000001
    Figure 0007855454000001
Patent Text Reader

Abstract

To provide a new vehicle control device for adjusting control of a vehicle in accordance with a state of an occupant.SOLUTION: A vehicle control device includes state determination means for determining a state of an occupant getting on a vehicle on the basis of an image acquired by a camera, and correction means for correcting a control value of the vehicle on the basis of a determination result of the state determination means.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This specification discloses a technology related to a vehicle control device.

Background Art

[0002] Techniques for adjusting vehicle control according to the state of passengers are known. For example, Patent Document 1 discloses a technique for estimating the loading mass of a vehicle from the number of seat belt wearers and the amount of suspension sag, and performing control to correct the driving torque of the engine. Further, Patent Document 2 discloses a technique for measuring the number of passengers by providing a human detection sensor on the seat and adjusting the operating state of the air conditioner.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] In Patent Document 1, the loading mass is estimated when the vehicle is stopped. Therefore, the timing for estimating the loading mass is limited. Further, even when the vehicle is stopped, if the passengers move inside the vehicle, the amount of suspension sag fluctuates. Therefore, in Patent Document 1, the loading mass of the vehicle cannot be accurately estimated unless the vehicle is in a stopped state and the passengers are stationary (seated) inside the vehicle. Further, in Patent Document 2, adjustment according to the state (age, gender, body type, etc.) of the passengers cannot be performed, so adjustment that always satisfies the passengers cannot necessarily be performed. Therefore, there is a need for a technique for more accurately detecting the state of passengers and adjusting vehicle control. This specification aims to provide a novel vehicle control device that adjusts vehicle control according to the state of passengers.

Means for Solving the Problems

[0005] The first technology disclosed herein is a vehicle control device comprising a state determination means for determining the state of an occupant in a vehicle based on an image acquired by a camera, and a correction means for correcting the vehicle's control values ​​based on the determination result of the state determination means.

[0006] A second technology disclosed herein is a vehicle control device of the first technology, wherein a state determination means estimates the mass of each passenger in the vehicle, and a correction means may correct the output of the vehicle propulsion system based on the total mass of the estimated masses.

[0007] A third technology disclosed herein is a vehicle control device of the first and second technologies described above, wherein the correction means may correct the output of the air conditioner based on the determination result of the state determination means.

[0008] The fourth technology disclosed herein is a vehicle control device of any of the first to third technologies described above, which may further include a range estimation means for estimating the vehicle's range based on the determination result of a state determination means. [Effects of the Invention]

[0009] According to the first technology, the status of each passenger in the vehicle (age, gender, body type, etc.) can be acquired from camera images. Therefore, the status determination means can accurately detect the status of the passengers and perform vehicle control according to the status of the passengers. Furthermore, since the status of the passengers is determined from camera images, the timing of the status determination means is not limited; that is, the status determination means can determine the status of passengers even if they are not sitting in their seats, and can also determine the status of passengers even if the vehicle is moving.

[0010] According to the second technology, vehicle propulsion that responds to driving operations can be achieved regardless of the number or body type of passengers. Normally, as the load on a vehicle increases, the inertial force increases, and the vehicle's response to driving operations becomes slower. Specifically, even with the same amount of accelerator pedal depression, the vehicle's acceleration decreases as the load on the vehicle (total mass of passengers) increases. Also, even with the same accelerator and brake operation, the vehicle's deceleration (negative acceleration) decreases as the load on the vehicle increases. In the second technology, when the total mass of passengers is large (for example, when there are multiple passengers), the control values ​​are corrected so that, for example, the engine speed increases even with the same amount of accelerator pedal depression as when the total mass of passengers is small (for example, when there is only the driver). As a result, with the same amount of accelerator pedal depression, the same acceleration can be obtained regardless of the total mass of passengers.

[0011] According to the third technology, for example, if there are many passengers, the compressor output can be increased to improve the effectiveness of the air conditioning, or if there are infants among the passengers, the compressor output can be adjusted to make temperature changes caused by the air conditioning more gradual.

[0012] According to the fourth technology, it is possible to estimate the load on the propulsion system (engine) and fuel consumption caused by the passenger's condition, thereby enabling highly accurate estimation of the cruising range. [Brief explanation of the drawing]

[0013] [Figure 1] The configuration of the vehicle control system is shown. [Modes for carrying out the invention]

[0014] Referring to Figure 1, the vehicle control device 50 will be described. The vehicle control device 50 consists of a state determination means 4 and an ECU 20. As will be described in detail later, the ECU 20 is equipped with a correction means 22 for correcting control values ​​to each device and a range estimation means 24 for estimating the vehicle's range. Images of occupants acquired by the camera 2 are input to the state determination means 4. The timing of acquisition of occupant images by the camera 2 can be arbitrarily adjusted, such as after the vehicle door opens or after the vehicle's propulsion system (powertrain) starts. Based on the images input from the camera 2, the state determination means 4 determines the number of occupants, gender, age, weight, etc. The method for determining the gender, age, weight, etc. of a person from an image is publicly known and will be omitted. The information of occupants determined by the state determination means 4 is input to the ECU 20.

[0015] The ECU 20 receives various information from devices installed within the vehicle. For example, the ECU 20 receives signals such as the accelerator pedal depression amount from the accelerator pedal 6, the set temperature and airflow of the air conditioner from the air conditioner control unit 8, and the remaining fuel level from the fuel sensor 10. Although not shown in the diagram, the ECU 20 also receives signals corresponding to the throttle valve opening and air-fuel ratio information. The ECU 20 outputs signals to drive various devices installed within the vehicle. For example, the ECU 20 outputs signals to control the rotational speed of the engine 30, signals to drive the compressor of the air conditioner 32, and signals to display vehicle information (e.g., driving range based on the current fuel level) on the display meter 34. Although not shown in the diagram, the ECU 20 also outputs signals to open and close the throttle valve and signals to drive the fuel pump. Note that the engine 30 is an example of a vehicle propulsion system.

[0016] The ECU 20 is equipped with a correction means 22 and a driving range estimation means 24. The correction means 22 corrects the control values ​​output from the ECU 20 to each device (engine 30, air conditioner 32, etc.) based on the passenger information input from the state determination means 4. For example, if the total mass of the passenger input to the ECU 20 from the state determination means 4 is heavier than a standard value, the correction means 22 corrects the control value output to the engine 30 when the accelerator 6 is pressed so that the engine 30 is driven at a higher rotational speed than when the total mass of the passenger is at a standard value. This makes it possible to suppress the sluggishness of the vehicle's acceleration when the accelerator 6 is pressed, even when the total mass of the passenger is heavier than a standard value. In other words, the driver can obtain the desired acceleration with the same amount of accelerator pedal depression, regardless of the total mass of the passenger. The "reference value for the total mass of the occupants" is a numerical value (mass) that is pre-stored in the ECU 20. If the total mass determined by the state determination means 4 is less than or equal to the reference value, the correction means 22 does not correct the control value output from the ECU 20 to the engine 30. As a result, the ECU 20 outputs a control value to the engine 30 that corresponds to the amount the accelerator pedal 6 is pressed.

[0017] The cruising range estimation means 24 estimates the cruising range based on the passenger information (total mass of the passengers) input from the state determination means 4 and the remaining fuel signal input from the fuel sensor 10. The estimated cruising range is displayed on the display meter 34. Alternatively, the cruising range estimation means 24 may calculate the current cruising range based on the relationship between past fuel levels and cruising range, correct the calculation result based on the passenger information (total mass of the passengers) input from the state determination means 4, and display the corrected cruising range on the display meter 34.

[0018] (Features of the vehicle control device 50) As described above, the vehicle control device 50 determines the number of occupants, gender, age, weight, etc., in the state determination means 4, and uses the results to correct the control values ​​output from the ECU 20 to equipment such as the engine 30 and air conditioner 32. Below are some specific examples of the control that the vehicle control device 50 can perform. Note that the vehicle control device 50 does not necessarily have to perform all of the following controls 1 to 4, but only one or more of controls 1 to 4.

[0019] (Control 1) Based on the total mass of the passengers, in this case, for example, if the total mass of the passengers is heavier than a standard value, the output control value is corrected so that the engine output is greater than when the total mass is at the standard value. For example, the engine output can be increased by making the throttle opening larger than when the total mass is at the standard value, increasing the fuel injection amount larger than when the total mass is at the standard value, or increasing the engine speed larger than when the total mass is at the standard value. The correction of the engine output control value may be determined using map data of the total mass and the correction value, or it may be determined using a calculated value based on a function of the total mass and the correction value.

[0020] (Control 2) The air conditioner's output control value is corrected based on the number of passengers, their gender, age, and body type. In this case, for example, if the number of passengers is greater than the standard value, the output control value is corrected so that the air conditioner's output is greater than when the number of passengers is the standard value. Specifically, the compressor output in the air conditioner is increased, and the output control value is corrected so that the temperature inside the car changes to the set temperature more quickly. The correction of the air conditioner's output control value may be determined using all of the factors of the number of passengers, gender, age, and body type, or it may be determined using some of these factors (one or more). The "standard value for the number of passengers" is a numerical value (number of passengers) that is stored in advance in the ECU 20, and if the number of passengers determined by the state determination means 4 is less than or equal to the standard value, the correction means 22 does not correct the control value output from the ECU 20 to the compressor. As a result, the ECU 20 outputs a control value to the compressor according to the operation of the air conditioner operation unit 8.

[0021] (Control 3) Based on the age of the passengers, correct the engine output control value. In this case, for example, if it is determined that there are elderly people or infants among the passengers, correct the engine output control value so that sudden acceleration or deceleration does not occur. That is, even when the driver performs a sudden accelerator operation, correct the engine output control value to reduce the acceleration of the vehicle and improve the riding comfort of the vehicle. Specifically, set upper limit values for the throttle opening change speed, fuel injection amount change speed, engine speed change speed, etc. When an accelerator operation exceeding the upper limit value is performed, correct the output control value to each device so that the throttle opening, fuel injection amount, and engine speed change at the upper limit value.

[0022] (Control 4) Based on the age of the driver, correct the engine output control value. In this case, for example, if it is determined that the driver is an elderly person, correct the engine output control value so that the vehicle does not start suddenly when the vehicle starts moving (forward or backward). Specifically, when the vehicle starts moving (forward or backward), set upper limit values for the throttle opening change speed, fuel injection amount change speed, engine speed change speed, etc. When an accelerator operation exceeding the upper limit value is performed, correct the output control value to each device so that the throttle opening, fuel injection amount, and engine speed change at the upper limit value. Thereby, when the vehicle starts moving (forward or backward), the vehicle can move slowly and prevent the vehicle from jumping out. Alternatively, when the accelerator is misoperated (such as stepping on the accelerator by mistake), a margin for stepping on the brake can be obtained, and the occurrence of an accident can be prevented.

[0023] (Other Embodiments) A key aspect of the technology disclosed herein is the use of a camera to determine the status of occupants in a vehicle (number of people, age, gender, body type, etc.) and to correct control values ​​for in-vehicle equipment based on that determination. Therefore, the controlled equipment is not limited to the equipment described above. For example, the output control value (volume) for in-vehicle audio equipment may be corrected according to the occupants' status. Alternatively, the output control value (opening / closing speed) for power windows may be corrected according to the occupants' status. Furthermore, a person may be identified based on an image acquired by the camera, and the control values ​​(especially the engine output control value) may be corrected according to that person's past driving habits.

[0024] Furthermore, the vehicle control device disclosed herein may be configured to correct all of the output control values ​​of the above-mentioned devices, or it may be configured to correct some (one or more) of the output control values ​​of the above-mentioned devices.

[0025] In the above embodiment, an example was described in which the correction means 22 and the range estimation means 24 are provided within the ECU 20, but the correction means 22 and / or the range estimation means 24 may be separate from the ECU 20. Furthermore, the range estimation means 24 is not necessarily an essential component in the vehicle control device disclosed herein.

[0026] Although embodiments of the present invention have been described in detail above, these are merely illustrative and do not limit the scope of the claims. The technologies described in the claims include various modifications and changes to the specific examples illustrated above. Furthermore, the technical elements described in this specification or drawings exhibit technical usefulness individually or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technologies illustrated in this specification or drawings achieve multiple objectives simultaneously, and achieving even one of these objectives constitutes technical usefulness in itself. [Explanation of Symbols]

[0027] 2: Camera 4: Means for determining the state 22: Correction means 50: Vehicle control device

Claims

1. A system for determining the status of passengers in a vehicle, which acquires images of each passenger inside the vehicle using a camera and determines the status of the passengers inside the vehicle based on the number of passengers, gender, and age of the passengers inside the vehicle, based on the acquired images. A correction means that corrects the vehicle's control values ​​based on the judgment result of the state determination means, It is equipped with, The state determination means estimates the mass of each passenger in the vehicle, The correction means is a vehicle control device that corrects the output of the vehicle propulsion system based on the estimated total mass and the age of the occupants.

2. A system for determining the status of passengers in a vehicle, which acquires images of each passenger inside the vehicle using a camera and determines the status of the passengers inside the vehicle based on the number of passengers, gender, and age of the passengers inside the vehicle, based on the acquired images. A correction means that corrects the vehicle's control values ​​based on the judgment result of the state determination means, It is equipped with, The correction means is a vehicle control device that corrects the output of the air conditioner so that the temperature changes according to the age of the passenger, based on the judgment result of the state judgment means.

3. A vehicle control device according to claim 1 or 2, Furthermore, the vehicle control device includes a range estimation means that estimates the vehicle's range based on the determination result of the state determination means.

Citation Information

Patent Citations

  • Drive force control device for vehicle

    JP2007263242A

  • Air conditioning device for vehicle

    JP2010083204A

  • Vehicle with air-conditioner mounted

    JP2013095214A

  • Vehicle speed restriction device

    JP2017186945A

  • Automatic operation support device and automatic operation support method

    JP2018122750A