Control device and control method

Abstract

To obtain a control device and a control method which enable improvement of safety of a saddle-riding type vehicle.SOLUTION: In a control device (20) and a control method according to the invention, an acquisition unit of the control device (20) acquires on-vehicle state information, i.e., information on a state of an imaged body riding on a saddle-riding type vehicle (1), based on an output result of a rear camera (15) which is provided at the rear side relative to a riding position of a rider (2) of the saddle-riding type vehicle (1) and oriented to the front side. An execution unit of the control device (20) executes driving assist operation for the rider (2) by a rider assist system (10) based on the on-vehicle state information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a control device and a control method that can improve the safety of a saddle-ride type vehicle. [Background technology]

[0002] 2. Description of the Related Art Conventional techniques relating to saddle-ride vehicles such as motorcycles include techniques for assisting the rider in driving in order to improve safety.

[0003] For example, Patent Document 1 discloses a driver assistance system that warns a motorcycle driver that he or she is inappropriately approaching an obstacle based on information detected by a sensor device that detects an obstacle in the direction of travel or substantially in the direction of travel. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2009-116882 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the posture of a saddle-type vehicle is more likely to be unstable than, for example, the posture of an automobile having four wheels. Therefore, when a driving assistance operation that assists the rider in driving is performed (for example, a warning operation for the rider or an operation that automatically controls acceleration / deceleration, etc.), safety may be compromised depending on the state of the saddle-type vehicle (for example, the rider's posture).

[0006] The present invention has been made in light of the above-mentioned problems, and has an object to provide a control device and a control method that can improve the safety of a saddle-ride type vehicle. [Means for solving the problem]

[0007] The control device of the present invention is a control device for a rider assistance system that assists a rider in driving a saddle-ride type vehicle, and includes an acquisition unit that acquires on-vehicle status information, which is status information of an imaged object riding on the saddle-ride type vehicle, based on the output result of a rear camera that is located behind the riding position of the rider of the saddle-ride type vehicle and faces forward, and an execution unit that executes driving assistance operation of the rider by the rider assistance system based on the on-vehicle status information.

[0008] The control method of the present invention is a control method for a rider assistance system that assists a rider in driving a saddle-ride type vehicle, in which an acquisition unit of a control device acquires on-vehicle status information, which is status information of an imaged object riding on the saddle-ride type vehicle, based on the output result of a rear camera that is located behind the riding position of the rider of the saddle-ride type vehicle and faces forward, and an execution unit of the control device executes a driving assistance operation for the rider by the rider assistance system based on the on-vehicle status information. Effect of the Invention

[0009] In the control device and control method according to the present invention, an acquisition unit of the control device acquires on-vehicle status information, which is status information of an imaged object riding on the saddle-ride type vehicle, based on the output result of a rear camera that is located behind the riding position of the rider of the saddle-ride type vehicle and faces forward, and an execution unit of the control device executes a driving assistance operation for the rider by the rider assistance system based on the on-vehicle status information. This makes it possible to appropriately perform the driving assistance operation according to the status on the saddle-ride type vehicle, thereby improving the safety of the saddle-ride type vehicle. [Brief description of the drawings]

[0010] [Figure 1] 1 is a schematic side view showing a schematic configuration of a saddle-ride type vehicle according to an embodiment of the present invention; [Diagram 2] 1 is a schematic top view showing a schematic configuration of a saddle-ride type vehicle according to an embodiment of the present invention; [Diagram 3]FIG. 2 is a block diagram showing an example of a functional configuration of a control device according to an embodiment of the present invention. [Figure 4] 5 is a flowchart showing an example of a processing flow related to a warning operation to a rider performed by a control device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, a control device according to the present invention will be described with reference to the drawings.

[0012] Note that, although the following describes a control device used for a two-wheeled motorcycle (see saddle-ride vehicle 1 in FIG. 1), the vehicle controlled by the control device according to the present invention may be any saddle-ride vehicle on which a rider straddles, such as a three-wheeled motorcycle, bicycle, buggy, etc. Motorcycles include vehicles using an engine as a propulsion source and vehicles using an electric motor as a propulsion source, such as motorcycles, scooters, and electric scooters. Furthermore, bicycles refer to all vehicles that can be propelled down the road by the rider's pedaling force applied to the pedals. Bicycles include ordinary bicycles, electrically assisted bicycles, electric bicycles, etc.

[0013] In addition, the following describes a case where an engine (specifically, engine 11 in FIG. 1 described below) is installed as a driving source capable of outputting power to drive the wheels, but a driving source other than an engine (e.g., an electric motor) may also be installed as the driving source, or multiple driving sources may be installed.

[0014] Furthermore, the configurations and operations described below are merely examples, and the control device and control method according to the present invention are not limited to such configurations and operations.

[0015] In the following, the same or similar descriptions are appropriately simplified or omitted. In addition, in each drawing, the same or similar members or parts are not labeled with a reference symbol or are labeled with the same reference symbol. In addition, the detailed structure is appropriately simplified or omitted.

[0016] <Straddle-type vehicle configuration> The configuration of a saddle-ride type vehicle 1 according to an embodiment of the present invention will be described with reference to Figs. 1 to 3.

[0017] Fig. 1 is a schematic side view showing a schematic configuration of a saddle type vehicle 1. Fig. 2 is a schematic top view showing a schematic configuration of the saddle type vehicle 1. Fig. 3 is a block diagram showing an example of a functional configuration of a control device 20.

[0018] The saddle-ride type vehicle 1 is a two-wheeled motorcycle that corresponds to an example of the saddle-ride type vehicle according to the present invention. As shown in Figures 1 and 2, the saddle-ride type vehicle 1 includes an engine 11, a hydraulic control unit 12, a notification device 13, a front camera 14, a rear camera 15, an ambient environment sensor 16, a front wheel speed sensor 17, a rear wheel speed sensor 18, and a control device (ECU) 20.

[0019] The saddle-ride type vehicle 1 is equipped with a rider assistance system 10 that assists the rider 2 in driving the saddle-ride type vehicle 1. The rider assistance system 10 includes the above-mentioned components (i.e., the engine 11, the hydraulic control unit 12, the alarm device 13, the front camera 14, the rear camera 15, the surrounding environment sensor 16, the front wheel speed sensor 17, the rear wheel speed sensor 18, and the control device 20).

[0020] The engine 11 corresponds to an example of a drive source of the saddle type vehicle 1, and is capable of outputting power for driving wheels. For example, the engine 11 is provided with one or more cylinders in which a combustion chamber is formed, a fuel injection valve that injects fuel toward the combustion chamber, and an ignition plug. A mixture containing air and fuel is formed in the combustion chamber by injecting fuel from the fuel injection valve, and the mixture is ignited by the ignition plug and combusted. This causes a piston provided in the cylinder to reciprocate, causing a crankshaft to rotate. In addition, a throttle valve is provided in an intake pipe of the engine 11, and the amount of intake air into the combustion chamber changes according to the throttle opening, which is the opening degree of the throttle valve.

[0021] The hydraulic control unit 12 is a unit that has the function of controlling the braking force acting on the wheels. For example, the hydraulic control unit 12 is provided on an oil passage that connects a master cylinder and a wheel cylinder, and includes components (e.g., a control valve and a pump) for controlling the brake hydraulic pressure of the wheel cylinder. The braking force acting on the wheels is controlled by controlling the operation of the components of the hydraulic control unit 12. Note that the hydraulic control unit 12 may control the braking force acting on both the front and rear wheels, or may control only the braking force acting on one of the front and rear wheels.

[0022] The notification device 13 issues a notification to the rider. The notification device 13 has a sound output function and a display function. The sound output function is a function of outputting sound, and is realized by, for example, a speaker. The display function is a function of visually displaying information, and is realized by, for example, a liquid crystal display or a lamp.

[0023] The front camera 14 is provided forward of the riding position (specifically, the assumed riding position) of the rider 2 of the saddle-ride type vehicle 1 and faces rearward. The front camera 14 captures an image of an object to be photographed (e.g., the rider 2) riding on the saddle-ride type vehicle 1 from the front. Specifically, the front camera 14 is provided at the front of the body of the saddle-ride type vehicle 1 in a position facing rearward. During driving, as shown in Figs. 1 and 2, the field of view FV14 of the front camera 14 faces rearward from the front camera 14. The front camera 14 captures an image that reflects such a field of view FV14 during driving.

[0024] The rear camera 15 is provided behind the riding position (specifically, the assumed riding position) of the rider 2 of the saddle type vehicle 1 and faces forward. The rear camera 15 captures an image of an object to be captured (e.g., the rider 2) riding on the saddle type vehicle 1 from behind. Specifically, the rear camera 15 is provided at the rear of the body of the saddle type vehicle 1 in a position facing forward. During driving, as shown in Figs. 1 and 2, the field of view FV15 of the rear camera 15 faces forward from the rear camera 15. The rear camera 15 captures an image that reflects such a field of view FV15 during driving.

[0025] Each of the front camera 14 and the rear camera 15 includes, for example, an imaging device such as a complementary metal oxide semiconductor (CMOS) image sensor, and an image processing device such as an image signal processor (ISP).

[0026] The surrounding environment sensor 16 detects surrounding environment information related to the environment around (for example, in front of) the saddle-ride type vehicle 1. The surrounding environment sensor 16 in FIG. 1 is provided at the front of the body of the saddle-ride type vehicle 1, and detects surrounding environment information in front of the saddle-ride type vehicle 1. The surrounding environment sensor 16 is for acquiring information regarding the relationship between the positions of targets present around the saddle-ride type vehicle 1 and the position of the saddle-ride type vehicle 1 (for example, the relative distance, direction, speed, acceleration, or jerk of the saddle-ride type vehicle 1 with respect to the target) as surrounding environment information. Furthermore, the surrounding environment information may be, for example, status information of targets present around the saddle-ride type vehicle 1. Note that the above targets may include, in addition to vehicles, various obstacles other than vehicles (for example, road facilities, fallen objects, people, animals, etc.).

[0027] The surrounding environment sensor 16 may be, for example, a camera that captures an image of the surroundings of the saddle type vehicle 1 and a radar that can detect the distance from the saddle type vehicle 1 to a surrounding target. For example, a preceding vehicle is detected using an image captured by the camera, and the detection result of the preceding vehicle and the detection result of the radar are used to detect the inter-vehicle distance between the saddle type vehicle 1 and the preceding vehicle, and the relative speed of the saddle type vehicle 1 with respect to the preceding vehicle. Note that the configuration of the surrounding environment sensor 16 is not limited to the above example. For example, in the surrounding environment sensor 16, the radar may be replaced with a LIDAR (Laser Imaging Detection and Ranging) or an ultrasonic sensor. Also, for example, the surrounding environment sensor 16 may be a stereo camera.

[0028] The front wheel speed sensor 17 is a wheel speed sensor that detects the wheel speed of the front wheels (for example, the number of rotations per unit time [rpm] of the front wheels or the travel distance per unit time [km / h], etc.) and outputs the detection result. The front wheel speed sensor 17 may also detect other physical quantities that can be substantially converted into the wheel speed of the front wheels. The front wheel speed sensor 17 is provided on the front wheels.

[0029] The rear wheel speed sensor 18 is a wheel speed sensor that detects the wheel speed of the rear wheels (for example, the number of rotations per unit time [rpm] of the rear wheels or the distance traveled per unit time [km / h], etc.) and outputs the detection result. The rear wheel speed sensor 18 may also detect other physical quantities that can be substantially converted into the wheel speed of the rear wheels. The rear wheel speed sensor 18 is provided on the rear wheels.

[0030] The control device 20 controls the rider assistance system 10. For example, a part or all of the control device 20 is configured with a microcomputer, a microprocessor unit, or the like. Also, for example, a part or all of the control device 20 may be configured with an updatable component such as firmware, or may be a program module executed by commands from a CPU or the like. The control device 20 may be, for example, one unit, or may be divided into multiple units.

[0031] 3, the control device 20 includes, for example, an acquisition unit 21 and an execution unit 22. The control device 20 also communicates with each device of the rider assistance system 10.

[0032] The acquisition unit 21 acquires information from each device of the rider assistance system 10 and outputs it to the execution unit 22. For example, the acquisition unit 21 acquires information from the front camera 14, the rear camera 15, the surrounding environment sensor 16, the front wheel speed sensor 17, and the rear wheel speed sensor 18. Here, the acquisition unit 21 can acquire secondary information based on the information acquired from the devices of the rider assistance system 10. In particular, the acquisition unit 21 acquires on-vehicle status information based on the output result of the rear camera 15. The on-vehicle status information is status information of an object to be photographed (e.g., the rider 2) riding on the saddle-ride type vehicle 1. Details of the on-vehicle status information will be described later. In this specification, acquisition of information can include extraction or generation of information.

[0033] The execution unit 22 executes driving assistance operations for the rider 2 by the rider assistance system 10. The driving assistance operations are operations that assist the rider 2 in driving, and may include various operations. For example, the driving assistance operations may include operations such as a warning operation for the rider 2, a slip control operation, a hill hold operation, or an operation using surrounding environment information (e.g., adaptive cruise control, etc.). Details of these operations will be described later. In the driving assistance operations, the execution unit 22 appropriately controls the operation of the engine 11, the hydraulic control unit 12, and the notification device 13.

[0034] As described above, in the control device 20, the execution unit 22 executes the driving assistance operation for the rider 2 by the rider assistance system 10. Here, the execution unit 22 executes the driving assistance operation based on the on-vehicle state information acquired based on the output result of the rear camera 15. This realizes improvement in the safety of the saddle riding type vehicle 1. The processing related to the driving assistance operation performed by the control device 20 will be described in detail later.

[0035] <Control device operation> The operation of the control device 20 according to the embodiment of the present invention will be described with reference to FIG.

[0036] As described above, in this embodiment, the execution unit 22 of the control device 20 executes a driving assistance operation based on the on-vehicle state information acquired based on the output result of the rear camera 15. Below, an example will be described in which the execution unit 22 executes a warning operation to the rider 2 as the driving assistance operation. However, as described above, the driving assistance operation may be an operation other than a warning operation to the rider 2.

[0037] Fig. 4 is a flowchart showing an example of a process flow related to a warning operation to the rider 2 performed by the control device 20. The control flow shown in Fig. 4 is executed repeatedly, for example, at preset time intervals. Step S101 in Fig. 4 corresponds to the start of the control flow shown in Fig. 4. Step S107 in Fig. 4 corresponds to the end of the control flow shown in Fig. 4.

[0038] When the control flow shown in Fig. 4 is started, in step S102, the execution unit 22 determines whether or not the rider 2 is on the vehicle. If it is determined that the rider 2 is on the vehicle (step S102 / YES), the process proceeds to step S103, where on-board state information is acquired. On the other hand, if it is determined that the rider 2 is not on the vehicle (step S102 / NO), the control flow shown in Fig. 4 ends.

[0039] In step S102, for example, the execution unit 22 determines whether or not the rider 2 is riding on the vehicle based on the output result of the front camera 14 or the output result of the rear camera 15.

[0040] If the determination in step S102 is YES, in step S103, the acquisition unit 21 acquires on-vehicle state information based on the output result of the rear camera 15. Next, in step S104, the execution unit 22 evaluates the risk of traveling the saddle type vehicle 1 based on the on-vehicle state information.

[0041] 4, as described later, the execution unit 22 executes a warning operation according to the degree of danger evaluated in step S104. That is, the execution unit 22 executes a warning operation based on the on-vehicle state information acquired in step S103.

[0042] An example of the on-vehicle state information is posture information of the rider 2. The posture information is information indicating the posture of the rider 2 riding on the saddle-ride type vehicle 1. Specifically, the posture information may include information indicating the position of the body parts of the rider 2 relative to the saddle-ride type vehicle 1. The posture information may also include information indicating the orientation of the body parts of the rider 2 relative to the saddle-ride type vehicle 1. Below, an example of the posture information acquired as the on-vehicle state information in step S103 and an example of the risk assessment based on the posture information in step S104 will be described.

[0043] For example, the acquisition unit 21 acquires information indicating the direction of the rider 2's head with respect to the traveling direction of the saddle type vehicle 1 (specifically, the direction of the front of the head) as posture information. The execution unit 22 can determine whether the rider 2 is looking away from the road based on the direction of the rider 2's head. For example, when the rider 2's head is facing in a direction that is far away from the traveling direction of the saddle type vehicle 1, it is assumed that the rider 2 is looking away from the road, and therefore the execution unit 22 increases the risk assessment value compared to when the rider 2's head is facing in a direction close to the traveling direction of the saddle type vehicle 1.

[0044] Also, for example, the acquisition unit 21 acquires information indicating the vertical position of the rider 2's buttocks relative to the seat of the saddle-ride type vehicle 1 as posture information. The execution unit 22 can determine whether the rider 2 is sitting or standing based on the vertical position of the rider 2's buttocks. For example, when the vertical position of the rider 2's buttocks approximately matches the vertical position of the seat of the saddle-ride type vehicle 1, it can be determined that the rider 2 is sitting. On the other hand, when the vertical position of the rider 2's buttocks is higher than the seat of the saddle-ride type vehicle 1, it can be determined that the rider 2 is standing, and it is assumed that the posture of the rider 2 is unstable and prone to change due to external forces. Therefore, when the vertical position of the rider 2's buttocks is higher than the seat of the saddle-ride type vehicle 1, the execution unit 22 increases the evaluation value of the risk level compared to when the vertical position of the rider 2's buttocks approximately matches the vertical position of the seat of the saddle-ride type vehicle 1.

[0045] Also, for example, the acquisition unit 21 acquires information indicating the position of the rider 2's hands relative to the handlebars of the saddle-ride type vehicle 1 as posture information. The execution unit 22 can determine whether the rider 2 is gripping the handlebars based on the position of the rider 2's hands. For example, if the rider 2's hands are not separated from the handlebars of the saddle-ride type vehicle 1, it can be determined that the rider 2 is gripping the handlebars. On the other hand, if the rider 2's hands are separated from the handlebars of the saddle-ride type vehicle 1, it can be determined that the rider 2 is not gripping the handlebars, and it is assumed that the rider 2's posture is unstable and prone to change due to external forces. Therefore, if the rider 2's hands are separated from the handlebars of the saddle-ride type vehicle 1, the execution unit 22 increases the evaluation value of the risk level compared to when the rider 2's hands are not separated from the handlebars of the saddle-ride type vehicle 1.

[0046] In addition, when the position of the rider's 2 hands is away from the position of the handlebars of the saddle riding type vehicle 1, the execution unit 22 may decrease the degree of risk as the rider's 2 hands get closer to the handlebars of the saddle riding type vehicle 1.

[0047] Also, for example, the acquisition unit 21 acquires information indicating the left and right positions of the buttocks of the rider 2 relative to the saddle riding vehicle 1 as posture information. The execution unit 22 can determine the stability of the posture of the rider 2 based on, for example, the relationship between the left and right positions of the buttocks of the rider 2 and the turning direction of the saddle riding vehicle 1 (for example, whether the left and right direction of the buttocks of the rider 2 relative to the saddle riding vehicle 1 coincides with the turning direction of the saddle riding vehicle 1), and evaluate the risk level according to the determination result. It is preferable that the execution unit 22 determines the stability of the posture of the rider 2 based on posture information indicating the posture of the rider 2's back (i.e., the position and direction of the back), the direction of the head, or the degree of opening of the arms (i.e., the posture including the position and direction of the arms) in addition to the relationship between the left and right positions of the buttocks of the rider 2 and the turning direction of the saddle riding vehicle 1. That is, it is preferable that the execution unit 22 determines the stability of the posture of the rider 2 based on the overall posture of the rider 2 when the rider 2 is viewed from behind.

[0048] The turning direction of the saddle type vehicle 1 may be acquired, for example, based on the output result of the surrounding environment sensor 16, or may be acquired from a navigation device. The execution unit 22 may also determine the stability of the posture of the rider 2 based on the relationship between the turning direction of the saddle type vehicle 1 and posture information other than the left and right positions of the rider 2's hips (for example, information indicating the position and orientation of the rider 2's back with respect to the saddle type vehicle 1, etc.).

[0049] The on-vehicle state information may also include information about accessories attached to the rider 2. The accessory information is information about accessories attached to the rider 2 riding on the saddle riding type vehicle 1. For example, the acquisition unit 21 acquires information indicating whether or not the rider 2 is wearing a helmet as the accessory information. When the rider 2 is not wearing a helmet, the execution unit 22 increases the evaluation value of the risk level compared to when the rider 2 is wearing a helmet.

[0050] The on-vehicle condition information may also include skin exposure information of the rider 2. The skin exposure information is information indicating whether or not the skin of the rider 2 riding on the saddle riding type vehicle 1 is exposed. For example, when the rider 2 is wearing short-sleeved clothing and the rider 2's arms are exposed, the acquisition unit 21 acquires information indicating that the rider 2's skin is exposed as skin exposure information. In this case, the execution unit 22 increases the risk assessment value compared to when the rider 2's skin is not exposed.

[0051] The on-vehicle state information may include information on the number of passengers in the saddle-ride type vehicle 1. The information on the number of passengers is information indicating the number of passengers riding in the saddle-ride type vehicle 1. For example, when only the rider 2 is riding in the saddle-ride type vehicle 1, the acquisition unit 21 acquires information indicating that the number of passengers is one as the information on the number of passengers. On the other hand, when a passenger other than the rider 2 is riding in the saddle-ride type vehicle 1 in addition to the rider 2, the acquisition unit 21 acquires information indicating that the number of passengers is two as the information on the number of passengers. When the number of passengers is two, it is expected that the posture of the saddle-ride type vehicle 1 is more likely to become unstable than when the number of passengers is one. Therefore, when the number of passengers is two, the execution unit 22 increases the evaluation value of the risk level compared to when the number of passengers is one.

[0052] The on-vehicle state information may also include luggage information of the saddle riding type vehicle 1. The luggage information is information indicating luggage carried on the saddle riding type vehicle 1. It is expected that the more luggage there is, the more likely the behavior of the saddle riding type vehicle 1 will be delayed in response to driving operations. Therefore, the more luggage there is, the higher the risk assessment value is set by the execution unit 22.

[0053] Here, the acquisition unit 21 may acquire the on-vehicle status information based on the output results of the front camera 14, which is provided forward of the riding position of the rider 2 and faces rearward, in addition to the output results of the rear camera 15. This allows the on-vehicle status information to be acquired based on more information than when the on-vehicle status information is acquired based only on the output results of the rear camera 15, so that the on-vehicle status information can be acquired more appropriately.

[0054] Furthermore, by using the output result of the front camera 14, information other than the information exemplified above can also be acquired as on-vehicle state information. For example, the acquisition unit 21 acquires information indicating the eye direction of the rider 2 with respect to the traveling direction of the saddle riding type vehicle 1 (i.e., the direction of the line of sight) as posture information. For example, when the eyes of the rider 2 are directed in a direction far away from the traveling direction of the saddle riding type vehicle 1, it is assumed that the rider 2 is looking away while driving, and therefore the execution unit 22 increases the evaluation value of the risk level compared to when the eyes of the rider 2 are directed in a direction close to the traveling direction of the saddle riding type vehicle 1. Note that the information indicating the eye direction of the rider 2 may be acquired based on the output result of a camera provided on a helmet worn on the head of the rider 2.

[0055] The acquisition unit 21 may acquire information indicating the degree of eye opening of the rider 2 (i.e., the degree of eyelid opening) as the on-vehicle state information. The information indicating the degree of eye opening of the rider 2 may be acquired based on the output result of a camera provided on a helmet worn on the head of the rider 2. It is assumed that the smaller the degree of eye opening of the rider 2, the lower the rider 2's concentration on driving. Therefore, the smaller the degree of eye opening of the rider 2, the higher the risk assessment value is set by the execution unit 22.

[0056] Next, in step S105, the execution unit 22 judges whether the risk is greater than the threshold value. If it is judged that the risk is greater than the threshold value (step S105 / YES), the process proceeds to step S106, where a warning operation is performed. On the other hand, if it is judged that the risk is equal to or less than the threshold value (step S105 / NO), the control flow shown in FIG. 4 ends.

[0057] The threshold value is set to a value that can appropriately determine whether or not the risk level evaluated in step S104 is high enough to require a warning operation to be performed on the rider 2. The threshold value may differ depending on the driving mode that can be switched in the saddle type vehicle 1. The driving modes include, for example, an urban mode and a circuit mode, and the behavior characteristics (for example, the damping characteristics of the suspension or the braking characteristics of the anti-lock brake operation) of the saddle type vehicle 1 during driving differ between the driving modes.

[0058] If the determination in step S105 is YES, in step S106, the execution unit 22 executes a warning operation to the rider 2, and the control flow shown in Fig. 4 ends. For example, after the warning operation to the rider 2 continues for a set time, the control flow shown in Fig. 4 ends. Also, for example, when an input operation for stopping the warning operation to the rider 2 is performed by the rider 2, the control flow shown in Fig. 4 ends.

[0059] The warning operation for the rider 2 is an operation of causing various devices to issue a warning to the rider 2 to pay attention to driving. For example, in the warning operation for the rider 2, the execution unit 22 causes the notification device 13 to display a message calling attention to driving. Also, for example, in the warning operation for the rider 2, the execution unit 22 causes the notification device 13 to output a sound to call attention to driving.

[0060] The warning operation for the rider 2 is not limited to the above example using the notification device 13.

[0061] For example, in the warning operation to the rider 2, the execution unit 22 may cause a display device (for example, a transparent display arranged in the line of sight of the rider 2) provided on a helmet worn on the head of the rider 2 to display a message calling attention to driving. Also, for example, in the warning operation to the rider 2, the execution unit 22 may cause an audio output device provided on a helmet worn on the head of the rider 2 to output an audio message calling attention to driving.

[0062] Furthermore, for example, the execution unit 22 may cause a vibration generating device to generate vibrations that call the rider 2's attention while driving in a warning operation for the rider 2. The vibration generating device may be provided in the saddle type vehicle 1, or may be worn by the rider 2.

[0063] Furthermore, for example, the execution unit 22 may call the driver's attention by instantaneously decelerating the saddle type vehicle 1 in the warning operation to the rider 2. Note that the instantaneous deceleration may be realized by reducing the output of the engine 11, by causing the hydraulic control unit 12 to generate a braking force, or by changing the gear ratio of the gear change mechanism of the saddle type vehicle 1.

[0064] As described above, in the control flow shown in FIG. 4, the execution unit 22 executes a warning operation to the rider 2 based on the on-vehicle state information. Here, the on-vehicle state information is acquired based on the output result of the rear camera 15. Compared with the image captured by the front camera 14, the image captured by the rear camera 15 captures a wider range of the subject (e.g., the rider 2) riding on the saddle-ride type vehicle 1. For example, the image captured by the rear camera 15 captures parts of the rider 2's body that are not captured in the image captured by the front camera 14 (e.g., the buttocks, etc.). Therefore, by acquiring the on-vehicle state information based on the output result of the rear camera 15, it is possible to acquire the on-vehicle state information more appropriately. Therefore, it is possible to appropriately perform a warning operation to the rider 2 according to the state on the saddle-ride type vehicle 1. Therefore, it is possible to improve the safety of the saddle-ride type vehicle 1.

[0065] In the above, an example has been described in which the warning operation to the rider 2 is executed based on the on-vehicle state information. However, as described above, the execution unit 22 may execute an operation other than the warning operation to the rider 2 as the driving assistance operation.

[0066] The driving assistance operation may include, for example, a slip control operation. The slip control operation is an operation for controlling the slip degree of the wheels to a slip degree target by increasing or decreasing the braking force or driving force of the saddle type vehicle 1, and is, for example, an antilock brake operation or a traction control operation. The slip degree is an index showing the degree to which the wheels are slipping on the road surface. For example, a slip ratio obtained by dividing the difference between the vehicle speed and the wheel speed by the vehicle speed is used as the slip degree. The execution unit 22 calculates the slip ratio of each wheel based on, for example, the wheel speed of the front wheels and the wheel speed of the rear wheels. Note that, a parameter other than the slip ratio (for example, another physical quantity that can be substantially converted into a slip ratio) may be used as the slip degree.

[0067] The execution unit 22 may execute a slip control operation based on on-vehicle state information acquired based on the output result of the rear camera 15. For example, the execution unit 22 may control the slip degree of the wheels in the slip control operation so that the slip degree of the wheels changes according to the risk of traveling estimated from the on-vehicle state information. However, in this case, the execution unit 22 does not necessarily have to perform a process of evaluating the risk of traveling. As described above, by acquiring the on-vehicle state information based on the output result of the rear camera 15, it is possible to acquire the on-vehicle state information more appropriately. Therefore, it is possible to appropriately perform a slip control operation according to the state on the saddle type vehicle 1. Therefore, it is possible to improve the safety of the saddle type vehicle 1.

[0068] The driving assistance operation may include, for example, a hill hold operation. The hill hold operation is an operation that generates a braking force on the saddle type vehicle 1 while the vehicle is stopped without the brake operation by the rider 2 in order to prevent the saddle type vehicle 1 from rolling backward when starting on a slope.

[0069] The execution unit 22 may execute a hill-hold operation based on on-vehicle state information acquired based on the output result of the rear camera 15. For example, the execution unit 22 may control the braking force of the saddle-ride type vehicle 1 in the hill-hold operation so that the braking force of the saddle-ride type vehicle 1 is changed according to the degree of danger of traveling estimated from the on-vehicle state information. However, in this case, the execution unit 22 does not necessarily have to perform the process of evaluating the degree of danger of traveling. As described above, by acquiring the on-vehicle state information based on the output result of the rear camera 15, it is possible to acquire the on-vehicle state information more appropriately. Therefore, the hill-hold operation can be appropriately performed according to the state on the saddle-ride type vehicle 1. Therefore, the safety of the saddle-ride type vehicle 1 can be improved.

[0070] The driving assistance operation may include, for example, an operation using surrounding environment information obtained based on the output results of the surrounding environment sensor 16 provided in the saddle-type vehicle 1, or surrounding environment information obtained via wireless communication with other vehicles or infrastructure facilities.

[0071] The operation using the surrounding environment information may be, for example, a notification operation that notifies the rider of the approach of another vehicle. In the above-mentioned notification operation, the execution unit 22 causes the alarm device 13 to perform, for example, a display or a voice output that notifies the rider of the approach of another vehicle. The operation using the surrounding environment information may be, for example, an adaptive cruise control. In the adaptive cruise control, the execution unit 22 controls the speed of the saddle type vehicle 1 according to the inter-vehicle distance between the saddle type vehicle 1 and the preceding vehicle so as to avoid a collision with the preceding vehicle. The operation using the surrounding environment information may be, for example, an automatic emergency brake. In the automatic emergency brake, when the saddle type vehicle 1 approaches the preceding vehicle excessively, the execution unit 22 automatically generates a braking force on the saddle type vehicle 1 so as to avoid a collision with the preceding vehicle.

[0072] The execution unit 22 may execute an operation using the surrounding environment information based on the on-vehicle state information acquired based on the output result of the rear camera 15. For example, the execution unit 22 may perform various controls in the operation using the surrounding environment information so that the timing of notifying the rider of the approach of another vehicle and the braking force and driving force of the saddle type vehicle 1 change according to the risk of traveling estimated from the on-vehicle state information. However, in this case, the execution unit 22 does not necessarily have to perform the process of evaluating the risk of traveling. As described above, by acquiring the on-vehicle state information based on the output result of the rear camera 15, it is possible to acquire the on-vehicle state information more appropriately. Therefore, it is possible to appropriately perform the operation using the surrounding environment information according to the state on the saddle type vehicle 1. Therefore, it is possible to improve the safety of the saddle type vehicle 1.

[0073] Here, the acquisition unit 21 may acquire the surrounding environment information based on the output result of the rear camera 15 as the surrounding environment sensor. The field of view FV15 of the rear camera 15 faces forward. Therefore, the acquisition unit 21 can acquire the surrounding environment information related to the environment within the field of view FV15 of the rear camera 15 based on the image captured by the rear camera 15. In particular, since the field of view FV15 of the rear camera 15 includes the area on the side of the saddle type vehicle 1, the surrounding environment information acquired based on the output result of the rear camera 15 includes information on the relationship between the position of a target (e.g., another vehicle) existing on the side of the saddle type vehicle 1 and the position of the saddle type vehicle 1. Therefore, for example, by using the surrounding environment information acquired based on the output result of the rear camera 15 in addition to the surrounding environment information detected by the surrounding environment sensor 16, the operation using the surrounding environment information can be more appropriately performed.

[0074] <Effects of the control device> The effects of the control device 20 according to the embodiment of the present invention will be described.

[0075] In the control device 20, the acquisition unit 21 acquires on-vehicle state information, which is state information of an imaged object riding on the saddle-ride type vehicle 1, based on the output result of the rear camera 15. The execution unit 22 executes the driving assistance operation of the rider 2 by the rider assistance system 10 based on the on-vehicle state information. As described above, the image captured by the rear camera 15 shows a wider range of the imaged object (e.g., the rider 2) riding on the saddle-ride type vehicle 1 compared to the image captured by the front camera 14. Therefore, by acquiring the on-vehicle state information based on the output result of the rear camera 15, it is possible to acquire the on-vehicle state information more appropriately. Therefore, it is possible to appropriately perform the driving assistance operation according to the state on the saddle-ride type vehicle 1. Therefore, it is possible to improve the safety of the saddle-ride type vehicle 1.

[0076] Preferably, in the control device 20, the on-vehicle state information includes posture information of the rider 2. Here, the posture information of the rider 2 is acquired based on the output result of the rear camera 15. This makes it possible to acquire the posture information of the rider 2 more appropriately. Therefore, it is possible to appropriately perform the driving assistance operation according to the posture of the rider 2. Therefore, it is possible to appropriately improve the safety of the saddle riding type vehicle 1.

[0077] Preferably, in the control device 20, the posture information includes information indicating the positions of the body parts of the rider 2 relative to the saddle type vehicle 1. This makes it possible to obtain more detailed posture information of the rider 2. This makes it possible to more appropriately perform the driving assistance operation according to the posture of the rider 2. This makes it possible to more appropriately improve the safety of the saddle type vehicle 1.

[0078] Preferably, in the control device 20, the posture information includes information indicating the orientation of the body parts of the rider 2 with respect to the saddle type vehicle 1. This makes it possible to obtain more detailed posture information of the rider 2. This makes it possible to more appropriately perform the driving assistance operation according to the posture of the rider 2. This makes it possible to more appropriately improve the safety of the saddle type vehicle 1.

[0079] Preferably, in the control device 20, the on-vehicle status information includes information on accessories attached to the rider 2. Here, the information on accessories attached to the rider 2 is acquired based on the output result of the rear camera 15. This makes it possible to acquire the information on accessories attached to the rider 2 more appropriately. Therefore, it is possible to appropriately perform the driving assistance operation according to the attachment state of the accessories attached to the rider 2. Therefore, it is possible to appropriately improve the safety of the saddle riding type vehicle 1.

[0080] Preferably, in the control device 20, the on-vehicle condition information includes skin exposure information of the rider 2. Here, the skin exposure information of the rider 2 is acquired based on the output result of the rear camera 15. This makes it possible to acquire the skin exposure information of the rider 2 more appropriately. Therefore, it is possible to appropriately perform the driving assistance operation according to the exposed skin state of the rider 2. Therefore, it is possible to appropriately improve the safety of the saddle type vehicle 1.

[0081] Preferably, in the control device 20, the on-vehicle status information includes information on the number of passengers in the saddle-ride type vehicle 1. Here, the information on the number of passengers is acquired based on the output result of the rear camera 15. This makes it possible to acquire the information on the number of passengers more appropriately. Therefore, it is possible to appropriately perform the driving assistance operation according to the number of passengers in the saddle-ride type vehicle 1. Therefore, it is possible to appropriately improve the safety of the saddle-ride type vehicle 1.

[0082] Preferably, in the control device 20, the on-vehicle status information includes luggage information of the saddle type vehicle 1. Here, the luggage information is acquired based on the output result of the rear camera 15. This makes it possible to acquire the luggage information more appropriately. Therefore, it is possible to appropriately perform the driving assistance operation according to the luggage loading status of the saddle type vehicle 1. Therefore, it is possible to appropriately improve the safety of the saddle type vehicle 1.

[0083] Preferably, in the control device 20, the driving assistance operation includes a warning operation for the rider 2. This allows the warning operation for the rider 2 to be appropriately performed according to the state on the saddle type vehicle 1. Therefore, the safety of the saddle type vehicle 1 can be appropriately improved.

[0084] Preferably, in the control device 20, the driving assistance operation includes a slip control operation. This allows the slip control operation to be appropriately performed according to the state of the saddle type vehicle 1. Therefore, the safety of the saddle type vehicle 1 can be appropriately improved.

[0085] Preferably, in the control device 20, the driving assistance operation includes a hill hold operation. This allows the hill hold operation to be performed appropriately according to the state of the saddle type vehicle 1. Therefore, the safety of the saddle type vehicle 1 can be appropriately improved.

[0086] Preferably, in the control device 20, the driving assistance operation includes an operation using surrounding environment information acquired based on the output result of the surrounding environment sensor 16 provided in the saddle type vehicle 1, or surrounding environment information acquired via wireless communication with other vehicles or infrastructure facilities. This makes it possible to appropriately perform an operation using the surrounding environment information according to the state of the saddle type vehicle 1. Therefore, the safety of the saddle type vehicle 1 can be appropriately improved.

[0087] Preferably, in the control device 20, the acquisition unit 21 acquires the surrounding environment information based on the output result of the rear camera 15 serving as the surrounding environment sensor. Thereby, for example, by using the surrounding environment information acquired based on the output result of the rear camera 15 in addition to the surrounding environment information detected by the surrounding environment sensor 16, it is possible to more appropriately perform an operation using the surrounding environment information.

[0088] Preferably, in the control device 20, the acquisition unit 21 acquires the on-vehicle state information based on the output result of the front camera 14, which is provided forward of the riding position of the rider 2 and faces backward, in addition to the output result of the rear camera 15. As a result, the on-vehicle state information is acquired based on more information than when the on-vehicle state information is acquired based only on the output result of the rear camera 15, so that the on-vehicle state information can be acquired more appropriately. Furthermore, by using the output result of the front camera 14, it is also possible to acquire on-vehicle state information other than the on-vehicle state information acquired based only on the output result of the rear camera 15. Therefore, the driving assistance operation can be performed more appropriately according to the state on the saddle-ride type vehicle 1. Therefore, the safety of the saddle-ride type vehicle 1 can be improved more appropriately.

[0089] The present invention is not limited to the description of the embodiment. For example, only a part of the embodiment may be implemented. In addition, in the above, an example in which on-vehicle status information is acquired based only on the output result of the rear camera 15, or an example in which on-vehicle status information is acquired based on the output result of the front camera 14 in addition to the output result of the rear camera 15, has been described. However, on-vehicle status information may be acquired based only on the output result of the front camera 14. [Explanation of symbols]

[0090] 1 saddle-type vehicle, 2 rider, 10 rider assistance system, 11 engine, 12 hydraulic control unit, 13 alarm device, 14 front camera, 15 rear camera, 16 surrounding environment sensor, 17 front wheel speed sensor, 18 rear wheel speed sensor, 20 control device, 21 acquisition unit, 22 execution unit, FV14 field of view, FV15 field of view.

Claims

1. A control device (20) for a rider assistance system (10) that assists a rider (2) in driving a saddle-type vehicle (1), comprising: an acquisition unit (21) that acquires on-vehicle status information, which is status information of an imaged object riding on the saddle-ride type vehicle (1), based on an output result of a rear camera (15) that is provided rearward of a riding position of the rider (2) of the saddle-ride type vehicle (1) and faces forward; an execution unit (22) that executes a driving assistance operation for the rider (2) by the rider assistance system (10) based on the on-vehicle state information; Equipped with The execution unit (22) determines whether or not the rider (2) is riding on the vehicle based on the output result of the rear camera (15), and executes the driving assistance operation when the rider (2) is riding on the vehicle. Control device.

2. The on-board state information includes posture information of the rider (2). The control device according to claim 1 .

3. The posture information includes information indicating positions of body parts of the rider (2) relative to the saddle riding type vehicle (1). The control device according to claim 2.

4. The posture information includes information indicating an orientation of a body part of the rider (2) relative to the saddle riding type vehicle (1). The control device according to claim 2 or 3.

5. The on-board status information includes information about equipment worn by the rider (2). The control device according to any one of claims 1 to 4.

6. The on-board state information includes skin exposure information of the rider (2). The control device according to any one of claims 1 to 5.

7. The on-board status information includes information on the number of passengers in the saddle-ride type vehicle (1). The control device according to any one of claims 1 to 6.

8. The on-board status information includes luggage information of the saddle type vehicle (1). The control device according to any one of claims 1 to 7.

9. The driving assistance operation includes a warning operation to the rider (2). The control device according to any one of claims 1 to 8.

10. The driving assistance operation includes a slip control operation. The control device according to any one of claims 1 to 9.

11. The driving assistance operation includes a hill hold operation. The control device according to any one of claims 1 to 10.

12. The driving assistance operation includes an operation using surrounding environment information acquired based on an output result of a surrounding environment sensor (16) provided in the saddle type vehicle (1), or surrounding environment information acquired via wireless communication with another vehicle or infrastructure equipment. A control device according to any one of claims 1 to 11.

13. The acquisition unit (21) acquires the surrounding environment information based on an output result of the rear camera (15) serving as the surrounding environment sensor. The control device according to claim 12.

14. The acquisition unit (21) acquires the on-vehicle state information based on the output result of the front camera (14) that is provided forward of the riding position of the rider (2) and faces rearward, in addition to the output result of the rear camera (15). A control device according to any one of claims 1 to 13.

15. A control method for a rider assistance system (10) that assists a rider (2) in driving a saddle-type vehicle (1), comprising the steps of: an acquisition unit (21) of the control device (20) acquires on-vehicle status information, which is status information of an imaged object riding on the saddle-ride type vehicle (1), based on an output result of a rear camera (15) that is provided rearward of a riding position of the rider (2) of the saddle-ride type vehicle (1) and faces forward; an execution unit (22) of the control device (20) executes a driving assistance operation for the rider (2) by the rider assistance system (10) based on the on-vehicle state information; the execution unit (22) determines whether or not the rider (2) is riding on the vehicle based on the output result of the rear camera (15), and executes the driving assistance operation if the rider (2) is riding on the vehicle. Control methods.

Images