Vehicle control system, control method, and control program
The vehicle control device addresses the challenge of elderly passengers operating conventional systems by using sensors to detect exit intentions and adjust speed, ensuring easy disembarkation without unnecessary deceleration.
Patent Information
- Application Number
- JP2023081348
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-17
- Publication Date
- 2024-11-28
AI Technical Summary
Conventional vehicle systems impose a heavy burden on elderly passengers who have difficulty operating the operating unit, and unnecessary deceleration due to erroneous operations increase travel time, impairing convenience.
A vehicle control device that uses sensors to detect a passenger's intention to exit, issues a notification, and adjusts speed accordingly to facilitate easy disembarkation without requiring manual operation.
Enables easy passenger disembarkation without impairing vehicle convenience by accurately detecting exit intentions and adjusting speed, reducing the need for manual operation and minimizing unnecessary deceleration.
Smart Images

Figure 2024165281000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a vehicle control device, a control method, and a control program. [Background technology]
[0002] Conventionally, for example, vehicles that run at low speed along a predetermined route in a shopping mall and allow passengers to get on and off while the vehicle is moving are known (see, for example, Patent Document 1). With this technology, when a passenger gets off the vehicle, the vehicle slows down by operating an operating unit such as a push button. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2016-45805 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the conventional technology, the burden of operating the operation unit is large for elderly people and others who have difficulty operating the operation unit while driving. In addition, if the operation unit is operated incorrectly and the vehicle is unnecessarily decelerated, the travel time for the route increases, and the convenience of the vehicle may be impaired.
[0005] The present application has been made in consideration of the above, and aims to provide a vehicle control device, a control method, and a control program that enable a user to easily disembark from the vehicle without compromising its convenience. [Means for solving the problem]
[0006] A vehicle control device according to the present application includes a controller. The controller controls an unmanned vehicle that allows a passenger to disembark while traveling. When the controller determines that the passenger has expressed an intention to disembark based on sensor information related to the passenger, the controller outputs an alert instruction signal to an alert device to confirm the intention to disembark, and when the controller determines that the passenger still has an intention to disembark based on the sensor information related to the passenger after the alert by the alert device, the controller outputs a control signal to a drive device of the unmanned vehicle to decelerate the unmanned vehicle. Effect of the Invention
[0007] According to one aspect of the embodiment, it is possible to provide an advantage that a passenger can easily disembark from the vehicle without compromising the convenience of the vehicle. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram showing an overview of a vehicle control method according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of the configuration of the vehicle control device according to the embodiment. [Diagram 3] FIG. 3 is a diagram for explaining a method for detecting an intention to get off. [Figure 4] FIG. 4 is a diagram for explaining a method for detecting an intention to get off. [Diagram 5] FIG. 5 is a flowchart illustrating an example of a process executed by the controller of the vehicle control device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of a vehicle control device, a control method, and a control program will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiment.
[0010] First, an overview of a vehicle control method according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an overview of a vehicle control method according to an embodiment. As shown in Fig. 1, the vehicle control method according to the embodiment is executed by a vehicle control device 1 mounted on a vehicle C.
[0011] Here, the vehicle C is a slow mobility vehicle, and is a vehicle that travels by automatic driving at a low speed (for example, about the walking speed of a person, such as 3 km / h) on a predetermined route in facilities such as shopping malls, airports, stations, theme parks, and parks. In addition, the vehicle C does not have a door or the like at the boarding and alighting position, and users can board and alight freely while traveling. In other words, since the vehicle C in the present disclosure allows boarding and alighting while traveling, it does not usually stop for boarding and alighting. In addition, the number of people that can board the vehicle C is not limited to one person, and may be multiple people. In this case, the vehicle C has a boarding space that can accommodate multiple people. In addition, the boarding and alighting position of the vehicle C is not limited to one side of the vehicle C, but may be both sides, and may be the rear or front of the vehicle C. In addition, the vehicle C is capable of unmanned driving without a driver on board. Note that automatic driving (unmanned driving) refers to autonomous driving equipped with artificial intelligence and capable of self-determination, self-control, and self-adjustment, automatic driving that substitutes for human driving operation using sensors and software, and automated driving in which human operation is minimized. Vehicle C is a vehicle that is remotely controlled and travels along a predetermined route.
[0012] In the present disclosure, the vehicle control device 1 controls the traveling speed of the vehicle C, and also assists the occupant in getting off the vehicle by decelerating the vehicle when a specific state is detected from the occupant.
[0013] Specifically, the vehicle control device 1 first detects an intention to get off indicating an intention of the occupant to get off (step S1). For example, the vehicle control device 1 detects the intention to get off when the position, orientation, and posture of the occupant are in a specific state based on an image captured by a camera (not shown). A detailed method of detecting the intention to get off will be described later with reference to Figs. 3 and 4.
[0014] Next, the vehicle control device 1 issues a notification to the occupant who has been detected as having the intention to dismount (step S2). For example, the vehicle control device 1 issues a notification indicating that deceleration will occur after a predetermined time. In addition, the vehicle control device 1 may also issue a notification requesting the occupant to eliminate the intention to dismount (for example, requesting the occupant to move inward from the dismounting line in FIG. 3) in consideration of a case in which the vehicle control device 1 detects an intention to dismount from an occupant who has no intention to dismount.
[0015] Next, the vehicle control device 1 detects whether the intention to get off continues after the notification in step S2 (step S3), and if so, reduces (decels) the traveling speed of the vehicle (step S4). Specifically, the vehicle control device 1 outputs a control signal instructing deceleration or acceleration to a drive device (not shown) provided in the vehicle C. Note that the vehicle control device 1 may achieve deceleration or stopping by braking means such as brakes. The type of brake may be a mechanical brake such as a disc brake or drum brake, or may be an electromagnetic brake that generates a braking force by utilizing electrical force to stop the rotation of the motor. Furthermore, the braking means using the brakes can be controlled remotely.
[0016] In this manner, in the present disclosure, since the occupant's intention to get off is detected by a sensor such as a camera, there is no need to operate an operating unit to indicate the intention to get off. Furthermore, since the vehicle control device 1 detects the intention to get off and once notifies the occupant, the occupant can cancel the intention to get off by the notification and the vehicle does not need to be decelerated, even if the occupant mistakenly indicates the intention to get off. Therefore, the vehicle control device 1 according to the embodiment allows the occupant to easily get off the vehicle without compromising the convenience of the vehicle.
[0017] In the present disclosure, the use of a sensor (such as a camera) attached to the vehicle C is not limited, and for example, information on infrastructure equipment in the surrounding facilities or information on sensors in the surrounding vehicles may be acquired to detect the occupant's intention to get off. In other words, the vehicle control device 1 uses a sensor provided inside or outside the vehicle.
[0018] In addition, in the present disclosure, the vehicle control device 1 may decelerate when an operation unit (such as a disembarking switch) provided in the vehicle C is operated. In this way, when an occupant wants to immediately decelerate the vehicle C in order to disembark, the occupant can decelerate the vehicle C by operating the operation unit.
[0019] Next, a configuration example of the vehicle control device 1 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a functional block diagram showing a configuration example of the vehicle control device 1 according to the embodiment. As shown in Fig. 2, the vehicle control device 1 includes a controller 2 and a storage unit 3. In addition, a sensor 100 mounted on a vehicle C is connected to the vehicle control device 1.
[0020] The sensor 100 is a sensor for detecting the state of an occupant in the vehicle C, and may be, for example, a camera, an infrared sensor, a weight sensor, or the like.
[0021] The storage unit 3 is a storage unit configured with a storage device such as a non-volatile memory, a data flash, a hard disk drive, etc. The storage unit 3 stores information necessary for the processing of the controller 2, such as various programs.
[0022] The controller 2 includes a detection unit 21, a notification unit 22, and a speed control unit 23. The controller 2 includes, for example, a computer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), input / output ports, and various other circuits.
[0023] The CPU of the computer, for example, reads out and executes a program stored in the ROM, thereby functioning as the detection unit 21, the notification unit 22, and the speed control unit 23 of the controller 2. In addition, at least some or all of the detection unit 21, the notification unit 22, and the speed control unit 23 of the controller 2 can be configured with hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0024] The detection unit 21 detects an intention to get off indicating an intention of an occupant of the vehicle C to get off. Specifically, the detection unit 21 detects the intention to get off based on a detection result of the sensor 100. For example, the detection unit 21 detects the intention to get off based on the position, orientation, and posture of the occupant detected based on an image of the camera, which is the sensor 100. Here, a method for detecting the intention to get off will be described with reference to Figs. 3 and 4.
[0025] Fig. 3 and Fig. 4 are diagrams for explaining a method for detecting an intention to get off. Note that Fig. 3 and Fig. 4 will be described by taking an example in which the sensor 100 is a camera. Also, Fig. 3 is a diagram of the vehicle C seen from above, and Fig. 4 is a diagram of the vehicle C seen from the rear (or front). Also, Fig. 3 and Fig. 4 are diagrams showing an intention to get off when an occupant stands on the floor surface F of the vehicle C and tries to get off from the side of the vehicle C. Note that Fig. 3 and Fig. 4 show a simplified structure of the vehicle C.
[0026] As shown in Fig. 3, for example, the detection unit 21 detects whether the position of the occupant is outside the disembarking line based on the image of the camera, and detects the intention to disembark when the occupant is outside the disembarking line. Specifically, the detection unit 21 defines that the occupant is outside the disembarking line when the distance between the disembarking line and the end of the vehicle C (disembarking entrance) is equal to or less than a threshold distance (e.g., 1 / 3 or less of the vehicle width) and a part of the occupant's body is present in the area between the disembarking line and the end of the vehicle C. Furthermore, the detection unit 21 detects that the occupant is not outside (is inside) the disembarking line when no part of the occupant is included in the area.
[0027] The disembarking line is, for example, a line located a predetermined distance inside from the end (disembarking entrance) of the vehicle C. Note that the disembarking line may be an actual line that can be detected from an image captured by a camera, or may be a virtually existing line located a predetermined distance inside from the end of the vehicle C.
[0028] 3, the detection unit 21 may detect the intention to get off when the occupant located outside the get-off line faces outward. That is, the detection unit 21 detects the intention to get off when the occupant faces the direction of getting off (the direction of the get-off exit).
[0029] In this way, the detection unit 21 detects the state of intent to get off based on the position and orientation of the occupant, thereby being able to detect the state of intent to get off with high accuracy.
[0030] 3, the detection unit 21 is not limited to detecting the dismounting intention state using a camera, but may detect whether or not the occupant has crossed the dismounting line by installing an infrared sensor along the dismounting line, for example. The detection unit 21 may also detect whether or not the occupant is outside the dismounting line by arranging a weight sensor in an area outside the dismounting line.
[0031] 4, the detection unit 21 may detect the intention to get off based on the posture of the occupant detected based on the image of the camera. Specifically, the detection unit 21 detects the skeleton of the occupant based on the image of the camera, and detects the posture based on the detected skeleton.
[0032] For example, the detection unit 21 detects the intention to get off when the detected posture is a posture in which the occupant leans outward from the vehicle C. Specifically, the detection unit 21 detects the intention to get off when a part of the occupant's body is positioned outward from the end of the vehicle C.
[0033] More specifically, as shown in Fig. 4, the detection unit 21 detects the intention to get off when the occupant is in a bowing position and the occupant's head is located outside the end of the vehicle C. In this way, the detection unit 21 can detect the intention to get off with high accuracy by detecting the intention to get off based on the occupant's posture.
[0034] The detection unit 21 may detect the intention to get off immediately after detecting the state of the occupant as shown in Fig. 3 and Fig. 4, or may detect the intention to get off when the above state continues for a predetermined time (e.g., 10 seconds) or more. The predetermined time is an example of the first time.
[0035] 3 and 4 show an example in which the occupant's body faces the side of the vehicle C, which is the disembarking position, but the disembarking intention state may be detected even if the occupant's body faces a direction other than the disembarking position (forward or backward of the vehicle C). In other words, the detection unit 21 detects the disembarking intention state even if the occupant crosses the disembarking line with his or her body facing forward of the vehicle C.
[0036] Furthermore, the detection unit 21 may detect the intention to get off based on the direction of the occupant's toes. For example, the detection unit 21 may detect the intention to get off when the occupant crosses the get-off line with the toes facing the side of the vehicle C (the direction of the get-off position).
[0037] Furthermore, the detection unit 21 may detect the intention to get off when the occupant's baggage (e.g., an umbrella or a bag) protrudes outside the vehicle C and the occupant crosses the disembarking line. The detection unit 21 may detect the intention to get off based on whether the occupant's baggage is outside the vehicle, regardless of whether the occupant crosses the disembarking line. The detection unit 21 may detect the intention to get off when the intention to get off can be confirmed based on both whether the baggage is outside the vehicle and the direction of the occupant's body.
[0038] Furthermore, the detection unit 21 may express the detected skeleton as a simplified skeleton line BL in FIG. 4, and may detect the intention to get off based on the skeleton line BL.
[0039] The notification unit 22 issues a notification to an occupant whose intention to get off has been detected by the detection unit 21. That is, when the notification unit 22 determines that the occupant has expressed an intention to get off, it outputs a notification instruction signal to a notification device (speaker, display, etc.) (not shown) to confirm the intention to get off. Specifically, the notification unit 22 issues a notification when the intention to get off continues for a predetermined time (for example, 10 seconds: an example of the first time). In this way, by issuing a notification when the intention to get off continues for a predetermined time, the notification unit 22 can prevent an alert from being issued when an intention to get off is erroneously expressed.
[0040] The contents of the notification by the notification unit 22 are, for example, a message indicating that deceleration will be performed after a predetermined time, or a message requesting that the passenger who has no intention of getting off the vehicle cancel the state of intention of getting off in consideration of the detection of the state of intention of getting off from the passenger who has no intention of getting off. The notification may be made by audio output through a speaker or by a screen display through a display.
[0041] The notification unit 22 is not limited to notifying by devices (speakers and displays) attached to the vehicle C, and may notify by using notification means of communication-enabled devices attached to infrastructure facilities, for example. In other words, the notification unit 22 notifies by using notification means provided inside or outside the vehicle.
[0042] In addition, the notification unit 22 may use a notification means provided in a communication terminal device such as a smartphone owned by the user of the vehicle C to make the notification.
[0043] The speed control unit 23 reduces the traveling speed of the vehicle C when the intention to get off continues after the notification by the notification unit 22. Specifically, the speed control unit 23 reduces the traveling speed of the vehicle C to a certain value when the intention to get off is detected for a predetermined period of time (e.g., 2 seconds: an example of the second time) after the notification. In this way, the speed control unit 23 waits for the second period of time after the notification before decelerating, thereby creating time for the occupant to resolve the intention to get off due to the notification.
[0044] If the intention to disembark is resolved while decelerating to a certain value (resolved when the passenger disembarks or gets on), the speed control unit 23 increases (accelerates) the traveling speed to return it to the normal speed (e.g., 3 km / h).
[0045] As a result, the speed control unit 23 can return the vehicle C to the normal speed without stopping it. The speed control unit 23 may change the amount of change in speed between deceleration and acceleration. For example, the speed control unit 23 sets the amount of change in acceleration to be smaller than the amount of change in deceleration. This makes it possible to prevent the occupant from becoming unsteady inside the vehicle during acceleration.
[0046] Furthermore, when the intention to get off is still detected even after the speed is decelerated to a certain value, the speed control unit 23 further decelerates the speed from the certain value and stops the vehicle C. This allows, for example, even a passenger who has difficulty getting off the vehicle even at a certain speed after deceleration to easily get off the vehicle.
[0047] At this time, the notification unit 22 may issue a notification requesting the occupant to get off after stopping, or a notification requesting the occupant to cancel the intention to get off. If the intention to get off continues after the notification, the notification unit 22 may issue a notice to the manager of the vehicle C to instruct him or her to check the situation, or may use a conversation device (equipped with a speaker and a microphone) to have a conversation between the occupant and the manager, for example.
[0048] When the occupant's intention to get off the vehicle C is eliminated while the vehicle C is turning, the speed control unit 23 accelerates the vehicle C under acceleration conditions different from those during straight driving until the turning is completed. For example, the speed control unit 23 accelerates the vehicle C more slowly when turning than when driving straight.
[0049] Furthermore, the speed control unit 23 may use a sensor to detect the road surface condition immediately before stopping and determine the stopping position. For example, when the road surface near the planned stopping position is in a state unsuitable for disembarking due to a puddle or the like, the speed control unit 23 passes through the puddle while maintaining the speed immediately before stopping, and when it is determined that there is no puddle at the stopping position, it further decelerates and stops.
[0050] Next, a process executed by the controller 2 of the vehicle control device 1 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of a process executed by the controller 2 of the vehicle control device according to the embodiment. Note that the flowchart shown in Fig. 5 is repeatedly executed after the vehicle C is started up until it is stopped (powered off).
[0051] First, the controller 2 detects the intention to get off based on the detection result of the sensor 100 (step S101). Specifically, the controller 2 detects the intention to get off based on the position, orientation, posture, etc. of the occupant. If the controller 2 does not detect the intention to get off (step S101: No), the controller 2 ends the process.
[0052] When the controller 2 detects the intention to get off (step S101: Yes), the controller 2 judges whether the intention to get off has continued for a first time or more (step S102). If the intention to get off has not continued for the first time or more (step S102: No), that is, if the intention to get off is resolved within less than the first time, the controller 2 ends the process.
[0053] Furthermore, when the dismounting intention state continues for the first time or more (step S102: Yes), the controller 2 issues a notification to the occupant (step S103). For example, the controller 2 issues a notification indicating that deceleration will be performed after a predetermined time or a notification requesting cancellation of the dismounting intention state.
[0054] Next, the controller 2 detects whether the state of intention to get off continues for a second time or more after the notification (step S104). If the state of intention to get off is resolved within the second time (step S104: No), the controller 2 ends the process.
[0055] Furthermore, if the state of intending to get off continues for a second time or more after the notification (step S104: Yes), the controller 2 decelerates the vehicle to a certain value (step S105).
[0056] Next, the controller 2 determines whether the occupant has alighted (or has canceled the intention to alight) (step S106). If the occupant has alighted (or has canceled the intention to alight) (step S106: Yes), the controller 2 accelerates and returns to the normal speed (step S107) and ends the process.
[0057] If the occupant does not get off the vehicle (or does not cancel the intention to get off) (step S106: No), the controller 2 further decelerates from the fixed value and stops the vehicle (step S108), and ends the process.
[0058] As described above, the vehicle control device 1 according to the embodiment includes the controller 2. The controller 2 controls the traveling speed of the vehicle C traveling by autonomous driving. The controller 2 notifies an occupant who has detected by a sensor an intention to get off, and reduces the traveling speed of the vehicle C if the intention to get off continues after the notification.
[0059] As a result, the vehicle control device 1 detects the occupant's intention to get off using a sensor such as a camera, so there is no need to operate an operating unit to indicate the intention to get off. Furthermore, since the vehicle control device 1 detects the intention to get off and once notifies the occupant, it decelerates the vehicle, so even if the occupant mistakenly indicates the intention to get off, the notification can cancel the intention to get off and deceleration is not required. Therefore, the vehicle control device 1 according to the embodiment allows the occupant to easily get off the vehicle without compromising the convenience of the vehicle.
[0060] In the above embodiment, the vehicle control device 1 is mounted on the vehicle C to control the vehicle C, but the vehicle C may be controlled by a server device. For example, the server device receives sensor information acquired by a sensor provided in the vehicle C, and determines an intention to get off the vehicle and controls the speed of the vehicle C based on the received sensor information.
[0061] In addition, in the present disclosure, control related to the automatic driving of the vehicle C (speed control, etc.) and control related to the determination of the intention to get off may be performed by separate computers (controllers).
[0062] Further advantages and modifications may readily occur to those skilled in the art. Thus, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and equivalents thereof. [Explanation of symbols]
[0063] 1 Vehicle control device 2. Controller 3 Storage section 21 Detection unit 22 Information Department 23 Speed control section 100 Sensors C Vehicle
Claims
1. Equipped with a controller that controls an unmanned vehicle that allows passengers to disembark while driving, The controller: When it is determined that the occupant has expressed an intention to get off based on the sensor information related to the occupant, a notification instruction signal for confirming the intention to get off is output to an alarm device, and when it is determined that the occupant still has an intention to get off based on the sensor information related to the occupant after the alarm by the alarm device, a control signal for decelerating the unmanned vehicle is output to a drive device of the unmanned vehicle. Vehicle control device.
2. The controller: It is determined that the occupant has expressed an intention to get off the vehicle based on the position information of the occupant. The vehicle control device according to claim 1.
3. The controller: It is determined that the passenger is indicating an intention to get off the vehicle based on information on the direction of the passenger's body. The vehicle control device according to claim 1.
4. The controller: It is determined that the occupant indicates an intention to get off the vehicle based on the posture of the occupant. The vehicle control device according to claim 1.
5. The controller: When the intention to get off is continuously indicated for a first period of time, a notification instruction signal for confirming the intention to get off is output to the notification device, and when the intention to get off is continuously indicated for a second period of time after the notification by the notification device, a control signal for decelerating the unmanned vehicle is output to a drive device of the unmanned vehicle. The vehicle control device according to claim 1.
6. The controller: If the intention to get off is resolved while the traveling speed is being reduced to a certain value greater than 0, a control signal for accelerating the unmanned vehicle is output to a drive device of the unmanned vehicle. The vehicle control device according to claim 1.
7. The controller: When it is determined that the intention to get off is still present after the traveling speed has reached the constant value, a control signal for setting the traveling speed to 0 is output to a drive device of the unmanned vehicle. The vehicle control device according to claim 6.
8. A vehicle control device including a controller for controlling an unmanned vehicle, The controller: When a specific motion by an occupant is detected by a sensor while the unmanned vehicle is traveling at a first traveling speed at which the occupant can disembark, a notification instruction signal notifying the detection of the specific motion is output to an alarm device, and when the specific motion is continuously detected for a first period from the start of detection, a control signal for changing the traveling speed to a second traveling speed slower than the first traveling speed is output to a drive device. Vehicle control device.
9. A control method for an unmanned vehicle capable of allowing a passenger to disembark while traveling, the control method comprising: When it is determined that the occupant has expressed an intention to get off based on the sensor information related to the occupant, a notification instruction signal for confirming the intention to get off is output to an alarm device, and when it is determined that the occupant still has an intention to get off based on the sensor information related to the occupant after the alarm by the alarm device, a control signal for decelerating the unmanned vehicle is output to a drive device of the unmanned vehicle. Control methods.
10. A control program for an unmanned vehicle capable of allowing a passenger to disembark while traveling, the control program being executed by a computer, When it is determined that the occupant has expressed an intention to get off based on the sensor information related to the occupant, a notification instruction signal for confirming the intention to get off is output to an alarm device, and when it is determined that the occupant still has an intention to get off based on the sensor information related to the occupant after the alarm by the alarm device, a control signal for decelerating the unmanned vehicle is output to a drive device of the unmanned vehicle. Control program.
Citation Information
Patent Citations
Excursion support system
JP2016045805A
