MOBILE BODY CONTROL DEVICE, MOBILE BODY CONTROL METHOD, AND PROGRAM

Abstract

This invention provides a device for controlling a mobile body that one or more passengers can ride and that can move on both a roadway and in a predetermined area different from the roadway, said control device comprising a road type recognition unit that recognizes whether the mobile body is moving on a roadway or in the predetermined area on the basis of output of an external world detection device that detects the external situation of the mobile body, and a control unit that on the basis of the road type recognized by the road type recognition unit, causes the mobile body to travel in either a first travel state in which the speed of the mobile body is limited to a first speed or a second travel state in which the speed of the mobile body is limited to a second speed lower than the first speed. The control unit causes the mobile body to travel in the second travel state when the base material is traveling in the predetermined area, and when the mobile body is caused to travel from the predetermined area to a roadway, the control unit switches between the first travel state and the second travel state in accordance with an instruction that is received from the passenger and that relates to the travel state of the mobile body.

Description

[Technical field]

[0001] The present invention relates to a control device for a moving object, a control method for a moving object, and program Regarding. [Background technology]

[0002] Conventionally, practical application of mobile objects that can move on both sidewalks and roadways has been progressing. In this context, a technology is known that detects the direction in which an electric vehicle can move from an image of a block for guiding visually impaired people included in image data captured by an imaging unit, and controls the traveling of the electric vehicle based on the detected direction (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-197328 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in a mobile body that can travel on both sidewalks and roadways, it is necessary to set different upper speed limits for the sidewalk and roadway, but when the sidewalk is interrupted and the vehicle travels only a short distance on the roadway, and then immediately travels on the next sidewalk, the speed changes frequently, which may cause a burden on the mobile body and its occupants. However, conventional technology does not take into consideration driving control in such situations, and there are cases where appropriate driving control according to road conditions cannot be performed.

[0005] The present invention has been made in consideration of the above circumstances, and provides a control device and a control method for a moving body that can make the moving body travel in a more appropriate traveling state according to the surrounding road conditions, and program One of the aims is to provide. [Means for solving the problem]

[0006] The control device for a moving object, the control method for a moving object, and the storage medium according to the present invention employ the following configuration. (1): A control device for a moving body according to one embodiment of the present invention is a control device for a moving body that has one or more occupants on board and is capable of moving both on a roadway and a predetermined area different from the roadway, and includes: a road type recognition unit that recognizes whether the moving body is moving on a roadway or in the predetermined area based on the output of an external environment detection device that detects the external condition of the moving body; and a control unit that causes the moving body to travel in either a first running state in which the speed of the moving body is limited to a first speed or a second running state in which the speed of the moving body is limited to a second speed lower than the first speed, based on the road type recognized by the road type recognition unit. The control unit causes the moving body to travel in the second running state when the moving body is traveling in the predetermined area, and switches between the first running state and the second running state in response to an instruction regarding the running state of the moving body received from the occupant when causing the moving body to travel from the predetermined area to the roadway.

[0007] (2): In the above aspect (1), the vehicle further includes an operator that accepts driving operations of the moving body by the occupant, and the control unit determines whether or not to switch from the second driving state to the first driving state based on the steering operation of the moving body by the operator.

[0008] (3): In the above aspect (2), when the steering amount by the operator is less than a predetermined amount, the control unit does not switch from the second driving state to the first driving state even when the moving body moves from the specified area onto a roadway.

[0009] (4): In the above aspect (3), when the moving body moves from the specified area to the roadway and the steering amount by the operator is less than a specified amount, the control unit does not switch from the second driving state to the first driving state even if an operation to accelerate the moving body is further received by the operator.

[0010] (5): In the above aspect (2), the control unit continues the second traveling state when the steering amount by the operator is less than a predetermined amount and when the distance from the predetermined area in which the moving body was traveling to another predetermined area is less than a predetermined distance.

[0011] (6): In the above aspect (2), the control unit switches from the second driving state to the first driving state when control is performed to move the moving body toward the roadway by steering operation using the operator.

[0012] (7): In the above aspect (1), the control unit switches from the second driving state to the first driving state when a sidewalk is present in the road width direction based on the position of the moving body leaving the sidewalk and traveling on the roadway.

[0013] (8): In the above aspect (1), the vehicle further includes a switching reception unit that receives instructions regarding switching the running state of the moving body, and the control unit determines whether to switch from the second running state to the first running state based on the instructions received by the switching reception unit.

[0014] (9): In the above aspect (1), when the moving body is traveling on a roadway in the second traveling state, the control unit causes an external alarm device of the moving body to notify that the moving body is traveling on a roadway in the second traveling state.

[0015] (10): In the above aspect (1), the control unit, when the moving body is traveling on a roadway in the second driving state, notifies the occupant of information for switching from the second driving state to the first driving state.

[0016] (11): A method for controlling a moving body according to another aspect of the present invention is a method for controlling a moving body, the method comprising: a computer that controls a moving body having one or more occupants on board and capable of moving both on a roadway and a predetermined area different from the roadway, recognizing whether the moving body is moving on the roadway or in the predetermined area based on the output of an external environment detection device that detects the external condition of the moving body; causing the moving body to travel in either a first running state in which the speed of the moving body is limited to a first speed or a second running state in which the speed of the moving body is limited to a second speed lower than the first speed based on the recognized road type; causing the moving body to travel in the second running state when the moving body is traveling in the predetermined area; and switching between the first running state and the second running state in response to an instruction regarding the running state of the moving body received from the occupant when causing the moving body to travel from the predetermined area onto the roadway.

[0017] (12): A storage medium according to another aspect of the present invention is a storage medium having stored therein a program that causes a computer that controls a mobile body, which has one or more occupants on board and is capable of moving both on a roadway and a predetermined area different from the roadway, to recognize whether the mobile body is moving on the roadway or in the predetermined area based on the output of an external environment detection device that detects the external condition of the mobile body, to run the mobile body in either a first running state in which the speed of the mobile body is limited to a first speed or a second running state in which the speed of the mobile body is limited to a second speed lower than the first speed based on the recognized road type, to run the mobile body in the second running state when the mobile body is running in the predetermined area, and to switch between the first running state and the second running state in response to an instruction regarding the running state of the mobile body received from the occupant when running the mobile body from the predetermined area onto the roadway. Effect of the Invention

[0018] According to the above aspects (1) to (12), the mobile object can be caused to travel in a more appropriate traveling state in accordance with the surrounding road conditions. [Brief description of the drawings]

[0019] [Figure 1] 1 is a diagram illustrating an example of the configuration of a moving object 1 and a control device 100 according to an embodiment. [Diagram 2] 1 is a perspective view of a moving body 1 seen from above. [Diagram 3] 10 is a diagram for explaining a first switching pattern of the traveling state of the moving object 1. FIG. [Figure 4] FIG. 13 is a diagram showing an example of switching from a second running state to a first running state. [Diagram 5] 13 is a diagram for explaining a second switching pattern of the traveling state of the moving object 1. FIG. [Figure 6] 4 is a flowchart showing an example of a flow of processing executed by the control device 100 of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] Hereinafter, with reference to the drawings, an embodiment of a mobile body control device, a mobile body control method, and a storage medium of the present invention will be described. A mobile body moves on both roadways and a predetermined area different from the roadway. A mobile body may be called micromobility. An electric kick scooter is a type of micromobility. The predetermined area is, for example, a sidewalk. The predetermined area may be a part or all of a sidewalk, a bicycle lane, a public open space, etc., or may include all of a sidewalk, a sidewalk, a bicycle lane, a public open space, etc. In the following description, the predetermined area is assumed to be a sidewalk. In the following description, the part written as "sidewalk" may be appropriately read as "predetermined area".

[0021] 1 is a diagram showing an example of the configuration of a moving object 1 and a control device 100 according to an embodiment. The moving object 1 is equipped with, for example, an external environment detection device 10, a moving object sensor 12, an operator 14, an internal camera 16, a positioning device 18, a mode change switch 22, a moving mechanism 30, a driving device 40, an external notification device 50, a storage device 70, and a control device 100. Note that some of these configurations that are not essential for realizing the functions of the present invention may be omitted. The mode change switch 22 is an example of a "switching reception unit."

[0022] The external environment detection device 10 is a device having a detection range in the traveling direction of the moving object 1. The external environment detection device 10 includes an external camera, a radar device, a LIDAR (Light Detection and Ranging), a sensor fusion device, and the like. The external environment detection device 10 detects the external situation of the moving object 1. In addition, the external environment detection device 10 outputs information indicating the detection result (images, object positions, etc.) to the control device 100.

[0023] The mobile body sensor 12 includes, for example, a speed sensor, an acceleration sensor, a yaw rate (angular velocity) sensor, a direction sensor, and an operation amount detection sensor attached to the operation element 14.

[0024] The operator 14 accepts driving operations by a passenger of the moving body. The operator 14 includes, for example, an operator for instructing acceleration / deceleration (for example, an accelerator pedal, a brake pedal, a dial switch or a lever for adjusting speed) and an operator for instructing steering (for example, a steering wheel). In this case, the moving body sensor 12 may include an accelerator opening sensor, a brake depression sensor, a steering torque sensor, etc. The moving body 1 may include an operator of a type other than those described above as the operator 14 (for example, a non-annular rotary operator, a joystick, a button, etc.).

[0025] Internal camera 16 captures an image of at least the head of an occupant of moving body 1 from the front. Internal camera 16 is a digital camera that uses an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). Internal camera 16 outputs the captured image to control device 100.

[0026] The positioning device 18 is a device that measures the position of the mobile object 1. The positioning device 18 is, for example, a Global Navigation Satellite System (GNSS) receiver, and identifies the position of the mobile object 1 based on a signal received from a GNSS satellite, and outputs the position information. Note that the position information of the mobile object 1 may be estimated from the position of a Wi-Fi base station to which a communication device mounted on the mobile object 1 is connected.

[0027] The mode changeover switch 22 is a switch operated by the occupant. The mode changeover switch 22 accepts an instruction for switching the traveling state of the moving body 1. The mode changeover switch 22 may be a mechanical switch or a GUI (Graphical User Interface) switch set on a touch panel. The mode changeover switch 22 accepts an operation for switching the driving mode to one of the following modes: mode A: an assist mode in which one of the steering operation and the acceleration / deceleration control is performed by the occupant and the other is performed automatically; mode A-1 in which the steering operation is performed by the occupant and the acceleration / deceleration control is performed automatically; mode A-2 in which the acceleration / deceleration operation is performed by the occupant and the steering control is performed automatically; mode B: a manual driving mode in which the steering operation and the acceleration / deceleration operation are performed by the occupant; and mode C: an automatic driving mode in which the operation control and the acceleration / deceleration control are performed automatically. The mode changeover switch 22 may also accept an operation for switching the traveling state of the moving body 1 described later (for example, an operation for switching between a first traveling state and a second traveling state by the occupant). Note that the operation to switch the above-mentioned modes (or driving states) may be received from a microphone or an internal camera provided in the moving body 1 instead of the mode changeover switch 22. In this case, the control device 100 may receive the mode switching operation from the analysis result of the occupant's voice input by the microphone, or may receive the mode switching operation from the occupant's gestures, mouth movements, etc. obtained as the analysis result of the front image of the occupant captured by the internal camera.

[0028] The moving mechanism 30 is a mechanism for moving the moving body 1 on a road. The moving mechanism 30 is, for example, a group of wheels including steering wheels and drive wheels. The moving mechanism 30 may also be legs for multi-legged walking.

[0029] The driving device 40 outputs a force to the moving mechanism 30 to move the moving body 1. For example, the driving device 40 includes a motor that drives the driving wheels, a battery that stores the power to be supplied to the motor, a steering device that adjusts the steering angle of the steering wheels, and the like. The driving device 40 may include an internal combustion engine, a fuel cell, or the like as a driving force output means or a power generation means. The driving device 40 may further include a brake device that utilizes frictional force or air resistance.

[0030] The external notification device 50 is, for example, a lamp, a display device, a speaker, etc., provided on the outer plate of the moving body 1 to notify information to the outside of the moving body 1. The external notification device 50 performs different operations depending on the difference in the running state of the moving body 1 controlled by the control unit 140, for example. The running state includes, for example, at least a first running state and a second running state. The first running state is a running state in which the moving body 1 basically moves on a roadway. The second running state is a running state in which the moving body 1 basically moves on a sidewalk. In the embodiment, when a predetermined condition described later is satisfied, there may be an exceptional case where the moving body 1 runs on a roadway in the second running state. In the first running state, at least the upper limit speed of the moving body 1 is limited to a first speed, and in the second running state, at least the upper limit speed of the moving body 1 is limited to a second speed lower than the first speed.

[0031] For example, the external notification device 50 is controlled to emit a lamp when the moving object 1 is moving on a sidewalk in the second traveling state, and not emit the lamp when the moving object 1 is moving on a roadway in the first traveling state. The light emission color of this lamp is preferably a color specified by regulations. The external notification device 50 may also be controlled to emit a lamp in green when the moving object 1 is moving on a sidewalk, and emit a lamp in blue when the moving object 1 is moving on a roadway. When the external notification device 50 is a display device, the external notification device 50 displays the fact that the moving object 1 is "traveling on a sidewalk" in text or graphics when the moving object 1 is traveling on a sidewalk. When a predetermined condition is satisfied and the moving object 1 is traveling on a roadway in the second traveling state, the external notification device 50 may emit a lamp in a color different from the above-mentioned light emission color, and may display the fact that the vehicle is traveling in the second traveling state in text or graphics on the display device.

[0032] Furthermore, the external notification device 50 may be provided with an audio output device such as a speaker in addition to (or instead of) the lamps and display device outputs, and audio indicating the state of the moving object described above may be output from the speaker.

[0033] FIG. 2 is a perspective view of the moving body 1 seen from above. In the figure, FW is a steering wheel, RW is a driving wheel, SD is a steering device, MT is a motor, and BT is a battery. The steering device SD, the motor MT, and the battery BT are included in the driving device 40. AP is an accelerator pedal, BP is a brake pedal, WH is a steering wheel, SP is a speaker, and MC is a microphone. The moving body 1 shown in the figure is a one-seater moving body, and an occupant P is seated in the driver's seat DS and fastens a seat belt SB. An arrow α1 is the traveling direction (velocity vector) of the moving body 1. The external environment detection device 10 is provided near the front end of the moving body 1, the internal camera 16 is provided at a position where the head of the occupant P can be imaged from in front of the occupant P, and the mode changeover switch 22 is provided at the boss part of the steering wheel WH. An external notification device 50 as a display device is provided near the front end of the moving body 1. The external notification device 50 may be formed integrally with the speaker SP.

[0034] Returning to Fig. 1, the storage device 70 is a non-transient storage device such as a hard disk drive (HDD), a flash memory, or a random access memory (RAM). The storage device 70 stores map information 72, a program 74 executed by the control device 100, and the like. In the figure, the storage device 70 is illustrated outside the frame of the control device 100, but the storage device 70 may be included in the control device 100.

[0035] [Control device] The control device 100 includes, for example, a road type recognition unit 120, an object recognition unit 130, and a control unit 140. For example, the control device 100 is realized by a hardware processor such as a CPU (Central Processing Unit) executing a program (software) 74. Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by a combination of software and hardware. The program may be stored in the storage device 70 in advance, or may be stored in a removable storage medium (non-transient storage medium) such as a DVD or CD-ROM, and may be installed in the storage device 70 by mounting the storage medium in a drive device.

[0036] The road type recognition unit 120 recognizes whether the moving object 1 is moving on a roadway or a sidewalk. For example, the road type recognition unit 120 recognizes whether the moving object 1 is moving on a roadway or a sidewalk by analyzing an image captured by an external camera of the external environment detection device 10. Note that the output of a radar device, a LIDAR, a sensor fusion device, or the like may be used auxiliary.

[0037] An example of image analysis is semantic segmentation. The road type recognition unit 120 classifies each pixel in an image frame into a class (roadway, sidewalk, boundary, obstacle, etc.) and assigns a label to it, and recognizes that the moving body 1 is moving on a roadway when there are many pixels with a roadway label in an area corresponding to the front of the moving body 1 in the image, and recognizes that the moving body 1 is moving on a sidewalk when there are many pixels with a sidewalk label in an area corresponding to the front of the moving body 1 in the image. Without being limited to this, the road type recognition unit 120 may recognize that the moving body 1 is moving on a roadway when a vehicle is recognized in an area corresponding to the front of the moving body 1 in the image, and may recognize that the moving body 1 is moving on a sidewalk when a pedestrian is recognized in an area corresponding to the front of the moving body 1 in the image. In addition, the road type recognition unit 120 may recognize that the moving body 1 is moving on a roadway when the width of the road surface area in the area corresponding to the front of the moving body 1 in the image is large, and may recognize that the moving body 1 is moving on a sidewalk when the width of the road surface area in the area corresponding to the front of the moving body 1 in the image is small.

[0038] The road type recognition unit 120 may also compare the position information of the mobile object 1 obtained by the positioning device 18 with the map information 72 to recognize whether the mobile object 1 is moving on a roadway or a sidewalk. In this case, the map information must have a high enough accuracy to distinguish between sidewalks and roadways from the position coordinates. In addition, if the "predetermined area" is not only sidewalks, the road type recognition unit 120 performs similar processing on shoulders, bicycle lanes, public open spaces, and the like.

[0039] The object recognition unit 130 recognizes objects present around the moving body 1 (within a predetermined distance from the moving body 1) based on the output of the external environment detection device 10. The objects include some or all of the following obstacles: moving bodies such as vehicles, bicycles, and pedestrians, road boundaries such as road division lines, steps, guardrails, road shoulders, and median strips, structures installed on the road such as road signs and billboards, and objects that have fallen on the road. The object recognition unit 130 may also recognize steps and grooves that exist between the road and the sidewalk (boundary). The object recognition unit 130 obtains information such as the presence, position, and type of other moving bodies by inputting an image captured by an external camera into a trained model that has been trained to output information such as the presence, position, and type of an object when an image captured by the external camera of the external environment detection device 10 is input. The type of other moving bodies can also be estimated based on the size in the image and the intensity of the reflected wave received by the radar device of the external environment detection device 10. Furthermore, the object recognition unit 130 may recognize the speed of another moving object detected by a radar device using, for example, a Doppler shift.

[0040] The control unit 140 controls the drive unit 40 according to the driving mode set by, for example, the mode changeover switch 22. The moving object 1 may execute only some of the driving modes described below, but in any case, the control unit 140 basically sets different speed limit values ​​for when the moving object 1 moves on a roadway and when it moves on a sidewalk. In that case, the mode changeover switch 22 may be omitted.

[0041] In mode A-1, the control unit 140 refers to information on the running path and the object based on the output of the object recognition unit 130, and when the moving body 1 moves on a roadway, the control unit 140 switches to a first running state to maintain a distance to an object in front of the moving body 1 at a certain level or more, and controls the motor MT of the drive unit 40 so that the moving body 1 moves at a first speed V1 (for example, a speed of 10 km / h or more and less than several tens of km / h) when the moving body 1 moves on a sidewalk. The control unit 140 controls the motor MT of the drive unit 40 so that the moving body 1 moves at a second speed V2 (for example, a speed of less than 10 km / h) when the moving body 1 moves on a sidewalk. This function is similar to the ACC (Adaptive Cruise Control) function of a vehicle with the first speed V1 or the second speed V2 set as the set speed, and the technology used in ACC can be used. In mode A-1, the control unit 140 controls the steering device SD to change the steering angle of the steering wheels based on the amount of operation of the operator 14 such as a steering wheel. This function is similar to that of a power steering device, and the technology used in the power steering device can be used. Note that, instead of electronically controlling steering, the moving body 1 may have a steering device in which the operator 14 and a steering mechanism are mechanically connected.

[0042] In mode A-2, the control unit 140 refers to the information on the running path and the object based on the output of the object recognition unit 130, generates a target trajectory that can be moved while avoiding the object on the running path, and controls the steering device SD of the drive device 40 so that the moving body 1 moves along the target trajectory. Regarding acceleration and deceleration, the control unit 140 controls the motor MT of the drive device 40 based on the speed of the moving body 1 and the operation amount of the accelerator pedal or the brake pedal. When the moving body 1 is moving on a roadway, the control unit 140 switches to the first running state and controls the motor MT of the drive device 40 with the first speed V1 as the upper limit speed (in the case of mode A-2, when the upper limit speed is reached, this means that the moving body 1 will not accelerate even if a further acceleration command is given), and when the moving body 1 is moving on a sidewalk, the control unit 140 switches to the second running state and controls the drive device 40 with the second speed V2 as the upper limit speed.

[0043] In mode B, the control unit 140 controls the motor MT of the drive device 40 based on the speed of the moving object 1 and the operation amount of the accelerator pedal or the brake pedal. When the moving object 1 is moving on a roadway, the control unit 140 switches to the first running state and controls the motor MT of the drive device 40 with the first speed V1 as the upper limit speed (in the case of mode B, this means that the moving object 1 will not accelerate even if a further acceleration command is given when the upper limit speed is reached), and when the moving object 1 is moving on a sidewalk, the control unit 140 switches to the second running state and controls the motor MT of the drive device 40 with the second speed V2 as the upper limit speed. Steering is the same as in mode A-1.

[0044] In mode C, the control unit 140 refers to information about the path and objects based on the output of the object recognition unit 130, generates a target trajectory along which the moving body 1 can move while avoiding objects in the path, and controls the driving device 40 so that the moving body 1 moves along the target trajectory. Even in mode C, the control unit 140 switches to the first running state and controls the driving device 40 with a first speed V1 as the upper limit speed when the moving body 1 is moving on a roadway, and switches to the second running state and controls the driving device 40 with a second speed V2 as the upper limit speed when the moving body 1 is moving on a sidewalk.

[0045] Here, depending on the road conditions such as a T-junction, a crossroad, construction, and other conditions, the sidewalk area may be interrupted. In such a case, the moving body 1 traveling on the sidewalk may temporarily travel on the roadway and then travel on the sidewalk again, or continue traveling on the roadway. In each of the above-mentioned driving modes, the traveling state (e.g., the upper limit speed) is switched by switching between the sidewalk and the roadway, so that when the moving body 1 travels from the sidewalk to the roadway temporarily and then immediately back on the sidewalk, frequent switching of the traveling state may occur, which may place a burden on the moving body 1 and the occupant P. Therefore, in the above-mentioned road conditions, the control unit 140 switches or continues the traveling state according to the intention of the occupant P of the moving body 1 as a predetermined condition. Hereinafter, the switching patterns of the traveling state in the control unit 140 will be described in several categories.

[0046] <First switching pattern> FIG. 3 is a diagram for explaining a first switching pattern of the traveling state of the moving object 1. In the example of FIG. 3, a road RD1 including a roadway area 200 and a sidewalk area 210 is shown. The road RD1 is assumed to extend in the X-axis direction in the figure, and the moving object 1 and the vehicle 220 are assumed to be traveling along the extension direction. In the example of FIG. 3, the sidewalk area 210 is assumed to be divided into a sidewalk area 210-1 on the near side of the traveling direction of the moving object 1 (in other words, the extension direction of the road RD1) and a sidewalk area 210-2 on the far side. In FIG. 3, the time T1 is assumed to be the earliest, followed by T2 (T2# described later) and T3 in that order. In FIG. 3, the position and traveling direction of the moving object 1 at each time are shown. The same is assumed for the subsequent figures.

[0047] At time T1, the moving object 1 is traveling in the sidewalk area 210-1 of the road RD1 along the extension direction. In this case, the road type recognition unit 120 recognizes that the type of road on which the moving object 1 is currently traveling is a sidewalk. The control unit 140 controls the moving object 1 to travel in a second traveling state in which the moving object 1 travels on the sidewalk. In addition, the control unit 140 causes the external notification device 50 to notify information (text, graphics, sound, lamp color, etc.) indicating that the moving object 1 is traveling on the sidewalk in the second traveling state.

[0048] At time T2, the moving body 1 is traveling in the roadway area 200 from the sidewalk area 210-1 to the sidewalk area 210-2 because the sidewalk area 210-1 and the sidewalk area 210-2 are disconnected. In this case, the road type recognition unit 120 recognizes that the type of road on which the moving body 1 is currently traveling is the roadway. In addition, the object recognition unit 130 recognizes that the sidewalk area 210-2 exists in the traveling direction (forward) of the moving body 1. Based on the recognition results by the road type recognition unit 120 and the object recognition unit 130, when the moving body 1 traveling in the sidewalk area 210-1 travels in the roadway area 200, the control unit 140 switches between the first traveling state and the second traveling state in response to an instruction regarding the traveling state of the moving body 1 received from the occupant P. Here, the instruction regarding the traveling state of the moving body 1 received from the occupant P is, for example, an instruction based on the intention of the occupant P indicating whether the occupant P wants to travel on the sidewalk or the roadway. Furthermore, the instruction regarding the running state of the moving body 1 received from the occupant P may be, for example, an instruction for conveying the intention of the occupant P as to whether he / she wants the moving body 1 to run in the first running state or the second running state (an instruction for conveying the running state desired by the occupant P to the moving body 1). In other words, when the moving body 1 that has been running in the sidewalk area 210-1 runs in the roadway area 200, the control unit 140 confirms the intention of the occupant P before switching the running state.

[0049] For example, the control unit 140 confirms the intention of the occupant based on the steering content of the occupant received by, for example, a steering wheel included in the operation unit 14. For example, if the steering amount by the steering wheel for a predetermined time (for example, from time T1 to time T2) (or the steering amount after the moving body 1 leaves the sidewalk area 210-1) is less than a predetermined amount, the control unit 140 confirms (estimates) the intention of the occupant P to travel on the sidewalk (intention to continue the second traveling state) and continues the second traveling state even at time T2 when traveling on the roadway. As a result, the moving body 1 travels on the sidewalk (sidewalk area 210-2) again, and the second traveling state continues after time T3, so that the burden on the moving body 1 and the occupant P due to switching of the traveling state can be reduced, and the moving body 1 can be made to travel in a more appropriate traveling state.

[0050] In addition, if the distance D1 from the end point PO1 of the sidewalk area 210-1 on which the moving body 1 has been traveling to the start point PO2 of the sidewalk area 210-2 to which the moving body 1 is heading (present in the traveling direction of the moving body 1) is long, the moving body 1 must continue traveling at a low speed on the roadway area 200, which may hinder other vehicles (e.g., the vehicle 220) traveling on the roadway area 200 from turning left. Therefore, the control unit 140 may perform control to continue the second traveling state when the distance D1 from the sidewalk area 210-1 on which the moving body 1 has been traveling to the next sidewalk area 210-2 (an example of another predetermined area) is less than the predetermined distance Dth in addition to when the steering amount is less than the predetermined amount. This allows the moving body 1 to travel more appropriately without hindering the traveling of surrounding vehicles, etc.

[0051] Furthermore, the control unit 140 causes the external notification device 50 to exceptionally notify information (text, graphics, sound, lamp color, etc.) indicating that the vehicle is traveling on a roadway in the second driving state. In this case, the control unit 140 causes the lamp to emit light in a display mode (for example, a different color or blinking) different from the light emission color of the lamp when the vehicle is traveling on a roadway in the first driving state and the light emission color of the lamp when the vehicle is traveling on a sidewalk in the second driving state. Furthermore, the control unit 140 may display, on the display device of the external notification device 50, using text or graphics, the message "driving at a low speed because heading for the sidewalk" or the message "driving at a low speed because the vehicle is temporarily traveling on the roadway."

[0052] 3, when the moving object 1 travels on the roadway area 200 temporarily in the second traveling state according to the will of the occupant P, even if an operation to accelerate the moving object 1 is received using an accelerator pedal, a speed adjustment dial, a lever, or the like included in the operation device 14 while traveling on the roadway area 200, the second traveling state is continued without switching from the second traveling state to the first traveling state. Therefore, speed control is executed with the second speed V2 as the upper limit speed.

[0053] In addition, if the amount of steering by the steering wheel in a predetermined period of time (or the amount of steering after the moving body 1 leaves the sidewalk area 210-1) is equal to or greater than a predetermined amount, the control unit 140 confirms (estimates) the occupant P's intention to travel on the roadway (intention to switch to the first driving state) and switches from the second driving state to the first driving state.

[0054] FIG. 4 is a diagram showing an example of switching from the second running state to the first running state. The example of FIG. 4 is different from the example of FIG. 3 in that the steering amount is equal to or greater than a predetermined amount due to the steering operation of the occupant P between time T1 and time T2. In this way, when the moving body 1 moves toward the roadway area 200 side (in other words, in a direction away from the sidewalk area 210-2) due to the steering control of the occupant P, the control unit 140 switches the running state of the moving body 1 from the second running state to the first running state. In addition, the control unit 140 causes the external notification device 50 to notify information (text, graphics, sound, lamp color, etc.) indicating that the moving body 1 is running on the roadway in the first running state. As a result, the moving body 1 can accelerate to the second speed, which is faster than the second speed that is the upper limit speed when running on the sidewalk, and thus can suppress the moving body 1 from interfering with the running of surrounding vehicles and can run more appropriately.

[0055] <Second switching pattern> FIG. 5 is a diagram for explaining a second switching pattern of the traveling state of the moving object 1. In the example of FIG. 5, the same road RD1 as in FIG. 3 and FIG. 4 is shown. At time T1, the moving object 1 is traveling along the extension direction of the sidewalk area 210-1 of the road RD1. The road type recognition unit 120 recognizes that the type of road on which the moving object 1 is currently traveling is a sidewalk. The control unit 140 causes the moving object 1 to travel in a second traveling state in which the moving object 1 travels on the sidewalk, and causes the external notification device 50 to notify information (text, graphics, sound, lamp color, etc.) indicating that the moving object 1 is traveling on the sidewalk in the second traveling state.

[0056] At time T2, the road type recognition unit 120 recognizes that the type of the road on which the moving object 1 is currently traveling is a roadway. Here, in the second switching pattern, the control unit 140 confirms the intention of the occupant P based on the position of the moving object. For example, when the object recognition unit 130 detects that a sidewalk area exists in the road width direction (Y-axis direction in the figure) relative to the current position of the moving object 1, it confirms (estimates) the intention of the occupant to travel on the roadway, and switches from the second traveling state to the first traveling state. At time T3 shown in FIG. 5, the sidewalk area 210-2 exists in the road width direction of the reference position (e.g., center of gravity) of the moving object 1. Therefore, in the second switching pattern, the control unit 140 switches the traveling state of the moving object 1 from the second traveling state to the first traveling state at time T3.

[0057] Furthermore, when the moving object 1 travels on the sidewalk area 210-1 and then exits the roadway area 200 (moves to the position shown at time T2# in FIG. 5) before reaching the end point PO1 of the sidewalk area 210-1, the control unit 140 switches the traveling state of the moving object 1 from the second traveling state to the first traveling state because the sidewalk area 210-1 exists in the road width direction of the moving object 1. In the second switching pattern, by setting a condition that the moving object 1 has not moved to the sidewalk even though there is a sidewalk in the road width direction from the reference position of the moving object 1, the intention of the occupant can be confirmed and the traveling control of the moving object 1 can be performed more appropriately according to the intention.

[0058] In addition, when there is a step or a groove between the roadway and the sidewalk due to road conditions, the occupant P may not be able to move the moving body 1 from the roadway area to the sidewalk area immediately even if he / she wants to. Therefore, when the object recognition unit 130 determines that a sidewalk exists in the road width direction from the reference position of the moving body 1, and when the sidewalk is an area where the moving body 1 can move from the roadway, the control unit 140 may perform control to switch the running state of the moving body 1 running on the roadway from the second running state to the first running state.

[0059] [Processing flow] FIG. 6 is a flowchart showing an example of the flow of processing executed by the control device 100 of the embodiment. In the example of FIG. 6, among various processing executed by the control device 100, the description will be centered on the switching processing of the running state. The processing of FIG. 6 may be repeatedly executed at a predetermined timing. In the example of FIG. 6, the road type recognition unit 120 judges whether the mobile object 1 is running on a sidewalk (step S100). If it is judged that the mobile object 1 is running on a sidewalk, the control unit 140 makes the mobile object run in the second running mode (step S110). In addition, the control unit 140 makes the external notification device 50 output information indicating that the mobile object is running on a sidewalk in the second running state (step S120).

[0060] Next, the road type recognition unit 120 judges whether the moving object 1 is traveling on a roadway (step S130). If it is judged that the moving object 1 is traveling on a roadway, the control unit 140 judges whether or not an operation of a steering amount equal to or greater than a predetermined amount has been received by the operating element 14 (step S140). If it is judged that an operation of a steering amount equal to or greater than a predetermined amount has been received, the control unit 140 switches the traveling state of the moving object 1 from the second traveling state to the first traveling state (step S150). If it is judged in the process of step S140 that an operation of a steering amount equal to or greater than a predetermined amount has not been received (the steering amount is less than the predetermined amount), the control unit 140 continues the second traveling state until the moving object 1 next travels on a sidewalk, and causes the external notification device 50 to output information indicating that the moving object 1 is traveling on a roadway in the second traveling state (step S160).

[0061] Furthermore, if it is determined in the process of step S100 that the moving object 1 is not traveling on a sidewalk, the control unit 140 causes the moving object 1 to travel in a first traveling state (step S170), and causes the external notification device 50 to output information indicating that the moving object 1 is traveling on a roadway in the first traveling state (step S180). This ends the process of this flowchart. Furthermore, if it is determined in the process of step S130 that the moving object 1 is not traveling on a roadway, the process of this flowchart ends.

[0062] <Modification> In the above-described embodiment, instead of (or in addition to) confirming the intention of the occupant P according to the steering amount obtained from the operation element 14, the intention of the occupant P may be confirmed based on the running state accepted by the mode changeover switch 22. For example, when the moving body 1 that has been running on a sidewalk runs on a roadway and there is another sidewalk ahead (in the traveling direction) of the moving body 1, if an instruction to perform the second running state is accepted by the mode changeover switch 22, the control unit 140 maintains the second running state, and if an instruction to perform the first running state is accepted, the control unit 140 switches from the second running state to the first running state. This makes it possible to grasp the intention of the occupant P more accurately, and to realize appropriate running control according to the intention. Also, in the embodiment, instead of (or in addition to) the mode changeover switch 22, the control unit 140 may perform switching control of the running state based on a switching operation of the running state analyzed based on information obtained from the microphone MC or the internal camera 16.

[0063] In the embodiment, the control unit 140 may notify the occupant of information for switching to the first running state when exceptional running control is being performed (for example, when the vehicle is running on a roadway in the second running state). In this case, the control unit 140 notifies the occupant from the speaker SP or the external notification device 50 of at least one of information regarding the reason why the vehicle is running on a roadway and information indicating what operation should be performed to switch to the first running state. This allows the occupant to more accurately grasp the situation of the moving body 1, and also allows the occupant to more accurately convey his or her intention to the moving body 1 by a predetermined operation.

[0064] According to the embodiment described above, the control device 100 for a mobile body 1 that has one or more occupants on board and is capable of moving both on a roadway and a predetermined area different from the roadway includes a road type recognition unit 120 that recognizes whether the mobile body 1 is moving on a roadway or in a predetermined area based on the output of an external environment detection device 10 that detects the external situation of the mobile body 1, and a control unit 140 that causes the mobile body to run in either a first running state in which the speed of the mobile body 1 is limited to a first speed or a second running state in which the speed of the mobile body 1 is limited to a second speed lower than the first speed based on the road type recognized by the road type recognition unit. When the mobile body 1 is running in a predetermined area, the control unit 140 causes the mobile body to run in the second running state, and when the control unit 140 causes the mobile body 1 to run from the predetermined area onto the roadway, the control unit 140 switches between the first and second running states in response to instructions regarding the running state of the mobile body received from the occupants, thereby allowing the mobile body to run in a more appropriate running state depending on the surrounding road conditions.

[0065] The above-described embodiment can be expressed as follows. A storage medium storing computer-readable instructions for controlling a vehicle capable of carrying one or more passengers and moving on both a roadway and a predetermined area different from the roadway; a processor coupled to the storage medium; The processor executes the computer-readable instructions to: Based on an output from an external environment detection device that detects an external situation of the moving object, the moving object is recognized as being moving on a roadway or in the predetermined area; Based on the recognized road type, the moving body is caused to travel in either a first traveling state in which the speed of the moving body is limited to a first speed, or a second traveling state in which the speed of the moving body is limited to a second speed lower than the first speed; When the moving body is traveling in the predetermined area, the moving body is caused to travel in the second traveling state, and when the moving body is caused to travel from the predetermined area onto a roadway, the first traveling state and the second traveling state are switched in response to an instruction regarding the traveling state of the moving body received from the occupant. A control device for a moving object.

[0066] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0067] 10. External sensing devices 12 Mobile Sensor 14 Controls 16 Internal Camera 18 Positioning Device 22 Mode switch 30 Moving mechanism 40 Drive unit 50 External alarm device 70 Storage device 100 Control device 120 Road type recognition unit 130 Object recognition section 140 Control section

Claims

1. A control device for a moving body capable of carrying one or more occupants and moving on both a roadway and a predetermined area different from the roadway, a road type recognition unit that recognizes whether the moving object is moving on a roadway or in the predetermined area based on an output of an external environment detection device that detects an external situation of the moving object; a control unit that causes the moving body to travel in either a first traveling state in which a speed of the moving body is limited to a first speed, or a second traveling state in which the speed of the moving body is limited to a second speed lower than the first speed, based on the road type recognized by the road type recognition unit; the control unit causes the moving body to travel in the second traveling state when the moving body is traveling in the predetermined area, and when the moving body travels from the predetermined area onto a roadway, switches between the first traveling state and the second traveling state in response to an instruction regarding the traveling state of the moving body received from the occupant, The vehicle further includes an operator that receives a driving operation of the vehicle by the occupant, the control unit determines whether or not to switch from the second traveling state to the first traveling state based on a steering operation of the moving body by the operator; When the steering amount by the operation element is less than a predetermined amount, the control unit does not switch from the second traveling state to the first traveling state even when the moving body travels from the predetermined area to a roadway. A control device for a moving object.

2. A control device for a moving body capable of carrying one or more occupants and moving on both a roadway and a predetermined area different from the roadway, a road type recognition unit that recognizes whether the moving object is moving on a roadway or in the predetermined area based on an output of an external environment detection device that detects an external situation of the moving object; a control unit that causes the moving body to travel in either a first traveling state in which a speed of the moving body is limited to a first speed, or a second traveling state in which the speed of the moving body is limited to a second speed lower than the first speed, based on the road type recognized by the road type recognition unit; the control unit causes the moving body to travel in the second traveling state when the moving body is traveling in the predetermined area, and when the moving body travels from the predetermined area onto a roadway, switches between the first traveling state and the second traveling state in response to an instruction regarding the traveling state of the moving body received from the occupant, The vehicle further includes an operator that receives a driving operation of the vehicle by the occupant, the control unit determines whether or not to switch from the second traveling state to the first traveling state based on a steering operation of the moving body by the operator; the control unit continues the second traveling state when the steering amount by the operation element is less than a predetermined amount and when the distance from the predetermined area in which the moving body has traveled to another predetermined area is less than a predetermined distance. A control device for a moving object.

3. the control unit, when the moving body moves from the predetermined area to a roadway and the steering amount by the operation element is less than a predetermined amount, does not switch from the second traveling state to the first traveling state even when an operation to accelerate the moving body is further received by the operation element. The control device for a moving body according to claim 1 .

4. the control unit switches the traveling state from the second traveling state to the first traveling state when a control is performed to move the traveling body toward a roadway by a steering operation using the operation element. The control device for a moving body according to claim 2.

5. the control unit switches from the second traveling state to the first traveling state when the predetermined area exists in a road width direction based on a position of the moving object traveling on a roadway after leaving the predetermined area with a steering amount by the operating element being equal to or greater than a predetermined amount. The control device for a moving body according to claim 1 .

6. A switching reception unit that receives an instruction regarding switching of the traveling state of the moving body, The control unit determines whether or not to switch from the second running state to the first running state based on the instruction accepted by the switching acceptance unit. The control device for a moving body according to claim 1 or 2.

7. the control unit, when the moving body is traveling on a roadway in the second traveling state, causes an external notification device of the moving body to notify that the moving body is traveling on a roadway in the second traveling state. The control device for a moving body according to claim 1 or 2.

8. The control unit, when the moving body is traveling on a roadway in the second traveling state, notifies the occupant of information for switching from the second traveling state to the first traveling state. The control device for a moving body according to claim 1 or 2.

9. A computer controls a mobile body that has one or more occupants on board and is capable of moving on both a roadway and a predetermined area different from the roadway, Based on an output from an external environment detection device that detects an external situation of the moving object, the moving object is recognized as being moving on a roadway or in the predetermined area; Based on the recognized road type, the moving body is caused to travel in either a first traveling state in which the speed of the moving body is limited to a first speed, or a second traveling state in which the speed of the moving body is limited to a second speed lower than the first speed; When the moving body is traveling in the specified area, the moving body is caused to travel in the second traveling state, and when the moving body is caused to travel from the specified area onto a roadway, the first traveling state and the second traveling state are switched in response to an instruction regarding the traveling state of the moving body received from the occupant, determining whether to switch from the second traveling state to the first traveling state based on a steering operation of the moving body by an operator that receives a driving operation of the moving body by the occupant; when the steering amount by the operation element is less than a predetermined amount, even when the moving body travels from the predetermined area to a roadway, the second traveling state is not switched to the first traveling state. A method for controlling a moving object.

10. A computer controls a mobile body that has one or more occupants on board and is capable of moving on both a roadway and a predetermined area different from the roadway, Based on an output from an external environment detection device that detects an external situation of the moving object, the moving object is recognized as being moving on a roadway or in the predetermined area; Based on the recognized road type, the moving body is caused to travel in either a first traveling state in which the speed of the moving body is limited to a first speed, or a second traveling state in which the speed of the moving body is limited to a second speed lower than the first speed; When the moving body is traveling in the specified area, the moving body is caused to travel in the second traveling state, and when the moving body is caused to travel from the specified area onto a roadway, the first traveling state and the second traveling state are switched in response to an instruction regarding the traveling state of the moving body received from the occupant, determining whether to switch from the second traveling state to the first traveling state based on a steering operation of the moving body by an operator that receives a driving operation of the moving body by the occupant; continuing the second traveling state when the steering amount by the operating element is less than a predetermined amount and when the distance from the predetermined area in which the moving body has been traveling to another predetermined area is less than a predetermined distance; A method for controlling a moving object.

11. A computer controls a mobile body that has one or more occupants on board and can move on both a roadway and a predetermined area different from the roadway, Based on an output from an external environment detection device that detects an external situation of the moving object, the moving object is made to recognize whether it is moving on a roadway or in the predetermined area; Based on the recognized road type, the moving body is made to travel in either a first traveling state in which the speed of the moving body is limited to a first speed, or a second traveling state in which the speed of the moving body is limited to a second speed lower than the first speed; when the moving body is traveling in the specified area, the moving body is caused to travel in the second traveling state, and when the moving body is caused to travel from the specified area onto a roadway, the first traveling state and the second traveling state are switched in response to an instruction regarding the traveling state of the moving body received from the occupant, determining whether or not to switch from the second traveling state to the first traveling state based on a steering operation of the moving body by an operator that receives a driving operation of the moving body by the occupant; When the steering amount by the operation element is less than a predetermined amount, the second traveling state is not switched to the first traveling state even when the moving body travels from the predetermined area to a roadway. program.

12. A computer controls a mobile body that has one or more occupants on board and can move on both a roadway and a predetermined area different from the roadway, Based on an output from an external environment detection device that detects an external situation of the moving object, the moving object is made to recognize whether it is moving on a roadway or in the predetermined area; Based on the recognized road type, the moving body is made to travel in either a first traveling state in which the speed of the moving body is limited to a first speed, or a second traveling state in which the speed of the moving body is limited to a second speed lower than the first speed; when the moving body is traveling in the specified area, the moving body is caused to travel in the second traveling state, and when the moving body is caused to travel from the specified area onto a roadway, the first traveling state and the second traveling state are switched in response to an instruction regarding the traveling state of the moving body received from the occupant, determining whether or not to switch from the second traveling state to the first traveling state based on a steering operation of the moving body by an operator that receives a driving operation of the moving body by the occupant; when the steering amount by the operation element is less than a predetermined amount and when the distance from the predetermined area in which the moving body has been traveling to another predetermined area is less than a predetermined distance, the second traveling state is continued. program.

Images