Mobile body control device, mobile body control method, and storage medium

By combining the road type identification and the control unit, the road type is identified and the driving state is adjusted according to the recognition results, the problem of misidentification of the mobile body when it is difficult to identify the road type is solved, and safer and more stable driving control is achieved.

CN119072727APending Publication Date: 2024-12-03HONDA MOTOR CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202280094240.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2022-03-29
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In the case where it is difficult to identify the road type, the mobile body may misidentify the road type, resulting in the inability to perform appropriate driving controls and affect driving safety.

Method used

The road type identification unit and the control unit are used to identify the road type through the output of the device by the outside world, and the speed and driving state are limited according to the identification results, and the driving state is forced to switch under the operation of the occupant to ensure that the moving body is in the lane and the specified area. Drive appropriately.

Benefits of technology

It realizes more appropriate driving state control based on road conditions, reduces driving errors caused by misidentification, and improves driving safety and stability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119072727A_ABST
    Figure CN119072727A_ABST
Patent Text Reader

Abstract

A control device for a moving body on which one or more occupants are boarding and which is capable of moving both in a lane and in a predetermined region different from the lane, the control device being provided with: a road type recognition unit that recognizes the type of a road on the basis of the output of an external detection device and recognizes the type of the road on the basis of the type of the road; identifying which road type the moving body moves in the lane and the specified area; and a control unit that, on the basis of the recognized road type, causes the moving body to move in either a first travel state in which the speed of the moving body is limited to a first speed or a second travel state in which the speed of the moving body is limited to a second speed lower than the first speed. When it is recognized that the moving body is moving in the lane, the moving body is moved in a first traveling state, and when it is recognized that the moving body is moving in the predetermined area, the moving body is moved in a second traveling state. When an operation for switching a travel state is performed by a switching operation unit that accepts an operation for switching the travel state by an occupant, the travel state under control is forcibly switched even if it is recognized that a moving body is moving on a lane or a predetermined region.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a control device for a mobile object, a control method for a mobile object and a storage medium. Background Art

[0002] In the past, there has been progress in the practical application of a moving body that can move on both a sidewalk and a road. In connection with this, the following technology has been disclosed: a direction in which an electric vehicle can move is detected based on an image of a tactile paving brick for guiding a visually impaired person included in image data captured by a camera unit, and the travel of the electric vehicle is controlled based on the detected direction (for example, see Patent Document 1).

[0003] Prior Art Literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2019-197328 Summary of the invention

[0006] Problems to be solved by the invention

[0007] However, a mobile body that can move on both the sidewalk and the lane needs to move on the sidewalk and the lane in respective driving states with different upper speed limits. However, in a situation where it is difficult to identify the road type, the system may misidentify the road type, so that the mobile body may move in an incorrect driving state. However, in the prior art, driving control in such a scenario is not considered, and sometimes appropriate driving control corresponding to the road condition cannot be performed.

[0008] The present invention has been completed in consideration of such a situation, and one of its objects is to provide a control device for a mobile body, a control method for a mobile body, and a storage medium that can move the mobile body in a more appropriate driving state according to the road conditions during movement.

[0009] Solutions to Solve Problems

[0010] The control device for a mobile object, the control method for a mobile object, and the storage medium according to the present invention employ the following configurations.

[0011] (1): One aspect of the present invention relates to a control device for a mobile body, wherein the mobile body can carry one or more passengers and can move in both a lane and a specified area different from the lane, wherein the control device for the mobile body comprises: a road type recognition unit, which recognizes on which road type the mobile body is moving in the lane and the specified area based on the output of an external detection device that detects the external condition of the mobile body; and a control unit, which causes the mobile body to move in either a first driving state or a second driving state based on the road type recognized by the road type recognition unit, and in the first driving state, the speed of the mobile body is limited The control unit controls the moving body to move in the first driving state when the moving body is identified as moving in the lane, and controls the moving body to move in the second driving state when the moving body is identified as moving in the prescribed area. When an operation of switching the driving state is performed by a switching operation unit that accepts an operation of switching the driving state by the occupant, the control unit forcibly switches the driving state being controlled even when the moving body is identified as moving in the lane or the prescribed area.

[0012] (2): Based on the scheme of (1) above, when the driving state is switched based on the switching operation of the switching operation unit, the control unit reports information indicating that the driving state has been forcibly switched to one or both of the occupant and the surroundings of the moving body.

[0013] (3): Based on the scheme of (1) above, when the driving state is switched based on the switching operation of the switching operation unit, the control unit reports information indicating in which of the first driving state and the second driving state the moving body is moving to the occupant and one or both of the surroundings of the moving body.

[0014] (4): Based on the scheme of (1) above, the control unit makes the reporting form of the case where the driving state is switched by the switching operation of the switching operation unit different from the reporting form of the case where the driving state is determined based on the road type identified by the road type identification unit.

[0015] (5): Based on the scheme of (1) above, the control unit causes the mobile body to move in any one of a plurality of pre-set driving modes, and when the driving mode being executed is a specific driving mode, the control unit does not execute the switching of the driving state based on the switching operation of the switching operation unit.

[0016] (6) Based on the above scheme (1), when the degree of recognition of the road type recognized by the road type recognition unit is greater than a threshold value, the control unit does not execute the switching of the driving state based on the switching operation of the switching operation unit.

[0017] (7) In the above-mentioned aspect (1), when the switching operation of the driving state is performed by the switching operation unit, the control unit notifies the position information of the moving body to an external device.

[0018] (8) Another aspect of the present invention relates to a method for controlling a moving body, wherein the moving body is provided with one or more passengers and is capable of moving in both a lane and a prescribed area different from the lane, the method for controlling the moving body causing a computer controlling the moving body to perform the following processing: based on the output of an external detection device that detects the external condition of the moving body, identifying the road type in which the moving body is moving between the lane and the prescribed area; based on the identified road type, causing the moving body to move in either a first driving state or a second driving state, wherein the speed of the moving body is limited to a first speed in the first driving state and the speed of the moving body is limited to a second speed lower than the first speed in the second driving state; when it is identified that the moving body is moving in the lane, causing the moving body to move in the first driving state; when it is identified that the moving body is moving in the prescribed area, causing the moving body to move in the second driving state; and when an operation to switch the driving state is performed by a switching operation unit that receives the switching operation of the driving state by the passenger, forcibly switching the driving state being controlled even when it is identified that the moving body is moving in the lane or the prescribed area.

[0019] (9) Another aspect of the present invention relates to a storage medium storing a program, wherein a moving body is provided with one or more passengers and is capable of moving in both a lane and a prescribed area different from the lane, the program causing a computer controlling the moving body to perform the following processing: based on the output of an external detection device that detects the external condition of the moving body, identifying in which road type the moving body is moving in the lane and the prescribed area; based on the identified road type, causing the moving body to move in any one of a first driving state and a second driving state, wherein in the first driving state, the speed of the moving body is limited to a first speed, and in the second driving state, the speed of the moving body is limited to a second speed lower than the first speed; when it is identified that the moving body is moving in the lane, causing the moving body to move in the first driving state; when it is identified that the moving body is moving in the prescribed area, causing the moving body to move in the second driving state; and when an operation to switch the driving state is performed by a switching operation unit that receives the switching operation of the driving state by the passenger, forcibly switching the driving state being controlled even when it is identified that the moving body is moving in the lane or the prescribed area.

[0020] Effects of the Invention

[0021] According to the above aspects (1) to (9), the movable body can be moved in a more appropriate running state according to the road conditions during movement. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a diagram showing an example of the configuration of the moving object 1 and the control device 100 according to the embodiment.

[0023] Figure 2 This is a perspective view of the moving body 1 as seen from above.

[0024] Figure 3 This is a diagram for explaining the content of control of the moving object 1 by the control unit 140 .

[0025] Figure 4 This is a diagram showing an example of the content of the report at time T1.

[0026] Figure 5 This is a diagram showing an example of the content of the report at time T2.

[0027] Figure 6 This is a diagram showing an example of the content of the report at time T3.

[0028] Figure 7 This is a diagram showing an example of information indicating that the driving state cannot be forcibly switched.

[0029] Figure 8 This is a flowchart showing an example of the flow of processing executed by the control device 100 according to the embodiment. DETAILED DESCRIPTION

[0030] Hereinafter, embodiments of a control device for a mobile body, a control method for a mobile body, and a storage medium of the present invention will be described with reference to the accompanying drawings. The mobile body moves in both a lane and a prescribed area different from the lane. The mobile body is sometimes referred to as a micro-mobile body. An electric scooter is a type of micro-mobile body. A prescribed area refers to, for example, a sidewalk. In addition, the so-called prescribed area may be part or all of a roadside area, a bicycle lane, an open space, etc., or may include all of a sidewalk, a roadside area, a bicycle lane, an open space, etc. In the following description, the prescribed area is assumed to be a sidewalk. The portion described as "sidewalk" in the following description can be appropriately read as "prescribed area".

[0031] Figure 1 1 is a diagram showing an example of the structure of a mobile body 1 and a control device 100 according to the embodiment. The mobile body 1 is equipped with, for example, an external detection device 10, a mobile body sensor 12, an operating member 14, an internal camera 16, a positioning device 18, a communication device 20, a mode switching switch 22, a forced switching switch 24, an HMI (Human Machine Interface) 26, a moving mechanism 30, a driving device 40, an external reporting device 50, a storage device 70, and a control device 100. It should be noted that a part of the structures that are not necessary for realizing the functions of the present invention may be omitted.

[0032] The external detection device 10 detects the external conditions of the mobile body 1. For example, the external detection device 10 is a variety of devices that use at least a portion of the surroundings of the mobile body 1 (including the traveling direction) as a detection range. The external detection device 10 includes an external camera, a radar device, LIDAR (Light Detection and Ranging), a sensor fusion device, etc. The external detection device 10 outputs information (images, object positions, etc.) indicating the detection results to the control device 100.

[0033] The moving body sensor 12 includes, for example, a velocity sensor, an acceleration sensor, a yaw rate (angular velocity) sensor, an orientation sensor, and an operation amount detection sensor attached to the operating element 14 .

[0034] The operating member 14 receives driving operations performed by the occupants of the moving body. The operating member 14 includes, for example, operating members for indicating acceleration and deceleration (e.g., accelerator pedal, brake pedal, speed adjustment dial switch, lever), and operating members for indicating steering (e.g., steering wheel). In this case, the moving body sensor 12 may also include an accelerator opening sensor, a brake pedaling amount sensor, a steering torque sensor, etc. The moving body 1 may also have operating members in forms other than the above forms (e.g., non-circular rotating operating members, joysticks, buttons, etc.) as the operating member 14.

[0035] The interior camera 16 captures at least the head of the occupant of the moving object 1 from the front. The interior camera 16 is a digital camera using an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The interior camera 16 outputs the captured image to the control device 100 .

[0036] The positioning device 18 is a device for measuring the position of the mobile body 1. The positioning device 18 is, for example, a GNSS (Global Navigation Satellite System) receiver, which determines the position of the mobile body 1 based on the signal received from the GNSS satellite and outputs the position of the mobile body 1 as position information. It should be noted that the position information of the mobile body 1 can also be estimated based on the position of the Wi-Fi base station to which the communication device 20 is connected.

[0037] The communication device 20 communicates with other mobile objects in the surrounding area using, for example, a cellular network, Wi-Fi network, Bluetooth (registered trademark), DSRC (Dedicated Short Range Communication), or communicates with various external devices (eg, a management server) via a wireless base station.

[0038] The mode switching switch 22 is a switch operated by the passenger. The mode switching switch 22 may be a mechanical switch or a GUI (Graphical User Interface) switch set on the touch panel of the HMI 26. The mode switching switch 22, for example, accepts an operation to switch the driving mode to any one of Mode A, Mode B, and Mode C. Mode A is an assist mode in which the passenger performs one of the steering operation and the acceleration / deceleration control, and the other of the steering operation and the acceleration / deceleration control is automatically performed. Mode A may include Mode A-1 and Mode A-2. In Mode A-1, the passenger performs the steering operation and the acceleration / deceleration control is automatically performed. In Mode A-2, the passenger performs the acceleration / deceleration operation and the steering control is automatically performed. Mode B is a manual driving mode in which the passenger performs the steering operation and the acceleration / deceleration operation. Mode C is an automatic driving mode in which the operation control and the acceleration / deceleration control are automatically performed.

[0039] The forced switching switch 24 is a switch that receives an operation of forcibly switching the driving state of the mobile body 1 described later and an operation of canceling the switching. The forced switching switch 24 may be a mechanical switch or a GUI switch set on the touch panel of the HMI 26. The forced switching switch 24 is an example of a "switching operation unit". The switching operation unit may also include a mode switching switch 22.

[0040] It should be noted that the operation of switching the above-mentioned modes and driving states may be received from a microphone or an internal camera 16 provided on the mobile body 1 instead of the mode switching switch 22 or the forced switching switch 24. In this case, the control device 100 may receive the switching operation of the mode and driving state based on the analysis result of the voice input by the occupant through the microphone, or may receive the switching operation of the mode and driving state based on the posture of the occupant, the movement of the mouth, etc. obtained as the analysis result of the front image of the occupant captured by the internal camera 16.

[0041] HMI26 prompts (or reports, notifies) various information to the passengers of the mobile body 1, and accepts input operations performed by the passengers. HMI26 includes various display devices, speakers, microphones, buzzers, touch panels, switches, buttons, lights, etc. HMI26 is an example of an "internal reporting device". For example, HMI26 reports the driving state of the mobile body 1 controlled by the control unit 140 to the passengers in different reporting forms according to the difference in driving state. In addition, HMI26 prompts information from the control device 100, or prompts information obtained from an external device by the communication device 20.

[0042] The moving mechanism 30 is a mechanism for moving the moving body 1 on the road. The moving mechanism 30 is, for example, a wheel group including a steering wheel and a driving wheel. In addition, the moving mechanism 30 may also be a leg for multi-legged walking.

[0043] The drive device 40 outputs force to the moving mechanism 30 to move the moving body 1. For example, the drive device 40 includes a motor that drives the driving wheel, a battery that stores power supplied to the motor, a steering device that adjusts the steering angle of the steering wheel, etc. The drive device 40 may also include an internal combustion engine, a fuel cell, etc. as a driving force output mechanism or a power generation mechanism. In addition, the drive device 40 may also include a braking device that brakes by friction or air resistance.

[0044] The external reporting device 50 is provided on, for example, an outer plate portion of the mobile body 1, and is a lamp, a display device, a speaker, etc. for reporting information to the outside of the mobile body 1. The external reporting device 50 reports the driving state of the mobile body 1 controlled by the control unit 140 to the surroundings of the mobile body (within a predetermined distance from the mobile body 1) in different reporting forms according to the difference in the driving state, for example.

[0045] Figure 2 1 is a perspective view of the moving body 1 viewed from above. In the figure, FW is a steering wheel, RW is a driving wheel, SD is a steering device, MT is a motor, and BT is a battery. The steering device SD, the motor MT, and the battery BT are included in the driving device 40. In addition, AP is an accelerator pedal, BP is a brake pedal, WH is a steering wheel, SP is a speaker, and MC is a microphone. The moving body 1 shown in the figure is a moving body for one person, and the passenger P sits in the driver's seat DS and wears a seat belt SB. The arrow α1 is the direction of travel (speed vector) of the moving body 1. The external detection device 10 is set near the front end of the moving body 1, the internal camera 16 is set at a position that can capture the head of the passenger P from the front of the passenger P, and the mode switching switch 22 and the forced switching switch 24 are set on the hub of the steering wheel WH. In addition, an external reporting device 50 as a display device is set near the front end of the moving body 1. In addition, an HMI26 as a display device is set in front of the passenger P inside the moving body. The external reporting device 50 may be formed integrally with the speaker SP, and the HMI 26 may be formed integrally with the speaker SP and the microphone MC.

[0046] return Figure 1 The storage device 70 is a non-temporary storage device such as a HDD (Hard Disk Drive), a flash memory, or a RAM (Random Access Memory). The storage device 70 stores map information 72, a program 74 for execution by the control device 100, and the like. Although the storage device 70 is shown outside the frame of the control device 100 in the figure, the storage device 70 may be included in the control device 100.

[0047] [Control device]

[0048] The control device 100 includes, for example, a road type recognition unit 120, an object recognition unit 130, and a control unit 140. For example, it is implemented by executing a program (software) 74 by a hardware processor such as a CPU (Central Processing Unit). Some or all of these components can be implemented by hardware (including circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Processing Unit), etc., or can be implemented by the cooperation of software and hardware. The program can be stored in the storage device 70 in advance, or it can be stored in a removable storage medium (non-temporary storage medium) such as a DVD or CD-ROM, and installed in the storage device 70 by assembling the storage medium in a drive device.

[0049] The road type recognition unit 120 recognizes whether the moving object 1 is moving in a lane or a sidewalk. For example, the road type recognition unit 120 recognizes which road type, a lane or a sidewalk, the moving object 1 is moving on by analyzing an image captured by an external camera of the external detection device 10. It should be noted that the output of a radar device, a LIDAR, a sensor fusion device, etc. may also be used as an auxiliary.

[0050] As an example of image analysis, semantic segmentation can be cited. The road type recognition unit 120 classifies each pixel in the frame of the image by type (lane, sidewalk, boundary such as road dividing line, obstacle, etc.) and assigns a label. When there are many pixels assigned the label of lane in the area corresponding to the front of the moving body 1, it is recognized that the moving body 1 is moving in the lane, and when there are many pixels assigned the label of sidewalk in the area corresponding to the front of the moving body 1 in the image, it is recognized that the moving body 1 is moving on the sidewalk. Not limited to this, it is also possible that the road type recognition unit 120 recognizes that the moving body 1 is moving in the lane when a vehicle is recognized in the area corresponding to the front of the moving body 1 in the image, and recognizes that the moving body 1 is moving on the sidewalk when a pedestrian is recognized in the area corresponding to the front of the moving body 1 in the image. In addition, it is also possible that the road type recognition unit 120 recognizes that the moving body 1 is moving in the lane when the width of the road surface area in the area corresponding to the front of the moving body 1 in the image is large, and recognizes that the moving body 1 is traveling on the sidewalk when the width of the road surface area in the area corresponding to the front of the moving body 1 in the image is small.

[0051] In addition, the road type recognition unit 120 may also compare the position information of the moving body 1 measured by the positioning device 18 with the map information 72 to recognize whether the moving body 1 is moving in a lane or a sidewalk. In this case, the map information needs to have a degree of accuracy that can distinguish the sidewalk and the lane based on the position coordinates. In addition, when the "prescribed area" is not only the sidewalk, the road type recognition unit 120 also performs the same processing on the roadside area, bicycle lane, open space, etc.

[0052] In addition, the road type recognition unit 120 can also obtain the recognition degree of the recognized road type. The recognition degree refers to an index value indicating the accuracy (accuracy) of the recognized road type. The higher the recognition degree, the higher the possibility that the actual road type is the same as the recognized road type. The recognition degree varies, for example, depending on the performance degradation (e.g., degradation, failure) of the external detection device 10, the surrounding environment (dirt, wear, weather, road shape of the road dividing line), etc. For example, the recognition degree is derived based on the degree of fit between the road type recognized according to the image captured by the external camera of the external detection device 10 and the road type that serves as the benchmark. In addition, the recognition degree can be derived based on the degree of fit between the road type recognized according to the image captured by the external camera and the dividing line information recognized by the LIDAR, and the road type recognized according to the image captured by the external camera and the road type included in the map information instead of the above-mentioned fit (or in addition to the above-mentioned fit).

[0053] The object recognition unit 130 recognizes objects existing around the mobile body 1 (e.g., within a specified distance from the mobile body 1) based on the output of the external detection device 10. The so-called object includes a part or all of the obstacles such as mobile bodies such as vehicles, bicycles, pedestrians, road boundaries such as road dividing lines, steps, guardrails, shoulders, and central median strips, road signs, billboards, etc., and fallen objects existing (falling) on ​​the road. In addition, the object recognition unit 130 can also recognize steps and grooves existing between the lane and the sidewalk (boundary). The object recognition unit 130 obtains information such as the existence, position, and category of other mobile bodies by, for example, inputting an image captured by an external camera to a learned model. The learned model is learned in a manner that outputs information such as the existence, position, and category of objects when an image captured by an external camera of the external detection device 10 is input. The category of other mobile bodies can also be estimated based on the size of the image, the intensity of the reflected wave received by the radar device of the external detection device 10, etc. Furthermore, the object recognition unit 130 may recognize the speed of another moving object detected by the radar device using Doppler shift or the like, for example.

[0054] The control unit 140 controls the drive device 40, for example, according to a driving mode determined by the mode switching switch 22 or the like among a plurality of pre-set driving modes. It should be noted that the mobile body 1 may execute only a part of the driving modes described below, but the control unit 140 in principle makes the driving state different when the mobile body 1 moves in a lane and when it moves on a sidewalk in any case. In this case, the mode switching switch 22 can be omitted. The driving state includes at least state information related to the speed limit value. The driving state includes, for example, at least a first driving state and a second driving state. The first driving state is, in principle, a driving state when the mobile body 1 moves in a lane, and the upper limit speed of the mobile body 1 is limited to a first speed. The second driving state is, in principle, a driving state when the mobile body 1 moves on a sidewalk, and the upper limit speed of the mobile body 1 is limited to a second speed lower than the first speed.

[0055] For example, in mode A-1, when the control unit 140 recognizes that the moving body 1 is moving in a lane by referring to the information on the driving path and the object obtained based on the outputs of the road type recognition unit 120 and the object recognition unit 130, the control unit 140 switches to the first driving state and maintains the distance between the moving body 1 and the object in front to be at least a certain value, and when the distance between the moving body 1 and the object in front is sufficiently long, controls the motor MT of the drive device 40 so that the moving body 1 moves at a first speed V1 (for example, a speed of more than ten [km / h] and less than several tens [km / h]). In addition, when the control unit 140 recognizes that the moving body 1 is moving on a sidewalk, the control unit 140 switches to the second driving state and maintains the distance between the moving body 1 and the object in front to be at least a certain value, and when the distance between the moving body 1 and the object in front is sufficiently long, controls the motor MT of the drive device 40 so that the moving body 1 moves at a second speed V2 (for example, a speed of less than ten [km / h]). The function involved is the same as the ACC (Adaptive Cruise Control) function of the vehicle that makes the first speed V1 or the second speed V2 a set speed, and the technology used in ACC can be used. In addition, in mode A-1, the control unit 140 controls the steering device SD in a manner that changes the steering angle of the steering wheel based on the operation amount of the operating member 14 such as the steering wheel. The function involved is the same as the function of the power steering device, and the technology used in the power steering device can be used. It should be noted that the steering is not electronically controlled, and the mobile body 1 may also have a steering device that mechanically connects the operating member 14 and the steering mechanism.

[0056] In mode A-2, the control unit 140 refers to the information of the travel path and the object obtained based on the output of the road type recognition unit 120 and the object recognition unit 130, generates a target trajectory that can be moved while avoiding the object in the travel path, and controls the steering device SD of the drive device 40 so that the vehicle 1 moves along the target trajectory. Regarding acceleration and deceleration, the control unit 140 controls the motor MT of the drive device 40 based on the speed of the vehicle 1 and the operation amount of the accelerator pedal or the brake pedal. When the control unit 140 recognizes that the vehicle 1 is moving in the lane, it switches to the first travel state and controls the motor MT of the drive device 40 with the first speed V1 as the upper limit speed (that is, in the case of mode A-2, the vehicle 1 is not accelerated even if there is a further acceleration instruction when the upper limit speed is reached), and when it recognizes that the vehicle 1 is moving on the sidewalk, it switches to the second travel state and controls the drive device 40 with the second speed V2 as the upper limit speed.

[0057] In mode B, the control unit 140 controls the motor MT of the drive device 40 based on the speed of the vehicle 1 and the amount of operation of the accelerator pedal or the brake pedal. When the control unit 140 recognizes that the vehicle 1 is moving in a lane, it switches to the first driving state and controls the motor MT of the drive device 40 with the first speed V1 as the upper limit speed (that is, in the case of mode B, the vehicle 1 is not accelerated even if there is a further acceleration instruction when the upper limit speed is reached), and when it recognizes that the vehicle 1 is moving on a sidewalk, it switches to the second driving state and controls the motor MT of the drive device 40 with the second speed V2 as the upper limit speed. With regard to steering, it is the same as mode A-1.

[0058] In mode C, the control unit 140 refers to the information of the travel path and the object obtained based on the output of the object recognition unit 130, generates a target trajectory that can move while avoiding the object in the travel path, and controls the drive device 40 in such a way that the moving body 1 moves along the target trajectory. In mode C as well, the control unit 140 switches to the first travel state when it is recognized that the moving body 1 is moving in the lane, controls the drive device 40 with the first speed V1 as the upper limit speed, and switches to the second travel state when it is recognized that the moving body 1 is moving on the sidewalk, controls the drive device 40 with the second speed V2 as the upper limit speed.

[0059] In addition, the control unit 140 may, for example, switch the driving state controlled based on the recognition result obtained by the road type recognition unit 120 and the object recognition unit 130 based on the switching operation of the occupant P when receiving a switching operation of the driving state from the occupant P through the forced switching switch 24 (when the switching operation is performed by the occupant P).

[0060] Hereinafter, switching of the driving state by the control unit 140 and the content of the report to one or both of the occupant and the surroundings of the mobile object 1 based on the driving state will be described in detail.

[0061] [Switching of driving status]

[0062] Figure 3 1 is a diagram for explaining the control contents of the mobile body 1 by the control unit 140. Figure 3 In the example of FIG. 1 , a road RD1 including a lane 200 and a sidewalk 210 is shown. Figure 3 In the figure, the road RD1 is divided by the road dividing line L1 and the road dividing line L3, the lane 200 is divided by the road dividing line L1 and the road dividing line L2, and the sidewalk 210 is divided by the road dividing line L2 and the road dividing line L3. The road RD1 extends along the X-axis direction in the figure, and the moving body 1 and the vehicle 220 move along the extending direction. Figure 3 In the example, time T1 is the earliest, followed by T2 and T3. Figure 3 In the example of , the position and direction of movement of the moving body 1 at each time are shown. Figure 3 In the example, the section D1 before reaching the road point (position in the X-axis direction) PO1 in the road RD1 can recognize the road dividing line L2 on the system side (road type recognition unit 120, object recognition unit 130), but the section D2 in front of the point PO1 in the road RD1 cannot recognize the road dividing line L2 on the system side due to the dirtiness, wear and tear of the road dividing line L2.

[0063] At time T1, the moving body 1 is moving in the extending direction of the lane 200 of the road RD1. In this case, the road type recognition unit 120 recognizes that the road type on which the moving body 1 is currently moving is the lane 200. The control unit 140 recognizes that the moving body 1 is moving in the lane 200 by the road type recognition unit 120, and thus controls the moving body 1 to move in the first driving state.

[0064] exist Figure 3 In the example, the moving body 1 moves from the lane 200 to the sidewalk 210 during the period from time T1 to time T2. At time T2, the road type recognition unit 120 recognizes that the road type on which the moving body 1 is traveling is the lane 200. The control unit 140 recognizes that the moving body 1 is moving on the sidewalk 210 by the road type recognition unit 120, and thus moves the moving body 1 in the second driving state. It should be noted that the control unit 140 may switch from the first driving state to the second driving state when the reference position (e.g., center of gravity) of the moving body 1 and the entire moving body 1 crosses the road dividing line L2 from the lane 200 and exists on the sidewalk 210 (or when a predetermined time has passed since it was determined to exist on the sidewalk 210).

[0065] The time T3 is the time when the moving body 1 is moving on the sidewalk 210, and it shows the time when the moving body T1 traveling in the extension direction of the road RD1 passes the road point PO1. At the time T3, the road type recognition unit 120 fails to recognize the road dividing line L2, and therefore recognizes that the road type on which the moving body 1 is traveling is the lane 200 through the road dividing lines L1 and L3. In this case, the control unit 140 recognizes that the moving body 1 is moving in the lane 200 by the road type recognition unit 120, and therefore switches from the second driving state to the first driving state to move the moving body 1. However, the moving body 1 is actually traveling on the sidewalk 210, so the passenger P forcibly switches to the second driving state through the forced switching switch 24. Based on the switching operation (instruction) received by the forced switching switch 24, the control unit 140 controls the driving state of the moving body 1 to be forcibly switched from the first driving state to the second driving state.

[0066] Thus, even when the system side misidentifies the type of the road on which the vehicle 1 is traveling, the traveling state of the vehicle 1 can be switched according to the intention of the occupant P, so that more appropriate traveling control can be performed according to the road conditions on which the vehicle 1 is traveling.

[0067] It should be noted that the control of forcibly switching the driving state continues, for example, until an operation to cancel the switching is received by the forced switching switch 24. Alternatively, the control of forcibly switching may continue until a predetermined time has passed since the switching control was executed, and / or until the mobile body 1 has traveled a predetermined distance. Thus, frequent switching of the driving state can be suppressed, and more stable driving control can be achieved.

[0068] In addition, the control unit 140 may not switch the driving control based on the operation received by the forced switching switch 24 when the degree of recognition of the road type by the road type recognition unit 120 is greater than the threshold value. Figure 3 In the example, in section D1, road dividing lines L1 to L3 can be identified, so the degree of recognition of the road type becomes above the threshold. On the other hand, in section D2, road dividing line L2 cannot be identified, so the degree of recognition of the road type decreases and is less than the threshold. Therefore, the control unit 140 does not perform the switching of the driving control based on the operation received by the forced switching switch 24 in section D1, and performs the switching of the driving control based on the operation received by the forced switching switch 24 in section D2. In addition, the control unit 140 may also forcibly perform the driving control corresponding to the instruction received by the forced switching switch 24 only during the period when the degree of recognition is less than the threshold, and terminate the above-mentioned driving control when the degree of recognition returns to above the threshold, and switch to the driving control based on the recognition result of the road type.

[0069] [About the report content]

[0070] Next, the content of the report reported to the occupant P (inside the mobile body 1) and the surroundings (outside the mobile body 1) based on the driving state of the mobile body 1 will be specifically described. The control unit 140 reports information related to the driving state to one or both of the occupant P and the surroundings in different reporting forms for each driving state of the mobile body 1. In addition, the control unit 140 may make the reporting form in the case of reporting the driving state switched by the switching operation of the forced switching switch 24 different from the reporting form in the case of reporting the driving state determined based on the road type identified by the road type identification unit 120. The reporting form refers to, for example, the lighting, flashing, color of a light, text, font, graphics, etc. displayed on a display device, the sound of a speaker, an alarm, etc.

[0071] For example, the control unit 140 controls the lamp of the external notification device 50 not to light up when the vehicle 1 is moving in the lane in the first driving state, and to light up the lamp of the external notification device 50 when the vehicle 1 is moving in the second driving state on the sidewalk. The light color of the lamp is preferably a color determined by laws and regulations. In addition, the control unit 140 may control the lamp to light up blue when the road type recognition unit 120 recognizes that the vehicle 1 is moving in the lane 200, and to light up green when the road type recognition unit 120 recognizes that the vehicle 1 is moving on the sidewalk 210. Furthermore, the control unit 140 may control the lamp to light up or flash red (different from the normal color) when the vehicle 1 is traveling in the driving state corresponding to the switching operation received by the forced switching switch 24. It should be noted that the control unit 140 may control the reporting form of the lamp so that the reporting form is different for each driving state corresponding to the switching operation.

[0072] In addition, when the HMI 26 and the external reporting device 50 are equipped with a display device, the control unit 140 causes the HMI 26 and the external reporting device 50 to display information indicating that the vehicle 1 is moving in the lane 200 in the form of text or graphics. In addition, when the road type recognition unit 120 recognizes that the vehicle 1 is moving on the sidewalk 210, the control unit 140 causes the HMI 26 and the external reporting device 50 to display information indicating that the vehicle 1 is moving on the sidewalk in the form of text or graphics. In addition, the control unit 140 may cause the HMI 26 and the external reporting device 50 to display information indicating that the vehicle 1 is moving in the first driving state or in the second driving state in the form of text or graphics. In addition, the control unit 140 may cause the HMI 26 and the external reporting device 50 to display information indicating that the vehicle 1 is forcibly moving in the driving state corresponding to the switching operation received by the forced switching switch 24 in the form of text or graphics.

[0073] In addition, when the HMI 26 and the external reporting device 50 are equipped with a sound output device such as a speaker, the control unit 140 may also cause the HMI 26 and the external reporting device 50 to output a sound or an alarm corresponding to the content displayed on the above-mentioned display device. It should be noted that the control unit 140 may also report in the form of a report that combines a plurality of the above-mentioned light display, display, and sound output.

[0074] The control unit 140 reports (notifies) the state of the moving body 1 to the passenger P by causing the HMI 26 to output the above content, and reports the state of the moving body 1 to the surroundings of the moving body 1 by causing the external reporting device 50 to output the above content. As a result, the passenger P, surrounding traffic participants (such as pedestrians, other vehicles), etc. can more accurately grasp the state of the moving body 1. Therefore, the passenger P can perform appropriate driving operations according to the driving state, and the surrounding traffic participants can pass appropriately.

[0075] Hereinafter, a specific example of the content of the report at each of the above-mentioned times T1 to T3 will be described. Figure 4 is a diagram showing an example of the content of the report at time T1. Figure 4 In FIG. 5 , an example of an image IM10 displayed on a display screen when the external reporting device 50 is equipped with a display device is shown as an example. In addition, the display form such as the content and layout displayed on the image IM10 is not limited to Figure 4 The same applies to the following figures.

[0076] At time T1, the control unit 140 generates an image IM10 based on the recognition result of the road type recognition unit 120, and causes the external reporting device 50 to display the generated image IM10, which includes information indicating that the vehicle 1 is traveling in the first traveling state and information related to the upper speed limit in the first traveling state. Figure 4 The image IM10 shows text information such as "Moving in lane mode." and "The upper speed limit is set to 30 [km / h]." The lane mode refers to a mode in which the moving body 1 is in the first driving state. In addition, the upper speed limit is a speed that is associated with the first driving state, but is not limited to Figure 4 By displaying the image IM10 at time T1, it is possible to notify the surroundings that the moving object 1 is traveling correctly in the lane 200 in the lane pattern.

[0077] Figure 5 1 is a diagram showing an example of the content of the report at time T2. At time T2, the control unit 140 generates an image IM20 based on the recognition result of the road type recognition unit 120, and causes the external reporting device 50 to display the generated image IM20, which includes information indicating that the mobile body 1 is traveling in the second driving state and information related to the upper speed limit in the second driving state. Figure 5 The image IM20 shows text information such as "Moving in pedestrian mode." and "The upper speed limit is set to 6 [km / h]." The pedestrian mode is a mode in which the moving body 1 is in the second driving state. The upper speed limit is a speed that is associated with the second driving state, but is not limited to Figure 5 By displaying the image IM20 at time T2, it is possible to notify the surroundings that the moving object 1 is properly traveling on the sidewalk 210 in the sidewalk mode.

[0078] Figure 6 1 is a diagram showing an example of the content of the report at time T3. At time T3 (after the forced switching), the control unit 140 generates an image IM30 based on the switching operation received by the forced switching switch 24, and causes the external reporting device 50 to display the generated image IM30, which includes information indicating that the mobile body 1 is forced to travel in the second driving state and information related to the upper speed limit in the second driving state. Figure 6 The image IM30 displays text information (text) such as “Moving in pedestrian mode due to forced switching by the occupant.” and “The upper limit speed is set to 6 [km / h].”

[0079] In addition, the control unit 140 may flash a part of the text information, change the font (thickness) and color, or change the color of the outer periphery (edge) of the image IM30, as shown in the image IM30, when the driving state is forcibly switched by the instruction of the passenger P. In this way, by emphasizing the display compared with the normal display (the driving state obtained based on the recognition result on the system side), it is possible to report to the surrounding more reliably, and it is possible to make the surrounding traffic participants pay more attention to the behavior of the moving body 1 while passing. Therefore, the safety of the moving body 1 in the driving control performed by the instruction of the passenger P can be further improved. The control unit 140 may also display the above-mentioned images IM10 to IM30 on the display device of the HMI26 instead of (or in addition to) displaying the external reporting device 50.

[0080] In addition, the control unit 140 may also obtain the position information of the mobile body 1 from the positioning device 18 when receiving the switching operation of the driving state through the forced switching switch 24, and notify the external device (for example, the management server) of the obtained position information via the communication device 20. Thus, by obtaining the position information from one or more mobile bodies 1 on the server side, it is possible to grasp the road locations where the possibility of misidentification of the road type is high. In addition, the following processing can be performed on the server side: the cause of misidentification based on the grasped road locations, the improvement of the recognition processing (program, etc.), and the elimination of misidentification by determining the road type of the grasped road location and notifying the mobile body 1 of the road type. Thus, it is possible to reduce misidentification and perform more appropriate driving control.

[0081] In addition, the control unit 140 may add identification information of the moving body 1 and identification information of the passenger P to the position information of the moving body 1 and notify the external device. Thus, for example, the moving body 1 and the passenger P that frequently perform switching operations using the forced switching switch 24 can be identified on the server side, and inappropriate use of the forced switching switch 24 can be suppressed by issuing a warning to the identified moving body 1 and the passenger P.

[0082] It should be noted that, when the forced switching switch 24 can switch the driving state, the occupant P may not switch the driving state appropriately even though the system can correctly identify the road type and the vehicle moves in the driving state corresponding to the identified road type. Therefore, when the control unit 140 satisfies the predetermined conditions, the control unit 140 does not switch the driving control even when the switching operation of the driving state is received by the forced switching switch 24.

[0083] For example, the control unit 140, as a predetermined condition, does not accept the switching operation of the driving state performed by the forced switching switch 24 when executing a specific driving mode among a plurality of pre-set driving modes. The specific driving mode refers to, for example, mode C (automatic driving mode). In the case of mode C, the moving body 1 is traveling along a target trajectory for avoiding objects, so when the driving state is forcibly switched by the switching operation of the occupant P during the execution of mode C, there is a possibility that the object cannot be avoided. Therefore, the control unit 140 performs control in a manner that does not accept the switching operation of the driving state performed by the forced switching switch 24 during the execution of mode C. It should be noted that when there is a switching operation performed by the forced switching switch 24 during the execution of mode C, the control unit 140 may also notify the occupant P of information indicating that the driving state cannot be forcibly switched.

[0084] Figure 7 is a diagram showing an example of information indicating that the driving state cannot be forcibly switched. Figure 7 In the example of FIG. 1 , an image IM40 is shown displayed on the display device of HMI 26 when the operation of switching the driving state is received by the forced switching switch 24 during the execution of mode C at time T1. For example, when the control unit 140 receives the operation of switching the driving state by the forced switching switch 24 during the execution of mode C at time T1, the control unit 140 generates an image IM40 indicating that forced switching is not possible, and displays the generated image IM40 on HMI 26. It should be noted that Figure 7 In the example of , the image IM40 is displayed superimposed on the image IM10, but the image IM10 may be switched to the image IM40 and displayed. Figure 7 The image IM40 displays a text message (text) such as "The driving state cannot be forcibly switched because the vehicle is in automatic driving." This allows the occupant P to more accurately understand the reason why the driving state is not switched.

[0085] In addition, the control unit 140 may, as a predetermined condition, not switch the driving control based on the operation received by the forced switching switch 24 when the degree of recognition of the road type by the road type recognition unit 120 is greater than the threshold value as described above. In addition, the control unit 140 may forcibly perform the driving control corresponding to the instruction received by the forced switching switch 24 only during the period when the degree of recognition is less than the threshold value, and terminate the above-mentioned driving control when the degree of recognition returns to greater than the threshold value, and switch to the driving control based on the recognition result of the road type.

[0086] As a result, it is possible to allow switching of the driving state based on the instruction of the occupant P under conditions where the possibility of misidentification of the road type is high, and to suppress switching of the driving state based on the instruction of the occupant P under conditions where the recognition accuracy on the system side is high, thereby enabling more appropriate driving control.

[0087] <Modification>

[0088] In the above-mentioned embodiment, instead of forcibly switching from the first driving state to the second driving state based on the switching operation received by the forced switching switch 24, it is also possible to forcibly switch to the first driving control by the switching operation of the forced switching switch 24 while the second driving state is being executed based on the recognition result of the road type recognized by the system side, etc.

[0089] In addition, in the embodiment, the reporting form to the occupant P or the surrounding is different depending on each driving state or whether the driving control is switched based on the switching operation received by the forced switching switch 24, but instead of this (or in addition to this), a different reporting form may be used for each driving mode being executed by the mobile body 1.

[0090] [Processing Flow]

[0091] Figure 8 1 is a flowchart showing an example of a process flow executed by the control device 100 of the embodiment. Figure 8 In the example, the description will be centered around the various processes executed by the control device 100, especially the control and reporting processes of the driving state. Figure 8 The processing can be repeatedly executed at a specified timing.

[0092] exist Figure 8 In the example of FIG. 1 , the road type recognition unit 120 recognizes the road type of the road on which the mobile body 1 is traveling (step S100). Next, the control unit 140 causes the mobile body 1 to travel in a driving state corresponding to the recognized road type (step S110). Next, the control unit 140 reports information indicating the driving state to one or both of the passenger P and the surroundings (step S120).

[0093] Next, the control unit 140 determines whether the passenger has performed a switching operation of the driving state (step S130). If it is determined that the passenger has performed a switching operation of the driving state, the control unit 140 determines whether the mobile body 1 is executing the automatic driving mode (step S140). If it is determined that the automatic driving mode is not executed, the control unit 140 forcibly switches the driving state based on the switching operation until the passenger performs a release operation (step S150). Next, the control unit 140 reports to the passenger P and one or both of the surroundings information indicating that the vehicle is driving in the driving state switched by forced switching (step S160). In addition, in step S140, if it is determined that the automatic driving mode is being executed, the control unit 140 reports to the passenger P information indicating that the switch cannot be made (step S170). Thus, the processing of this flowchart ends. In addition, in the processing of step S130, if it is determined that the passenger has not performed a switching operation of the driving control, the processing of this flowchart ends.

[0094] In the process of step S140 described above, the control unit 140 may determine whether the degree of recognition of the road type is equal to or above a threshold value instead of determining whether the automatic driving mode is being executed, or may determine whether other predetermined conditions that do not forcibly switch the driving state are satisfied.

[0095] According to the embodiment described above, the mobile body 1 is provided with one or more passengers and can move in both a lane and a prescribed area different from the lane. The control device 100 of the mobile body 1 includes: a road type recognition unit 120, which recognizes the road type in the lane and the prescribed area on which the mobile body is moving based on the output of the external detection device 10 that detects the external condition of the mobile body 1; and a control unit 140, which, based on the road type recognized by the road type recognition unit 120, causes the mobile body to move in any one of a first driving state and a second driving state, in which the speed of the mobile body 1 is limited to a first speed in the first driving state and a second driving state in which the speed of the mobile body 1 is limited to a first speed in the second driving state. In this embodiment, the speed of the moving body 1 is limited to a second speed that is lower than the first speed. When it is recognized that the moving body 1 is moving in a lane, the control unit 140 causes the moving body 1 to move in the first driving state. When it is recognized that the moving body 1 is moving in a specified area, the control unit 140 causes the moving body 1 to move in the second driving state. When an operation of switching the driving state is performed by a switching operation unit that accepts a switching operation of the driving state performed by an occupant, the control unit 140 forcibly switches the driving state under control even when it is recognized that the moving body 1 is moving in a lane or a specified area, thereby being able to move the moving body in a more appropriate driving state according to the road conditions during movement.

[0096] The above-described embodiment can be expressed as follows.

[0097] A control device for a mobile object, comprising:

[0098] a storage medium storing computer-readable instructions that can be read by a computer for controlling a moving vehicle, the moving vehicle being capable of carrying one or more passengers and being capable of moving both in a lane and in a predetermined area different from the lane; and

[0099] a processor connected to the storage medium,

[0100] The processor executes the computer-readable instructions to perform the following processing:

[0101] Based on the output of the external detection device that detects the external condition of the moving body, identifying on which road type the moving body is moving in the lane and the prescribed area;

[0102] Based on the identified road type, the mobile body is moved in any one of a first driving state and a second driving state, wherein the speed of the mobile body is limited to a first speed in the first driving state and the speed of the mobile body is limited to a second speed lower than the first speed in the second driving state;

[0103] When it is recognized that the moving object is moving in the lane, causing the moving object to move in the first driving state;

[0104] When it is recognized that the mobile body is moving in the predetermined area, moving the mobile body in the second driving state; and

[0105] When the operation of switching the driving state is performed by the switching operation unit that receives the switching operation of the driving state by the occupant, the driving state being controlled is forcibly switched even when it is recognized that the moving object is moving in the lane or the predetermined area.

[0106] Although specific embodiments of the present invention have been described above using the embodiments, the present invention is not limited to such embodiments at all, and various modifications and substitutions can be made without departing from the gist of the present invention.

[0107] Description of reference numerals:

[0108] 10 External Detection Device

[0109] 12 Moving body sensor

[0110] 14 Operating parts

[0111] 16 Internal Camera

[0112] 18 Positioning device

[0113] 20 Communication devices

[0114] 22 Mode switch

[0115] 24 Forced switch

[0116] 26 HMT

[0117] 30 Mobile mechanism

[0118] 40 Drive unit

[0119] 50 External reporting device

[0120] 70 Storage Device

[0121] 100 Control device

[0122] 120 Road type identification unit

[0123] 130 Object Recognition Unit

[0124] 140 Control Department.

Claims

1. A control device for a mobile body, wherein the mobile body is provided with one or more passengers and is capable of moving in both a lane and a predetermined area different from the lane, in, The control device of the mobile body comprises: a road type recognition unit for recognizing on which road type the moving body is moving in the lane and the prescribed area based on an output of an external detection device for detecting an external condition of the moving body; as well as a control unit that causes the mobile body to move in any one of a first driving state and a second driving state based on the road type identified by the road type identification unit, wherein the speed of the mobile body is limited to a first speed in the first driving state and the speed of the mobile body is limited to a second speed lower than the first speed in the second driving state, When it is recognized that the moving object is moving in the lane, the control unit causes the moving object to move in the first driving state. When it is recognized that the mobile body is moving in the predetermined area, the control unit causes the mobile body to move in the second driving state. When the operation of switching the driving state is performed by the switching operation unit that receives the switching operation of the driving state by the occupant, the control unit forcibly switches the driving state being controlled even when it is recognized that the moving object is moving in the lane or the predetermined area.

2. The control device for a mobile object according to claim 1, in, When the driving state is switched based on the switching operation of the switching operation unit, the control unit reports information indicating that the driving state is forcibly switched to one or both of the occupant and the surroundings of the moving body.

3. The control device for a mobile object according to claim 1, in, When the driving state is switched based on a switching operation of the switching operation unit, the control unit reports information indicating in which of the first driving state and the second driving state the moving body is moving to one or both of the occupant and the surroundings of the moving body.

4. The control device for a mobile object according to claim 1, in, The control unit makes a reporting mode different when reporting a driving state switched by a switching operation of the switching operation unit from a reporting mode when reporting a driving state determined based on a road type recognized by the road type recognition unit.

5. The control device for a mobile object according to claim 1, in, The control unit causes the mobile body to move in any one of a plurality of preset driving modes. The control unit does not switch the driving state based on the switching operation of the switching operation unit when the driving mode being executed is a specific driving mode.

6. The control device for a moving object according to claim 1, in, The control unit does not switch the driving state based on the switching operation of the switching operation unit when the degree of recognition of the road type recognized by the road type recognition unit is equal to or greater than a threshold value.

7. The control device for a moving object according to claim 1, in, The control unit notifies an external device of position information of the moving object when the switching operation of the driving state is performed by the switching operation unit.

8. A method for controlling a moving object, in, The moving object can carry one or more passengers and can move in both a lane and a predetermined area different from the lane. The control method of the mobile body causes a computer controlling the mobile body to perform the following processing: Based on the output of the external detection device that detects the external condition of the moving body, identifying on which road type the moving body is moving in the lane and the prescribed area; Based on the identified road type, the mobile body is moved in any one of a first driving state and a second driving state, wherein in the first driving state, the speed of the mobile body is limited to a first speed, and in the second driving state, the speed of the mobile body is limited to a second speed lower than the first speed; When it is recognized that the moving object is moving in the lane, causing the moving object to move in the first driving state; When it is recognized that the mobile body is moving in the predetermined area, the mobile body is moved in the second driving state; as well as When the operation of switching the driving state is performed by the switching operation unit that receives the switching operation of the driving state by the occupant, the driving state being controlled is forcibly switched even when it is recognized that the moving object is moving in the lane or the predetermined area.

9. A storage medium storing a program, in, The moving object can carry one or more passengers and can move both in a lane and in a predetermined area different from the lane. The program causes the computer controlling the moving object to perform the following processing: Based on the output of the external detection device that detects the external condition of the moving body, identifying on which road type the moving body is moving in the lane and the prescribed area; Based on the identified road type, the mobile body is moved in any one of a first driving state and a second driving state, wherein in the first driving state, the speed of the mobile body is limited to a first speed, and in the second driving state, the speed of the mobile body is limited to a second speed lower than the first speed; When it is recognized that the moving object is moving in the lane, causing the moving object to move in the first driving state; When it is recognized that the mobile body is moving in the predetermined area, the mobile body is moved in the second driving state; as well as When the operation of switching the driving state is performed by the switching operation unit that receives the switching operation of the driving state by the occupant, the driving state being controlled is forcibly switched even when it is recognized that the moving object is moving in the lane or the predetermined area.