Driving assistance method, processing device, and mobile device
The method and device facilitate the return of a mobile device to its autonomous driving route by displaying positional and angular differences and generating support information, enhancing the ease of resuming autonomous operation through manual intervention.
Patent Information
- Application Number
- JP2022212113
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-12-28
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2042-12-28
AI Technical Summary
Returning a mobile device that has strayed from its travel route to the autonomous driving route, especially through manual operation from a remote location, is not always easy.
A method and device that support the operation of a mobile device capable of both autonomous and manual driving by displaying a first position on the autonomous driving route and a second position during manual operation, calculating differences in position and angle, and generating driving support information to assist the driver in returning to the autonomous route based on predetermined conditions.
Enables effective support for the mobile device to resume autonomous operation by providing clear guidance for manual operation, reducing the difficulty in returning to the autonomous driving route and minimizing interference with the device's work plan.
Smart Images

Figure 0007579839000001 
Figure 0007579839000002 
Figure 0007579839000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a driving assistance method, a processing device, and a mobile device. [Background technology]
[0002] If there is, for example, an obstacle on the driving route of a mobile device that is driving autonomously with no occupants, the driving mode can be switched to remote manual driving, and the mobile device can temporarily deviate from the autonomous driving route, allowing the mobile device to avoid the obstacle.
[0003] In this regard, Patent Document 1 discloses a work travel management system. The work travel management system manages work travel to a work site by a work vehicle capable of automatically traveling along a travel route. The work travel management system has an interruption information recording unit that records interruptions of work travel by the work vehicle as interruption information, an interruption information extraction unit that extracts the interruption information from the interruption information recording unit, an information display unit that displays the extracted interruption information before determining the interrupted work travel, and a resume information generation unit that generates resume information for resuming the interrupted work travel based on the interruption information and displays it on the information display unit. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent Publication No. 2021-40653 Summary of the Invention [Problem to be solved by the invention]
[0005] If a mobile device that has strayed from its driving route can be returned to its driving route, the mobile device can resume autonomous driving. However, returning a mobile device to its driving route, especially by manual driving from a remote location, is not necessarily easy.
[0006] The present invention provides a driving assistance method, a processing device, and a mobile device that are capable of assisting the driving of a mobile device capable of both autonomous driving and manual driving. [Means for solving the problem]
[0007] Driving assistance method according to the present invention One aspect of A method for assisting driving of a mobile device, comprising: one or more processors When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; The manual driving is performed according to at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position. Returning the autonomous driving to the route by The device executes a process of outputting driving assistance information that assists the driver in driving. Another aspect of the driving assistance method according to the present invention is a driving assistance method for assisting driving of a mobile device, comprising: one or more processors When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving, and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, When at least one of a first condition that a difference between the first position and the second position is equal to or greater than a first predetermined value and a second condition that a difference between the first angle and the second angle is equal to or greater than a second predetermined value is satisfied, the one or more processors generate notification information for a person performing manual driving; The driving assistance information includes the generated notification information, The notification information when the first condition is satisfied and the second condition is not satisfied is different from the notification information when the second condition is not satisfied and the second condition is satisfied, and the notification information when the first condition is satisfied and the second condition is satisfied. Another aspect of the driving assistance method according to the present invention is a driving assistance method for assisting driving of a mobile device, comprising: one or more processors When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving, and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, the one or more processors further perform a process of generating information of a return route from the second position to the first position; The driving assistance information includes information about the generated return route. Another aspect of the driving assistance method according to the present invention is a driving assistance method for assisting driving of a mobile device, comprising: one or more processors When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving, and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, The one or more processors further execute a process of calculating the first position based on the second position and the second angle, and the position of a next route point or a destination on the route of the autonomous driving. Another aspect of the driving assistance method according to the present invention is a driving assistance method for assisting driving of a mobile device, comprising: one or more processors When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving, and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, The first location is a location between a location where the mobile device deviates from the route for autonomous driving and a next route waypoint or destination on the route for autonomous driving. Another aspect of the driving assistance method according to the present invention is a driving assistance method for assisting driving of a mobile device, comprising: one or more processors When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving, and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, The first location is a location where the mobile device is off the route of the autonomous driving. One aspect of the processing apparatus according to the present invention is a processing apparatus, a first processing unit that, when a mobile device deviates from a route of the autonomous driving due to switching from autonomous driving to manual driving, acquires at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position; a second processing unit that outputs driving assistance information that assists in returning to the autonomous driving route by the manual driving in accordance with at least one of a difference between the first position and a second position, which is a position of the mobile device traveling by the manual driving, and a difference between the first angle and a second angle that indicates a direction in which the mobile device is traveling at the second position; and has. Another aspect of the driving assistance method according to the present invention is a driving assistance method for assisting driving of a mobile device, comprising: one or more processors When the mobile device deviates from the route of the autonomous driving due to switching from the autonomous driving to the manual driving, a return position on the route of the autonomous driving is acquired; generating information of a return route from the second position to the return position according to the return position and a second position which is a position of the mobile device traveling by the manual driving; Execute the process. Effect of the Invention
[0008] According to the present invention, it is possible to assist the driving of a mobile device capable of both autonomous driving and manual driving. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram showing an outline of a system according to the present embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of the management apparatus. [Diagram 3] FIG. 3 is a diagram illustrating an example of a functional block diagram of the management device. [Figure 4] FIG. 4 is a diagram illustrating an example of a hardware configuration of an autonomous mobile device. [Diagram 5]FIG. 5 is a diagram illustrating an example of a functional block diagram of an autonomous mobile device. [Figure 6] FIG. 6 is a diagram showing a flow of processing executed by the autonomous mobile device. [Figure 7] FIG. 7 is a diagram showing a flow of processing executed by the autonomous mobile device. [Figure 8] FIG. 8 is a first diagram for explaining the specification of the return position. [Figure 9] FIG. 9 is a second diagram for explaining the specification of the return position. [Figure 10] FIG. 10 is a diagram illustrating a flow of the process executed by the management device. [Figure 11] FIG. 11 is a diagram showing an example of a screen displayed on an output device of the management apparatus. [Figure 12] FIG. 12 is a diagram illustrating a flow of the process executed by the management device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, the present embodiment will be described with reference to the accompanying drawings. FIG. 1 is a diagram showing an overview of the system of this embodiment. The system of this embodiment includes a management device 1 and an autonomous mobile device 2. The management device 1 and the autonomous mobile device 2 can communicate with each other via a network 5 such as the Internet. In the example of FIG. 1, the number of autonomous mobile devices is one, but it may be two or more. The autonomous mobile device 2 can travel by autonomous driving, and can also travel by manual driving. The autonomous mobile device 2 moves to carry luggage, materials, equipment, and the like in work locations such as construction sites, farms, and ports.
[0011] The autonomous mobile device 2 has an antenna for positioning. In this embodiment, the autonomous mobile device 2 has an antenna for RTK-GNSS (Real Time Kinematic Global Navigation Satellite System), and the management device 1 can grasp the position of the autonomous mobile device 2 by using the RTK-GNSS. A fixed base station for RTK-GNSS installed on the ground surface is provided in the work place where the autonomous mobile device 2 operates. However, the positioning method may be other than RTK-GNSS.
[0012] The management device 1 is a device that manages the operation of the autonomous mobile device 2. The management device 1 sets an operation mode in the autonomous mobile device 2 and controls the autonomous mobile device 2 to operate according to the operation mode. In this embodiment, the operation modes include an autonomous driving mode and a manual driving mode. In the autonomous driving mode, the autonomous mobile device 2 performs autonomous driving according to a program installed in advance. In the manual driving mode, the management device 1 transmits a movement instruction to the autonomous mobile device 2, including information such as a movement destination, a route to the movement destination, and a movement speed, to the autonomous mobile device 2 in accordance with a user's operation (i.e., manual driving), and causes the autonomous mobile device 2 to move.
[0013] 2 is a diagram illustrating an example of a hardware configuration of the management device 1. The management device 1 includes a processor 11, a memory 12, a communication interface 13, and a user interface 14. The processor 11, the memory 12, the communication interface 13, and the user interface 14 are connected by a bus 19, for example.
[0014] The processor 11 is a circuit that performs signal processing, and is, for example, a CPU (Central Processing Unit) that performs overall control of the management device 1. The processor 11 may be realized by other digital circuits such as an FPGA (Field Programmable Gate Array) or a DSP (Digital Signal Processor). The processor 11 may also be realized by combining a plurality of digital circuits.
[0015] The memory 12 includes, for example, a main memory and an auxiliary memory. The main memory is, for example, a random access memory (RAM). The main memory is used as a work area for the processor 11.
[0016] The auxiliary memory is a non-transitory computer-readable storage medium, such as a non-volatile memory such as a magnetic disk, an optical disk, or a flash memory. The auxiliary memory stores various programs that operate the management device 1. The programs stored in the auxiliary memory are loaded into the main memory and executed by the processor 11.
[0017] The auxiliary memory may also include a portable memory that is removable from the management device 1. The portable memory is, for example, a Universal Serial Bus (USB) flash drive, a memory card such as a Secure Digital (SD) memory card, or an external hard disk drive.
[0018] The communication interface 13 is a communication interface for communicating with an external device (eg, the autonomous mobile device 2) of the management device 1. The communication interface 13 is controlled by the processor 11.
[0019] The user interface 14 includes, for example, an input device that accepts operation input from a user (for example, a person operating the management device 1) and an output device that outputs information. The input device is realized, for example, by a pointing device (for example, a mouse), a key (for example, a keyboard), or a remote control. The output device is realized, for example, by a display or a speaker. Furthermore, both the input device and the output device may be realized by a touch panel or the like. The user interface 14 is controlled by the processor 11.
[0020] Fig. 3 is a diagram showing an example of a functional block diagram of the management device 1. In the management device 1, a program (software) is executed by the processor 11 to realize the functions of a receiving unit 151 and a data processing unit 152 shown in Fig. 3. A data storage unit 153 is realized in the memory 12.
[0021] The receiving unit 151 receives data from the autonomous mobile device 2 and stores it in the data storage unit 153 .
[0022] The data processing unit 152 executes processing such as generating data to be displayed on an output device (eg, a display) of the management apparatus 1 based on the data stored in the data storage unit 153 .
[0023] The data storage unit 153 stores position data received from the autonomous mobile device 2, notifications of deviation from the autonomous driving route, and notifications of deviation from the position and traveling direction at the time of return.
[0024] 4 is a diagram showing an example of a hardware configuration of the autonomous mobile device 2. The autonomous mobile device 2 includes a processor 211, a memory 212, a wireless communication interface 213, a sensor 214, a moving mechanism 215, and an antenna 216. The processor 211, the memory 212, the wireless communication interface 213, the sensor 214, the moving mechanism 215, and the antenna 216 are connected by a bus 219, for example.
[0025] The processor 211 and the memory 212 of the autonomous mobile device 2 have the same configurations as the processor 11 and the memory 12 of the management device 1, respectively.
[0026] The wireless communication interface 213 is a communication interface for performing wireless communication with an external device (eg, the management device 1) of the autonomous mobile device 2. The wireless communication interface 213 is controlled by the processor 211.
[0027] The sensor 214 includes various sensors capable of acquiring information on the moving state of the autonomous mobile device 2 and external information, etc. The sensor 214 is controlled by the processor 11, and the sensing data of the sensor 214 is acquired by the processor 11.
[0028] The sensors 214 include, for example, a camera, a Light Detection And Ranging (LiDAR) sensor, a wheel encoder, and an Inertial Measurement Unit (IMU).
[0029] The camera is a sensor for acquiring image data. The LiDAR sensor is a three-dimensional sensor for recognizing the outside of the autonomous mobile device 2 in three dimensions. Specifically, the LiDAR sensor irradiates a laser light, measures the time it takes for the irradiated laser light to hit an object and bounce back, and measures the distance and direction to the object. The LiDAR sensor is provided, for example, so as to be able to sense the front of the autonomous mobile device 2. A plurality of LiDAR sensors may be provided so as to be able to sense a plurality of directions. The LiDAR sensor may be capable of swinging (panning and tilting), zooming, and the like. The wheel encoder is a sensor for measuring the rotational speed of the wheels (wheel speed), and the vehicle speed of the autonomous mobile device 2 can be obtained from the results of measurement by the wheel encoder. The IMU is a sensor for measuring the acceleration in the forward / backward, left / right, and up / down directions of the autonomous mobile device 2, and the angular velocity in the pitch direction, roll direction, and yaw direction.
[0030] The moving mechanism 215 is a mechanism for the autonomous mobile device 2 to move autonomously. The moving mechanism 215 is, for example, wheels or legs for walking. The moving mechanism 215 is controlled by the processor 211. In the following example, the moving mechanism 15 is assumed to be wheels. Although not shown, the autonomous mobile device 2 includes an actuator such as a motor unit, and moves by driving the moving mechanism 15 with this actuator.
[0031] The antenna 216 is an antenna for performing RTK-GNSS positioning. A communication module (not shown) receives a signal transmitted from an artificial satellite via the antenna 216, and calculates position information by the communication module. The calculated position information is processed by the processor 211 or transmitted to the management device 1 via the wireless communication interface 213.
[0032] Fig. 5 is a diagram showing an example of a functional block diagram of the autonomous mobile device 2. In the autonomous mobile device 2, a program (software) is executed by the processor 211 to realize the functions of a deviation detection unit 251 and a transmission unit 252 shown in Fig. 5. A data storage unit 253 is realized in the memory 212.
[0033] The deviation detection unit 251 executes a process of determining whether a deviation from the autonomous driving route has occurred, and a process of determining whether there is a deviation from the position and traveling direction at the time of return.
[0034] The transmission unit 252 transmits to the management device 1 data on the position of the autonomous mobile device 2, a notification of deviation from the autonomous driving route, and a notification of the position and deviation from the traveling direction at the time of return.
[0035] The data storage unit 253 stores information on the autonomous driving route, position information of the autonomous mobile device 2 during a predetermined period in the past, etc. The information on the autonomous driving route includes position information and information on the driving direction at each point on the autonomous driving route.
[0036] Fig. 6 is a diagram showing a flow of processing executed by the autonomous mobile device 2. This processing is executed, for example, at regular time intervals while the autonomous mobile device 2 is moving. However, after a deviation from the position and traveling direction at the time of return is detected by the processing described with reference to Fig. 7, the processing of steps S131 and S133 may be skipped.
[0037] After switching from autonomous driving in the autonomous driving mode to manual driving in the manual driving mode, the transmission unit 252 of the autonomous mobile device 2 identifies the current position of the autonomous mobile device 2 and the traveling direction of the autonomous mobile device 2 at the current position. Then, the transmission unit 252 transmits the identified information on the current position and information on the traveling direction to the management device 1 (step S131) and stores it in the data storage unit 253. The reception unit 151 of the management device 1 receives the information on the current position and information on the traveling direction of the autonomous mobile device 2 from the autonomous mobile device 2 and stores it in the data storage unit 153.
[0038] The deviation detection unit 251 of the autonomous mobile device 2 judges whether deviation from the autonomous traveling route has occurred based on the data stored in the data storage unit 253 (step S133). In step S133, it is judged whether a condition that the difference between a specific position on the autonomous traveling route and the current position of the autonomous mobile device 2 is a predetermined value (e.g., 3 meters) or more and a condition that the difference between the traveling direction of the autonomous mobile device 2 at the specific position on the autonomous traveling route and the traveling direction of the autonomous mobile device 2 at the current position is a predetermined value (e.g., 5 degrees) or more are satisfied. The specific position on the autonomous traveling route is, for example, a position on the autonomous traveling route that is closest to the current position of the autonomous mobile device 2. In the present embodiment, if any of the conditions is satisfied, it is judged that deviation from the autonomous traveling route has occurred. By using such conditions, it becomes possible to prevent a signal from being generated even when there is only a slight deviation from the autonomous traveling route.
[0039] If no deviation from the autonomous driving route has occurred (step S133: No route), the process returns to step S131. If deviation from the autonomous driving route has occurred (step S133: Yes route), the deviation detection unit 251 of the autonomous mobile device 2 generates a notification of deviation from the autonomous driving route and outputs it to the transmission unit 252. The transmission unit 252 transmits the notification of deviation from the autonomous driving route to the management device 1 (step S135). Then, the process ends.
[0040] When the receiver 151 of the management device 1 receives the notification of a deviation from the autonomous driving route, it stores the notification in the data storage unit 153. The notification of the deviation from the autonomous driving route includes, for example, information on the position where the deviation occurred (in this embodiment, a specific position on the autonomous driving route), information on the time the deviation was detected, and information indicating which condition was satisfied.
[0041] Fig. 7 is a diagram showing a flow of processing executed by the autonomous mobile device 2. This processing is executed at regular time intervals, for example, after a predetermined time (for example, 10 seconds) has elapsed since the occurrence of deviation from the autonomous driving route was detected by the processing described with reference to Fig. 6.
[0042] The transmitter 252 of the autonomous mobile device 2 identifies the return position on the autonomous driving route and the traveling direction of the autonomous mobile device 2 at the return position (hereinafter referred to as the “position and traveling direction at the time of return”) based on the data stored in the data storage unit 253 (step S141), and stores it in the data storage unit 253.
[0043] The return position is identified based on information such as, for example, (1) the current position of the autonomous mobile device 2 and the traveling direction at the current position, (2) the position of the destination or the next route passing point on the autonomous traveling route, and (3) the constraints of the autonomous mobile device 2. The constraints of the machine are, for example, the turning radius of the autonomous mobile device 2. The traveling direction at the return position is identified from the information of the autonomous traveling route and the return position stored in the data storage unit 253. The processing of step S141 does not need to be executed every time. For example, it may be executed when the position or traveling direction has increased by a predetermined value or more from the value identified last time.
[0044] Fig. 8 is a first diagram for explaining the specification of the return position. In Fig. 8, P1 represents a first route passing point (first node) of the autonomous mobile device 2, P2 represents a position where deviation from the autonomous driving route R1 occurs, P3 represents the current position of the autonomous mobile device 2, P4 represents the return position, and P5 represents a second route passing point (second node) of the autonomous mobile device 2. Furthermore, the entire route of the autonomous mobile device 2 is composed of a number of route passing points (nodes) such as the first route passing point (first node), the second route passing point (second node), ..., and route lines (edges) connecting these route passing points (driving routes such as R0, R1, R2, ...). T1 represents the trajectory of the autonomous mobile device 2 from P2 to P3, and T2 represents the return route from the current position of the autonomous mobile device 2 to the return position. R1 represents the autonomous travel route until the autonomous mobile device 2 reaches P5, and R2 represents the autonomous travel route after the autonomous mobile device 2 reaches P5. The direction of the apex angle of the isosceles triangle of P3 and P4 represents the travel direction of the autonomous mobile device 2. Here, the return route T2 is set based on the current position of the autonomous mobile device 2, a return position P4 that is set on the autonomous traveling route before the next route passing point, and the turning radius of the autonomous mobile device 2.
[0045] The return position P4 may be the same as the position P2 where the deviation occurred, but if it is a position on the autonomous driving route R1 between the position P2 where the deviation occurred and the second route passing point P5, the time required to reach the second route passing point P5 can be shortened. Also, in consideration of, for example, the turning radius of the autonomous mobile device 2, it may be easier to move manually to a position closer to the second route passing point P5 than to returning to the position P2 where the deviation occurred.
[0046] Fig. 9 is a second diagram for explaining the specification of the return position. In the example of Fig. 9, the position P2 where the deviation occurred is closer to the second route passing point P5 than in the example of Fig. 8. In such a case, if the return position P4 is set to a position beyond the second route passing point P5 (i.e., a position on R2), the autonomous mobile device 2 will have to return to the second route passing point P5 once after returning to the autonomous driving route R2. Therefore, even in the example of Fig. 9, the return position P4 is specified from the autonomous driving route R1.
[0047] Returning to the explanation of Fig. 7, the deviation detection unit 251 of the autonomous mobile device 2 determines whether there is a deviation from the position and traveling direction at the time of return based on the data stored in the data storage unit 253 (step S143). In step S143, it is determined whether the condition that the difference between the return position and the current position is a predetermined value (e.g., 3 meters) or more and the condition that the difference between the traveling direction of the autonomous mobile device 2 at the return position and the traveling direction of the autonomous mobile device 2 at the current position is a predetermined value (e.g., 5 degrees) or more are satisfied. In this embodiment, if either of the conditions is satisfied, it is determined that there is a deviation from the position and traveling direction at the time of return.
[0048] If there is a deviation from the position and heading direction at the time of return (step S143: No route), the process returns to step S143. If there is a deviation from the position and heading direction at the time of return (step S143: Yes route), the deviation detection unit 251 of the autonomous mobile device 2 generates a notification of the deviation from the position and heading direction at the time of return and outputs it to the transmission unit 252. The transmission unit 252 transmits the notification of the deviation from the position and heading direction at the time of return to the management device 1 (step S145). Then the process ends.
[0049] When the receiving unit 151 of the management device 1 receives the notification of the occurrence of deviation from the position and traveling direction at the time of return, the receiving unit 151 stores the notification in the data storage unit 153. The notification of the occurrence of deviation from the position and traveling direction at the time of return includes, for example, information on the position and traveling direction at the time of return, the time the deviation was detected, and information indicating which condition was satisfied.
[0050] 10 is a diagram showing a flow of processing executed by the management device 1. This processing is executed when a notification of deviation from the autonomous traveling route is transmitted from the autonomous mobile device 2 by the processing in FIG.
[0051] The receiving unit 151 of the management device 1 receives a notification of a deviation from the autonomous traveling route from the autonomous mobile device 2 (step S151), and stores it in the data storage unit 153.
[0052] The data processing unit 152 of the management device 1 generates display data of the deviation occurrence signal based on the data stored in the data storage unit 153, and displays it on an output device (e.g., a display) of the management device 1 (step S153). The display data of the deviation occurrence signal is generated based on information indicating which condition is satisfied.
[0053] The data processing unit 152 of the management device 1 generates display data of the position where the deviation occurred and the trajectory of the deviation based on the data stored in the data storage unit 153, and displays it on the output device of the management device 1 (step S155). The display data of the trajectory of the deviation is generated, for example, from data of the time when the deviation was detected and data of the position between the position at the detection time and the position where the deviation occurred.
[0054] Fig. 11 is a diagram showing an example of a screen displayed on an output device of the management device 1. In the example of Fig. 11, the screen includes a map display portion A1 in which a map of an area in which the autonomous driving route of the autonomous mobile device 2 is located is displayed, and an image display portion A2 in which an image captured by the camera of the autonomous mobile device 2 is displayed.
[0055] The deviation occurrence signal SG is displayed on the map display portion A1. The deviation occurrence signal SG has a first region S1, a second region S2, and a third region S3. The data processing unit 152 changes the state of each region depending on which of the two conditions related to the occurrence of deviation from the autonomous driving route is satisfied. For example, when only the condition that the difference between a specific position on the autonomous driving route and the current position of the autonomous mobile device 2 is a predetermined value or more is satisfied, the state of the first region S1 is made different from the state of the second region S2 and the state of the third region S3. When only the condition that the difference between the traveling direction of the autonomous mobile device 2 at a specific position on the autonomous driving route and the traveling direction of the autonomous mobile device 2 at the current position is a predetermined value or more is satisfied, the state of the second region S2 is made different from the state of the first region S1 and the state of the third region S3. When both conditions are satisfied, the state of the third region S3 is made different from the state of the first region S1 and the state of the second region S2. This allows the person performing manual driving to properly grasp the state of the autonomous mobile device 2. In the example of Fig. 11, the state of the second area S2 is different from the state of the first area S1 and the state of the third area S3.
[0056] The deviation occurrence position P and deviation trajectory T are displayed on the map display portion A1. In the example of FIG. 11, the autonomous mobile device 2 deviates from the autonomous driving route at the deviation occurrence position P and returns to the deviation occurrence position P again. In this example, the return position is the deviation occurrence position P. The map display portion A1 also shows the driving direction D1 at the deviation occurrence position and the current driving direction D2. The apex angle direction of the isosceles triangle represents the driving direction. By performing manual driving operations while checking such displays, it becomes possible to properly return the autonomous mobile device 2 to the autonomous driving route.
[0057] 12 is a diagram showing a flow of processing executed by the management device 1. This processing is executed when a notification of a position at the time of return and a deviation from the traveling direction is transmitted from the autonomous mobile device 2 by the processing in FIG.
[0058] The receiving unit 151 of the management device 1 receives a notification of the position at the time of return and the deviation from the traveling direction from the autonomous mobile device 2 (step S161), and stores it in the data storage unit 153.
[0059] The receiving unit 151 of the management device 1 identifies a route from the autonomous mobile device 2 to the return position based on the data stored in the data storage unit 153 (step S163), and stores the data of the identified route in the data storage unit 153. The route to the return position is identified based on the position and traveling direction at the time of return, the position at the time of detection of the deviation and the traveling direction at that position, the turning radius of the autonomous mobile device 2, etc.
[0060] The data processing unit 152 of the management device 1 generates display data for the deviation occurrence signal based on the data stored in the data storage unit 153, and displays it on the output device of the management device 1 (step S165). The display data for the deviation occurrence signal is generated based on information indicating which condition has been satisfied. The display mode of the deviation occurrence signal displayed in step S165 is the same as the display mode of the deviation occurrence signal displayed in step S153.
[0061] The data processing unit 152 of the management device 1 generates display data of the route to the return position, the return position, and the traveling direction at the return position based on the data stored in the data storage unit 153, and displays it on the output device of the management device 1 (step S167). Then, the process ends.
[0062] The return route to the return position is displayed on the screen, for example, in a manner such as T2 in Fig. 8 and Fig. 9. The return route to the return position may also be displayed to show the return route from the current position to the return position on the manual driving trajectory T in Fig. 11. The return position is displayed, for example, in a manner such as P4 in Fig. 8 and Fig. 9. The display data of the traveling direction at the return position may be displayed in a manner such as D1 in Fig. 11, or in a manner such as P4 in Fig. 8 and Fig. 9.
[0063] Although various embodiments have been described above with reference to the drawings, it goes without saying that the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modified or revised examples within the scope of the claims, and it is understood that these also naturally belong to the technical scope of the present invention. Furthermore, the components in the above-mentioned embodiments may be arbitrarily combined within the scope of the invention.
[0064] In the example described above, the deviation is detected in the autonomous mobile device 2, but the deviation may also be detected in the management device 1 that receives position information from the autonomous mobile device 2. Also, in the example described above, the return position is specified in the autonomous mobile device 2, but the return position may be specified in the management device 1, and information on the specified return position may be transmitted to the autonomous mobile device 2. In this way, which side executes each process in this embodiment can be changed as appropriate without departing from the spirit of the invention.
[0065] The display shown in Fig. 11 is one example. A screen in which the deviation occurrence signal SG is larger may be displayed so that a person performing manual operation can more easily recognize the deviation occurrence signal SG. Furthermore, the shape of the display of the deviation occurrence signal SG is not limited to the example shown in Fig. 11. Furthermore, the deviation occurrence signal does not have to be a visual signal, and may be an auditory signal.
[0066] The positioning method is not limited to RTK-GNSS, and other relative positioning methods may be used.
[0067] This specification also describes at least the following items. Note that, in parentheses, components corresponding to those in the above-mentioned embodiment are shown, but the present invention is not limited to these.
[0068] (1) A driving assistance method, comprising: One or more processors (11, 211), When a mobile device (2) deviates from a route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired (steps S131, 141). output driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position (steps S153, 155, 165, 167); A driving assistance method for executing a process.
[0069] According to (1), it is possible to support the operation of a mobile device capable of both autonomous driving and manual driving. In particular, when the mobile device deviates from the autonomous driving route due to switching to manual driving, it is possible to support manual driving and reduce the impact on the mobile device's operation plan.
[0070] (2) A driving assistance method according to (1), When at least one of a first condition that a difference between the first position and the second position is equal to or greater than a first predetermined value and a second condition that a difference between the first angle and the second angle is equal to or greater than a second predetermined value is satisfied, the one or more processors generate notification information for a person performing manual driving; The driving assistance information includes the generated notification information. Driving assistance methods.
[0071] According to (2), the person who is manually driving the vehicle can notice that the position and angle of the mobile device are not appropriate. In particular, in the case of manual driving from a remote location, it is not easy to notice that the position and angle of the mobile device are not appropriate, so the effect of the driving support information is greater.
[0072] (3) A driving assistance method according to (1), Notification information when the first condition is satisfied and the second condition is not satisfied is different from notification information when the second condition is not satisfied and the second condition is satisfied, and notification information when the first condition is satisfied and the second condition is satisfied. Driving assistance methods.
[0073] According to (3), a person manually driving the mobile device can more accurately recognize whether the position and angle of the mobile device are appropriate.
[0074] (4) A driving assistance method according to (1), the one or more processors further perform a process of generating information of a return route from the second position to the first position; The driving assistance information includes information of the generated return route. Driving assistance methods.
[0075] According to (4), it becomes possible to promote the resumption of autonomous driving. By checking the return route, the person performing manual driving can more easily return the mobile device to the autonomous driving route.
[0076] (5) A driving assistance method according to (1), The one or more processors further execute a process of calculating the first position based on the second position and the second angle, and a position of a next route point or a destination on the route of the autonomous driving. Driving assistance methods.
[0077] The location to which the mobile device should return may vary depending on the situation. According to (5), the mobile device can be returned to an appropriate location depending on the positional relationship with the next route point or destination.
[0078] (6) A driving assistance method according to (5), the one or more processors calculating the first location further based on aircraft constraints of the mobile device. Driving assistance methods.
[0079] Depending on the constraints of the mobile device, for example, there may be cases where it is not possible to return via the calculated return route. According to (6), it becomes possible to return the mobile device to an appropriate position according to the constraints of the mobile device.
[0080] (7) A driving assistance method according to (1), The driving assistance information includes the first position and the first angle. Driving assistance methods.
[0081] The manual driver can more easily return the mobile unit to the appropriate location on the autonomous driving route.
[0082] (8) A driving assistance method according to (1), The first location is a location between a location where the mobile device deviates from the route of the autonomous driving and a next route waypoint or a destination on the route of the autonomous driving. Driving assistance methods.
[0083] There are cases where the mobile device does not need to travel from start to finish along the autonomous driving route as long as it can reach the next route point or destination. According to (8), it becomes possible to return the mobile device to an appropriate position in relation to the next route point or destination.
[0084] (9) A driving assistance method according to (1), The first location is a location where the mobile device is off the route of the autonomous driving. Driving assistance methods.
[0085] According to (9), it becomes possible to return a mobile device to a position that is off the autonomous driving route.
[0086] (10) A processing device (management device 1, processor 11, mobile device 2, processor 211), a first processing unit that, when a mobile device deviates from a route of the autonomous driving due to switching from autonomous driving to manual driving, acquires at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position; a second processing unit that outputs driving assistance information that assists the manual driving in accordance with at least one of a difference between the first position and a second position that is a position of the mobile device traveling by the manual driving and a difference between the first angle and a second angle that indicates a direction in which the mobile device is traveling at the second position; and A processing device having
[0087] According to (10), it is possible to support the operation of a mobile device capable of both autonomous and manual driving. In particular, when the mobile device deviates from the route of autonomous driving due to switching to manual driving, it is possible to support manual driving and suppress the occurrence of interference with the work of the mobile device.
[0088] (11) A mobile device (2), The processing device according to (10) is provided. Mobile device.
[0089] (11) makes it possible to execute processing on the mobile device itself.
[0090] (12) A driving assistance method for assisting driving of a mobile device, comprising: One or more processors (11, 211), When the mobile device deviates from the route of the autonomous driving due to switching from the autonomous driving to the manual driving, a return position on the route of the autonomous driving is acquired (step S141). Generate information on a return route from the second position to the return position according to the return position and a second position which is a position of the mobile device traveling by the manual driving (step S167). A driving assistance method for executing a process.
[0091] According to (12), it is possible to support the driving of a mobile device capable of both autonomous driving and manual driving. In particular, when the mobile device deviates from the autonomous driving route due to switching to manual driving, it becomes easy to return to the autonomous driving route.
[0092] (13) A driving assistance method according to (12), The return position is a position between a position where the mobile device deviates from the route of the autonomous driving and a next route waypoint or a destination on the route of the autonomous driving. Driving assistance methods.
[0093] There are cases where the mobile device does not need to travel from start to finish along the autonomous driving route as long as it can reach the next route point or destination. According to (13), it becomes possible to return the mobile device to an appropriate position in relation to the next route point or destination.
[0094] (14) A driving assistance method according to (12), the return position is a position where the mobile device deviates from the route of the autonomous driving; Driving assistance methods. [Explanation of symbols]
[0095] 1 Management device 2 Autonomous mobile device 5 Network 11 processor 12 memory 13 communication interface 14 User interface 19 Bus 151 Receiver 152 data processing unit 153 data storage unit 211 processor 212 memory 213 wireless communication interface 214 sensor 215 moving mechanism 251 deviation detection unit 252 transmission unit 253 Data Storage Unit
Claims
1. A driving assistance method for assisting driving of a mobile device, comprising: one or more processors, When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the mobile device in returning to the autonomous driving route by the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; A driving assistance method for executing a process.
2. A driving assistance method for assisting driving of a mobile device, comprising: one or more processors, When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, When at least one of a first condition that a difference between the first position and the second position is equal to or greater than a first predetermined value and a second condition that a difference between the first angle and the second angle is equal to or greater than a second predetermined value is satisfied, the one or more processors generate notification information for a person performing manual driving; The driving assistance information includes the generated notification information, Notification information when the first condition is satisfied and the second condition is not satisfied is different from notification information when the second condition is not satisfied and the second condition is satisfied, and notification information when the first condition is satisfied and the second condition is satisfied. Driving assistance methods.
3. A driving assistance method for assisting driving of a mobile device, comprising: one or more processors, When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, The one or more processors further perform a process of generating information of a return route from the second position to the first position; The driving assistance information includes information of the generated return route. Driving assistance methods.
4. A driving assistance method for assisting driving of a mobile device, comprising: one or more processors, When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, The one or more processors further execute a process of calculating the first position based on the second position and the second angle, and a position of a next route waypoint or a destination on the route of the autonomous driving. Driving assistance methods.
5. A driving assistance method according to claim 4, the one or more processors calculating the first location further based on aircraft constraints of the mobile device. Driving assistance methods.
6. The driving assistance method according to claim 1 or 2, The driving assistance information includes the first position and the first angle. Driving assistance methods.
7. A driving assistance method for assisting driving of a mobile device, comprising: one or more processors, When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, The first location is a location between a location where the mobile device deviates from the route of the autonomous driving and a next route waypoint or a destination on the route of the autonomous driving. Driving assistance methods.
8. A driving assistance method for assisting driving of a mobile device, comprising: one or more processors, When the mobile device deviates from the route of the autonomous driving due to switching from autonomous driving to manual driving, at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position is acquired; outputting driving assistance information for assisting the manual driving in accordance with at least one of a difference between the first position and a second position which is a position of the mobile device traveling by the manual driving and a difference between the first angle and a second angle which indicates a direction in which the mobile device is traveling at the second position; Execute the process, the first location is a location where the mobile device is off the route of the autonomous driving; Driving assistance methods.
9. A processing device comprising: a first processing unit that, when a mobile device deviates from a route of the autonomous driving due to switching from autonomous driving to manual driving, acquires at least one of a first position on the route of the autonomous driving and a first angle indicating a direction in which the mobile device will travel at the first position; a second processing unit that outputs driving assistance information that assists in returning to the autonomous driving route by the manual driving in accordance with at least one of a difference between the first position and a second position, which is a position of the mobile device traveling by the manual driving, and a difference between the first angle and a second angle that indicates a direction in which the mobile device is traveling at the second position; and A processing device having
10. A mobile device, The processing device according to claim 9, Mobile device.
11. A driving assistance method for assisting driving of a mobile device, comprising: one or more processors, When the mobile device deviates from the route of the autonomous driving due to switching from the autonomous driving to the manual driving, a return position on the route of the autonomous driving is acquired; generating information of a return route from the second position to the return position according to the return position and a second position which is a position of the mobile device traveling by the manual driving; A driving assistance method for executing a process.
12. A driving assistance method according to claim 11, the return position is a position between a position where the mobile device deviates from the route of the autonomous driving and a next route waypoint or a destination on the route of the autonomous driving; Driving assistance methods.
13. A driving assistance method according to claim 11, the return position is a position where the mobile device deviates from the route of the autonomous driving; Driving assistance methods.
Citation Information
Patent Citations
Autonomous driving control unit
JP2016137819A
Working vehicle
JP2019127120A
Route search program, route search system, and service car having the route search system built therein
JP2021006818A
Work travelling management system and work travelling management device
JP2021040653A
Driver assisting system
US20190146495A1
