Control system, control method, and computer program
The control system addresses the challenge of data sharing and utilization among autonomous mobile bodies by associating spatial information with unique identifiers, enabling coordinated control and operation without system rebuilding.
Patent Information
- Application Number
- JP2023074797
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-28
- Publication Date
- 2024-11-08
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing systems lack a method for different autonomous mobile bodies to share and utilize spatiotemporal divided region data without requiring extensive rebuilding of systems and specify usage methods, hindering collaboration and control among various users.
A control system that includes a conversion information holding mechanism to associate spatial information with unique identifiers, allowing different autonomous mobile bodies to control each other by converting and storing spatial data in a format that can be referenced across systems.
Enables seamless sharing and utilization of spatiotemporal divided region data among autonomous mobile bodies, facilitating coordinated control and operation without the need for extensive system rebuilding.
Smart Images

Figure 2024159056000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a control system, a control method, a computer program, and the like. [Background technology]
[0002] In recent years, with technological innovations such as autonomous mobility and spatial recognition systems, the world has seen intensifying competition to develop the big picture (hereinafter referred to as digital architecture) that connects data and systems between different organizations and members of society.
[0003] By utilizing digital architecture, autonomous mobility and spatial recognition systems will be able to obtain more information and work with external devices and systems to solve bigger problems. To achieve this, technology is needed to link real-world spaces with digital information.
[0004] Conventionally, there is a technology such as that described in Patent Document 1 as a technology for linking real-world space with digital information. In Patent Document 1, a single processor divides a space-time region in time and space according to space-time management data provided by a user to generate multiple space-time divided regions. In addition, taking into consideration the time and space proximity of the space-time divided regions, an identifier expressed as a one-dimensional integer value is assigned to each of the multiple space-time divided regions in order to uniquely identify them. Then, a space-time data management system is disclosed that determines the arrangement of time-series data so that data from space-time divided regions with similar identifiers are arranged close to each other on a storage device. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Patent Application No. 2012-136855 Summary of the Invention [Problem to be solved by the invention]
[0006] However, the technology of Patent Document 1 does not mention the rules for generating the time-space division region, and the data related to the generated region can be understood by the identifier only within the processor that generated it. Therefore, in order to share and use the data among different system users, each system user needs to understand the data structure in advance and then reconstruct the existing system so that the data structure can be handled by the system users, which may result in a large-scale work. Note that the system users are, for example, members of an organization or a society.
[0007] Furthermore, there has been no mention of a specific method for different system users to use the information of the time-space division domains.
[0008] Therefore, an object of the present invention is to provide a system that can be controlled while sharing information on time-space division regions among different autonomous moving bodies. [Means for solving the problem]
[0009] A control system according to one aspect of the present invention comprises a control means for issuing control instructions to at least one or more autonomous moving bodies, and a conversion information storage means for converting spatial information, including information regarding a type of object existing in a space defined by latitude / longitude / height and information regarding time, into a format in association with a unique identifier and storing the converted information, wherein the unique identifier is stored in a manner that allows reference to information regarding a unique identifier other than the unique identifier. Effect of the Invention
[0010] According to the present invention, it is possible to provide a system that can be controlled while sharing information on time-space division regions among different autonomous moving bodies. [Brief description of the drawings]
[0011] [Figure 1] 1 is a diagram showing an example of the overall configuration of an autonomous mobile object control system according to a first embodiment of the present invention. [Diagram 2] FIG. 1A is a diagram showing an example of an input screen when a user inputs location information, and FIG. 1B is a diagram showing an example of a selection screen for selecting an autonomous moving body to be used. [Diagram 3] FIG. 1A is a diagram showing an example of a screen for checking the current position of an autonomous moving body, and FIG. 1B is a diagram showing an example of a map display screen for checking the current position of an autonomous moving body. [Figure 4] FIG. 2 is a block diagram showing an example of the internal configuration of each device in FIG. [Diagram 5] 1A is a diagram showing the spatial relationship between an autonomous mobile body 12 in the real world and a pillar 99 that exists as feature information around it, and FIG. 1B is a diagram showing the state in which the autonomous mobile body 12 and the pillar 99 are mapped into an arbitrary XYZ coordinate system space with P0 as the origin. [Figure 6] 2 is a perspective view showing an example of the mechanical configuration of an autonomous moving body 12 according to the first embodiment. FIG. [Figure 7] 2 is a block diagram showing an example of a specific hardware configuration of control unit 10-2, control unit 11-2, control unit 12-2, control unit 13-2, control unit 14-2, and control unit 15-2. FIG. [Figure 8] FIG. 2 is a sequence diagram illustrating a process executed by the autonomous mobile control system according to the first embodiment. [Figure 9] This is a continuation of the sequence diagram of FIG. [Figure 10] This is a continuation of the sequence diagram of FIG. [Figure 11] 1A is a diagram showing latitude / longitude information of the earth, and FIG. 1B is a perspective view showing a predetermined space 100 of FIG. [Figure 12] 1 is a diagram showing a schematic diagram of spatial information within a space 100. FIG. [Figure 13] (A) is a diagram showing route information displayed as map information, (B) is a diagram showing route information using position point cloud data displayed as map information, and (C) is a diagram showing route information using a unique identifier displayed as map information. [Figure 14] FIG. 11 is a diagram for explaining how data is stored in the format database 14-4. [Figure 15]FIG. 1 is a diagram illustrating a blind spot accident. [Figure 16] This is a view of the intersection from above. [Figure 17] This is a diagram showing the information currently held in the format database 14-4 as a map. [Figure 18] FIG. 13 is a diagram illustrating a format for saving completed data. [Figure 19] 13 is a diagram illustrating a sequence in which the conversion information storage device 14 updates the result of the associated unique identifier list header associated with the unique identifier of the right-turn lane. FIG. [Figure 20] FIG. 20 is a diagram for explaining a sequence in which the conversion information storage device 14 updates the result of the associated unique identifier list header associated with the unique identifier of the right-turn lane, and is a diagram continuing from FIG. 19. [Figure 21] 1 is a diagram illustrating a sequence executed by a control unit 12-2 of an autonomous moving body 12. FIG. [Figure 22] FIG. 1 is a diagram for explaining an outline of a prior information detection method. [Diagram 23] FIG. 13 is a diagram illustrating the types of results of the associated unique identifier list header, including blind spot accident mitigation methods. [Figure 24] FIG. 13 is a diagram illustrating a sequence in which result numbers 3 and 4 are determined by the prior information detection method. [Diagram 25] FIG. 11 is a diagram illustrating a sequence executed by a control unit 12-2 of an autonomous moving body 12 in a method for detecting route information in advance. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiment. In each drawing, the same members or elements are given the same reference numbers, and duplicated descriptions are omitted or simplified. In the embodiment, an example applied to the control of an autonomous moving body will be described, but the moving body may be one in which the user can operate at least a part of the movement of the moving body. That is, for example, various displays related to the moving route, etc. may be displayed to the user, and the user may perform part of the driving operation of the moving body by referring to the display.
[0013] (First embodiment) FIG. 1 is a diagram showing an example of the overall configuration of an autonomous mobile control system according to a first embodiment of the present invention. 1, the autonomous mobile object control system (sometimes abbreviated as control system) of this embodiment includes a system control device 10, a user interface 11, an autonomous mobile object 12, a route determination device 13, a conversion information storage device 14, a sensor node 15, etc. Here, the user interface 11 means a user terminal device. The system control device 10 is an example of an information processing device.
[0014] 1 are connected to each other through the Internet 16 by respective network connection units (to be described later). However, other network systems such as a LAN (Local Area Network) may also be used. Furthermore, some of the system control device 10, the user interface 11, the route determination device 13, the conversion information storage device 14, etc. may be configured as a single device.
[0015] The system control device 10, the user interface 11, the autonomous mobile body 12, the route determination device 13, the conversion information storage device 14, and the sensor node 15 each include an information processing device that is made up of a CPU as a computer and a ROM, RAM, HDD, etc. as storage media. The details of the function and internal configuration of each device will be described later.
[0016] Next, the service application software (hereinafter, abbreviated as app) provided by the autonomous mobile control system will be described. In the description, first, a screen image displayed on the user interface 11 when the user inputs location information will be described with reference to Figs. 2(A) and (B). Next, a screen image displayed on the user interface 11 when the user browses the current location of the autonomous mobile body 12 will be described with reference to Figs. 3(A) and 3(B). Based on these descriptions, an example will be used to explain how the app is operated in the autonomous mobile control system.
[0017] In this description, for convenience, the map display is described as a two-dimensional plane, but in this embodiment, the user can specify a three-dimensional position including "height" and can also input "height" information. That is, according to this embodiment, a three-dimensional map can be generated.
[0018] Fig. 2(A) is a diagram showing an example of an input screen when a user inputs location information, and Fig. 2(B) is a diagram showing an example of a selection screen for selecting an autonomous mobile body to be used. When a user operates the display screen of the user interface 11 to access the Internet 16 and selects, for example, a route setting application of the autonomous mobile body control system, a web page of the system control device 10 is displayed.
[0019] What is displayed first on the WEB page is an input screen 40 for inputting a departure point, a stopover point, and a destination point for setting the departure point, a stopover point, and a destination point when moving the autonomous moving body 12. The input screen 40 has a list display button 48 for displaying a list of the autonomous moving body (mobility) to be used, and when the user presses the list display button 48, a mobility list display screen 47 is displayed as shown in FIG. 2(B). The user first selects the autonomous moving body (mobility) to be used on the list display screen 47. On the list display screen 47, for example, mobilities M1 to M3 are displayed as selectable, but the number is not limited to this.
[0020] When the user selects one of the mobilities M1 to M3 by clicking or the like, the screen automatically returns to the input screen 40 in FIG. 2(A). The selected mobility name is displayed on the list display button 48. The user then inputs the location to be set as the departure point into the "Departure point" input field 41. The user also inputs the location to be set as the intermediate point into the "Intermediate point 1" input field 42. It is possible to add intermediate points, and by pressing the add intermediate point button 44 once, an input field 46 for "Intermediate point 2" is additionally displayed, allowing the user to input the intermediate point to be added.
[0021] Each time the Add Waypoint button 44 is pressed, an input field 46 is additionally displayed, such as "Waypoint 3", "Waypoint 4", etc., allowing multiple waypoints to be added to be input. The user also inputs the location to be set as the destination into the "Destination" input field 43. Although not shown in the figure, clicking on the input fields 41 to 43, 46, etc. temporarily displays a keyboard or the like for inputting characters, allowing the user to input desired characters.
[0022] Then, the user can set the travel route of the autonomous moving body 12 by pressing the decision button 45. In the example of Fig. 2, "AAA" is set as the departure point, "BBB" as the waypoint 1, and "CCC" as the arrival point. The text to be input in the input field may be, for example, an address, or location information indicating a specific location, such as latitude / longitude information, a store name, or a telephone number, may be input.
[0023] FIG. 3(A) is a diagram showing an example of a screen for checking the current position of an autonomous moving body, and FIG. 3(B) is a diagram showing an example of a map display screen for checking the current position of an autonomous moving body. 3(A) denotes a confirmation screen 50, which is displayed by operating an operation button (not shown) after setting the movement route of the autonomous moving body 12 on a screen such as that of FIG. 2(A). On the confirmation screen 50, the current position of the autonomous moving body 12 is displayed on the web page of the user interface 11, for example, as a current location 56. Therefore, the user can easily grasp the current position.
[0024] Furthermore, the user can update the screen display information to display the latest state by pressing an update button 57. Furthermore, the user can change the departure point, intermediate point, or arrival point by pressing a stopover / destination change button 54. That is, the user can change the points by inputting the desired locations to be reset in the "departure point" input field 51, the "intermediate point 1" input field 52, and the "destination" input field 53, respectively.
[0025] Fig. 3(B) shows an example of a map display screen 60 that is switched from the confirmation screen 50 when the map display button 55 in Fig. 3(A) is pressed. The map display screen 60 displays the position of a current location 62 on a map, thereby making it easier to confirm the current location of the autonomous moving body 12. Furthermore, when the user presses a back button 61, the display screen can be returned to the confirmation screen 50 in Fig. 3(A).
[0026] As described above, the user can easily set a travel route for moving the autonomous moving body 12 from one predetermined location to another by operating the user interface 11. Note that such a route setting application can also be applied to, for example, a taxi dispatch service or a drone delivery service.
[0027] Next, an example of the configuration and function of each of the devices 10 to 15 in Fig. 1 will be described in detail with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the internal configuration of each device in Fig. 1. 4, the user interface 11 includes an operation unit 11-1, a control unit 11-2, a display unit 11-3, an information storage unit (memory / HDD) 11-4, and a network connection unit 11-5. The operation unit 11-1 is configured with a touch panel, key buttons, etc., and is used for inputting data. The display unit 11-3 is, for example, an LCD screen, etc., and is used for displaying route information and other data.
[0028] The display screen of the user interface 11 shown in Fig. 2 and Fig. 3 is displayed on the display unit 11-3. The user can select a route, input information, confirm information, etc., using the menu displayed on the display unit 11-3. In other words, the operation unit 11-1 and the display unit 11-3 provide an operation interface for the user to actually perform operations. Instead of providing the operation unit 11-1 and the display unit 11-3 separately, a touch panel may be used as both the operation unit and the display unit.
[0029] The control unit 11-2 has a built-in CPU as a computer, manages various applications in the user interface 11, and manages modes such as information input and information confirmation, and controls communication processing. It also controls processing in each unit in the system control device.
[0030] The information storage unit (memory / HDD) 11-4 is a database for storing necessary information such as computer programs executed by the CPU. The network connection unit 11-5 controls communication via the Internet, LAN, wireless LAN, etc. The user interface 11 may be a device such as a smartphone, or may be in the form of a tablet terminal.
[0031] In this way, the user interface 11 of this embodiment displays the input screen 40 for the departure point, intermediate point, and arrival point on the browser screen of the system control device 10, and enables the user to input location information such as the departure point, intermediate point, and arrival point. Furthermore, by displaying the confirmation screen 50 and map display screen 60 on the browser screen, the current location of the autonomous moving body 12 can be displayed.
[0032] 4, the route determination device 13 includes a map information management unit 13-1, a control unit 13-2, a position / route information management unit 13-3, an information storage unit (memory / HDD) 13-4, and a network connection unit 13-5. The map information management unit 13-1 holds wide-area map information, and searches for route information showing a route on a map based on specified position information, and transmits the route information of the search result to the position / route information management unit 13-3.
[0033] The map information is three-dimensional map information including information such as topography and latitude / longitude / altitude, and also includes information on roads, sidewalks, travel directions, traffic regulations, and other traffic regulations related to the Road Traffic Act. It also includes time-varying information, such as one-way roads depending on the time of day, or pedestrian-only roads depending on the time of day, along with time information for each road. The control unit 13-2 has a built-in CPU as a computer and controls the processing in each unit of the route determination device 13.
[0034] The position / route information management unit 13-3 manages the position information of the autonomous moving body acquired via the network connection unit 13-5, transmits the position information to the map information management unit 13-1, and manages the route information acquired as the search result from the map information management unit 13-1. In accordance with a request from an external system, the control unit 13-2 converts the route information managed by the position / route information management unit 13-3 into a predetermined data format and transmits it to the external system.
[0035] As described above, in this embodiment, the route determination device 13 is configured to search for a route that complies with the Road Traffic Act and the like based on specified position information, and to output the route information in a predetermined data format.
[0036] 4, the conversion information storage device 14 includes a location / route information management unit 14-1, a unique identifier management unit 14-2, a control unit 14-3, a format database 14-4, an information storage unit (memory / HDD) 14-5, and a network connection unit 14-6. The location / route information management unit 14-1 manages predetermined location information acquired through the network connection unit 14-6, and transmits the location information to the control unit 14-3 in response to a request from the control unit 14-3. The control unit 14-3 has a built-in CPU as a computer, and controls the processing in each unit in the conversion information storage device 14.
[0037] Based on the location information acquired from the location / route information management unit 14-1 and the format information managed by the format database 14-4, the control unit 14-3 converts the location information into a unique identifier defined by the format. Then, it transmits the information to the unique identifier management unit 14-2. The format will be described in detail later, but it is a format in which an identifier (hereinafter, a unique identifier) is assigned to a space starting from a specified location, and the space is managed by the unique identifier. In this embodiment, the corresponding unique identifier and information within the space can be acquired based on the specified location information.
[0038] The unique identifier management unit 14-2 manages the unique identifier converted by the control unit 14-3 and transmits it via the network connection unit 14-6. The format database 14-4 manages the format information and transmits the format information to the control unit 14-3 in response to a request from the control unit 14-3.
[0039] The conversion information storage device 14 also uses the format to manage information about the space acquired through the network connection unit 14-6. The conversion information storage device 14 manages information about the space acquired by external devices, equipment, and networks by linking it to a unique identifier. The conversion information storage device 14 also provides the unique identifier and information about the space linked to it to external devices, equipment, and networks.
[0040] As described above, the conversion information storage device 14 acquires a unique identifier and information within the space based on specified location information, and manages and provides the information in a state where it can be shared by external devices, equipment, and networks connected to it. Moreover, the conversion information holding device 14 converts the location information specified by the system control device 10 into the unique identifier and provides it to the system control device 10 .
[0041] 4, the system control device 10 includes a unique identifier management unit 10-1, a control unit 10-2, a position / route information management unit 10-3, an information storage unit (memory / HDD) 10-4, and a network connection unit 10-5. The position / route information management unit 10-3 holds simple map information in which topographical information and latitude / longitude information are associated with each other, and manages predetermined position information and route information acquired through the network connection unit 10-5.
[0042] The location / route information management unit 10-3 can also divide the route information at a predetermined interval and generate location information such as the latitude / longitude of the divided locations. The unique identifier management unit 10-1 manages the location information and the route information converted into the unique identifier. The control unit 10-2 has a built-in CPU as a computer, and is responsible for controlling the communication functions of the system control device 10 for the location information, the route information, and the unique identifier, and controls the processing in each unit within the system control device 10.
[0043] The control unit 10-2 also provides a WEB page to the user interface 11, and transmits predetermined position information acquired from the WEB page to the route determination device 13. The control unit 10-2 also acquires predetermined route information from the route determination device 13, and transmits each piece of position information of the route information to the conversion information storage device 14. Then, the control unit 10-2 transmits the route information converted into the unique identifier acquired from the conversion information storage device 14 to the autonomous moving body 12.
[0044] As described above, the system control device 10 is configured to be able to acquire predetermined position information designated by the user, transmit and receive position information and route information, generate position information, and transmit and receive route information using a unique identifier.
[0045] In addition, the system control device 10 collects the route information required for the autonomous mobile body 12 to move autonomously based on the position information input to the user interface 11, and provides the route information using a unique identifier to the autonomous mobile body 12. In this embodiment, the system control device 10, the route determination device 13, and the conversion information storage device 14 function as, for example, a server.
[0046] 4, the autonomous mobile body 12 includes a detection unit 12-1, a control unit 12-2, a direction control unit 12-3, an information storage unit (memory / HDD) 12-4, a network connection unit 12-5, and a driving unit 12-6. The detection unit 12-1 has, for example, multiple image pickup elements, and has a function of measuring distance based on a phase difference between multiple image pickup signals obtained from the multiple image pickup elements. It also has a self-location estimation function that acquires detection information (hereinafter, detection information) such as surrounding terrain and obstacles such as building walls, and estimates its own location based on the detection information and map information.
[0047] Moreover, the detection unit 12-1 has a self-position detection function such as a GPS (Global Positioning System) and a direction detection function such as a geomagnetic sensor. Furthermore, the control unit 12-2 can generate a three-dimensional map of the cyberspace based on the acquired detection information, self-position estimation information, and direction detection information.
[0048] Here, the 3D map of cyberspace is capable of expressing spatial information equivalent to the positions of features in the real world as digital data. In this 3D map of cyberspace, the autonomous mobile body 12 existing in the real world and information on features around it are held as spatially equivalent digital data. Therefore, efficient movement is possible by using this digital data.
[0049] The 3D map of cyberspace used in this embodiment will be described below with reference to Fig. 5. Fig. 5(A) is a diagram showing the spatial positional relationship between the autonomous mobile body 12 in the real world and a pillar 99 that exists as feature information around it, and Fig. 5(B) is a diagram showing the state in which the autonomous mobile body 12 and the pillar 99 are mapped in an arbitrary XYZ coordinate space with P0 as the origin.
[0050] 5(A) and (B), the position of the autonomous moving body 12 is specified as a position α0 within the autonomous moving body 12 from position information of latitude and longitude acquired by a GPS or the like (not shown) mounted on the autonomous moving body 12. In addition, the direction and moving speed of the autonomous moving body 12 are specified by the difference between an orientation αY acquired by an electronic compass or the like (not shown) and a moving direction 12Y of the autonomous moving body 12.
[0051] The position of the pillar 99 is specified as the position of the vertex 99-1 from position information measured in advance. The distance from α0 of the autonomous mobile body 12 to the vertex 99-1 can be obtained by the distance measurement function of the autonomous mobile body 12. In Fig. 5(A), the coordinates of the vertex 99-1 are shown as (Wx, Wy, Wz) when the movement direction 12Y is the axis of the XYZ coordinate system and α0 is the origin.
[0052] In the three-dimensional map of cyberspace, the information acquired in this manner is managed as digital data, and can be reconstructed by the system control device 10, the route determination device 13, etc., as spatial information as shown in Fig. 5(B). Fig. 5(B) shows a state in which the autonomous mobile body 12 and the pillar 99 are mapped into an arbitrary XYZ coordinate system space with P0 as the origin. By setting P0 to a specific latitude and longitude in the real world, and taking the azimuth north of the real world as the Y-axis direction, it is possible to represent the autonomous mobile body 12, and P1 and the pillar 99 as P2 in this arbitrary XYZ coordinate system space.
[0053] Specifically, the position P1 of α0 in this space can be calculated from the latitude and longitude of α0 and the latitude and longitude of P0. Similarly, the position of the pillar 99 can be calculated as P2. In this example, the autonomous mobile unit 12 and the pillar 99 are represented on a three-dimensional map of the cyberspace, but it is of course possible to handle a larger number of objects in the same way. As described above, a 3D map is a mapping of the user's position and objects in the real world into a 3D space.
[0054] Returning to Fig. 4, the autonomous mobile body 12 stores learning result data of object detection performed by machine learning in, for example, an information storage unit (memory / HDD) 12-4, and can detect objects from captured images using machine learning. The detection information can also be acquired from an external system via a network connection unit 12-5 and reflected in a three-dimensional map. The control unit 12-2 has a built-in CPU as a computer, and controls the movement, direction changes, and autonomous driving functions of the autonomous mobile body 12, and controls the processing in each unit within the autonomous mobile body 12.
[0055] The direction control unit 12-3 changes the driving direction of the moving body by the driving unit 12-6, thereby changing the moving direction of the autonomous moving body 12. The driving unit 12-6 is composed of a driving device such as a motor, and generates a propulsive force for the autonomous moving body 12. The autonomous moving body 12 reflects the self-position, detection information, and object detection information in the 3D map, generates a route that maintains a certain distance from the surrounding terrain, buildings, obstacles, and objects, and can perform autonomous traveling.
[0056] The route determination device 13 mainly generates a route taking into consideration regulatory information related to the Road Traffic Act. Meanwhile, the autonomous moving body 12 detects the positions of surrounding obstacles more accurately on the route determined by the route determination device 13, and generates a route for moving without coming into contact with them based on its own size. Also, the information storage unit (memory / HDD) 12-4 of the autonomous moving body 12 can store the mobility type of the autonomous moving body itself. This mobility type is, for example, a legally identified type of moving body, such as a car, bicycle, drone, etc. Based on this mobility type, it is possible to generate formatted route information, which will be described later.
[0057] Here, the main body configuration of the autonomous moving body 12 in this embodiment will be described with reference to Fig. 6. Fig. 6 is a perspective view showing an example of the mechanical configuration of the autonomous moving body 12 according to the embodiment. Note that, in this embodiment, the autonomous moving body 12 is described as an example of a running body having wheels, but is not limited thereto, and may be an air vehicle such as a drone.
[0058] 6, the autonomous moving body 12 is equipped with a detection unit 12-1, a control unit 12-2, a direction control unit 12-3, an information storage unit (memory / HDD) 12-4, a network connection unit 12-5, and a driving unit 12-6, and each unit is electrically connected to each other. At least two or more driving units 12-6 and direction control units 12-3 are provided in the autonomous moving body 12.
[0059] The direction control unit 12-3 changes the direction of the drive unit 12-6 by rotating the shaft, thereby changing the moving direction of the autonomous moving body 12, and the drive unit 12-6 moves the autonomous moving body 12 forward and backward by rotating the shaft. Note that the configuration described using Fig. 6 is one example and is not limited to this, and for example, the moving direction may be changed using an omni wheel or the like.
[0060] The autonomous mobile body 12 is a mobile body that uses, for example, SLAM (Simultaneous Localization and Mapping) technology. Also, the autonomous mobile body 12 is configured to be able to autonomously move along a specified route based on detection information detected by a detection unit 12-1 and detection information of an external system acquired via the Internet 16.
[0061] The autonomous moving body 12 can perform a trace movement, tracing precisely specified points, or it can pass through roughly set points and generate its own route information for the space between them to move.
[0062] As described above, the autonomous moving body 12 transmits information on the operation of the autonomous moving body 12, such as its orientation, moving speed, and position information, to the system control device 10 through the network connection unit 12-5. Furthermore, the system control device 10 transmits information on the operation of the autonomous moving body 12 received from the autonomous moving body 12 to the conversion information holding device 14 through the network control unit 10-5. The conversion information holding device 14 stores information on the operation of the autonomous moving body 12, such as its orientation, moving speed, and position information, received from the system control device 10, in the format database 14-4. In this embodiment, information on the operation of other moving bodies other than the autonomous moving body 12, such as its orientation, moving speed, and position information, is transmitted to the conversion information holding device 14, similar to the autonomous moving body 12. Therefore, the format database 14-4 is in a state where the orientation, moving speed, and position information of the moving body existing in the space managed by the unique identifier are stored. How this information is stored will be described later with reference to FIG. 11(A), FIG. 11(B), and FIG. 12. In a second embodiment described later, a control system for reducing blind spot accidents will be described on the assumption that such information is stored.
[0063] As described above, the autonomous moving body 12 of this embodiment can move autonomously based on route information using the unique identifier provided by the system control device 10.
[0064] 4, the sensor node 15 is an external system such as a video monitoring system, for example, a roadside camera unit, and includes a detection unit 15-1, a control unit 15-2, an information storage unit (memory / HDD) 15-3, and a network connection unit 15-4. The detection unit 15-1 acquires detection information of an area in which it can detect itself, for example, a camera, and has an object detection function, a distance measurement function, an object recognition function, shooting direction information, self-position information, and the time when the object was recognized.
[0065] The control unit 15-2 has a built-in CPU as a computer, and controls the detection, data storage, and data transmission functions of the sensor node 15, and controls the processing in each unit within the sensor node 15. In addition, the detection information acquired by the detection unit 15-1 is stored in the information storage unit (memory / HDD) 15-3, and is also transmitted to the conversion information holding device 14 via the network connection unit 15-4.
[0066] As described above, the sensor node 15 is configured to store and communicate detection information such as image information detected by the detection unit 15-1, feature point information of the detected object, and position information in the information storage unit 15-3. The sensor node 15 also provides the detection information of the area that the sensor node 15 can detect to the conversion information holding device 14.
[0067] Next, a specific hardware configuration of each control unit in FIG. 4 will be described. FIG. 7 is a block diagram showing a specific example of the hardware configuration of control unit 10-2, control unit 11-2, control unit 12-2, control unit 13-2, control unit 14-2, and control unit 15-2.
[0068] 7, reference numeral 21 denotes a CPU as a computer that controls the calculation and control of the information processing device. Reference numeral 22 denotes a RAM, which functions as the main memory of the CPU 21, as an area for an execution program, as an execution area for the program, and as a data area. Reference numeral 23 denotes a ROM that stores the operation processing procedures of the CPU 21.
[0069] The ROM 23 comprises a program ROM in which is recorded an operating system (OS), which is a system program for controlling the equipment of the information processing device, and a data ROM in which information necessary for operating the system is recorded. Note that the ROM 23 may be replaced with a HDD 29, which will be described later. Reference numeral 24 denotes a network interface (NETIF), which controls data transfer between information processing devices via the Internet 16 and diagnoses the connection status. Reference numeral 25 denotes a video RAM (VRAM), which develops images to be displayed on the screen of the LCD 26 and controls the display. Reference numeral 26 denotes a display device such as a display (hereinafter referred to as LCD).
[0070] Reference numeral 27 denotes a controller (hereinafter referred to as KBC) for controlling input signals from an external input device 28. Reference numeral 28 denotes an external input device (hereinafter referred to as KB) for receiving operations performed by a user, and for example, a keyboard or a pointing device such as a mouse is used. Reference numeral 29 denotes a hard disk drive (hereinafter referred to as HDD), which is used for storing application programs and various data. The application program in this embodiment is a software program or the like that executes various processing functions in this embodiment.
[0071] Reference numeral 30 denotes a CDD, which is used to input and output data to and from a removable medium 31 serving as a removable data recording medium, such as a CD-ROM drive, a DVD drive, or a Blu-Ray (registered trademark) disk drive. The CDD 30 is an example of an external input / output device. The CDD 30 is used, for example, when reading the above-mentioned application program from the removable medium. 31 denotes a removable medium such as a CD-ROM disk, a DVD, or a Blu-Ray disk that is read by the CDD 30.
[0072] The removable medium may be a magneto-optical recording medium (e.g., MO), a semiconductor recording medium (e.g., a memory card), etc. Application programs and data stored in the HDD 29 can also be stored in a removable medium 31 for use. Reference numeral 20 denotes a transmission bus (address bus, data bus, input / output bus, and control bus) for connecting the above-mentioned units.
[0073] Next, details of the control operation in the autonomous mobile control system for realizing the route setting application or the like as described with reference to FIGS. 2 and 3 will be described with reference to FIGS. FIG. 8 is a sequence diagram for explaining the processing executed by the autonomous mobile control system according to this embodiment, FIG. 9 is a sequence diagram continuing from FIG. 8, and FIG. 10 is a sequence diagram continuing from FIG.
[0074] 8 to 10 show the processes executed by each device from when the user inputs the position information to the user interface 11 until the current position information of the autonomous moving body 12 is received. Note that the operation of each step of the sequence in Fig. 8 to 10 is performed by the computer in the control unit of each device executing a computer program stored in the memory.
[0075] First, in step S201, the user accesses a WEB page provided by the system control device 10 through the user interface 11. In step S202, the system control device 10 displays a location input screen as described in Fig. 2 on the display screen of the WEB page. In step S203, as described in Fig. 2, the user selects an autonomous moving body (mobility) and inputs location information (hereinafter, location information) indicating the departure / via / arrival points.
[0076] The location information may be a word (hereinafter, location word) that specifies a specific location, such as a building name, station name, or address, or a method of specifying a specific location on a map displayed on the web page as a point (hereinafter, point).
[0077] In step S204, the system control device 10 stores the type information of the selected autonomous moving body 12 and the input location information. At this time, if the location information is the location word, the location word is stored, and if the location information is the point, the latitude / longitude corresponding to the point is searched for based on the simple map information stored in the location / route information management unit 10-3, and the latitude / longitude is stored.
[0078] Next, in step S205, the system control device 10 specifies the type of route that can be traveled (hereinafter, route type) from the mobility type (type) of the autonomous moving body 12 specified by the user. Then, in step S206, it transmits it to the route determination device 13 together with the position information.
[0079] The mobility type is a legally distinguished type of moving body, such as an automobile, a bicycle, a drone, etc. The type of route is, for example, a general road, an expressway, a road exclusively for automobiles, etc., and for bicycles, a specified sidewalk, a shoulder of a general road, a bicycle lane, etc.
[0080] In step S207, the route determination device 13 inputs the received location information into the map information it possesses as a departure / intermediate / arrival point. If the location information is the location word, it searches the map information using the location word and uses the corresponding latitude / longitude information. If the location information is latitude / longitude information, it inputs it directly into the map information and uses it.
[0081] Next, in step S208, the route determination device 13 searches for a route from the departure point to the arrival point via the waypoint. At this time, the route to be searched is a route that conforms to the route type. Then, in step S209, the route determination device 13 outputs the route from the departure point to the arrival point via the waypoint (hereinafter, route information) in GPX format (GPS eXchange Format) as a result of the search, and transmits it to the system control device 10.
[0082] GPX format files are mainly composed of three types of data: waypoints (unordered location information), routes (ordered location information with added time information), and tracks (a collection of multiple location information: a trajectory).
[0083] The attribute values of each point information are latitude / longitude, and sub-elements include altitude, geoid height, GPS reception conditions, accuracy, etc. The minimum element required for a GPX file is the latitude / longitude information of a single point, and other information can be described as desired. The route information output is the route, which is a collection of point information consisting of ordered latitude / longitude. Note that the route information may be in other formats as long as it satisfies the above.
[0084] Here, an example of the format configuration managed by the format database 14-4 of the conversion information storage device 14 will be described in detail with reference to FIGS. 11(A), 11(B) and 12. FIG. Fig. 11(A) is a diagram showing latitude / longitude information of the earth, and Fig. 11(B) is a perspective view showing a predetermined space 100 in Fig. 11(A). In Fig. 11(B), the center of the predetermined space 100 is defined as center 101. Fig. 12 is a diagram showing a schematic diagram of spatial information within space 100.
[0085] In Fig. 11(A) and Fig. 11(B), the format divides the space of the earth into three-dimensional spaces determined by ranges starting from latitude / longitude / height, and makes it possible to add a unique identifier to each space and manage them. For example, here, a space 100 is displayed as a predetermined three-dimensional space. The space 100 is a divided space defined with a center 101 at 20 degrees north latitude, 140 degrees east longitude, and height H, with a width in the latitude direction defined as D, a width in the longitude direction defined as W, and a width in the height direction defined as T. Also, it is one space obtained by dividing the space of the earth into spaces determined by ranges starting from the latitude / longitude / height.
[0086] For convenience, only space 100 is shown in Fig. 11(A), but in terms of the format specifications, it is assumed that spaces defined in the same way as space 100 are arranged side by side in the latitude / longitude / height directions, as described above. The horizontal position of each of the arranged divided spaces is defined by the latitude / longitude, and they also overlap in the height direction, with the height defining the position in the height direction.
[0087] In FIG. 11(B), the center 101 of the divided space is set as the starting point of the latitude / longitude / height, but this is not limited to this, and for example, a corner of the space or the center of the bottom surface may be set as the starting point. Additionally, the shape need only be roughly rectangular, but when considering the case of laying them out over the surface of a sphere such as the Earth, it is better to make the top of the rectangular prism slightly wider than the bottom so that they can be placed more tightly without any gaps.
[0088] 12, taking the space 100 as an example, the format database 14-4 stores information (spatial information) relating to the type of object that exists or can enter within the range of the space 100 and time, in association with a unique identifier. The formatted spatial information is stored in chronological order, such as from the past to the future.
[0089] That is, the conversion information storage device 14 formats spatial information regarding the type of object that exists or can enter a three-dimensional space defined by latitude / longitude / height in association with a unique identifier, and stores the formatted information in the format database 14-4. The spatial information is updated based on information input by an external system (e.g., a sensor node 15) communicatively connected to the conversion information storage device 14, and the information is shared with other external systems communicatively connected to the conversion information storage device 14.
[0090] As described above regarding the autonomous moving body 12, the autonomous moving body 12 transmits information regarding the operation of the vehicle, such as the direction and moving speed of the vehicle, and position information, but how this information is stored will be explained here.
[0091] Fig. 14 is a diagram for explaining how data is stored in the format database 14-4. Fig. 14(A) is a diagram showing a table showing an example of information stored in association with a unique identifier. Fig. 14(B) is a schematic perspective view showing an example of a state in which the sensor node 15 photographs a space.
[0092] The sensor node 15 is positioned so as to be able to photograph the space assigned unique identifier 001 (hereinafter also referred to as "ID001"), unique identifier 002 (hereinafter also referred to as "ID002"), and unique identifier 003 (hereinafter also referred to as "ID003").
[0093] The sensor node 15 recognizes the bicycle 1202 as a bicycle. The sensor node 15 also recognizes, by using a distance measurement function, how far away the bicycle 1202 is from the sensor node 15, that is, the distance from the sensor node 15 to the bicycle 1202. Furthermore, the sensor node 15 also has its own position information and shooting direction information, so by calculating this together with the distance, it is possible to determine that the bicycle 1202 is in the space assigned ID002 and ID003.
[0094] Since the sensor node 15 performs object recognition processing for each captured frame, the direction and moving speed of a moving object in a captured image can be calculated from the difference in position from the previous frame. Table 1203 is a table summarizing information recognized by the sensor node 15. In this control system, as shown in Table 1203, items for automobiles, motorcycles, bicycles, and people are prepared as recognized objects for each unique identifier. If the object does not exist in the space to which the unique identifier is assigned, -1 is input. If the object exists in the space to which the unique identifier is assigned, the direction and speed are input. In Table 1203, the direction is expressed as an angle with north as 0 degrees and one revolution in the counterclockwise direction as 360 degrees. In Table 1203, the speed is expressed in meters per second [m / s]. The sensor node 15 performs object recognition for each captured frame, summarizes the data as shown in Table 1203, and transmits the data to the conversion information storage device 14 through the network connection unit 15-4.
[0095] The sensor node 15 may perform only object recognition to determine what object is located at what position, and transmit the object recognition result to the conversion information storage device 14 via the network connection unit 15-4. In this case, the conversion information storage device 14 may store the received object recognition result in the unique identifier management unit 14-2 in a format such as Table 1203 in accordance with the format database 14-4.
[0096] As described above, in this embodiment, information on the type of object that exists or can enter a three-dimensional space defined by latitude / longitude / height and time (hereinafter referred to as spatial information) is associated with a unique identifier, formatted, and stored in a database. Then, the formatted spatial information makes it possible to manage space-time.
[0097] Returning to Fig. 8, the process executed by the autonomous mobile control system will be described below. In step S210, the system control device 10 checks the intervals between each piece of point information in the received route information. Then, the system control device 10 creates position point cloud data (hereinafter, position point cloud data) by matching the intervals between the point information and the intervals between the starting points of the divided spaces defined by the format.
[0098] At this time, if the interval between the point information is smaller than the interval between the start points of the divided space, the system control device 10 thins out the point information in the route information to match the interval between the start points of the divided space, and generates the position point cloud data. If the interval between the point information is larger than the interval between the start points of the divided space, the system control device 10 interpolates the point information within a range that does not deviate from the route information, and generates the position point cloud data.
[0099] 9, the system control device 10 transmits the latitude / longitude information of each point information of the position point cloud data in the order of the route to the conversion information storage device 14. In addition, in step S212, the conversion information storage device 14 searches the format database 14-4 for a unique identifier corresponding to the received latitude / longitude information, and transmits it to the system control device 10 in step S213.
[0100] In step S214, the system control device 10 arranges the received unique identifiers in the same order as the original position point cloud data, and stores them as route information using the unique identifiers (hereinafter, formatted route information). Thus, in step S214, the system control device 10 acquires spatial information from the database of the conversion information storage device 14, and generates route information related to the movement route of the moving object based on the acquired spatial information and the type information of the moving object.
[0101] Here, the process of generating the position point cloud data from the route information and converting it into route information using a unique identifier will be described in detail with reference to Figures 13(A), 13(B), and 13(C). Figure 13(A) is an image diagram showing route information displayed on map information, Figure 13(B) is an image diagram showing route information using position point cloud data displayed on map information, and Figure 13(C) is an image diagram showing route information using a unique identifier displayed on map information.
[0102] 13(A), 120 is route information, 121 is a non-movable area that the autonomous moving body 12 cannot pass through, and 122 is a movable area that the autonomous moving body 12 can move through. The route information 120 generated by the route determination device 13 based on the position information of the starting point, intermediate point, and arrival point designated by the user is generated as a route that passes through the starting point, intermediate point, and arrival point, and passes through the movable area 122 on the map information.
[0103] In Fig. 13(B), 123 denotes a plurality of pieces of position information on the route information. The system control device 10, which has acquired the route information 120, generates the position information 123 arranged at a predetermined interval on the route information 120. The position information 123 can be expressed by latitude / longitude / altitude, and in this embodiment, this position information 123 is called position point cloud data. Then, the system control device 10 transmits the latitude / longitude / altitude of each point of this position information 123 one by one to the conversion information storage device 14, and converts it into a unique identifier.
[0104] In FIG. 13(C), 124 is position-spatial information obtained by converting the position information 123 into unique identifiers one by one and expressing the spatial range defined by the unique identifiers in a rectangular frame. By converting the position information into unique identifiers, position-spatial information 124 is obtained. As a result, the route expressed by the route information 120 is converted and expressed as continuous position-spatial information 124. Each piece of position-spatial information 124 is linked to information regarding the type of object that exists or can enter the spatial range and time. In this embodiment, this continuous position-spatial information 124 is called format route information.
[0105] 9, the process executed by the autonomous mobile control system will be described below. After step S214, in step S215, the system control device 10 downloads the spatial information associated with each unique identifier of the formatted route information from the conversion information storage device 14.
[0106] Then, in step S216, the system control device 10 converts the spatial information into a format that can be reflected in a three-dimensional map of the cyberspace of the autonomous mobile body 12, and creates information (hereinafter, cost map) that indicates the positions of multiple objects (obstacles) in a predetermined space. The cost map may be created initially for the space of all routes in the format route information, or may be created by dividing the space into certain regions and updating it sequentially.
[0107] Next, in step S217, the system control device 10 stores the formatted route information and the cost map in association with a unique identification number assigned to the autonomous mobile body 12. The autonomous mobile body 12 monitors (hereinafter, polls) its own unique identification number via the network at a predetermined time interval, and downloads the associated cost map in step S218. In step S219, the autonomous mobile body 12 reflects the latitude / longitude information of each unique identifier in the formatted route information as route information in the 3D map of cyberspace that it has created.
[0108] Next, in step S220, the autonomous mobile body 12 reflects the cost map in a 3D map of the cyberspace as obstacle information on the route. If the cost map is created in a form divided at regular intervals, after moving through the area in which the cost map is created, the autonomous mobile body 12 downloads the cost map of the next area and updates the cost map.
[0109] In step S221, the autonomous moving body 12 moves along the route information while avoiding the object (obstacle) input in the cost map. That is, the movement control is performed based on the cost map. At this time, in step S222, the autonomous moving body 12 moves while performing object detection, and if there is a difference with the cost map, moves while updating the cost map using the object detection information.
[0110] In addition, in step S223, the autonomous mobile body 12 transmits difference information with respect to the cost map together with the corresponding unique identifier to the system control device 10. The system control device 10, which has acquired the difference information between the unique identifier and the cost map, transmits spatial information to the conversion information holding device 14 in step S224 of Fig. 10, and in step S225, the conversion information holding device 14 updates the spatial information of the corresponding unique identifier. The content of the updated spatial information does not directly reflect the difference information with respect to the cost map, but is abstracted by the system control device 10 and then transmitted to the conversion information holding device 14. The details of the abstraction will be described later.
[0111] In step S226, the autonomous moving body 12 moving based on the formatted route information transmits the unique identifier associated with the space it is currently passing through to the system control device 10 every time it passes through a divided space associated with the unique identifier. Alternatively, the unique identifier may be associated with its own unique identification number during the polling. The system control device 10 grasps the current position of the autonomous moving body 12 on the formatted route information based on the unique identifier information of the space received from the autonomous moving body 12.
[0112] By repeating step S226, the system control device 10 can grasp the current location of the autonomous moving body 12 from the formatted route information. Note that the system control device 10 may stop storing the unique identifier of the space through which the autonomous moving body 12 has passed, thereby reducing the amount of data stored in the formatted route information.
[0113] 2 and 3 based on the grasped current location information of the autonomous moving body 12, and display them on the display screen of the WEB page. Every time the autonomous moving body 12 transmits the unique identifier indicating the current location to the system control device 10, the system control device 10 updates the confirmation screen 50 and the map display screen 60.
[0114] On the other hand, in step S228, the sensor node 15 saves the detection information of the detection range, and in step S229 abstracts the detection information and transmits it as the spatial information to the conversion information holding device 14 in step S230. The abstraction is, for example, information on whether an object exists or not, and whether there has been a change in the existence state of the object, and is not detailed information on the object.
[0115] Detailed information about the object is stored in the memory of the sensor node. Then, in step S231, the conversion information storage device 14 associates the spatial information, which is abstracted detection information, with a unique identifier of a position corresponding to the spatial information and stores it. As a result, the spatial information is stored in one unique identifier in the format database.
[0116] In addition, when an external system different from the sensor node 15 utilizes the spatial information, the external system acquires and utilizes the detection information in the sensor node 15 via the conversion information storage device 14 based on the spatial information in the conversion information storage device 14. In this case, the conversion information storage device 14 also has a function of connecting the communication standard between the external system and the sensor node 15.
[0117] By storing the spatial information as described above among multiple devices, not limited to the sensor node 15, the conversion information storage device 14 has a function of linking data from multiple devices with a relatively light data amount. If the system control device 10 requires detailed object information when creating a cost map in steps S215 and S216, the detailed information can be downloaded from an external system that stores detailed detection information of the spatial information and used.
[0118] Here, it is assumed that the sensor node 15 updates the spatial information on the route of the format route information of the autonomous moving body 12. At this time, the sensor node 15 acquires the detection information in step S232, generates abstracted spatial information in step S233, and transmits it to the conversion information holding device 14 in step S234. The conversion information holding device 14 stores the spatial information in the format database 14-4 in step S235.
[0119] The system control device 10 checks for changes in the spatial information in the formatted route information that it manages at a predetermined time interval, and if there is a change, downloads the spatial information in step S236. Then, in step S237, it updates the cost map linked to the unique identification number assigned to the autonomous mobile body 12. In step S238, the autonomous mobile body 12 recognizes the update of the cost map by polling and reflects it in the 3D map of the cyberspace that it created.
[0120] As described above, by utilizing spatial information shared by multiple devices, the autonomous moving body 12 can recognize changes on the route that it cannot recognize by itself in advance and can respond to those changes. The above series of systems are performed, and when the autonomous moving body 12 arrives at the arrival point in step S239, the unique identifier is transmitted in step S240.
[0121] The system control device 10 thus recognizes the unique identifier, and in step S241 displays an arrival display on the user interface 11 and terminates the application. According to this embodiment, as described above, it is possible to provide a digital architecture format and an autonomous mobile control system using the same.
[0122] 11(A), (B) and 12, the format database 14-4 stores information (spatial information) on the types of objects that exist or can enter within the range of the space 100 and information on time in chronological order from the past to the future. In addition, the spatial information is updated based on information input from an external sensor or the like communicably connected to the conversion information storage device 14, and the information is shared with other external systems that can be connected to the conversion information storage device 14.
[0123] One of these spatial information is type information of objects in the space. The type information of objects in the space here is information that can be obtained from map information, such as a roadway, a sidewalk, a bicycle-only road, etc. In addition, information such as the direction of travel of mobility on a roadway and traffic regulations can also be defined as type information. Furthermore, type information can be defined for the space itself.
[0124] Second embodiment In this embodiment, a control system for reducing accidents in blind spots using the autonomous mobile control system of the first embodiment will be described. The control of this system is realized by the conversion information storage device 14 shown in Fig. 4 performing main control. Hereinafter, this system will be referred to as the blind spot accident reduction system.
[0125] FIG. 15 is a diagram for explaining a blind spot accident. A blind spot accident refers to an accident in which a collision factor such as a motorcycle, bicycle, or person unexpectedly enters the traveling path of the vehicle from a blind spot that cannot be recognized by the driver of the vehicle or the on-board camera, and causes a collision. There are various patterns of blind spot accidents, but in this embodiment, the pattern of FIG. 15, which is a typical blind spot accident, is used as an example. In this embodiment, an intersection is described as an example of a collision risk area that is an area where the autonomous moving body 12 may collide with a collision factor described later, but a collision risk area other than an intersection may also be used.
[0126] Fig. 15(A) shows the state before the accident occurred, and Fig. 15(B) shows the state after the accident occurred. Fig. 15(A) shows a state in which a host vehicle 1301, waiting to turn right at an intersection, starts to turn right at the same time that an oncoming vehicle 1302 turns right.
[0127] A front-mounted camera is mounted on the host vehicle 1301, and its field of view is represented by field of view 1304. At the time of Fig. 15(A), motorcycle 1303 is hidden in the blind spot of oncoming vehicle 1302 and is not captured by the front-mounted camera of the host vehicle 1301. Then, in Fig. 15(B), the host vehicle 1301 advances and becomes host vehicle 1305, and oncoming vehicle 1302 advances and becomes oncoming vehicle 1306. In Fig. 15(B), when the host vehicle 1305 is about to turn right, motorcycle 1307 suddenly appears from behind oncoming vehicle 1306, and detection is delayed, resulting in a collision with the host vehicle 1305.
[0128] In order to reduce accidents like the one shown in FIG. 15, the blind spot accident reduction system of this embodiment uses information from the autonomous mobile control system described above to detect collision factors that appear from blind spots that cannot be detected by the driver or the vehicle-mounted camera.
[0129] In order to reduce accidents such as those shown in FIG. 15, the blind spot accident mitigation system of this embodiment prevents collisions in advance by carrying out the following items (1) to (4). (1) Identify a search range (map coordinates) for unique identifiers where collision factors are likely to exist. (2) Create and save a list of unique identifiers from the identified search range (map coordinates). (3) It is determined from the created unique identifier list whether a collision factor exists, and the result is stored in the unique identifier of the right-turn lane. (4) The right-turning vehicle obtains collision factor information from a unique identifier in the right-turn lane and determines the timing of the right turn. Details of items (1) to (4) are given below.
[0130] (1) Identify a search range (map coordinates) for unique identifiers where collision factors are likely to exist. Fig. 16 is a diagram showing an intersection as viewed from above, and is a diagram for explaining a search range for collision factors in the blind spot accident reduction system of this embodiment.
[0131] The intersections shown in Fig. 16 were selected from a number of intersections by obtaining road information from road network data (not shown) on the Internet. Here, the road network data is road information created from digital road map data, and is information created by the Road Map Association, a foundation, and others.
[0132] The method of selecting intersections in this embodiment is to determine locations where accidents are likely to occur based on the number of lanes, road width, etc. obtained from the road information described above, and select them in order. Since it takes time to select and process all intersections, the number of intersections to be selected is limited according to the processing capacity of the conversion information storage device 14.
[0133] The conversion information storage device 14 acquires map information and intersection coordinates of the selected intersection, and the maximum speed of the road. Fig. 16 shows a right-turning vehicle 1401 traveling from right to left in the figure, about to enter the right-turn lane to turn right at the intersection in the upward direction of the figure. The right-turning vehicle 1401 is the autonomous mobile body 12 in Fig. 4.
[0134] In Fig. 16(A), areas 1405, 1410, 1411, 1408, and 1409 are set. These areas indicate areas where there is a high possibility that a motorbike, bicycle, or person may enter the path of right-turning vehicle 1401 when right-turning vehicle 1401 turns right and approaches an intersection several seconds after the state of Fig. 16(A) has been reached. The conversion information holding device 14 aims to automatically detect collision factors from these areas, and in this section (1), a rectangle encompassing these areas is automatically set.
[0135] An example of an automatically set rectangle is shown in Fig. 16(B) . Areas 1405, 1410, 1411, 1408, and 1409 are enclosed by rectangles 1418, 1419, 1420, 1421, and 1422, respectively.
[0136] First, a method for setting the rectangle 1418 will be described. The rectangle 1418 is an area surrounded by a dashed line, and is an area mainly used for detecting motorcycles. Motorcycles that may collide with the right-turning vehicle 1401 are currently only present to the left of the intersection of the oncoming lane. Therefore, the right edge of the rectangle 1418 is set as the intersection. Since motorcycles travel on the road, the vertical width of the rectangle 1418 is the road width of the oncoming lane.
[0137] The left edge of the rectangle 1418 is as follows. Since the right-turning car 1401 is still before the intersection, the motorcycle that may collide with the right-turning car 1401 is also traveling before the intersection. In FIG. 16(B), if the right-turning car 1401 is Tm seconds away from the intersection, the motorcycle that may collide with the right-turning car 1401 is also Tm seconds away from the intersection. However, since the speed of the motorcycle is not known at this time, the motorcycle speed is assumed to be 0 to the maximum speed of the road on which the motorcycle is traveling x 2. Here, the maximum speed is doubled in order to detect motorcycles that are not traveling at the maximum speed, and the double is the safety factor, and the safety factor may be, for example, 1.5 times or 3 times depending on the situation.
[0138] In this case, the distance A from the intersection to the position farthest from the intersection among the positions where the motorcycle that may collide with the right-turning vehicle 1401 at the current time may be located is expressed by the following equation 1. Distance A = Tm [s] × maximum speed of the road [m / s] × 2 (Equation 1) The motorcycle, which may collide with the right-turning vehicle 1401, is estimated to be somewhere between the intersection and a distance A. In this way, the left end of the rectangle 1418 when only the speed of the right-turning vehicle 1401 is taken into consideration is the distance A.
[0139] Furthermore, in order to detect a motorcycle that may collide with the right-turning vehicle 1401 from the data in the format database 14-4, it is necessary to take into account the update delay of this database. Here, the update delay of the format database 14-4 will be explained. In order to introduce information about the presence of a motorcycle into the format database 14-4, a process is required in which the sensor node photographs the motorcycle, recognizes the motorcycle by object recognition, generates data, and saves it in the format database 14-4. Therefore, the information saved in the format database 14-4 is older than the information at the current time.
[0140] FIG. 17 is a diagram showing the information currently held by the format database 14-4 when it is mapped. FIG. 17(A) shows the current state of the real world. The positional relationship between a right-turning car 1501, an oncoming car 1502, and a motorcycle 1503 is as shown in FIG. 17(A). At this time, the data stored in the format database 14-4 is information from a time difference Ts seconds ago, which is the current time minus the update time, as shown in FIG. 17(B). The right-turning car 1501 is stored in the format database 14-4 as a right-turning car 1511. The oncoming car 1502 is stored in the format database 14-4 as an oncoming car 1512. The motorcycle 1503 is stored in the format database 14-4 as a motorcycle 1513.
[0141] In this embodiment, this Ts second is 1 second. Therefore, in the format database 14-4, the right-turning vehicle 1511, the oncoming vehicle 1512, and the motorcycle 1513 are stored in positions one second earlier than the current state of Fig. 17(A). Therefore, when the update delay of the database is taken into consideration, the left end of the rectangle 1418 is a distance B to the left of the above-mentioned distance A. Distance B is expressed by the following equation 2. Distance B = Ts [s] × maximum speed of the road [m / s] × 2 (Equation 2) The motorcycle that may collide with the right-turning vehicle 1401 is estimated to be somewhere between the intersection and (distance A + distance B). In this way, when the speed of the right-turning vehicle 1401 and the update delay of the database are taken into consideration, the left end of the rectangle 1418 is (distance A + distance B). In this embodiment, the distance from the right end to the left end of the rectangle 1418 is set as the length 1404.
[0142] Let us actually find an example of length 1404. The maximum speed of a road is 30km / h or 40km / h, which is determined for each road, converted to speed per second. In other words, for 30km / h, it is about 8.3m / h, and for 40km / h, it is about 11.1m / s. Here, it is assumed that a right-turning vehicle 1401 is 3 seconds away from the intersection. The update delay of the database is 1 second. The safety factor is also assumed to be double. It is also assumed that the maximum speed of the road is 40km / h. In this case, length 1404 can be found by the following formula 3. Length 1404 = 3 [s] x 11.1 [m / s] x 2 + 1 [s] x 11.1 [m / s] x 2 =88.8m (Equation 3) Thus, the length 1404 is 88.8 m, and a rectangle 1418 extends 88.8 m from the intersection along the road to the left in the drawing.
[0143] By setting the left edge of rectangle 1418 to the above value, it becomes possible to pick up almost all bikes that may currently be at the intersection. The coordinates of rectangle 1418 can be calculated from the starting coordinates at the top right and the ending coordinates at the bottom left based on the intersection coordinates in the road network data. At this point, rectangle 1418 includes more than just roads, but the next section (2) explains a method for picking up only unique identifiers that exist on roads in area 1405.
[0144] Next, a method of setting a rectangle 1419 and a rectangle 1420 which respectively encompass the area 1410 and the area 1411 will be described. The areas 1410 and 1411 are areas in which bicycles are to be detected. In Fig. 16, 1416 and 1417 are buildings.
[0145] Area 1410 indicates the range in which bicycles coming from the upper side of FIG. 16 on the sidewalk toward the intersection and bicycles coming from the left side of FIG. 16 exist. Meanwhile, area 1411 indicates the range in which bicycles coming from the upper side of FIG. 16 on the sidewalk toward the intersection and bicycles coming from the right side of FIG. 16 exist. Although bicycles may be prohibited by law from riding on sidewalks, this system is designed to detect bicycles that violate this rule in order to prevent accidents. Here, assuming that the maximum speed of bicycles is about 40 km / h, the distance C, which is the distance from the intersection to the end of the rectangle that picks up the presence of a bicycle on the far side from the intersection, is calculated using the following formula 4, as in the case of the motorcycle described above. Distance C=3[s]×11.1[m / s]+1[s]×11.1[m / s] =44.4m (Formula 4) In the case of bicycles, the double safety factor is not used. In this embodiment, each of the lengths 1407 and 1406 is set to the distance C. That is, each of the lengths 1407 and 1406 is 44.4 m. By setting this length to the distance C, it becomes possible to pick up almost all bicycles that may be currently present at the intersection.
[0146] The area coordinates of rectangle 1419 and rectangle 1420 can be calculated by finding the starting coordinates in the upper right and the ending coordinates in the lower left based on the intersection coordinates in the road network data. At this point, rectangle 1419 and rectangle 1420 each encompass area 1410 and area 1411, respectively, but the next section (2) will explain a method of picking up only the unique identifiers that exist in area 1410 and area 1411.
[0147] Next, a method of setting rectangles 1421 and 1422 which respectively encompass areas 1408 and 1409 will be described, similar to the case of bicycles. Areas 1408 and 1409 are areas for detecting people. It is assumed that a person runs 100 m in about 10 seconds, and in this embodiment, lengths 1412 and 1413 are each set to about 10 m. Setting lengths 1412 and 1413 to these values makes it possible to pick up almost all pedestrians who may currently be present at the intersection.
[0148] The area coordinates of rectangle 1421 and rectangle 1422 can be calculated by finding the starting coordinates in the upper right and the ending coordinates in the lower left based on the intersection coordinates in the road network data. At this point, rectangle 1421 and rectangle 1422 each encompass area 1408 and area 1409, respectively, but the next section (2) will explain a method of picking up only the unique identifiers that exist in area 1408 and area 1409.
[0149] The start point coordinates and end point coordinates obtained as described above are stored in the associated unique identifier list header, which will be described in the next section (2). In this embodiment, the range is entered automatically, but if the intersection has a complex shape, it may be possible to enter the range manually.
[0150] (2) Create and save a list of unique identifiers from the identified search range (map coordinates). In this section (2), we will explain how to pick up unique identifiers that exist in the valid area from the rectangle set in section (1) and create and save a unique identifier list. In section (1) above, we obtained the coordinates of the rectangle that contains areas 1405, 1408, 1409, 1410, and 1411. Here, we will check the information of each unique identifier in this rectangle to determine whether the confirmed unique identifier is within each area.
[0151] First, consider the case of area 1405. As shown in table 1203 in FIG. 14, the space type information of the quasi-static information is recorded in the unique identifier. In the case of area 1405, it is confirmed whether the space type information of the unique identifier is a road. If the space type information is a road, it is determined that the area is within area 1405, and the unique identifier is added to the unique identifier list. When the search for all unique identifiers within rectangle 1418 is completed, the unique identifier list is completed. Similarly, for areas 1410, 1411, 1408, and 1409, it is confirmed that the space type information of the unique identifier is a sidewalk, and a unique identifier list is created.
[0152] 18 is a diagram for explaining a format for saving the completed data. The unique identifier list created as described above is saved as an associated unique identifier list in the information storage unit 14-5, as shown in table 1601.
[0153] To make it easier to extract each data item from the associated unique identifier list in Table 1601, an associated unique identifier list header in Table 1602 is also created. Table 1602 is the metadata for the associated unique identifier list in Table 1601. In the associated unique identifier list header, area information is managed in a structure, and the structure is stored in a list. Elements of the structure include classification, update time, start coordinates, end coordinates, list start pointer, number, and result.
[0154] The classification of the structure elements is a number assigned to each area. In this embodiment, since there are five related areas (area 1405, area 1410, area 1411, area 1408, and area 1409), classifications 1 to 5 correspond to the five areas, respectively. In the example of table 1602, classification 1, that is, the header information of area 1405, is described.
[0155] The update time of the structure elements stores the time when the result, which will be described later, was updated. The list start pointer of the structure elements stores the start address of the unique identifier list for the area corresponding to the classification. The number of elements of the structure is the number of unique identifiers listed in the unique identifier list. The result of the structure elements stores the result of reading the unique identifier list. The contents of this result will be described later.
[0156] Next, the created associated unique identifier list header is associated with the unique identifier of the right-turn lane. As explained in table 1203 of Fig. 14, the unique identifier information has an associated unique identifier information item, in which the start address information of the associated unique identifier list header can be registered. For example, the start address of the associated unique identifier list header in table 1602 is stored in the associated unique identifier information of the unique identifier corresponding to area 1415 of the right-turn lane in Fig. 16. This makes it possible to associate areas 1405, 1410, 1411, 1408, and 1409 with the unique identifier indicating area 1415.
[0157] In this case, the information in table 1601 generated in items (1) and (2) is not information that changes in the short term, so it is changed only when road construction occurs. Therefore, confirmation and updating can be performed about once a day.
[0158] (3) From the created unique identifier list, it is determined whether a collision factor exists and stored in the unique identifier of the right-turn lane. In a control system for reducing blind spot accidents, it is checked whether there are motorbikes, bicycles, people, etc. in each area, and the results are stored as blind spot information in the form of elements of the associated unique identifier list header structure.
[0159] There are four types of blind spot information stored in the result as an element of the associated unique identifier list header structure: -1, 0, 1, and 2. -1 indicates that there is no information. 0 indicates that the information has been acquired and that there are no motorbikes, bicycles, or people, etc., and that it is safe to drive. 1 indicates that there are motorbikes, bicycles, or people, etc., in the acquired information, but there is no problem with the timing, so it is possible to proceed with caution. 2 indicates that there are motorbikes, bicycles, or people, etc. in the acquired information, and there is a possibility of a collision due to the timing, so it is temporarily not permitted to proceed.
[0160] Fig. 19 is a diagram illustrating a sequence in which the conversion information storage device 14 updates the result of the associated unique identifier list header associated with the unique identifier of the right-turn lane. Fig. 20 is a diagram illustrating a sequence in which the conversion information storage device 14 updates the result of the associated unique identifier list header associated with the unique identifier of the right-turn lane, and is a diagram continuing from Fig. 19.
[0161] In this embodiment, the conversion information storage device 14 updates the unique identifier of the right-turn lane at 1 [ms] intervals. In step S1700, the conversion information storage device 14 determines whether the unique identifier of the right-turn lane is associated with the associated unique identifier list header. Specifically, the conversion information storage device 14 refers to the associated unique identifier information in table 1203 and determines whether there is head address information. If there is head address information in the associated unique identifier information, the conversion information storage device 14 determines that the unique identifier of the right-turn lane is associated with the associated unique identifier list header. If there is no head address information in the associated unique identifier information, the conversion information storage device 14 determines that the unique identifier of the right-turn lane is not associated with the associated unique identifier list header. If the conversion information storage device 14 determines that the unique identifier of the right-turn lane is associated with the associated unique identifier list header, the process of step S1701 is executed. If the conversion information storage device 14 determines that the unique identifier of the right-turn lane is not associated with the associated unique identifier list header, the process of step S1713 is executed.
[0162] In step S1713, the conversion information storage device 14 sets the result of the associated unique identifier list header to -1. Following the process of step S1713, the conversion information storage device 14 executes the process of step S1708 in Fig. 20. The process of step S1708 will be described later.
[0163] In step S1701, the conversion information storage device 14 refers to the associated unique identifier list header stored in the associated unique identifier information, and acquires the top address of the unique identifier list.
[0164] 20, which follows step S1701, the conversion information storage device 14 acquires the unique identifier of the area in which to search for motorcycles, bicycles, people, etc. from the unique identifier list. The conversion information storage device 14 acquires directional information of dynamic information of collision factors to be searched for in each area. As described above, since the dynamic information in table 1203 in FIG. 14 is listed in the unique identifier list, the conversion information storage device 14 can acquire the directional information of this collision factor.
[0165] In step S1703, the conversion information storage device 14 checks the direction of the collision factor based on the direction information of the collision factor, and determines whether the collision factor faces the intersection. If the conversion information storage device 14 determines that the collision factor faces the intersection, it is determined that the collision factor may enter the intersection, and the process of step S1704 is executed. If the conversion information storage device 14 determines that the collision factor does not face the intersection, it is determined that the collision factor will not enter the intersection, and the process of step S1714 is executed.
[0166] In step S1714, the conversion information storage device 14 sets the result of the associated unique identifier list header to 0. Following the process of step S1714, the conversion information storage device 14 executes the process of step S1708, which will be described later.
[0167] In step S1704, the conversion information storage device 14 judges whether the speed of the collision factor is greater than 0. If the conversion information storage device 14 judges that the speed of the collision factor is 0, that is, if the vehicle is stopped, it is parked and the collision factor is not entering the intersection, and the process of step S1714 is executed. If the conversion information storage device 14 judges that the speed of the collision factor is greater than 0, it is determined that the collision factor may enter the intersection, and the process of step S1705 is executed.
[0168] In step S1705, the conversion information storage device 14 calculates the distance D from the collision factor, i.e., the unique identifier of interest, to the intersection. The conversion information storage device 14 acquires the coordinates of the intersection from the road network data. The unique identifier information in the unique identifier list stores dynamic information and position information of the unique identifier. The conversion information storage device 14 uses these two pieces of information to calculate the distance D from the collision factor to the intersection.
[0169] In step S1706, the conversion information storage device 14 calculates a predicted time Tf until the collision factor reaches the intersection from the distance D calculated in step S1705, the speed S of the collision factor, and the time difference Ts between the current time and the update time of the unique identifier. The conversion information storage device 14 acquires the speed S of the collision factor from the database. The conversion information storage device 14 calculates the predicted time Tf by the following formula 5. Tf=D / S-Ts (Formula 5)
[0170] Here, the distance D is information that is Ts seconds older than the current time, so the time it will take for the collision factor to reach the intersection from the current time is calculated by subtracting Ts seconds from the time calculated by dividing the distance D by the speed S.
[0171] In step S1707, the conversion information storage device 14 judges the possibility of collision between the vehicle and the collision factor by using the difference between Tf obtained in step S1706 and the predicted time Tm at which the vehicle will arrive at the intersection. If the conversion information storage device 14 judges that the absolute value |Tf-Tm| of the difference between Tf and Tm is smaller than a preset threshold T1, it is determined that the possibility of collision is high, and the process of step S1709 is executed. If the conversion information storage device 14 judges that |Tf-Tm| is equal to or greater than the threshold T1, it is determined that the possibility of collision is low, and the process of step S1711 is executed. In this embodiment, the threshold T1 is set to 10 seconds.
[0172] In step S1709, the conversion information storage device 14 sets the result of the related unique identifier list header to 2 because the collision factor present in this unique identifier has a high risk of collision. Following the process of step S1709, the conversion information storage device 14 executes the process of step S1708. The process of step S1708 will be described later.
[0173] In step S1711, since the collision factor present in this unique identifier has a low risk of collision, the conversion information storage device 14 sets the result of the associated unique identifier list header to 1. Following the process of step S1709, the conversion information storage device 14 executes the process of step S1708.
[0174] In step S1708, the conversion information holding device 14 updates information other than the associated unique identifier information from the camera node, etc. This update is as explained in the autonomous mobile control system, and so an explanation thereof will be omitted here.
[0175] In step S1712, the conversion information storage device 14 judges whether the next ID can be acquired in the unique identifier list, i.e., whether there are any unique identifiers remaining to be searched. If the conversion information storage device 14 judges that the next ID cannot be acquired, i.e., there are no unique identifiers remaining to be searched, the processing of Figures 19 and 20 ends. If the conversion information storage device 14 judges that the next ID can be acquired, i.e., there are any unique identifiers remaining to be searched, the processing of step S1702 is executed.
[0176] In this embodiment, it is assumed that the processing time from the start to the end of the sequences in Figures 19 and 20 is several hundred milliseconds. Even after the sequences in Figures 19 and 20 end, the sequences in Figures 19 and 20 are started again and again each time the unique identifier list is updated. In this way, the conversion information storage device 14 on the server side constantly updates the information of each area, making it possible to check the dynamic information of each area from the unique identifier of the right-turn lane.
[0177] (4) Vehicles turning right obtain information on collision factors from a unique identifier in the right-turn lane and determine the timing of their right turn. Fig. 21 is a diagram illustrating a sequence executed by the control unit 12-2 of the autonomous moving body 12. In this embodiment, the autonomous moving body 12 also executes the sequence of Fig. 21 at intervals of 1 ms.
[0178] In step S1801, the control unit 12-2 acquires information on the unique identifier of the current location of the autonomous moving body 12, and checks the associated unique identifier information therein.
[0179] In step S1802, control unit 12-2 determines whether there is information on the unique identifier of the current location. If control unit 12-2 determines that there is no information on the unique identifier of the current location, the process of Fig. 21 ends. If control unit 12-2 determines that there is information on the unique identifier of the current location, the process of step S1803 is executed.
[0180] In step S1803, control unit 12-2 determines whether the result of the associated unique identifier list header is -1. If control unit 12-2 determines that the result of the associated unique identifier list header is -1, the process of Fig. 21 ends. If control unit 12-2 determines that the result of the associated unique identifier list header is not -1, the process of step S1804 is executed.
[0181] In step S1804, control unit 12-2 determines whether the result of the associated unique identifier list header is 2. If control unit 12-2 determines that the result of the associated unique identifier list header is 2, the process of step S1808 is executed. If control unit 12-2 determines that the result of the associated unique identifier list header is not 2, the process of step S1805 is executed.
[0182] In step S1808, control unit 12-2 determines that there is a risk of collision, and outputs a command to stop turning right to drive unit 12-6.
[0183] In step S1805, control unit 12-2 determines whether the result of the associated unique identifier list header is 1. If control unit 12-2 determines that the result of the associated unique identifier list header is 1, the process of step S1807 is executed. If control unit 12-2 determines that the result of the associated unique identifier list header is not 1, the process of step S1806 is executed.
[0184] In step S1807, the control unit 12-2 determines that there is no risk of collision, but caution is required. The control is performed taking into consideration the situation and the margin of time until the arrival time. Specifically, the control unit 12-2 basically performs control not to execute a right turn, for example, but to wait until the collision factor is eliminated.
[0185] In step S1806, since there is no collision factor, the control unit 12-2 performs control to execute a right turn as is.
[0186] As can be seen from the explanation in this section, the autonomous moving body 12 can collect information on blind spot areas by referring to the unique identifier of the current location.
[0187] <Method of detecting route information in advance using an autonomous mobile control system> Here, a method for detecting information on a route to be traveled in advance (hereinafter, referred to as a method for detecting advance information) will be described using the configuration described in the method for reducing blind spot accidents. In the following, the route to be traveled in the future may be simply referred to as the route.
[0188] The key point of the blind spot accident reduction method explained so far is to obtain road information from road network data, automatically associate related spatial information, and grasp the route situation ahead in advance. This mechanism can be applied not only to blind spot detection, but also to applications where it is desired to obtain route information in advance. Route information includes, for example, information on structures that exist on the route. Structures include, for example, bridges, tunnels, and highway parking lots.
[0189] FIG. 22 is a diagram for explaining an outline of the advance information detection method. The top outline diagram 1901 shows how information on a bridge is associated in advance with a unique identifier 1904 located at the position of a mobile body traveling toward the bridge. The middle outline diagram 1902 shows how information inside a tunnel is associated in advance with a unique identifier 1905 located at the position of a mobile body traveling toward the tunnel. The bottom outline diagram 1903 shows how information on a parking lot on a highway is associated in advance with a unique identifier 1906 located at the position of a mobile body traveling toward the parking lot on the highway. In this way, the advance information detection method is a method for receiving information on a target such as a bridge or tunnel in advance from a unique identifier located at a position where the target is traveling toward the target.
[0190] The advance information detection method is configured in the same way as the blind spot accident mitigation method, by providing an item for related unique identifier information within the unique identifier information, and by making it possible to refer to the related unique identifier list header and related unique identifier list. The related unique identifier information is Table 1203 in Fig. 14. The related unique identifier list header is Table 1602 in Fig. 18. The related unique identifier list is Table 1601 in Fig. 18. These are the same as those explained in the blind spot accident mitigation method, so detailed explanations of each will be omitted here.
[0191] The difference with the blind spot accident mitigation method is the meaning of the numbers used in the associated unique identifier list header result. Figure 23 is a diagram explaining the types of associated unique identifier list header results, including the blind spot accident mitigation method.
[0192] If the result number, which is the result value of the associated unique identifier list header, is -1, 0, 1, or 2, it is as described in the blind spot accident reduction method described above. If the result number is 3, it indicates that there is an obstacle making it difficult to drive. If the result number is 4, it indicates that there is an obstacle and the road cannot be passed.
[0193] 24 is a diagram for explaining a sequence in which the result numbers 3 and 4 are determined by the prior information detection method. Here, the tunnel in the outline diagram 1902 in FIG. 22 will be explained as an example.
[0194] The conversion information storage device 14 executes the processes from step S2101 onwards at regular intervals (1 ms intervals) to update the unique identifier 1905. In step S2101, the conversion information storage device 14 determines whether an associated unique identifier list header pointer is stored in the associated unique identifier information. If the conversion information storage device 14 determines that an associated unique identifier list header pointer is stored in the associated unique identifier information, the process of step S2102 is executed. If the conversion information storage device 14 determines that an associated unique identifier list header pointer is not stored in the associated unique identifier information, the process of step S2106 is executed.
[0195] In step S2102, the conversion information storage device 14 acquires the associated unique identifier list registered in the associated unique identifier list header. In step S2103, the conversion information storage device 14 refers to individual unique identifier information from the acquired unique identifier list to determine whether there is any impassable matter. The impassable matter may be a heavy traffic jam, a large fallen object, or the like. The conversion information storage device 14 determines whether there is a heavy traffic jam by acquiring a traffic jam in the road information in the unique identifier. This information may be acquired from road network data, or may be determined when the speed of the car in the dynamic information of the unique identifier on the passageway is 0 or close to 0. The conversion information storage device 14 may also determine whether there is a large fallen object from the road network data, or from other information in the dynamic information. If the conversion information storage device 14 determines that there is any impassable matter, the process of step S2107 is executed. If the conversion information storage device 14 determines that there is no impassable matter, the process of step S2104 is executed.
[0196] In step S2107, the conversion information storage device 14 inputs the value 4, which indicates a driving prohibition, to the result of the associated unique identifier list header in the unique identifier 1905. After that, the conversion information storage device 14 executes the process of step S2106.
[0197] In step S2104, the conversion information storage device 14 judges whether or not the vehicle is in a situation where it is not possible to drive at a normal speed. Possible situations where it is not possible to drive at a normal speed include a narrow road width and a large number of parked cars. The conversion information storage device 14 can acquire whether or not the road width is narrow from the road information in the unique identifier. The conversion information storage device 14 can judge whether or not there are parked cars by whether or not there are cars with a speed of 0 even though the road conditions in the unique identifier show no congestion. If the conversion information storage device 14 judges that the vehicle is in a situation where it is not possible to drive at a normal speed, the process of step S2108 is executed. If the conversion information storage device 14 judges that the vehicle is not in a situation where it is not possible to drive at a normal speed, the process of step S2105 is executed.
[0198] In step S2108, the conversion information storage device 14 inputs the value 3, which indicates driving caution, to the result of the associated unique identifier list header in the unique identifier 1905. After that, the conversion information storage device 14 executes the process of step S2106.
[0199] In step S2105, the conversion information storage device 14 determines whether or not driving is possible based on the information in the unique identifier 1905, or whether or not there is no data in the unique identifier. If the conversion information storage device 14 determines that there is no data in the unique identifier, or if there is data in the unique identifier but the information in the unique identifier does not determine whether or not driving is possible, the process of step S2109 is executed. If the conversion information storage device 14 determines that it is possible to determine whether or not driving is possible based on the information in the unique identifier, the process of step S2110 is executed.
[0200] In step S2109, the conversion information storage device 14 inputs -1, which means no information, to the result of the associated unique identifier list header in the unique identifier 1905. After that, the conversion information storage device 14 executes the process of step S2106.
[0201] In step S2110, the conversion information storage device 14 inputs 0, which means that driving is permitted as normal, to the result of the associated unique identifier list header in the unique identifier 1905. After that, the conversion information storage device 14 executes the process of step S2106.
[0202] In step S2106, the conversion information storage device 14 updates information other than the associated unique identifier information and ends the process. The conversion information storage device 14 updates the result of the associated unique identifier list header by executing the sequence shown in FIG.
[0203] Fig. 25 is a diagram for explaining a sequence executed by the control unit 12-2 of the autonomous moving body 12 in a method for detecting route information in advance. In this embodiment, the autonomous moving body 12 executes the sequence of Fig. 25 at intervals of 1 [ms].
[0204] In step S2201, control unit 12-2 acquires unique identifier information of the current location, and acquires related unique identifier information therein.
[0205] In step S2202, control unit 12-2 determines whether the unique identifier information of the current location has related unique identifier information. If control unit 12-2 determines that the unique identifier information of the current location has related unique identifier information, processing in step S2203 is executed. If control unit 12-2 determines that the unique identifier information of the current location does not have related unique identifier information, the processing in FIG. 25 ends.
[0206] In step S2203, control unit 12-2 determines whether the result of the related unique identifier list header is -1. If control unit 12-2 determines that the result of the related unique identifier list header is -1, the process of Fig. 25 ends. If control unit 12-2 determines that the result of the related unique identifier list header is not -1, the process of step S2204 is executed.
[0207] In step S2204, control unit 12-2 determines whether the result of the related unique identifier list header is 2. If control unit 12-2 determines that the result of the related unique identifier list header is 2, the process of step S2208 is executed. If control unit 12-2 determines that the result of the related unique identifier list header is not 2, the process of step S2205 is executed.
[0208] In step S2205, control unit 12-2 determines whether the result of the associated unique identifier list header is 1. If control unit 12-2 determines that the result of the associated unique identifier list header is 1, the process of step S2207 is executed. If control unit 12-2 determines that the result of the associated unique identifier list header is not 1, the process of step S2206 is executed.
[0209] In step S2208, the control unit 12-2 determines that an event that makes it impossible to travel has occurred on the route, and transmits information indicating that it is impossible to proceed further to the control unit 10-2 of the system control device 10. The control unit 10-2 receives this information and determines whether to change the route or stop traveling. The system control device 10 transmits this determination result to the autonomous moving body 12. The autonomous moving body 12 receives the determination result of the system control device 10 and executes a route change or stops traveling. Thereafter, the processing ends.
[0210] In step S2207, the control unit 12-2 determines that there are many obstacles and caution is required, and controls the speed of the autonomous moving body 12 to be reduced to a speed that can handle obstacles jumping out, etc. Thereafter, the process ends.
[0211] In step S2206, since normal driving is possible, the control unit 12-2 continues driving as is, and then ends the process.
[0212] As will be understood from the explanation in this section, the autonomous moving body 12 can obtain information about what is ahead on the route by referring to the unique identifier of the current location, and can change its travel plan in advance.
[0213] As described above, the embodiments of the blind spot accident reduction method and advance information detection method using an autonomous mobile control system have been described.
[0214] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0215] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.
[0216] Incidentally, this embodiment includes the following combinations of configurations. (Configuration 1) A control means for issuing control instructions to at least one autonomous moving body; and a conversion information storage means for converting spatial information, including information on the type of object present in a space defined by latitude / longitude / height and information on time, into a format in association with a unique identifier and storing the converted information, The unique identifier is stored in association with another unique identifier. A control system comprising: (Configuration 2) The control means performs control by referring to information about the other unique identifier associated with the unique identifier. 2. The control system according to claim 1, (Configuration 3) The another unique identifier associated with the unique identifier includes information on a route of an autonomous moving body that is present at a position indicated by the spatial information associated with the unique identifier. 3. The control system according to configuration 1 or 2. (Configuration 4) The other unique identifier associated with the unique identifier includes information about an intersection to which an autonomous moving body located at a position indicated by the spatial information associated with the unique identifier is heading. 4. A control system according to any one of configurations 1 to 3. (Configuration 5) The another unique identifier associated with the unique identifier includes information about a structure on a route of an autonomous moving body that is present at a position indicated by the spatial information associated with the unique identifier. 5. A control system according to any one of configurations 1 to 4. (Method 1) a control step of issuing a control instruction to at least one or more autonomous moving bodies; a conversion information storage step of converting spatial information, including information on the type of object present in a space defined by latitude / longitude / height and information on time, into a format in association with a unique identifier and storing the converted information; The unique identifier is stored in association with another unique identifier. A control method comprising: (Program 1) A computer program for causing a computer to function as each of the means described in any one of configurations 1 to 5.
[0217] The present invention has been described in detail above based on its preferred embodiments, but the present invention is not limited to the above embodiments, and various modifications are possible based on the gist of the present invention, and these modifications are not excluded from the scope of the present invention. A computer program for implementing all or part of the control functions of the above-described embodiments may be supplied to a control system or the like via a network or various storage media. A computer (or a CPU, MPU, or the like) in the control system or the like may read and execute the program. In this case, the program and the storage medium storing the program constitute the present invention. [Explanation of symbols]
[0218] 10: System control device 11: User Interface 12: Autonomous mobile object 13: Route determination device 14: Conversion information storage device 15: Sensor node 16: Internet
Claims
1. A control means for issuing control instructions to at least one autonomous moving body; and a conversion information storage means for converting spatial information, including information on the type of object present in a space defined by latitude / longitude / height and information on time, into a format in association with a unique identifier and storing the converted information, The unique identifier is stored so as to be able to refer to information about a unique identifier other than the unique identifier. A control system comprising:
2. The control means performs control by referring to information about the other unique identifier associated with the unique identifier.
2. The control system of claim 1.
3. The another unique identifier associated with the unique identifier includes information on a route of an autonomous moving body that is present at a position indicated by the spatial information associated with the unique identifier.
2. The control system of claim 1.
4. The another unique identifier associated with the unique identifier includes information about an intersection to which an autonomous moving body located at a position indicated by the spatial information associated with the unique identifier is heading.
2. The control system of claim 1.
5. The another unique identifier associated with the unique identifier includes information about a structure on a route of an autonomous moving body that is present at a position indicated by the spatial information associated with the unique identifier.
2. The control system of claim 1.
6. a control step of issuing a control instruction to at least one or more autonomous moving bodies; a conversion information storage step of converting spatial information, including information on the type of object present in a space defined by latitude / longitude / height and information on time, into a format in association with a unique identifier and storing the converted information; The unique identifier is stored so as to be able to refer to information about a unique identifier other than the unique identifier. A control method comprising:
7. A computer program for causing a computer to function as each of the means according to any one of claims 1 to 5.
Citation Information
Patent Citations
Lighting device
JP2012136855A
