Server equipment, terminal equipment, communication system, information receiving method, information transmission method, information receiving program, information transmission program, and recording medium.

Abstract

To enable a server device to efficiently acquire information around a movable body to update map information while suppressing communication load.SOLUTION: A system receives status information indicating a status of autonomous driving from a first movable body capable of autonomous driving based on the conditions around the first movable body and a map, sends a request for status information to a second movable body capable of sending the status information indicating the conditions of the location to which the first movable body is moved, and if the received status information indicates that autonomous driving was possible, suppresses the sending of the request.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] This application belongs to the technical field of a communication system that transmits information around a moving body from the moving body to a server device for the maintenance of map information used in the automatic driving of the moving body.

Background Art

[0002] In recent years, research and development of vehicles for automatic driving have been actively conducted based on three-dimensional detailed map information using, for example, NDT (Normal Distribution Transform), OGM (Occupancy Grid Map), etc. For example, a dedicated vehicle equipped with a sensor that highly accurately detects the relative position and shape of an object existing around the vehicle, such as LIDAR (Laser Imaging Detection and Ranging), generates map information based on the information detected by this sensor while the vehicle is running. A vehicle for automatic driving compares the information detected by the sensor mounted on this vehicle with the map information to estimate the current position of the vehicle or to control the accelerator, brake, steering, etc.

[0003] Patent Document 1 discloses that when the behavior of a vehicle mounted on a vehicle is detected by, for example, automatic driving, etc., a transmission signal including a behavior detection notification signal indicating that the behavior has been detected is transmitted to a server device, and when the server device determines that a predetermined condition is satisfied in response to the reception of the transmission signal, an upload request for vehicle information representing the situation of the vehicle is transmitted to the vehicle-mounted device.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Since actual ground conditions can change frequently, it is desirable to update map information in accordance with these changes. Therefore, one possibility is for ordinary vehicles to transmit information detected by sensors mounted on the vehicle to a server device while driving, and for the server device to update the map information based on the received information. However, if information detected by sensors is constantly transmitted to the server device, there is a problem in that the communication load would become enormous.

[0006] While Patent Document 1 discloses a technology aimed at reducing communication load by transmitting information representing the vehicle's status, it makes no mention of reducing communication load by transmitting information about the vehicle's surroundings. [Means for solving the problem]

[0007] The invention described in claim 1 is a server device comprising: a status receiving unit that receives status information indicating the status of automatic driving from a first mobile body capable of automatic driving based on the surrounding conditions of the first mobile body and a map; and a requesting unit that transmits a request for status information to a second mobile body capable of transmitting status information indicating the conditions of the place to which the first mobile body has moved, wherein the requesting unit suppresses the transmission of the request if the received status information indicates that automatic driving was possible.

[0008] The invention described in claim 5 is a terminal device mounted on one mobile body included in a plurality of mobile bodies that can communicate with a server device and are capable of automatic driving based on the surrounding conditions of the mobile body and a map, characterized in that it comprises: a factor request receiving unit that receives from the server device a request for factor information indicating the reason why automatic driving was impossible for the mobile body that transmitted the status information indicating that automatic driving was impossible for one of the plurality of mobile bodies to the server device; and a factor transmitting unit that, when a request for factor information is received, transmits the factor information to the server device based on a determination result of whether automatic driving is possible for the one mobile body at the location where the mobile body that transmitted the status information indicating that automatic driving was impossible to the server device has moved.

[0009] The invention described in claim 10 includes a server device comprising: a status receiving unit that receives status information indicating the status of automatic driving from a first mobile body capable of automatic driving based on the surrounding conditions of the first mobile body and a map; a requesting unit that transmits a request for the status information to a second mobile body capable of transmitting status information indicating the conditions of the place to which the first mobile body has moved; and a status receiving unit that receives the status information from the second mobile body; a first terminal device comprising: an acquisition unit that acquires the status information indicating the status of automatic driving of the first mobile body; and a status transmitting unit that transmits the acquired status information to the server device; and a second terminal device comprising: a receiving unit that receives the request from the server device; and, when the request is received, a surrounding transmitting unit that transmits the status information indicating the surrounding conditions of the second mobile body at the place to which the first mobile body has moved to the server device, wherein the requesting unit suppresses the transmission of the request if the received status information indicates that automatic driving was possible.

[0010] The invention described in claim 11 is an information receiving method performed by a computer, comprising: a status receiving step of receiving status information indicating the status of automatic driving from a first mobile body capable of automatic driving based on the surrounding conditions of the first mobile body and a map; and a request step of transmitting a request for status information to a second mobile body capable of transmitting status information indicating the conditions of the place to which the first mobile body has moved, wherein the request step suppresses the transmission of the request if the received status information indicates that automatic driving was possible.

[0011] The invention described in claim 12 is an information transmission method performed by a computer of a terminal device mounted on one of a plurality of mobile bodies that are communicable with the server device and capable of automatic driving based on the surrounding conditions of the mobile body and a map, characterized in that it includes a factor request receiving step of receiving a request from the server device for factor information indicating the reason why automatic driving was impossible for one of the plurality of mobile bodies that transmitted the status information indicating that automatic driving was impossible to the server device, and a factor transmission step of transmitting the factor information to the server device when the request for factor information has been received, based on a determination result of whether automatic driving is possible for the one mobile body at the location where the mobile body that transmitted the status information indicating that automatic driving was impossible to the server device has moved.

[0012] The invention described in claim 13 is an information receiving program characterized by causing a computer to function as the server device.

[0013] The invention described in claim 14 is an information transmission program characterized by causing a computer to function as the terminal device.

[0014] The invention described in claim 15 is characterized in that the information receiving program is recorded in a computer-readable format.

[0015] The invention described in claim 16 is characterized in that the information transmission program is recorded in a computer-readable format. [Brief explanation of the drawing]

[0016] [Figure 1] This block diagram shows an example of the overview configuration of a server device according to the embodiment. [Figure 2] This is a block diagram showing an example of the outline configuration of a communication system according to the embodiment. [Figure 3] (a) is a block diagram showing an example of the general configuration of a server device according to the embodiment. (b) is a block diagram showing an example of the general configuration of a terminal device according to the embodiment. [Figure 4] The figure which shows an example of transmission and reception of information regarding automated driving according to an embodiment. [Figure 5] (a) is a flowchart showing an example of information reception processing according to an embodiment. (b) is a flowchart showing an example of automated driving situation information transmission processing according to an embodiment. (c) is a flowchart showing an example of impossible factor information transmission processing according to an embodiment. (d) is a flowchart showing an example of detailed information transmission processing according to an embodiment.

Mode for Carrying Out the Invention

[0017] Next, the mode for carrying out the present application will be described with reference to FIG. 1. FIG. 1 is a block diagram showing an example of the schematic configuration of a server device according to an embodiment.

[0018] As shown in FIG. 1, the server device 1 according to the embodiment includes a situation reception unit 1a and a request unit 1b. The server device 1 can communicate with the moving bodies 2a and 2b. Examples of the moving bodies 2a and 2b include vehicles such as automobiles and motorcycles, and aircraft such as drones (or Unmanned Aerial Vehicles). The moving body 2a can perform automated driving based on the state around the moving body 2a and a map. The moving body 2b can at least acquire the state around the moving body 2b.

[0019] The situation reception unit 1a receives situation information indicating the situation of automated driving from the moving body 2a.

[0020] The request unit 1b transmits a request for this state information to the moving body 2b capable of transmitting state information indicating the state of the place where the moving body 2a has moved.

[0021] Here, when the situation information received by the situation reception unit 1a indicates that automated driving was possible, the request unit 1b suppresses the transmission of the request for state information.

[0022] As described above, according to the operation of the server device 1 according to the embodiment, the moving body 2b does not transmit the state information of the place where the automatic driving by the moving body 2a was possible to the server device 1. Regarding the place where the automatic driving was possible, the map used for the automatic driving is considered to be basically problem-free. Therefore, the transmission of the state information that is unnecessary for the update of the map information is suppressed, so that the server device 1 can efficiently acquire the information around the moving body for the update of the map information while suppressing the communication load.

Example

[0023] Next, specific examples corresponding to the above-described embodiments will be described with reference to FIGS. 2 to 5. The examples described below are examples when the embodiment is applied to a server device that can communicate with a plurality of vehicles. FIG. 2 is a block diagram showing an example of the schematic configuration of a communication system according to the example. FIG. 3(a) is a block diagram showing an example of the schematic configuration of a server device according to the example. FIG. 3(b) is a block diagram showing an example of the schematic configuration of a terminal device according to the example. FIG. 4 is a diagram showing an example of the transmission and reception of information related to automatic driving according to the example. FIG. 5(a) is a flowchart showing an example of information reception processing according to the example. FIG. 5(b) is a flowchart showing an example of automatic driving status information transmission processing according to the example. FIG. 5(c) is a flowchart showing an example of impossible factor information transmission processing according to the example. FIG. 5(d) is a flowchart showing an example of detailed information transmission processing according to the example.

[0024] As shown in FIG. 2, the communication system S according to the example includes a server device 10 and a plurality of terminal devices 20. The server device 10 and each terminal device 20 can communicate with each other via a network 7. The network 7 may be, for example, the Internet. Each terminal device 20 is mounted on a vehicle 5. Each vehicle 5 can perform automatic driving based on the state around the vehicle 5 and the map.

[0025] As shown in Figure 3(a), the server device 10 comprises a control unit 11, a storage unit 12, and a communication unit 13. The control unit 11 to the communication unit 13 are connected via a bus 14. The combination of the control unit 11 and the communication unit 13 is an example of a status receiving unit 1a and a request unit 1b according to this embodiment.

[0026] The control unit 11 includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc. The CPU reads and executes various programs stored in the ROM and memory unit 12, thereby controlling the server device 10. The control unit 11 also acquires information regarding the autonomous driving of the vehicle 5 from each terminal device 20 via the communication unit 13 in order to update the map data. A detailed explanation of how information regarding autonomous driving is acquired will be given later.

[0027] The storage unit 12 is composed of non-volatile memory, such as a hard disk. The storage unit 12 stores various programs for controlling the server device 10. These programs may be read from a recording medium via a drive device (not shown), or downloaded from a predetermined server device via the network 7.

[0028] Furthermore, the memory unit 12 stores map data for the autonomous driving of the vehicle 5. The map data represents the areas where the vehicle can travel and the surrounding conditions in three dimensions. For example, the map data may be a grid map such as NDT or OGM, which represents the areas where the vehicle can travel and the surrounding conditions in multiple voxels. To create the map data, a dedicated vehicle (not shown) equipped with surrounding sensors that detect the surrounding conditions, such as LIDAR, may be driven. The surrounding sensors collect point cloud data that shows the shape and relative position of obstacles such as features that were present around the dedicated vehicle during driving, using the dedicated vehicle's position as a reference, as the position of multiple points. Based on the point cloud data and the position of the dedicated vehicle at the time of collection, the absolute position of the point cloud (e.g., longitude, latitude, altitude, etc.) is calculated. The space within the map is divided into multiple voxels arranged in a grid, and based on the absolute position of the point cloud, information such as a three-dimensional normal distribution showing the distribution of points within each voxel, or the probability of occupying an obstacle within each voxel, is calculated as the voxel value. Map data containing such voxel values ​​is created. The server device 10 transmits some or all of the map data stored in the storage unit 12 to the vehicle 5 as needed. Note that multiple types of map data may be stored in the storage unit 12. For example, map data representing the location and display content of traffic signals, road signs, etc., map data representing obstacles around the road, map data representing terrain, etc. may be stored. In addition, multiple types of map data may be stored in the storage unit 12 depending on the vehicle type, etc.

[0029] Furthermore, the storage unit 12 may also store vehicle identification information (e.g., chassis number, registration number, etc.) that identifies each vehicle 5, along with vehicle type information indicating the type of vehicle 5, and location information (e.g., longitude, latitude, altitude, etc.) indicating the location of each vehicle 5. For example, each vehicle 5 transmits its vehicle identification information and location information to the server device 10 periodically, irregularly, or at predetermined intervals. The server device 10 updates the map data stored in the storage unit 12 in response to receiving this information.

[0030] The communication unit 13 controls communication with each terminal device 20.

[0031] The terminal device 20 is capable of wireless communication and can connect to the network 7 via a base station (not shown). The terminal device 20 is a device for transmitting information related to the autonomous driving of the vehicle 5 on which the terminal device 20 is installed to the server device 10. The terminal device 20 also controls the autonomous driving of the vehicle 5. However, the terminal device 20 does not control autonomous driving itself; instead, it may be connected to a control device such as an ECU (Electronic Control Unit) that controls autonomous driving, and obtain autonomous driving information from this control device.

[0032] As shown in Figure 3(b), the terminal device 20 comprises a control unit 21, a storage unit 22, a communication unit 23, and an interface unit 24. The control unit 21 to the interface unit 24 are connected via a bus 25.

[0033] The control unit 21 includes a CPU, ROM, RAM, etc. The CPU reads and executes various programs stored in the ROM and memory unit 22, thereby controlling the terminal device 20.

[0034] The storage unit 22 is composed of non-volatile memory such as a hard disk or flash memory. The storage unit 22 stores various programs for controlling the terminal device 20. These programs may be read from a recording medium via a drive device (not shown), or downloaded from a server device 10 or the like via a network such as a wireless communication network.

[0035] Furthermore, map data is stored in the storage unit 22. For example, the control unit 21 receives all or part of the map data stored in the server device 10 from the server device 10 as needed, and updates the map data stored in the storage unit 22 with the received data. Similar to the map data stored in the server device 10, multiple types of map data may be stored in the storage unit 22.

[0036] The communication unit 23 controls communication with the server device 10.

[0037] The interface unit 24 is connected to the surrounding sensors 31, GNSS (Global Navigation Satellite System) sensor 32, inertial sensor 33, vehicle speed sensor 34, and ECU group 35 mounted on the vehicle 5. The interface unit 24 performs interface processing between the terminal device 20 and the surrounding sensors 31 to ECU group 35.

[0038] The surrounding sensor 31 detects the conditions around the vehicle 5. For example, the surrounding sensor 31 may be a sensor that detects the distance and direction from the vehicle 5 to obstacles such as landmarks and people present around the vehicle 5, and outputs point cloud data to the interface unit 24 that shows the shape and relative position of the obstacles as the position of multiple points, with the vehicle 5 as the reference. For example, LIDAR may be used. Alternatively, in addition to being a sensor that outputs point cloud data, the surrounding sensor 31 may be equipped with a camera that takes pictures of the conditions around the vehicle 5. In this case, the surrounding sensor 31 further outputs an image that represents the conditions around the vehicle 5.

[0039] The GNSS sensor 32 receives signals transmitted from GPS satellites (not shown), calculates the position of the vehicle 5 based on these signals, and outputs position information (e.g., longitude, latitude, altitude, etc.) indicating the calculated position to the interface unit 24.

[0040] The inertial sensor 33 detects the acceleration and angular velocity of the vehicle 5 and outputs this information to the interface unit 24.

[0041] The vehicle speed sensor 34 detects the vehicle speed 5 and outputs information indicating the detected speed to the interface unit 24.

[0042] The ECU group 35 consists of multiple ECUs that control the operation of the vehicle 5. Examples of such ECUs include an ECU that controls the accelerator, an ECU that controls the steering, an ECU that controls the brakes, and an ECU that controls the engine.

[0043] The control unit 21 controls the automatic driving of the vehicle 5 equipped with the terminal device 20 that includes the control unit 21. For example, the control unit 21 estimates the approximate current position of the vehicle 5 by correcting the position information output from the GNSS sensor 32 based on the information output from the inertial sensor 33 and the vehicle speed sensor 34. The control unit 21 compares the point cloud data output from the surrounding sensor 31 with the map data stored in the storage unit 22 to estimate the position with a high agreement rate with the actual surrounding conditions of the vehicle 5 as the more accurate current position of the vehicle 5. The control unit 21 uses this agreement rate as the estimation accuracy of the vehicle 5's current position, and if the estimation accuracy is less than a predetermined value, the control unit 21 determines that automatic driving is not possible. Alternatively, for example, the control unit 21 may determine that automatic driving is not possible if there is a difference between the point cloud data and the map data regarding the presence or absence of a predetermined feature (for example, a signal exists on the map but does not actually exist, or there is a difference in the display of a sign). Furthermore, the control unit 21 may determine that automatic driving is impossible if the error between the current position estimated based on point cloud data and map data and the current position estimated based on information output from the inertial sensor 33 and vehicle speed sensor 34 is greater than or equal to a predetermined value. Also, for example, if the surrounding sensor 31 detects that another vehicle, person, etc. has suddenly appeared in front of the vehicle 5, the control unit 21 may stop the vehicle 5 and determine that automatic driving is impossible. Alternatively, if the control unit 21 receives information via the communication unit 23 that a disaster, accident, etc. has occurred at or near the location where the vehicle 5 is located, it may stop the vehicle 5 and determine that automatic driving is impossible. If the control unit 21 determines that automatic driving is possible, it will control each part of the vehicle 5 to perform automatic driving by transmitting a control signal to the ECU group 35. However, if, for example, the driver chooses to drive the vehicle 5 themselves, the control unit 21 will disable automatic driving of the vehicle 5.

[0044] The control unit 21 transmits information regarding the autonomous driving of the vehicle 5 equipped with the terminal device 20 containing the control unit 21 to the server device 10 via the communication unit 23. Examples of information regarding autonomous driving include autonomous driving status information, impossible factors information, and detailed information, with the amount of information decreasing in the order of autonomous driving status information, impossible factors information, and detailed information.

[0045] The automated driving status information indicates the status of automated driving of vehicle 5. The automated driving status information includes at least information on whether automated driving is possible or not. The automated driving status information may further include automated driving execution information, location information of vehicle 5, driving level, etc. Automated driving execution information indicates whether vehicle 5 actually performed automated driving at a certain point in time or period. Automated driving possibility / disability information indicates whether automated driving was possible at the aforementioned point in time or period. Automated driving is only permitted if it is possible. As mentioned above, even if automated driving is possible, it does not necessarily mean that it will actually be performed. The automated driving possibility / disability information is used by the server device 10 to control the transmission of impossible factor requests or detailed requests, which will be described later. Location information indicates the location of the point or route where vehicle 5 was stopped or traveling at the aforementioned point in time or period. Driving level indicates the ratio of the speed at which vehicle 5 actually traveled to the recommended driving speed at the point or route traveled by vehicle 5. Even when autonomous driving is possible, if the accuracy of the current position estimation of vehicle 5 is relatively low, vehicle 5 may have to travel at a speed lower than the recommended speed. The control unit 21 transmits autonomous driving status information in response to receiving an autonomous driving status request from the server device 10. The control unit 21 may also transmit an autonomous driving status request to the server device 10 periodically, irregularly, or at predetermined timings, even without receiving an autonomous driving status request.

[0046] Impossibility factor information indicates the factors that make autonomous driving impossible when autonomous driving is not possible. Impossibility factor information may include, for example, reason information, the estimation accuracy of the vehicle 5's position, location information indicating the location of points where there is a difference of more than a predetermined standard between the point cloud data and the map data, information indicating the type of map data where there is a difference of more than a predetermined standard, and the vehicle 5's position information. Reason information indicates the reason why autonomous driving is not possible. Reason information is used to control the transmission of detailed requests by the server device, as described later. Examples of reasons include: (1) low accuracy in estimating the position of vehicle 5; (2) differences in the presence or absence of a specified feature between point cloud data and map data; (3) a large error between the current position estimated based on point cloud data and map data and the current position estimated based on information output from the inertial sensor 33 and vehicle speed sensor 34; (4) the sudden appearance of another vehicle or person in front of vehicle 5; (5) the occurrence of a disaster or accident; (6) when a feature is recognized by image recognition from an image taken by a camera installed on vehicle 5, the position of the feature recognized based on the image differs from the position of the feature defined in the map data; and (7) differences between the attributes of the feature recognized based on point cloud data or image and the attributes of the feature defined in the map data. Differences in the attributes of a feature mean that there is no difference in the presence or absence and position of the feature, but there is a difference in some attribute that the feature possesses. For example, if the feature is a sign, there may be a difference between the display content of the sign recognized from the image captured by the camera installed on the vehicle 5 and the display content of the sign shown in the map data. In this case, the attribute is the display content. Also, for example, in the case of point cloud data acquired by LIDAR, there may be a difference of a predetermined amount or more between the reflectance value of the feature obtained by the surrounding sensor 31 receiving the reflected light of the feature in response to laser irradiation from the surrounding sensor 31 of the vehicle 5 and the reflectance value of the feature shown in the map data. In this case, the attribute is reflectance. If the vehicle was in a state where automatic driving was possible, the reason information may indicate that the vehicle was in a state where automatic driving was possible. The control unit 21 transmits information on the cause of impossibility in response to receiving a request for cause of impossibility from the server device 10.

[0047] If the reason indicated by the reason information is that the estimation accuracy of the vehicle 5's position is low, the impossibility factor information may be further supplemented with accuracy information indicating the estimation accuracy for each of the multiple position estimation methods used to estimate the vehicle 5's position. Examples of multiple position estimation methods include methods using GPS, methods using the vehicle 5's acceleration, angular velocity, driving speed, etc., and methods based on the positional relationship with surrounding landmarks. If the reason indicated by the reason information is that there is a difference between the attributes of a predetermined feature recognized from point cloud data acquired by LIDAR, etc., or images taken by a camera, and the attributes of the feature defined in map data, the impossibility factor information may be further supplemented with attribute difference information indicating that there is a difference in the feature's attributes. This difference information may also be information about the attribute that has the difference. For example, the attribute difference information may indicate what attribute has the difference. This allows the server device 10 to determine what kind of information is needed as detailed information, and thus it can appropriately determine which vehicle 5 is the recipient of the detailed request described later. For example, if attribute difference information indicates a difference in the display content of a feature, the information required as detailed information is an image of the area around vehicle 5. Therefore, the server device 10 should send a detailed request to vehicle 5, which is equipped with a camera as a surrounding sensor 31. If attribute difference information indicates a difference in reflectance to laser irradiation, the information required as detailed information is point cloud data showing the state of the area around vehicle 5. Therefore, the server device 10 should send a detailed request to vehicle 5, whose surrounding sensor 31 is equipped with a sensor capable of acquiring point cloud data such as LIDAR.

[0048] The detailed information indicates the state of the area around vehicle 5. The detailed information may include, for example, point cloud data output from the surrounding sensor 31 and the position of vehicle 5 when the point cloud data was output. In addition to or instead of point cloud data, the detailed information may include images taken by a camera showing the state of the area around vehicle 5. The detailed information may further include information indicating the model of the surrounding sensor 31, the version of the program for automatic driving control of the ECU that controls automatic driving stored in the storage unit 22, the version of the map data stored in the storage unit 22, vehicle type information, etc. The control unit 21 transmits the detailed information in response to receiving a detailed request from the server device 10.

[0049] Next, we will explain how the server device 10 obtains information regarding autonomous driving from the vehicle 5. First, the control unit 11 of the server device 10 receives autonomous driving status information from the vehicle 5. The vehicle 5 that transmits the autonomous driving status information is referred to as vehicle 5-1, and the terminal device 20 installed in vehicle 5-1 is referred to as terminal device 20-1. For example, as shown in Figure 4, the control unit 11 sends an autonomous driving status request to vehicle 5-1, and the terminal device 20-1 that receives the autonomous driving status request transmits the autonomous driving status information to the server device 10. The control unit 11 may send the autonomous driving status request to only one vehicle 5-1, or it may send the autonomous driving status request to multiple vehicles 5-1. The control unit 11 may send the autonomous driving status request to all vehicles 5-1 that the server device 10 can communicate with. Alternatively, the control unit 11 may send the autonomous driving status request to one or more vehicles 5-1 located within an area selected by the control unit 11 or the administrator of the control unit 11 from among multiple areas. Alternatively, the control unit 11 may transmit an automated driving status request to one or more vehicles 5-1 located at a location selected by the control unit 11 or the administrator.

[0050] The control unit 11 sends a detailed request to a vehicle 5 capable of transmitting detailed information indicating the state of the location where vehicle 5-1, which transmitted the automated driving status information, traveled. The detailed request may include location information indicating the location where vehicle 5-1 traveled. The location where vehicle 5-1 traveled is the location where driving took place under the automated driving conditions indicated by the automated driving status information transmitted by vehicle 5-1. This location may be a specific section or point. For example, the road network may be divided into multiple sections on the map data. The vehicle 5 that receives the detailed request is referred to as vehicle 5-3, and the terminal device 20 mounted on vehicle 5-3 is referred to as terminal device 20-3. The control unit 11 may send the detailed request to only one vehicle 5-3, or it may send the detailed request to multiple vehicles 5-3. The terminal device 20-3 that received the detailed request transmits detailed information, including point cloud data output by the surrounding sensors 31 while vehicle 5-3 was traveling, to the server device 10, indicating the location where vehicle 5-1 traveled.

[0051] Vehicle 5-3, which can transmit detailed information indicating the state of the location where vehicle 5-1 has traveled, may be, for example, a vehicle currently traveling in the same location as vehicle 5-1. Alternatively, vehicle 5-3 may be a vehicle that is about to enter or pass through the location where vehicle 5-1 has traveled. Vehicle 5-3 may be different from or the same as vehicle 5-1. For example, if vehicle 5-1 travels again to the location where it transmitted the automated driving status information, terminal device 20-1 can transmit detailed information about this location. Also, for example, if terminal device 20-1 can store point cloud data output from the surrounding sensor 31 in the storage unit 22 for a certain period or distance, terminal device 20-1 can transmit detailed information about the location where vehicle 5-1 transmitted the automated driving status information.

[0052] If the control unit 11 indicates that the automated driving status information transmitted from vehicle 5-1 contains information indicating that automated driving was possible, it suppresses the transmission of detailed requests to vehicle 5-3. In locations where automated driving was possible, it is considered that there is no significant difference between the point cloud data output by the surrounding sensors 31 and the map data, so there is little need to update the map data for those locations.

[0053] When receiving autonomous driving status information from multiple vehicles 5-1 that traveled to the same location, it is possible that some vehicles 5-1 are capable of autonomous driving while others are not. For example, because the vehicle types and other characteristics differ among the multiple vehicles 5-1, the performance of autonomous driving may differ, and whether or not autonomous driving is possible may vary from vehicle 5-1 to vehicle 5-1. In this case, the control unit 11 may consider the autonomous driving status of the multiple vehicles 5-1 comprehensively and decide whether or not to suppress the detailed request. For example, the control unit 11 may suppress the detailed request if a predetermined percentage or more of the vehicles 5-1 are capable of autonomous driving.

[0054] If the control unit 11 receives information from vehicle 5-1 regarding whether autonomous driving is possible or impossible, and the autonomous driving status information transmitted from vehicle 5-1 indicates that autonomous driving was impossible, the control unit 11 sends an impossible factor request to vehicle 5, which is capable of transmitting impossible factor information indicating the factors that made autonomous driving impossible at the location where vehicle 5-1 traveled. The impossible factor request may include location information indicating the location where vehicle 5-1 traveled. Here, the control unit 11 may also request performance information from vehicle 5-1, which transmitted the autonomous driving status information, indicating the performance of sensors and other equipment mounted on vehicle 5-1 that are related to autonomous driving performance. Examples of sensors in this case include the surrounding sensor 31, GNSS 32, inertial sensor 33, vehicle speed sensor 34, etc. Examples of information indicating the performance of the sensors include values ​​indicating resolution and sensitivity, the manufacturer of the sensor, model number, and year of manufacture. The control unit 11 does not need to request performance information again from vehicle 5-1 for which it already has performance information. If the control unit 11 determines, based on the performance information, that the performance of the sensors mounted on vehicle 5-1 is extremely low, it does not need to send an impossible factor request. Furthermore, when determining whether autonomous driving is possible at a location using autonomous driving status information received from multiple vehicles 5-1 that have traveled to the same location, the control unit 11 may reduce the weight given to autonomous driving status information received from vehicles 5-1 with extremely low performance sensors when determining whether autonomous driving is possible.

[0055] Vehicle 5 that receives the impossibility factor request is referred to as vehicle 5-2, and the terminal device 20 mounted on vehicle 5-2 is referred to as terminal device 20-2. The control unit 11 may send the impossibility factor request to only one vehicle 5-2, or it may send the impossibility factor request to multiple vehicles 5-2. Upon receiving the impossibility factor request, terminal device 20-2 generates impossibility factor information indicating the factors that make automatic driving of vehicle 5-2 impossible, based on the determination result of whether automatic driving is possible for vehicle 5-2 while vehicle 5-2 is driving in the area where vehicle 5-1 has traveled, and sends this information to the server device 10.

[0056] Vehicle 5-2, which is capable of transmitting information indicating factors that make autonomous driving impossible in the location where vehicle 5-1 has traveled, may, for example, be a vehicle currently traveling in the same location as vehicle 5-1. Alternatively, vehicle 5-2 may be a vehicle that is about to enter or pass through the location where vehicle 5-1 has traveled. Vehicle 5-2 may be different from or the same as vehicle 5-1.

[0057] If the control unit 11 indicates that the impossibility factor information transmitted from vehicle 5-2 is due to a discrepancy between the actual state of the location where vehicle 5-1 moved, as shown by the point cloud data output from the surrounding sensor 31, and the map data, it sends a detailed request to vehicle 5-3. In this case, vehicle 5-2 and vehicle 5-3 may be different or the same. A discrepancy between the actual state of the location where vehicle 5-1 moved and the map data may occur, for example, when the estimation accuracy of vehicle 5's position is low, when there is a discrepancy between the point cloud data and the map data regarding the presence or absence of a predetermined feature, when the location of a feature recognized based on an image taken by a camera installed on vehicle 5 differs from the location of the same feature defined in the map data, or when there is a discrepancy between the attributes of a feature recognized based on the point cloud data or image and the attributes of the feature defined in the map data. There is a high need to update the map data for locations where automatic driving was impossible due to a discrepancy between the point cloud data output by the surrounding sensor 31 and the map data. The factor that causes a difference between the actual state of the location where vehicle 5-1 has moved and the map data is simply called a map factor. If the impossibility factor information received from vehicle 5-2 includes attribute difference information, as described above, the control unit 11 may determine which vehicle 5-3 will be the destination of the detailed request based on the attribute difference information.

[0058] Even if autonomous driving is impossible for vehicle 5-1, autonomous driving may be possible for vehicle 5-2. For example, the conditions in the area where vehicle 5-1 traveled may have been bad only when vehicle 5-1 was traveling. Alternatively, the autonomous driving performance may differ between vehicle 5-1 and vehicle 5-2 due to differences in vehicle type, etc. In such cases, the control unit 11 does not need to send a detailed request. Alternatively, vehicle 5-2 may determine the factors that make autonomous driving impossible based on the accuracy of the position estimation included in the impossibility factor information, or position information indicating the location of a point where there is a difference of more than a predetermined standard between the point cloud data and the map data.

[0059] When information on factors making autonomous driving impossible is received from each of multiple vehicles 5-2 that traveled to the same location, the reason why autonomous driving is impossible for one vehicle 5-2 may be a map-related factor, while the reason why autonomous driving is impossible for another vehicle 5-2 may be something other than a map-related factor, such as an emergency vehicle like an ambulance traveling nearby. In this case, the control unit 11 may consider the factors making autonomous driving impossible for multiple vehicles 5-2 comprehensively and decide whether or not to send a detailed request. For example, the control unit 11 may send a detailed request if the factors making autonomous driving impossible for a predetermined percentage or more of the vehicles 5-2 are map-related factors.

[0060] The control unit 11 may send an automated driving status request, an impossible factor request, and a detailed request to each vehicle 5 on a section-by-section basis. That is, vehicle 5-1 sends automated driving status information indicating the status of automated driving in the section it traveled, vehicle 5-2 sends impossible factor information indicating the factors that made automated driving impossible in the section it traveled, and vehicle 5-3 sends detailed information indicating the conditions around the section it traveled. However, for the detailed information, the control unit 11 may have vehicle 5-3 send detailed information indicating the conditions of only one or more points in the section traveled by vehicle 5-1 where there was a difference of a predetermined standard or more between the point cloud data and the map data. In this case, the control unit 11 sends a detailed request including location information of the points where there was a difference of a predetermined standard or more. Vehicle 5-3 sends detailed information including point cloud data only for the points indicated by the location information included in the detailed request in the section traveled by vehicle 5-1. This reduces the communication load of the detailed information.

[0061] When the control unit 11 receives detailed information, it may update the map data stored in the storage unit 12 based on the detailed information. For example, the control unit 11 may compare the point cloud data included in the detailed information with the data of the location where the vehicle 5 traveled and its surroundings in the map data, and identify locations where there is a difference of a predetermined standard or more between the point cloud data and the map data. The control unit 11 may update the voxel value corresponding to the identified location in the map data with the voxel value calculated based on the point cloud data. If the detailed information includes point cloud data only for locations where there is a difference of a predetermined standard or more, the control unit 11 may update the voxel value corresponding to that location in the map data with the voxel value calculated based on the point cloud data. Alternatively, the server device 10 may also compare the point cloud data and the map data and update the map data only if there is a difference of a predetermined standard or more at that location. When the control unit 11 receives detailed information from each of multiple vehicles 5-3 for the same location, it may make a comprehensive decision based on this detailed information whether or not to update the map data for that location. Furthermore, the control unit 11 may update the map data using multiple pieces of detailed information.

[0062] Instead of the server device 10 automatically updating the map data, an administrator may update the map data. For example, the administrator may update the map data based on point cloud data or images included in the detailed information. Alternatively, the administrator may know that there may be discrepancies in the map data for a particular surrounding sensor 31, program, or vehicle, based on information included in the detailed information, such as information indicating the model of the surrounding sensor 31, the version of the program for autonomous driving control, the version of the map data, or vehicle information.

[0063] Next, examples of processing performed by the server device 10 and the terminal device 20 will be explained using Figures 5(a) to 5(d). Figure 5(a) shows the processing performed by the server device 10. Figures 5(b) to 5(d) show the processing performed by the terminal device 20.

[0064] As shown in Figure 5(a), the control unit 11 of the server device 10 selects, for example, a vehicle 5-1 that meets predetermined conditions from among a plurality of vehicles 5, and sends an automatic driving status request to vehicle 5-1 (step S1).

[0065] The control unit 21 of the terminal device 20-1 mounted on vehicle 5-1 receives an automatic driving status request and executes the automatic driving status information transmission process shown in Figure 5(b). The control unit 21 acquires automatic driving status information about the location where vehicle 5-1 is currently traveling and transmits it to the server device 10 (step S11), thereby terminating the automatic driving status information transmission process.

[0066] When the control unit 11 of the server device 10 receives automatic driving status information from the vehicle 5-1 (step S2), it determines whether the automatic driving availability information included in the automatic driving status information indicates that automatic driving was not possible (step S3). If the control unit 11 determines that automatic driving was not possible (step S3: YES), it proceeds to step S4. On the other hand, if the control unit 11 determines that automatic driving was not impossible (step S3: NO), it terminates the information reception process.

[0067] In step S4, the control unit 11 identifies vehicle 5 as vehicle 5-2 based on the location information of vehicle 5 stored in the memory unit 12, and identifies vehicle 5 traveling in the same location as vehicle 5-1. The control unit 11 sends an impossibility request to vehicle 5-2.

[0068] The control unit 21 of the terminal device 20-2 mounted on vehicle 5-2 receives a request for impossible factors and executes the impossible factors information transmission process shown in Figure 5(c). The control unit 21 determines whether or not automatic driving is possible in the location where vehicle 5-2 is currently traveling, and generates impossible factors information based on the determination result. The control unit 21 transmits the impossible factors information to the server device 10 (step S12) and terminates the impossible factors information transmission process.

[0069] When the control unit 11 of the server device 10 receives information on factors making autonomous driving impossible from the vehicle 5-2 (step S5), it determines whether the information indicates that the factors making autonomous driving impossible are map factors (step S6). If the control unit 11 determines that the factors making autonomous driving impossible are map factors (step S6: YES), it proceeds to step S7. On the other hand, if the control unit 11 determines that the factors making autonomous driving impossible are not map factors (step S6: NO), it terminates the information reception process.

[0070] In step S7, the control unit 11 identifies vehicle 5 as vehicle 5-3 based on the location information of vehicle 5 stored in the memory unit 12, as it is traveling in the same location as vehicle 5-1. The control unit 11 then sends a detailed request to vehicle 5-3.

[0071] The control unit 21 of the terminal device 20-3 mounted on vehicle 5-3 receives a detailed request and executes the detailed information transmission process shown in Figure 5(d). The control unit 21 generates detailed information, including point cloud data output from the surrounding sensors 31, about the location where vehicle 5-3 is currently traveling. The control unit 21 transmits the detailed information to the server device 10 (step S13) and terminates the detailed information transmission process.

[0072] When the control unit 11 of the server device 10 receives detailed information from the vehicle 5-3 (step S8), it updates the map data stored in the storage unit 12 based on the detailed information (step S9) and terminates the information reception process.

[0073] As described above, according to the operation of the server device 10 in this embodiment, the server device 10 receives automatic driving status information from vehicle 5-1, which is capable of automatic driving based on the surrounding conditions of vehicle 5-1 and a map, and sends a detailed request to vehicle 5-3, which is capable of transmitting detailed information indicating the conditions of the location where vehicle 5-1 has moved. If the received automatic driving status information indicates that automatic driving was possible, the transmission of the detailed request is suppressed. Therefore, since the transmission of detailed information that is not necessary for updating the map data is suppressed, the server device 10 can efficiently acquire information about the surroundings of vehicle 5 for updating the map data while suppressing the communication load.

[0074] Furthermore, if the received automated driving status information indicates that automated driving was impossible, a request for the cause of impossibility is sent to a vehicle 5-2 capable of automated driving based on the surrounding conditions of vehicle 5-2 and the map. When the system receives the impossibility cause information from vehicle 5-2, and the received impossibility cause information indicates a difference between the conditions of the location where vehicle 5-1 moved and the map, a detailed request is sent. This further suppresses the transmission of detailed information that is unnecessary for updating the map data, thereby further reducing the communication load and enabling the server device 10 to efficiently acquire information about the surroundings of vehicle 5 for updating the map data.

[0075] Furthermore, the impossibility factor information includes location information indicating the location of a point where there is a difference of a predetermined value or more between the state of the location where vehicle 5-1 moved and the map. When a detailed request for detailed information indicating the state of the point at the location indicated by the location information is transmitted, the transmission of detailed information that is not necessary for updating the map data is further suppressed. This further reduces the communication load, allowing the server device 10 to efficiently acquire information about the area around vehicle 5 for updating the map data.

[0076] Furthermore, according to the operation of the terminal device 20 in this embodiment, it acquires autonomous driving status information indicating the status of autonomous driving of the vehicle 5 and transmits the acquired autonomous driving status information to the server device 10. Therefore, if the autonomous driving status information indicates that autonomous driving was possible, the transmission of detailed requests is suppressed, which allows the server device 10 to efficiently acquire information about the area around the vehicle 5 for updating the map data while suppressing the communication load.

[0077] Furthermore, when vehicle 5-1, which has transmitted autonomous driving status information to the server device 10 indicating that autonomous driving was not possible among the multiple vehicles 5, receives a detailed request from the server device 10 for detailed information indicating the state of the location it traveled to, and transmits detailed information indicating the state of the area around vehicle 5-3 at the location where vehicle 5-1 moved to the server device 10, the transmission of the detailed request is suppressed if the autonomous driving status information indicates that autonomous driving was possible. This suppresses the communication load and allows the server device 10 to efficiently acquire information about the area around vehicle 5 for updating the map data.

[0078] Furthermore, when vehicle 5-1, which has transmitted information indicating that autonomous driving was impossible among multiple vehicles 5 to the server device 10, receives a request from the server device 10 for information on the reasons why autonomous driving was impossible, and transmits the information on the reasons why autonomous driving was impossible to the server device 10 based on the determination result of whether autonomous driving is possible for vehicle 5-2 at the location where vehicle 5-1 has moved, if the information on the reasons why autonomous driving was impossible indicates that it is not a map-related factor, the transmission of a detailed request is suppressed. This further reduces the communication load, allowing the server device 10 to efficiently acquire information about the area around vehicle 5 for updating the map data.

[0079] Furthermore, if there is a difference between the attributes of a feature located at the site where vehicle 5-1 has moved and the attributes of that feature as defined in the map data, the system may transmit factor information with attribute difference information indicating that there is a difference in the attributes of that feature. For example, if the attribute difference information includes information about the attribute that has a difference, the system can determine what kind of information is needed as detailed information based on the attribute difference information, and the server device 10 can then send a detailed request to vehicle 5-3 that is capable of transmitting the necessary information.

[0080] Furthermore, in the data structure of the automated driving status information, if the automated driving status information includes location information indicating the position where vehicle 5-1 is moving, and automated driving capability information indicating whether or not automated driving was possible at that position, and the automated driving capability information is used by the server device 10 to control the transmission of impossibility request to vehicle 5-2, which is capable of transmitting impossibility factor information indicating factors that make automated driving impossible at the position indicated by the location information, then it becomes possible to send an impossibility request to vehicle 5-2 that is moving to the same location where vehicle 5-1 was unable to drive autonomously, and the transmission of impossibility request, which is unnecessary for determining whether to update the map data, is suppressed, so that the server device 10 can efficiently acquire information about the area around vehicle 5 for updating the map data while suppressing the communication load.

[0081] Furthermore, in the data structure of the impossibility factor information, if the impossibility factor information includes (i) reason information indicating the reason why autonomous driving is impossible, and (ii) location information indicating the location where there is a difference between the state of the surroundings of vehicle 5-2 acquired by sensors mounted on vehicle 5-2 and the state indicated by the map data used by vehicle 5-2 for autonomous driving, and if the reason information is used by the server device 10 to control the transmission of detailed requests to vehicle 5-3 that can transmit detailed information indicating the state of the location indicated by the location information, then if the reason why autonomous driving is impossible is a map factor, it becomes possible to send a detailed request to vehicle 5-3 that is moving to the same location that vehicle 5-2 has moved to, and the transmission of detailed information that is not necessary for updating the map data is suppressed, so that the server device 10 can efficiently acquire information about the surroundings of vehicle 5 for updating the map data while suppressing the communication load.

[0082] [Differentiation] If the server device 10 receives information from vehicle 5-1 indicating that autonomous driving was impossible, it may send a detailed request to vehicle 5-3. In this case as well, the server device 10 can efficiently acquire information about the area around vehicle 5 for updating the map data while suppressing the communication load. In this case, the server device 10 does not need to send a request for the reason why autonomous driving was impossible.

[0083] When the terminal device 20-1 mounted on vehicle 5-1 receives an automated driving status request from the server device 10, if it determines that automated driving is not possible, it may simultaneously send automated driving status information indicating that automated driving is not possible, and impossibility factor information indicating the reason why automated driving is not possible, to the server device 10. The server device 10, having received the automated driving status information and impossibility factor information, will send a detailed request to vehicle 5-3 only if the impossibility factor information indicates that the reason why automated driving is not possible is a map factor. In this case, the server device 10 does not need to send an impossibility factor request.

[0084] Among the multiple vehicles 5, there may be a vehicle 5 that can transmit only one or two types of information from among the automated driving status information, impossibility factor information, and detailed information. If there is a vehicle 5 that can transmit only detailed information, this vehicle 5 only needs to be equipped with surrounding sensors 31, and this vehicle 5 may be a vehicle that is not capable of automated driving. The storage unit 12 of the server device 10 may store, for example, information indicating the types of information that each vehicle 5 can transmit. The server device 10 sends a request for the required type of information to the vehicle 5 that can transmit that information. [Explanation of symbols]

[0085] 1 Server device 1a Status receiving unit 1b Request part 10 Server devices 11 Control Unit 12 Storage section 13 Communications Department 20 Terminal devices 21 Control Unit 22 Memory section 23 Communications Department 24 Interface section 31 Peripheral Sensors

Claims

1. A situation receiving unit that receives situation information indicating the status of the autonomous driving from the first mobile body, which is capable of autonomous driving based on the surrounding conditions of the first mobile body and a map, A request unit that transmits a request for status information to a second mobile body capable of transmitting status information indicating the state of the location to which the first mobile body has moved, Equipped with, The server device is characterized in that the request unit suppresses the transmission of the request when the received status information indicates that automatic operation was possible.

2. If the received status information indicates that autonomous driving was impossible, a factor request unit transmits a request for factor information indicating the reason why autonomous driving was impossible to a third mobile body capable of autonomous driving, based on the surrounding conditions of the third mobile body and a map. A factor receiving unit that receives the factor information from the third mobile body, Furthermore, The server device according to claim 1, wherein the request unit transmits a request for state information when the received factor information indicates a difference between the state of the location to which the first moving object moved and the map.

3. The status receiving unit receives the status information and factor information indicating the factors that made automatic driving impossible in cases where automatic driving was impossible. The server device according to claim 1, wherein the request unit transmits a request for state information when the factor information indicates that the factor is a difference between the state of the location where the first moving object moved and the map.

4. The factor information includes location information indicating a point among the locations where the first moving object moved that has a difference of a predetermined standard or more between the state of the location where the first moving object moved and the map. The server device according to claim 2 or 3, characterized in that the request unit transmits a request for location status information indicating the status of the location indicated by the location information.

5. A terminal device mounted on one mobile body included in a plurality of mobile bodies that can communicate with the server device described in claim 2 and is capable of automatic driving based on the surrounding conditions of the mobile body and a map, A factor request receiving unit receives a request from the server device for factor information indicating the reason why an object among the plurality of objects that was unable to be driven automatically transmitted status information to the server device indicating that it was unable to be driven automatically, When a request for the aforementioned factor information is received, a factor transmission unit transmits the factor information to the server device based on the determination result of whether or not automatic operation of the one mobile body is possible at the location where the mobile body that transmitted the situation information indicating that automatic operation was impossible to the server device has moved, A terminal device characterized by being equipped with the following features.

6. An acquisition unit that acquires status information indicating the status of the automatic driving of the aforementioned mobile body, A status transmission unit that transmits the acquired status information to the server device, The terminal device according to claim 5, further comprising the following:

7. The terminal device according to claim 5 or 6, wherein the factor transmission unit transmits the factor information to which difference information indicating a difference in the attributes of the feature is added, if there is a difference between the attributes of the feature present at the location where the first moving body has moved and the attributes of the feature shown on the map.

8. The terminal device according to claim 7, characterized in that the difference information includes information about the attribute that has a difference.

9. A peripheral request receiving unit receives a request from the server device for status information indicating the state of the location to which one of the aforementioned multiple mobile bodies has moved, which has transmitted status information to the server device indicating that it is in a state where automatic operation is not possible. When a request for the aforementioned status information is received, the peripheral transmission unit transmits to the server device the status information indicating the state of the surroundings of the one mobile body at the location where the mobile body that transmitted the status information indicating that automatic operation is impossible has moved, The terminal device according to any one of claims 5 to 8, further comprising the following:

10. A situation receiving unit that receives situation information indicating the status of the autonomous driving from the first mobile body, which is capable of autonomous driving based on the surrounding conditions of the first mobile body and a map, A request unit that transmits a request for status information to a second mobile body capable of transmitting status information indicating the state of the location to which the first mobile body has moved, A state receiving unit that receives the state information from the second mobile body, A server device equipped with, An acquisition unit that acquires status information indicating the status of the automatic operation of the first mobile body, A status transmission unit that transmits the acquired status information to the server device, A first terminal device equipped with, A receiving unit that receives the request from the server device, When the aforementioned request is received, the peripheral transmission unit transmits the status information indicating the state of the area around the second mobile object at the location where the first mobile object has moved to the server device, A second terminal device equipped with, Includes, The communication system is characterized in that the request unit suppresses the transmission of the request if the received status information indicates that automatic operation was possible.

11. In a computer-based method of receiving information, A status receiving step of receiving status information indicating the status of the autonomous driving from the first mobile body, which is capable of autonomous driving based on the surrounding conditions of the first mobile body and a map, A request step of sending a request for said state information to a second mobile body that is capable of transmitting state information indicating the state of the location to which the first mobile body has moved, Includes, The request step is characterized by suppressing the transmission of the request if the received status information indicates that automatic operation was possible.

12. An information transmission method performed by a computer of a terminal device mounted on one of a plurality of mobile bodies, which are capable of automatic driving based on the surrounding conditions and a map, and which are capable of communicating with the server device described in claim 2, A factor request receiving step, in which the server device receives a request from the server device for factor information indicating the reason why the automatic operation of one of the multiple mobile bodies that transmitted the status information indicating that automatic operation was not possible to the mobile body, When a request for the aforementioned factor information is received, the factor transmission step involves transmitting the factor information to the server device based on the determination result of whether or not automatic operation of the one mobile body is possible at the location where the mobile body that transmitted the situation information indicating that automatic operation was impossible to the server device has moved, A method for transmitting information, characterized by including the following:

13. An information receiving program characterized by causing a computer to function as a server device according to any one of claims 1 to 4.

14. An information transmission program characterized by causing a computer to function as a terminal device according to any one of claims 5 to 9.

15. A recording medium characterized by having the information receiving program described in claim 13 recorded in a computer-readable format.

16. A recording medium characterized by having the information transmission program described in claim 14 recorded in a computer-readable format.

Images