Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device, an information processing method, and an information processing program capable of efficiently acquiring information useful for a driver or an automatic driving system.SOLUTION: An information processing device (1), an information processing method, and an information processing program set a predetermined area to be prioritized among areas in which an object cannot be detected as a priority area based on a detection result obtained by detecting an object on a road, transmit request data for requesting object information included in the priority area to a request destination vehicle, and receive the object information in the priority area from the request destination vehicle.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to information processing technology, and more particularly to a technology for setting an area in which sensing is performed in a vehicle and distributing object information in the area. [Background technology]

[0002] Patent Document 1 discloses a method of requesting information on a blind spot range that is a blind spot for the vehicle from another vehicle and receiving image information corresponding to the blind spot range from the other vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-299676 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, because information on blind spots is randomly requested from other vehicles and image information corresponding to the blind spots is indiscriminately received, it is not possible to determine whether the blind spot information is useful to the driver of the vehicle or the autonomous driving system until all image information has been received.

[0005] The present invention has been made in consideration of the above circumstances, and has an object to efficiently obtain information that is useful to the driver and the automated driving system. [Means for solving the problem]

[0006] In order to solve the above problems, an information processing device, an information processing method, and an information processing program according to the present invention are Priority Area Of Temporary shielding area Data for non-detection areas excluding Other vehicles Or send it to the server. Effect of the Invention

[0007] According to the present invention, information that is useful to the driver and the automated driving system can be efficiently obtained. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing the configuration of a vehicle X according to the first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a hardware configuration of each component shown in FIG. [Diagram 3] FIG. 3 is a flowchart showing the processing procedure of the information processing method. [Figure 4] FIG. 4 is a supplementary diagram for explaining the process shown in FIG. [Diagram 5] FIG. 5 is a sequence diagram showing the process of transmitting and receiving information. [Figure 6] FIG. 6 is a diagram showing the configuration of vehicles A and B according to the second embodiment. [Figure 7A] FIG. 7A is a flowchart showing the processing procedure of the information processing method. [Figure 7B] FIG. 7B is a flowchart showing the processing procedure of the information processing method. [Figure 8] FIG. 8 is a supplementary diagram for explaining the processing shown in FIG. 7A and FIG. 7B. [Figure 9] FIG. 9 is a supplementary diagram for explaining the area setting method (variation 1). [Figure 10] FIG. 10 is a supplementary diagram for explaining the area setting method (variation 2). [Figure 11] FIG. 11 is a supplementary diagram for explaining the area setting method (variation 3). [Figure 12] FIG. 12 is a supplementary diagram for explaining the area setting method (variation 4). [Figure 13] FIG. 13 is a diagram showing the configuration of vehicles A, B, and D according to the third embodiment. [Figure 14] FIG. 14 is a flowchart showing the procedure of the information processing method. [Figure 15]FIG. 15 is a supplementary diagram for explaining the process shown in FIG. [Figure 16] FIG. 16 is a supplementary diagram for explaining the process shown in FIG. [Figure 17] FIG. 17 is a supplementary diagram for explaining the process shown in FIG. [Figure 18] FIG. 18 is a supplementary diagram for explaining the process shown in FIG. [Figure 19] FIG. 19 is a supplementary diagram for explaining the process shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] (overview) First, a vehicle traveling on a road executes an object detection process and sets a predetermined blind spot area among the blind spots where an object cannot be detected as a priority area. For example, the vehicle sets the lanes and roads on the planned driving route that are blocked by a preceding vehicle and the lanes that intersect with the planned driving route as priority areas. After that, the vehicle transmits request data to nearby vehicles using existing V2X (Vehicle to Everything) communication to request object information included in the two priority areas.

[0010] If there is another vehicle capable of V2X communication in the priority area, the other vehicle, after receiving the request data, detects objects included in the priority area among all areas in which the vehicle can detect objects. In addition, if the other vehicle is outside the priority area and there is a possibility that the vehicle that issued the request may change its planned driving route in the near future due to a parked vehicle or the like, the other vehicle increases the priority of non-priority areas related to the changed route among all areas, and sets them as further priority areas (extended areas), and also detects objects included in the further priority areas by priority. For example, in addition to the driving lane corresponding to the priority area to be requested, the other vehicle adds adjacent lanes adjacent to the driving lane as further priority areas.

[0011] Then, in order to preferentially transmit object information detected in the requested priority area and the added further priority area (extended area), the other vehicle transmits to the requesting vehicle distribution order information in which the lane link IDs corresponding to the priority areas are set as first and second, and lane link IDs corresponding to non-priority areas other than the priority areas are set as third or later.The other vehicle then transmits the object information of each priority area and non-priority area to the requesting vehicle in the distribution order of the distribution order information.

[0012] This enables useful information to be obtained efficiently for drivers and autonomous driving systems.

[0013] (First embodiment) A first embodiment to which the present invention is applied will be described.

[0014] (Configuration of vehicle and information processing device) 1 is a diagram showing the configuration of a vehicle X according to the first embodiment. The vehicle X is mainly configured to include a sensor 101, a position measurement unit 102, a first viewpoint object detection unit 103, a second viewpoint object detection unit 104, an object information collection unit 105, an area setting unit 106, an object selection unit 107, and an object communication unit 116.

[0015] As shown in FIG. 1, the information processing device 1 mainly comprises a first viewpoint object detection unit 103, a second viewpoint object detection unit 104, an object information collection unit 105, an area setting unit 106, an object selection unit 107, and an object communication unit 116.

[0016] The sensor 101 is mounted inside, outside, on the top, side, etc. of the vehicle X, and has a function of measuring the distance to an object present around the vehicle X, the direction of the object, etc. The sensor 101 also has a function of outputting the measured distance, direction, etc. of the object in association with the current time transmitted from the position measurement unit 102.

[0017] For example, the sensor 101 is a laser range finder or a visible light camera. The laser range finder irradiates near-infrared light to an object located around the road about 150 m ahead within a 360-degree azimuth range, and measures the strength of the response wave, the distance to the object, and the direction of the object based on the response time until the response wave is received. The laser range finder outputs raw data (strength, distance, direction) in a point cloud format that summarizes 180 degrees of azimuth with a unit point of 0.25 degrees azimuth. The visible light camera captures the surroundings of the road and outputs image data. The laser range finder is characterized by high position measurement accuracy, and the visible light camera is characterized by being able to recognize shapes, characters, colors, etc. on the road in addition to the position of the object by combining it with recognition processing such as machine learning.

[0018] The position measurement unit 102 has a function of measuring the current position of the vehicle X and outputting the measured position in association with the current time. For example, the position measurement unit 102 is a position measurement device or a three-dimensional position measurement system.

[0019] The first viewpoint object detection unit 103 has a function of calculating the relative position of an object as seen from the vehicle X using measurement data (distance, direction, etc. of the object) measured by the sensor 101 at the first viewpoint of the vehicle X, and calculating the absolute position of the object on a map using measurement data (position information of the vehicle X) measured by the position measurement unit 102. The coordinate system of the absolute position is expressed by a distance from a predetermined reference point located at an intersection or the like on a high-precision map, such as the World Geodetic System.

[0020] As a result, the first viewpoint object detection unit 103 detects objects that exist on the road at the current time. Then, the first viewpoint object detection unit 103 outputs the object detection result to the object information collection unit 105 and the area setting unit 106. Note that if the sensor 101 has also measured the type, speed, etc. of the object, the first viewpoint object detection unit 103 also outputs that information.

[0021] The second viewpoint object detection unit 104 detects objects present on the road at the current time from the second viewpoint of vehicle X, similar to the first viewpoint object detection unit 103, and outputs the object detection result to the object information collection unit 105 and the object selection unit 107. At this time, since the second viewpoint object detection unit 104 uses a viewpoint different from the first viewpoint, it uses, for example, measurement data measured by a sensor at a position different from sensor 101, measurement data measured by a sensor in a sensor main axis direction different from sensor 101, or measurement data measured at different measurement times when the same sensor 101 is used.

[0022] The object information collection unit 105 has a function of collecting and storing the detection results of objects detected by the first viewpoint object detection unit 103 and the second viewpoint object detection unit 104 in association with the detection time.

[0023] The object communication unit 116 has a function of transmitting and receiving data to and from vehicles and various servers via a predetermined communication network. For example, the object communication unit 116 transmits detection results of objects stored in the object information collection unit 105 to other vehicles and various servers. In addition, the object communication unit 116 receives detection results of objects transmitted from other vehicles and various servers and transmits them to the object information collection unit 105.

[0024] The predetermined communication network is, for example, a communication network based on a Dedicated Short Range Communications (DSRC) system conforming to IEEE (Institute of Electrical and Electronics Engineers) 802.11p, or a wireless communication network based on a Long Term Evolution (LTE) cellular V2X system conforming to 3GPP (Release 14). The communication network is not limited to a specific system, and an existing communication network or any communication network available in the future (for example, a next-generation mobile communication network such as 5G) may be used. In addition, the communication network may be a plurality of communication networks in which different types of communication networks are connected, or may be wireless or wired.

[0025] The area setting unit 106 has a function of setting a predetermined area in order to compensate for an area that cannot be detected within the sensor viewing angle of the sensor 101 in the first viewpoint object detection unit 103 with other viewpoint information. Specifically, the area setting unit 106 has a function of setting a predetermined area among areas in which an object cannot be detected as a priority area based on the object detection result in the first viewpoint object detection unit 103.

[0026] For example, the area setting unit 106 sets, as a priority area, a blind spot area that is useful for the driver of the vehicle X or the automatic driving system, among a plurality of blind spot areas blocked by an object in front of the vehicle X. The priority area is, for example, a driving area ahead and an intersection area ahead that are blocked by a preceding vehicle. On the other hand, a rear area blocked by a rear vehicle is not set as a priority area.

[0027] The object selection unit 107 has a function of selecting objects in an area that has become newly detectable from the second viewpoint using the object detection results of the second viewpoint object detection unit 104 for the priority area set by the area setting unit 106, and outputting the selected object information to the object information collection unit 105 with priority.

[0028] Object information is data detected as a result of performing object detection processing in a specified area, and is the following data regarding pre-set objects (e.g., people, vehicles (standard cars, large vehicles, motorcycles, etc.), bicycles, road structures, road obstacles, etc.) and objects that are a specified size or larger:

[0029] For example, object information is data indicating the geographical position of a detected object, such as a position specified by latitude and longitude, a position specified by predetermined parameters (nodes, links, etc.) present on a road map, or a relative position from a sensor that detected the object.

[0030] Moreover, the object information is data indicating the type of the detected object. For example, the type information is information on a person, a vehicle (a regular car, a large vehicle, a two-wheeled vehicle, etc.), a bicycle, a road structure, an obstacle on the road, etc. Moreover, the object information is data indicating the size of the detected object (length, width, height, etc.). Moreover, the object information is still image data, video data, or point cloud data including the detected object. Furthermore, the object information may include the speed of the detected object, the detection time, the observation time, etc.

[0031] In addition, the information processing device 1 further includes a monitoring sensor (not shown) for monitoring the sides of the road, a road boundary detection means (not shown), and a stationary object area estimation means (not shown). The stationary object area estimation means has a function of detecting road boundary lines or background objects, detecting objects on the road, determining an intersection between the detected object and a parting line based on the "detection result of the road boundary line or background object" and the "detection result of the object on the road", and detecting a vehicle or an obstacle by estimating and calculating a stationary object area.

[0032] When a vehicle or an obstacle is detected, the information processing device 1 displays the stationary object area as area information to the driving assistance system or the automatic driving system of the vehicle X, and notifies the presence of the stationary object by voice. The area information is, for example, GNSS (Global Navigation Satellite System) latitude and longitude coordinates and connection information, section information based on lane ID and road distance of a high-precision map, lane link ID and coordinate information, etc.

[0033] (Hardware configuration of vehicle and information processing device) Fig. 2 is a diagram showing the hardware configuration of each component shown in Fig. 1. Each component is composed of, for example, a sensor device H101, a position measurement device H102, a communication device H103, and a processing device H104.

[0034] The sensor device H101 is the sensor 101 shown in FIG. 1, and is composed of a front sensor H101a, a rear sensor H101b, a right sensor H101c, and a left sensor H101d.

[0035] The forward sensor H101a is equipped with a 4K resolution camera and lens with a 90 degree angle of view to capture a visible image ahead of the vehicle X. The forward sensor H101a is installed with the center of the camera facing the traveling direction of the vehicle X, and outputs image data according to the detection result of the road boundary line by a road boundary line detection means (not shown).

[0036] The rear sensor H101b is equipped with the same camera and lens as the front sensor H101a. The rear sensor H101b is installed with the center of the camera facing 180 degrees rearward from the traveling direction of the vehicle X, and outputs image data captured at the timing closest to the imaging timing of the front sensor H101a according to the detection result of the road boundary line by the road boundary line detection means (not shown).

[0037] The right side sensor H101c is equipped with a 4K resolution camera and lens with a viewing angle of 180 degrees to capture visible images of the right side of the vehicle X. The right side sensor H101c is installed with the center of the camera facing 90 degrees to the right of the traveling direction of the vehicle X, and outputs image data captured at the timing closest to the imaging timing of the front sensor H101a according to the output of a road boundary detection means (not shown).

[0038] The left sensor H101d is equipped with the same camera and lens as the right sensor H101c. The left sensor H101d is installed with the center of the camera facing 90 degrees leftward with respect to the traveling direction of the vehicle X, and outputs image data captured at the timing closest to the imaging timing of the front sensor H101a according to the output of a road boundary detection means (not shown).

[0039] The position measurement device H102 is the position measurement unit 102 shown in FIG. 1, and is mounted inside the vehicle X. The position measurement device H102 receives a GNSS signal from another device and calculates the position and traveling direction of the vehicle X at the current time.

[0040] The communication device H103 is composed of a first communication device H103a, a second communication device H103b, and a third communication device H103c. The first communication device H103a and the second communication device H103b are used when the sensor 101 and the position measurement unit 102 shown in FIG. 1 are mounted on the vehicle X, and the information processing device 1 is mounted on a device other than the vehicle X. The third communication device H103c is used when the information processing device 1 communicates with other vehicles and various servers. The second communication device H103b and the third communication device H103c may be composed of one wireless communication circuit.

[0041] The first communication device H103a controls communication of data transmitted and received between the sensor 101 and the position measurement unit 102 and the information processing device 1. Specifically, the first communication device H103a distributes the current time of the position measurement device H102 to the sensor device H101, and transmits and receives data between the first arithmetic processing device H104a, the second arithmetic processing device H104b, and the third arithmetic processing device H104c via the second communication device H103b.

[0042] The second communication device H103b controls communication of data transmitted and received by the information processing device 1 between the sensor 101 and the position measurement unit 102. Specifically, the second communication device H103b transmits and receives data between the sensor 101 and the position measurement unit 102 via the first communication device H103a.

[0043] The third communication device H103c controls communication of data transmitted and received between the information processing device 1 and other vehicles and various servers. Specifically, the third communication device H103c includes an object communication unit 116, and transmits and receives data between the information processing device 1 and other vehicles and various servers via a predetermined communication network.

[0044] The arithmetic processing device H104 is made up of a first arithmetic processing device H104a, a second arithmetic processing device H104b, and a third arithmetic processing device H104c.

[0045] The first arithmetic processing device H104a executes each process of the first viewpoint object detection unit 103 and the area setting unit 106 based on the data output from the sensor device H101 and the position measurement device H102. In addition, the first arithmetic processing device H104a transmits the object detection result of the first viewpoint object detection unit 103 to the third arithmetic processing device H104c, and transmits area setting information of the area setting unit 106 to the second arithmetic processing device H104b.

[0046] The second arithmetic processing device H104b executes each process of the second viewpoint object detection unit 104 and the object selection unit 107 based on the data output from the sensor device H101, the position measurement device H102, and the first arithmetic processing device 104a. In addition, the second arithmetic processing device H104b transmits the object detection result of the second viewpoint object detection unit 104 and the object information of the object selection unit 107 to the third arithmetic processing device H104c.

[0047] The third processing device H104c executes the processing of the object information collection unit 105 based on the data output from the first processing device H104a and the second processing device H104b. The third processing device H104c also transmits the data collected by the object information collection unit 105 to other vehicles and various servers through the third communication device H103c having the object communication unit 116. The third processing device H104c also receives object detection results and the like transmitted from other vehicles and various servers to the object communication unit 116 of the third communication device H103c, and outputs them to the object information collection unit 105.

[0048] The arithmetic processing device H104 can be realized by a computer equipped with a CPU, a memory, a hard disk, an input / output interface, etc. The arithmetic processing device H104 can be mounted on a vehicle, a mobile phone terminal, a mobile edge computer on a mobile communication network, a road traffic facility server installed on the roadside, a cloud server on the Internet, etc.

[0049] (Information processing method) Next, a description will be given of an information processing method performed by the information processing device 1. Fig. 3 is a flowchart showing the processing procedure of the information processing method.

[0050] First, the prerequisites will be described with reference to Fig. 4. Vehicle X is approaching at a speed of 20 km / h with an obstruction O1 in front of it from the first viewpoint shown in the upper part of Fig. 4. The obstruction O1 is stationary and occupies part of the road on which vehicle X is traveling.

[0051] Step S101; First, the first viewpoint object detection unit 103 performs object detection at the first viewpoint shown in the upper part of Fig. 4. After that, the first viewpoint object detection unit 103 stores the object detection result in the object information collection unit 105 and transmits it to the area setting unit 106. At the first viewpoint, an obstruction O1 is detected as an object.

[0052] Step S102; Next, the area setting unit 106 sets a predetermined blind spot area among the blind spot areas where an object cannot be detected due to the obstruction O1 as a priority area, and transmits the priority area to the object selection unit 107. Here, the area setting unit 106 sets an area where object information of a predetermined area cannot be obtained by the sensor of the vehicle due to the presence of an obstruction or the like as a priority area. For example, as shown in the upper part of Fig. 4, the area setting unit 106 obtains an intersection between the obstruction O1 and the parting lines L1, L2, and sets an area S1 that is behind the obstruction O1 and is on the obstruction O1 side of the parting lines L1, L2 as the priority area S1.

[0053] Step S103; Next, the second viewpoint object detection unit 104 performs object detection at the second viewpoint shown in the lower part of Fig. 4 to which the vehicle X has moved. After that, the second viewpoint object detection unit 104 transmits the object detection result to the object information collection unit 105, and then transmits it to the object selection unit 107. At the second viewpoint, a triangular cone O2 is detected as an object.

[0054] Step S104; Finally, the object selection unit 107 determines an area S2 within a range overlooking a road surrounded by the parting line L1 adjacent to the obstructing object O1 and the right lane as a temporarily obstructed area S2 that has become newly detectable and that was temporarily obstructed from the first viewpoint and is to be preferentially transmitted. Then, the object selection unit 107 selects a triangular cone O2 in the temporarily obstructed area S2 that has become newly detectable from the second viewpoint from the priority area S1 where an object could not be detected from the first viewpoint, and transmits the triangular cone O2 preferentially to the object information collection unit 105. For example, the object selection unit 107 transmits the object information of the triangular cone O2 first, and then transmits the object information of the obstructing object O1.

[0055] Furthermore, the object selection unit 107 transmits the object information of the triangular cone O2, and also transmits information indicating a temporarily obstructed area S2 in which an object could not be detected from the first viewpoint but can now be detected from the second viewpoint to the object information collection unit 105. That is, the object selection unit 107 transmits area information of the temporarily obstructed area S2 in addition to the object information contained in the temporarily obstructed area S2. For example, the object selection unit 107 transmits information indicating the geographical position of the temporarily obstructed area S2 and information indicating the geographical position of the second viewpoint in which it has become possible to detect the temporarily obstructed area S2.

[0056] Furthermore, the object information of the triangular cone O2 is object information (temporarily occluded object information) that cannot be detected at the first position of the first viewpoint due to the presence of an obstruction O1 in front, and can only be detected at the second viewpoint, which is closer to the triangular cone O2 object than the first viewpoint.

[0057] (Variation 1 of step S104) After the object selection unit 107 transmits the temporarily occluded object information to the object information collection unit 105 of the vehicle X, the object information collection unit 105 can also preferentially transmit the temporarily occluded object information from the vehicle X to other vehicles or various servers via the object communication unit 116.

[0058] As a result, even if another vehicle is not approaching the traffic cone O2, it is possible to detect the object of the temporarily occluding object information in advance based on the temporarily occluding object information transmitted from the vehicle X.

[0059] (Variation 2 of step S104) Furthermore, the object information collection unit 105 may transmit the temporarily blocked object information to other vehicles and various servers, and may also transmit information (area information) indicating the temporarily blocked area S2 to other vehicles and various servers. As described above, the information indicating the temporarily blocked area S2 is information regarding an area in which an object could not be detected from a first viewpoint, but in which an object can now be detected from a second viewpoint different from the first viewpoint. For example, the object information collection unit 105 transmits information indicating the geographical position or range of the temporarily blocked area S2, and information indicating the geographical position of the vehicle X from the second viewpoint in which the temporarily blocked area S2 can now be detected.

[0060] In this way, by transmitting information indicating the temporarily blocked area S2 from vehicle X to the other vehicle, the other vehicle can store and recognize that the temporarily blocked area S2 is an area in which an object can be detected by the sensor of the vehicle while traveling. By receiving the information indicating the temporarily blocked area S2, the other vehicle can determine that although an object cannot be detected by the sensor at the first viewpoint, an object can be detected in the temporarily blocked area S2 at the second viewpoint after passing the first viewpoint. Therefore, for example, the other vehicle can plan in advance a driving plan that performs vehicle control on the premise that an object will be detected by the sensor of the vehicle at the second viewpoint.

[0061] (Variation 3 of step S104) Furthermore, the object information collecting unit 105 may transmit information (non-detection area information) indicating an area (non-detection area) where an object cannot be detected from the first viewpoint and furthermore cannot be detected from the second viewpoint, from the vehicle X to other vehicles or various servers via the object communication unit 116. The information indicating the non-detection area is, for example, information indicating the geographical position or range of an area of ​​the priority area S1 that does not include the temporarily blocked area S2, and information indicating the geographical position of the second viewpoint.

[0062] In this way, by transmitting the non-detection area where an object cannot be detected even from the second viewpoint from vehicle X to other vehicles and various servers, the other vehicles can store and recognize the non-detection area as a caution area where an object cannot be detected by the sensor of the vehicle even when traveling on a road. Therefore, the other vehicles can reflect the non-detection area in the control of the vehicle's traveling, for example, by reducing the speed when traveling on the road.

[0063] After step S104, in the vehicle X, the object information stored in the object information collection unit 105 is used as an information source for generating a driving route for avoiding the area where the object is present.

[0064] In addition, in vehicle X, the object information stored in the object information collection unit 105 is transmitted to other vehicles and various servers via the object communication unit 116, and is used in the other vehicles and various servers. The object information transmitted to other vehicles and various servers is exemplified in Table 1 described later.

[0065] (Information transmission and reception processing sequence) Next, the process of transmitting and receiving information between the functional units will be described with reference to FIG 5. FIG 5 is a sequence diagram showing the procedure of the process of transmitting and receiving information performed by the information processing device 1.

[0066] Time t0; First, in the sensor 101, a visible light camera captures images of the surroundings of the vehicle X, and a laser range finder measures the distance, direction, etc. of objects present around the vehicle X. After that, the sensor 101 delivers the captured image data and measurement data to a first viewpoint object detection unit 103. At the same time, a position measurement unit 102 measures the current position of the vehicle X, and delivers this together with the current time to the first viewpoint object detection unit 103.

[0067] Time t1; Next, the first viewpoint object detection unit 103 detects objects by calculating the positions of objects on or in the vicinity of the road in the first viewpoint, and delivers the object detection results to the area setting unit 106 and the object information collection unit 105.

[0068] Time t2; Next, the area setting unit 106 sets, as a priority area S1, a blind spot area that is useful for the driver of the vehicle X and the autonomous driving system, among a plurality of blind spot areas that cannot be detected within the sensor viewing angle range of the sensor 101 due to an object present in front of the vehicle X. Thereafter, the area setting unit 106 delivers area specification information of the priority area S1 to the object selection unit 107.

[0069] Time t3; Next, the object selection unit 107 receives the area specifying information of the priority area S1.

[0070] Time t4; Next, in the sensor 101, the visible light camera captures images of the surroundings of the vehicle X, and the laser range finder measures the distance, direction, etc. of objects present around the vehicle X. After that, the sensor 101 delivers the captured image data and measurement data to the second viewpoint object detection unit 104. At the same time, the position measurement unit 102 measures the current position of the vehicle X, and delivers this together with the current time to the second viewpoint object detection unit 104.

[0071] Time t5; Next, the second viewpoint object detection unit 104 detects an object by calculating the position of the object on the road in the second viewpoint, and delivers the object detection result to the object selection unit 107 and the object information collection unit 105.

[0072] Time t6; Next, the object selection unit 107 uses the area identification information of the priority area S1 and the object information of the second viewpoint to preferentially deliver to the object information collection unit 105 the temporarily occluded object information contained in the temporarily occluded area S2, which is an area that has newly become detectable from the second viewpoint and which was temporarily occluded from the first viewpoint.

[0073] Time t7; Finally, the object information collector 105 integrates the object information received from the object selector 107 with the existing object information.

[0074] (Effects of the first embodiment) According to this embodiment, in the information processing device 1, the first viewpoint object detection unit 103 performs object detection at the first viewpoint, and the area setting unit 106 sets a predetermined blind spot area among the blind spot areas where an object cannot be detected as a priority area S1 based on the object detection result.

[0075] Further, a second viewpoint object detection unit 104 detects an object at the second viewpoint, and an object selection unit 107 selects an object from a temporary obstruction area S2 that has become newly detectable at the second viewpoint among the priority area S1 where an object could not be detected at the first viewpoint.

[0076] This allows the driver of vehicle X and the autonomous driving system to know in advance the possibility of the object's presence and plan a driving route that avoids stationary objects on the road in good time. As a result, the driver and the autonomous driving system can efficiently obtain useful information.

[0077] Second embodiment A second embodiment to which the present invention is applied will be described.

[0078] (Configuration of vehicle and information processing device) Fig. 6 is a diagram showing the configurations of vehicles A and B according to the second embodiment. Vehicle A may further include the configuration of vehicle B, and vehicle B may further include the configuration of vehicle A. In other words, both vehicle A and vehicle B may be configured to include all the functional units shown in Fig. 6 in a single vehicle.

[0079] (Vehicle A Configuration) Vehicle A is equipped with a sensor 101A, a position measurement unit 102A, a second viewpoint object detection unit 104A, an object selection unit 107A, a map information storage unit 111A, an object selection area correction unit 112A, and a communication unit 113A. Vehicle A may further be equipped with all the functional units equipped in vehicle B.

[0080] The sensor 101A has a function of measuring the distance, direction, etc. to objects present around the vehicle A.

[0081] The position measurement unit 102A has a function of measuring the current position of the vehicle A.

[0082] The second viewpoint object detection unit 104A has a function of detecting objects existing on a road from the viewpoint of the vehicle A, using the measurement data of the sensor 101A and the measurement data of the position measurement unit 102A. For example, the second viewpoint object detection unit 104A detects position information of vehicles, obstacles, etc. existing in a 360-degree azimuth area of ​​the vehicle A.

[0083] The object selection unit 107A has a function of selecting an object in the priority area detected from the viewpoint of vehicle A using the object detection result of the second viewpoint object detection unit 104A for the priority area set by the area setting unit 106B of vehicle B described later, and outputting the selected object information to the communication unit 113A with priority.

[0084] In addition, when the priority area set by vehicle B is expanded (added) by the object selection area correction unit 112A, the object selection unit 107A also has a function of selecting objects in the expanded priority area (expanded area) and outputting the selected object information to the communication unit 113A with the same priority as the priority area set by the area setting unit 106B of vehicle B.

[0085] Furthermore, object selection unit 107A has a function of selecting objects from non-priority areas other than the priority areas (including the extended area) among all detected areas, and outputting the selected object information to communication unit 113A with the next priority.

[0086] The map information storage unit 111A has a function of storing map information including road information, lane information, traffic light information, building information, etc., and outputting map information of the surrounding area where the vehicle A is located to the object selection area correction unit 112A.

[0087] The object selection area correction unit 112A has a function of determining the need for a lane change due to the influence of an object detected by the second viewpoint object detection unit 104A (e.g., a lane closure, etc.) based on the lane information of the map output from the map information memory unit 111A, the object detection result of the second viewpoint object detection unit 104A, and the position information of vehicle A.

[0088] The function for determining the need to change lanes is a function that detects the presence of stationary objects, such as road obstacles or stopped vehicles, in the planned lane ahead of the vehicle, and if a stationary object is detected, determines whether it is possible to travel in the adjacent lane, and if it is possible, determines that a lane change is necessary.

[0089] In addition, the object selection area correction unit 112A has a function of expanding (adding) the priority area set by vehicle B based on road boundary line information detected by a road boundary line detection means (not shown) when vehicle A needs to change lanes, etc.

[0090] For example, the object selection area correction unit 112A expands the priority area set by vehicle B to the entire road width including the driving lane of vehicle A (= the priority area) and the adjacent lane of the driving lane (= the expanded area added to the priority area). When the oncoming lane is to be the expanded area, the object selection area correction unit 112A adds an area 15 seconds away in the direction of travel of vehicle A. Furthermore, when lane information is not listed in the map information storage unit 111A, the object selection area correction unit 112A corrects (expands) the priority area so that it is inside the road boundary line on the road. For example, white lines on the road, boundary lines between curbs and roads, boundary lines between road structures such as roadside trees and shrubs and the road, boundary lines between buildings and roads, vehicles, etc. are used as road boundary lines.

[0091] The communication unit 113A has a function of receiving request data from vehicle B for requesting object information included in the priority area set by vehicle B. The request data transmitted from vehicle B to vehicle A includes, for example, data for identifying the requesting vehicle (such as the identification code of vehicle B), a flag indicating the priority of the object information request (such as a flag indicating high priority), a search area for detecting the object (such as data indicating the geographical range of the priority area), and a validity period for requesting the object information (such as the validity period of the transmission date and time of the object information). The data indicating the geographical range may be data expressed by latitude and longitude, or may be expressed by data indicating nodes and links included in a road map.

[0092] The communication unit 113A also has a function of preferentially transmitting object information of a priority area set by vehicle B to vehicle B. The communication unit 113A also has a function of transmitting object information of the expanded priority area that can be detected in the future with the same priority when the priority area is expanded by the object selection area correction unit 112A. Furthermore, the communication unit 113A has a function of transmitting object information of non-priority areas with the next priority to vehicle B. As described in the first embodiment, the object information is position information of vehicles, obstacles, etc. existing on the road.

[0093] For example, in order to preferentially transmit object information detected in the requested priority area and the expanded priority area, the communication unit 113A transmits in advance to the requesting vehicle distribution order information in which the lane link IDs corresponding to the priority areas are set as first and second, and the lane link IDs corresponding to non-priority areas other than the priority area are set as third or later. After that, the communication unit 113A transmits the object information of each priority area and each non-priority area to vehicle B in the distribution order of the distribution order information.

[0094] As described in the first embodiment, the communication unit 113A transmits and receives data by direct communication between vehicles based on, for example, a Dedicated Short Range Communications (DSRC) system conforming to the Institute of Electrical and Electronics Engineers (IEEE) 802.11p or a Long Term Evolution (LTE) cellular V2X system conforming to 3GPP (Release 14). The same applies to the communication unit 110B described later.

[0095] (Variation 1 of communication unit 113A) The communication unit 113A may further transmit information indicating a detection area within the priority area where an object has been detected by the sensor 101A of the vehicle A and which has been temporarily blocked (a temporarily blocked area in the first embodiment) together with the object information of the priority area (which may include the extended area). The information indicating the temporarily blocked area is information indicating the geographical position or range of the temporarily blocked area, and information indicating the geographical position of the vehicle A when the temporarily blocked area was detected.

[0096] In this way, by transmitting information indicating the temporarily blocked area from vehicle A to vehicle B, vehicle B can store and recognize the temporarily blocked area as an area in which an object can be detected by the sensor of the vehicle while traveling. By receiving the information indicating the temporarily blocked area, vehicle B can determine that an object can be detected in the temporarily blocked area at the position of vehicle A when the temporarily blocked area is detected. Therefore, for example, vehicle B can plan in advance a driving plan to perform vehicle control based on the assumption that an object will be detected by the sensor of the vehicle at the position of vehicle A when the temporarily blocked area is detected.

[0097] (Variation 2 of communication unit 113A) The communication unit 113A may also transmit information indicating an area (non-detection area in the first embodiment) in which vehicle A was unable to detect an object when vehicle A traveled around the priority area received from vehicle B. The information indicating the non-detection area is, for example, information indicating the geographical position or range of the non-detection area, and information indicating the geographical position of vehicle A when vehicle A was unable to detect an object (such as information on the route already traveled by vehicle A).

[0098] In this way, by transmitting the non-detection area in which an object cannot be detected even when vehicle A is traveling to vehicle B, vehicle B can store and recognize the non-detection area as a caution area in which an object cannot be detected by the sensor of the vehicle even when traveling on the road. Therefore, vehicle B can reflect the non-detection area in the control of vehicle traveling, such as by reducing the speed when traveling on the road.

[0099] (Common features of variations 1 and 2 of communication unit 113A) The temporarily blocked area and non-detection area described in the variations 1 and 2 of the communication unit 113A are not limited to only the priority area before expansion set by vehicle B, but can also be applied to the expanded priority area expanded by vehicle A. In other words, vehicle A can transmit to vehicle B information indicating the temporarily blocked area within the priority area expanded by its own vehicle where an object has been detected by the sensor of vehicle A, and information indicating the non-detection area where vehicle A was unable to detect an object when traveling around the expanded priority area.

[0100] Here, the temporary blocked area, the priority area, and the extended area will be explained again.

[0101] A temporarily blocked area is an area that is blocked by an obstacle located ahead of the vehicle on the driving lane in a given vehicle, and that becomes detectable when the vehicle moves temporarily to avoid the obstacle. For example, it is an area that becomes detectable when the vehicle avoids a stopped vehicle ahead, and is an area for object detection that covers both the original driving lane and the lane adjacent to the driving lane.

[0102] On the other hand, the priority area is an area set by another vehicle to obtain object information, and in the above example, refers to the area of ​​the original driving lane. The extended area is an area obtained by extending the priority area, and in the above example, refers to an area adjacent to the priority area and an area of ​​a lane adjacent to the driving lane.

[0103] (Object information sent from vehicle A to vehicle B) Table 1 shows an example of object information transmitted from vehicle A to vehicle B. The object information is object information and area information that are the results of sensing performed by vehicle A based on a request from vehicle B, and is an example of the data structure of answer content data that vehicle A responds to vehicle B with.

[0104] [Table 1]

[0105] (Vehicle B Configuration) Next, vehicle B will be described.

[0106] Vehicle B is equipped with a sensor 101B, a position measurement unit 102B, a first viewpoint object detection unit 103B, an object information collection unit 105B, an area setting unit 106B, a map / planned driving route information storage unit 108B, an area correction unit 109B, and a communication unit 110B. Vehicle B may further be equipped with all the functional units equipped in vehicle A.

[0107] The sensor 101B has a function of measuring the distance to, the direction of, and the like of objects present around the vehicle B.

[0108] The position measurement unit 102B has a function of measuring the current position of the vehicle B.

[0109] The first viewpoint object detection unit 103B has a function of detecting an object present on the road from the viewpoint of the vehicle B, using the measurement data of the sensor 101B and the measurement data of the position measurement unit 102B. For example, the first viewpoint object detection unit 103B detects position information of vehicles, obstacles, etc. present in a 360-degree azimuth area of ​​the vehicle B.

[0110] The object information collection unit 105B has a function of collecting and storing the detection results of objects detected by the first viewpoint object detection unit 103B and the second viewpoint object detection unit 104A of vehicle A in association with the detection time.

[0111] The area setting unit 106B has a function of setting a monitoring area, which is a predetermined blind spot area among a plurality of blind spot areas that could not be detected or were difficult to detect in the first viewpoint object detection unit 103B within the sensor viewing angle of the sensor 101B, as a priority area, and which is determined by the area correction unit 109B, in order to compensate for the blind spot area that could not be detected within the sensor viewing angle of the sensor 101B by using other viewpoint information. The priority area is an area based on a boundary based on a predetermined object (e.g., a white line on a road, a vehicle on a road) detected by the vehicle B at least at a predetermined timing.

[0112] Moreover, the area setting unit 106B has a function of setting a temporarily blocked area, which is an area where an object cannot be detected from a first viewpoint based on a detection result of an object on a road, and where the object can be detected from a second viewpoint at a different time from the first viewpoint. In this case, the vehicle B further has the configuration of the vehicle A (the second viewpoint object detection unit 104A, etc.).

[0113] The map / planned driving route information storage unit 108B has a function of storing map information including road information, lane information, traffic light information, building information, etc., and storing information on the future planned driving route and speed plan of vehicle B based on a route plan specified by the driver of vehicle B or the automatic driving system.

[0114] The area correction unit 109B has a function of acquiring the future planned driving route and speed plan of vehicle B, and based on the planned driving route and speed plan, determining a monitoring area that should be set as a priority in the future for the driver of vehicle B and the autonomous driving system from among the priority areas set by the area setting unit 106B.

[0115] For example, the area correction unit 109B determines the road area up to about 15 seconds ahead along the planned driving route as the monitoring area. In addition, if the planned driving route has a branch point such as an intersection or a junction, the area correction unit 109B also determines the road of the oncoming lane that flows into the branch point as the monitoring area. Specifically, the area correction unit 109B determines the road on the oncoming side that corresponds to the same distance as the distance from vehicle B to the branch point, or the same distance as the driving time for vehicle B to reach the branch point as the monitoring area.

[0116] When setting or determining blind spot areas, priority areas, and monitoring areas, the area setting unit 106B and the area correction unit 109B set them based on lane link IDs on the map, etc., using the map information stored in the map / planned driving route information storage unit 108B.

[0117] The communication unit 110B has a function of transmitting request data for requesting object information included in the priority area set by the area setting unit 106B to nearby vehicles. The request data includes, for example, information on the priority area, the position of the vehicle B requesting the object information, and information on the planned driving route. The communication unit 110B also has a function of transmitting the temporary shielded area to vehicle A such as vehicle B, vehicles other than vehicle A, or various servers. The communication unit 110B also has a function of selecting one or more of the multiple vehicles when there are multiple vehicles capable of V2X communication within the radio wave reach in the vicinity of vehicle B. The communication unit 110B also has a function of receiving object information transmitted from the requested vehicle (vehicle A) that transmitted the request data.

[0118] (Request data sent from vehicle B to vehicle A) An example of the request data transmitted from vehicle B to vehicle A is shown in Table 2. The request data is an example of a data structure for requesting object information in the priority area.

[0119] [Table 2]

[0120] (Information processing method) Next, a description will be given of an information processing method performed by the information processing device 1. Figures 7A and 7B are flowcharts showing the processing steps of the information processing method.

[0121] First, the prerequisites will be described with reference to FIG. 8. Vehicle B has a planned driving route that involves turning left at an intersection without traffic lights, and has a driving plan to drive at a maximum speed of 40 km / h. Vehicle B is passing a position 50 m before the intersection. In front of vehicle B, there is a preceding vehicle C1 that cannot perform V2X communication. A parked vehicle C2 is present at a predetermined position after turning left at the intersection within vehicle B's planned driving route. Vehicle A is at the timing to overtake parked vehicle C2 within vehicle B's planned driving route. Vehicle A is present at a position where vehicle B may be present 15 seconds from now, 130 m ahead.

[0122] Step S201; First, in vehicle B, first viewpoint object detection unit 103B performs object detection in a 360-degree azimuth area of ​​vehicle B. After that, first viewpoint object detection unit 103B stores the object detection result in object information collection unit 105B and transmits it to area setting unit 106B. Here, a preceding vehicle C1 in the forward area is detected as an object.

[0123] Step S202; Next, the area setting unit 106B sets the blind spot area where the object could not be detected by the preceding vehicle C1 as the priority area among the blind spot areas where the object could not be detected. For example, as shown in Fig. 8, the area setting unit 106 obtains the intersection between the vehicle C1 and the parting lines L1, L2, and sets the area behind the vehicle C1 and on the vehicle C1 side of the parting lines L1, L2 as the priority area.

[0124] Step S203; Next, the area correction unit 109B sets a monitoring distance in the priority area using the planned driving route and speed information of vehicle B acquired from the map and planned driving route information storage unit 108B. When the road area up to about 15 seconds ahead along the planned driving route is set as the monitoring area, since the maximum vehicle speed is 40 km / h, the area correction unit 109B sets the monitoring distance to 162 m ahead from the current position along the planned driving route.

[0125] Step S204; Next, the area correction unit 109B sets the lanes and roads along the planned travel route, 50 m into the road section where vehicle B is traveling and 112 m after turning left at the intersection, as the monitoring area S1. The area is specified by the lane link ID on the map and the distance from the intersection. If a high-precision map is provided within the road infrastructure network or on board the vehicle, only the lane link ID may be used. Four or more position coordinates of road / lane boundaries may be set as a complement or alternative.

[0126] Step S205; In addition, since the oncoming road along the planned driving route entering the intersection is a blind spot area for vehicle B, the area correction unit 109B sets the lanes and roads in a 50 m section from the intersection as the monitoring area S2.

[0127] Step S206; Next, the area setting unit 106B determines the monitoring areas S1 and S2 set by the area correction unit 109B in steps S204 and S205 as the priority areas S1 and S2 of the vehicle B in the priority area set in step S202.

[0128] In addition, in steps S205 and S206, the area setting unit 106B may set a temporarily blocked area which is an area where an object cannot be detected from a first viewpoint and where an object can be detected from a second viewpoint that is different from the first viewpoint at a time.

[0129] Step S207; Thereafter, in order to request object information included in the determined priority areas S1 and S2 of vehicle B, communication unit 110B selects one of a plurality of vehicles that are nearby and can communicate with vehicle B, and transmits request data to that vehicle (vehicle A). If a temporary obstruction area is set, communication unit 110B further transmits the temporary obstruction area. At this time, communication unit 110B may request object information included in the temporary obstruction area. The request data (packet data structure) transmitted from vehicle B to vehicle A is as shown in Table 2 above.

[0130] Step S208; Next, in vehicle A, the communication unit 113A receives the request data from vehicle B. The request data includes information on the priority areas S1 and S2, information on the position of vehicle B requesting object information, and information on the planned driving route.

[0131] Step S209; Next, the second viewpoint object detection unit 104A performs object detection in the 360-degree azimuth area of ​​the vehicle A. After that, the second viewpoint object detection unit 104A transmits the object detection result to the area setting unit 106B and the object selection area correction unit 112A. Here, the object detected is a parked vehicle C2 in the forward area.

[0132] Step S210; Next, the object selection area correction unit 112A observes the state of the monitored lane based on the lane information of the map acquired from the map information storage unit 111A and the object detection result of the second viewpoint object detection unit 104A.

[0133] Step S211; Next, the object selection area correction unit 112A determines the necessity of a lane change due to a lane closure caused by an object detected by the second viewpoint object detection unit 104A, further using the position information and speed information of the vehicle A. For example, when mapping a detected object on a map, the object selection area correction unit 112A determines that a lane is temporarily closed due to a parked vehicle, construction work, a fallen object, or the like, based on the absence of a moving speed of the detected object. If a lane change is necessary, the process proceeds to step S212, and if a lane change is not necessary, the process proceeds to step S213.

[0134] Step S212; When a lane change is necessary, the object selection area correction unit 112A increases the priority of the non-priority area of ​​the adjacent lane and adds it as a priority area S3 (extended area). The priority of the priority area S3 is the same as or higher than the priority areas S1 and S2. For example, assuming that vehicle A will arrive at the closed area in 13 to 25 seconds (upper limit) and the added area is an oncoming lane, the area from 13 to 25 seconds (upper limit) later at a travel speed of 0 km / h to 50 km / h (speed limit) is set as the priority area S3, and the range is set to 337 m from the lane block point.

[0135] Step S213; Next, the object selection unit 107A selects objects in the priority areas S1 and S2 that were set by vehicle B, and also selects objects in the priority area S3 that was added by the object selection area correction unit 112A. If there are objects in non-priority areas, the object selection unit 107A also selects objects in the non-priority areas. As for the priority area S3, even though an object on a closed lane has been selected, the road on which vehicle A passes has not been appropriately selected, so it can be said to be an area that was added by correction.

[0136] Step S214; Finally, the communication unit 113A sets the delivery order information in the header portion of the packet, in which the lane link IDs (which may include the end points corresponding to the distance from the intersection as the starting point) corresponding to each of the priority areas S1 to S3 are set as the first to third, respectively, and the lane link IDs corresponding to non-priority areas other than the priority areas are set as the fourth or later. Furthermore, the communication unit 113A sets the object information of each of the priority areas S1 to S3 and each non-priority area in the data portion of the packet in the delivery order. Thereafter, the communication unit 113A transmits the packet to the vehicle B. At this time, the vehicle A may set the priority of the priority area S3 higher than the priority areas S1 and S2. The object information (data structure of the packet) transmitted from the vehicle A to the vehicle B is as shown in Table 1 above.

[0137] (Variations of Priority Area Setting Method in Area Correction Unit 109B) Next, a method for setting a priority area will be described when the vehicle B is traveling in an area having a predetermined road shape. The predetermined road shape is, for example, an intersection, a curve, an S-shaped curve, a curve gradient inflection point, etc.

[0138] (Variation 1) As shown in FIG. 9, a case will be described where there is a traffic light Z at an intersection in the traveling direction of vehicle B. When there is a traffic light, there is a high possibility that the situation of the planned travel route will change in the future due to a temporary stop of vehicle B at the traffic light. Therefore, when a traffic light on the planned travel route continues to be red based on traffic light pattern information received from a traffic facility server or the like, the area setting unit 106B sets an area S1' from vehicle B to the stop line just before the traffic light as a monitoring area S1'. However, for the oncoming area on the entering side of the intersection, since it is necessary to monitor vehicles that may turn right and enter the planned travel route and intersect, the area setting unit 106B holds it as a monitoring area S2 regardless of the current pattern of the traffic light.

[0139] (Variation 2) As shown in FIG. 10, a case will be described where vehicle B is traveling along a right curve with poor visibility due to a forest area M. In the case of a curve beyond the line of sight, the area setting unit 106B sets a monitoring area based on the forest area M displayed on a map or detected by vehicle B and the current position of vehicle B. For example, the area setting unit 106B sets a parting line L to be in contact with the forest area M, and determines an intersection O' where the parting line L passes through a bisector of the road width (the median line of the road width). Then, the area setting unit 106B sets an intersection close to the current position of vehicle B as a reference point O, and an area S farther away than the distance from the reference point O to the intersection O' as a shielded area of ​​vehicle B, and sets the area S as the monitoring area S.

[0140] (Variation 3) 11, a case will be described where there is an upward gradient in the traveling direction of vehicle B. While vehicle B is traveling on a curved road surface with an upward gradient, area setting unit 106B sets a parting line L so as to be in contact with the curved road surface, and sets an area S that is equal to or smaller than the sensor mounting angle spread (-10 degrees) of sensor 101 from the reference height surface of vehicle B as a shielded area of ​​vehicle B, and sets it as a monitoring area S.

[0141] [Variation 4] 12, a case will be described in which the road gradient changes downward while vehicle B is traveling. The area setting unit 106B sets the parting line L that contacts the flat road surface on which the vehicle is traveling as the road reference plane L, and observes a change point P where the road gradient changes on the route on the map. Then, the area setting unit 106B sets an area S at a point at an altitude lower than the road reference plane L as the shielded area of ​​vehicle B, and sets it as the monitoring area S.

[0142] (Effects of the second embodiment) According to this embodiment, in vehicle B, the area setting unit 106B determines, as priority areas S1, S2, monitoring areas S1, S2 that are predetermined blind spot areas among multiple blind spot areas that could not be detected by the sensor 101B and that should be set as a priority in the future for the driver of vehicle B and the autonomous driving system based on the future planned driving route and speed plan of vehicle B.

[0143] In vehicle A, the object selection area correction unit 112A adds the lane adjacent to the driving lane as a priority area S3, and the object selection unit 107A selects objects from the priority areas S1 and S2 determined by vehicle B, and also selects objects from the added priority area S3. Then, the communication unit 113A preferentially transmits object information in the priority areas S1, S2, and S3 to vehicle A.

[0144] This allows vehicle B to know that object information for the priority area will be delivered first, and it can receive the object information for the priority area first. It is no longer necessary for vehicle B to wait until the object information for all blind spot areas has been received, and it is possible to efficiently obtain information that is useful to the driver and the autonomous driving system.

[0145] Furthermore, according to this embodiment, the area setting unit 106B acquires future position information of vehicle B requesting object information, and based on the future position information and the object detection result, sets monitoring areas in which objects cannot be detected in the future of vehicle B as priority areas S1, S2, thereby making it possible to acquire information that is useful to the driver and the autonomous driving system.

[0146] Furthermore, according to the present embodiment, a map / planned driving route information storage unit 108B is provided that stores map information, and the map / planned driving route information storage unit 108B uses the map information to set a priority area based on a lane link ID on the map, so that the priority area can be identified reliably.

[0147] Furthermore, according to this embodiment, the priority area is an area based on a boundary that is based on a predetermined object detected by vehicle B at least at a predetermined timing, so that the priority area can be identified reliably.

[0148] Furthermore, according to this embodiment, the predetermined object is a white line on a road or a vehicle, so that the priority area can be identified reliably.

[0149] Furthermore, according to this embodiment, the communication unit 110B selects one of a plurality of vehicles with which it can communicate, and transmits the requested data to that vehicle, thereby suppressing an increase in the amount of data in the V2X communication network, and enabling the driver and the autonomous driving system to acquire useful information more efficiently.

[0150] In addition, according to this embodiment, the request data includes information regarding the priority area as well as information regarding the position and planned driving route of vehicle B requesting the object information, so that vehicle A that receives the request can reliably grasp the position and planned driving route of vehicle B and can clearly identify the requested area.

[0151] Furthermore, according to this embodiment, the area setting unit 106B sets an area having a predetermined road shape as a priority area, so that it is possible to obtain object information included in areas having various road shapes.

[0152] Furthermore, according to this embodiment, the predetermined road shape is any one of an intersection, a curve, and a curve gradient inflection point, so that object information included in an area where an intersection, a curve, or a curve gradient inflection point is present can be obtained.

[0153] In addition, according to this embodiment, the object information includes not only object information detected by vehicle B in the priority area, but also object information detected in areas other than the priority area, or object information that can be detected in the future in areas other than the priority area, so that more useful information can be obtained for the driver of vehicle B and the autonomous driving system.

[0154] Furthermore, according to this embodiment, the object information includes vehicle information or obstacle position information on the road detected by vehicle B, so that the driver of vehicle B or the automatic driving system can reliably grasp the object information.

[0155] In addition, according to this embodiment, vehicle B is equipped with a monitoring sensor that monitors the sides of the road, detects road boundary lines or background objects, detects objects on the road, and determines the intersection between the detected object and the parting line, thereby detecting vehicles or obstacles, thereby enabling stationary objects to be reliably identified.

[0156] Furthermore, according to this embodiment, the information processing device 1 is provided in the vehicles A and B, so that internal communication within the vehicles is possible, and the processing speed can be improved.

[0157] Third embodiment A third embodiment to which the present invention is applied will be described below. In the third embodiment, a method for eliminating duplicate reception of the same object information from the next time onwards when a plurality of vehicles simultaneously observe the same area will be described.

[0158] (Configuration of information processing device) FIG. 13 is a diagram showing the configuration of vehicles A, B, and D according to the third embodiment.

[0159] Vehicle A is equipped with a second viewpoint object detection unit 104A and an object selection unit 107A. Vehicle A is also equipped with other functional units shown in FIG.

[0160] The second viewpoint object detection unit 104A has a function of detecting an object that exists on the road from the viewpoint of the vehicle A.

[0161] The object selection unit 107A has a function of selecting an object in a priority area detected from the viewpoint of vehicle A for the priority area set by vehicle B, and transmitting information on the selected object to vehicle B. In addition, when vehicle A expands (adds) the priority area, the object selection unit 107A also has a function of transmitting information on the object in the expanded priority area to vehicle B.

[0162] Vehicle D is equipped with a third viewpoint object detection unit 114D and an object selection unit 107D. Vehicle D is equipped with the same functional units as vehicle A shown in FIG.

[0163] The third viewpoint object detection unit 114D has a function of detecting an object that exists on the road from the viewpoint of the vehicle D.

[0164] The object selection unit 107D has a function of selecting an object in a priority area detected from the viewpoint of vehicle D for the priority area set by vehicle B, and transmitting information on the selected object to vehicle B. In addition, when vehicle D expands (adds) the priority area, the object selection unit 107D also has a function of transmitting information on the object in the expanded priority area to vehicle B.

[0165] The vehicle B is equipped with an area setting unit 106B and an overlapping area adjustment unit 115B. The vehicle B is also equipped with other functional units shown in FIG.

[0166] The area setting unit 106B has a function of setting a monitoring area, which is a predetermined blind spot area among a plurality of blind spot areas and which has been set by the area correction unit 109B (not shown), as a priority area in order to supplement blind spot areas that could not be detected within the sensor viewing angle of the vehicle B with other viewpoint information. However, the setting of the priority area is performed based on area designation information that sets a designated area to be monitored for each requesting vehicle.

[0167] Overlap area adjustment section 115B is connected to area setting section 106B and object selection sections 107A, 107D, and has a function of comparing object information transmitted from object selection sections 107A, 107D and determining the identity of the object information and the identity of the areas of the object information.

[0168] Moreover, overlapping area adjustment unit 115B has a function of determining the center of gravity of the overlapping area when the object information (areas) overlap, and maintaining the area designation of the area designation information for the vehicle that is closer than the respective distances from the positions of vehicles A and D, and temporarily canceling the area designation for the vehicle that is farther away. Overlapping area adjustment unit 115B also has a function of continuously monitoring whether or not there is overlap in the object information in the overlapping area, and returning the area designation of the area designation information to an initial value when there is no object information in the overlapping area.

[0169] (Information processing method) Next, a description will be given of an information processing method performed by the information processing device 1. Fig. 14 is a flowchart showing the processing procedure of the information processing method.

[0170] First, the preconditions will be described with reference to Fig. 15. There exists a vehicle B that receives object information, and vehicles A and D that simultaneously transmit object information. Based on the second embodiment, three monitoring areas S1-S3 are set.

[0171] Step S301; First, in vehicle B, overlapping area adjustment section 115B receives the object information transmitted from object selection section 107A of vehicle A and the object information transmitted from object selection section 107D of vehicle D.

[0172] Step S302; Next, overlap area adjustment unit 115B compares the position, size, etc. of the area related to the object information from object selection unit 107A with the area related to the object information from object selection unit 107D. When the initial setting area SA by vehicle A is set as shown in Fig. 16 and the initial setting area SD by vehicle D is set as shown in Fig. 17, the overlap area SX obtained by overlapping area SA and area SD will be as shown in Fig. 18. If there is an overlap area as a result of comparing the areas, the process transitions to step S303, and if there is no overlap area, the process transitions to step S307.

[0173] Step S303; If there is an overlapping area, the overlapping area adjustment unit 115B obtains the center of gravity of the overlapping area SX and calculates the distance from each of the vehicles A and D to the center of gravity. Then, the overlapping area adjustment unit 115B excludes the vehicle with the greater distance from the area designation at the next transmission.

[0174] 19, when there is an overlap area SX1 to the side of vehicle A, overlap area adjustment unit 115B obtains the center of gravity O of overlap area SX1 and calculates the distance OA between vehicle A and center of gravity O and the distance OD between vehicle D and center of gravity O. Then, overlap area adjustment unit 115B determines that vehicle A is easier to recognize in overlap area SX1 because distance OA<distance OD, and temporarily excludes vehicle A from the designated range of the designated area for vehicle D.

[0175] As for overlap area SX2, since it is equidistant from each of vehicles A and D, overlap area adjustment unit 115B maintains the area designation for vehicle D, which is closer to the host vehicle (vehicle B) and can communicate stably, and cancels the designated area for vehicle A. As for overlap area SX3, it maintains the designated area for vehicle D, which is closer to the center of gravity of overlap area SX3, and cancels the designated area for vehicle A.

[0176] Step S304; Next, the area setting unit 106B applies the area designation of the monitoring area to be included in the request data based on the new designated area by the overlap area adjustment unit 115B. For example, the overlap area adjustment unit 115B changes the area designation information so that the monitoring area requested for the vehicle A includes the overlap area SX1, and the monitoring area requested for the vehicle D does not include the overlap area SX1.

[0177] Then, based on the changed area designation information, area setting unit 106B requests, for example, overlapping area SX1 from the next time onwards only to vehicle A. As a result, vehicle D will no longer receive a request for object information in overlapping area SX1 from vehicle B, and will not transmit object information in overlapping area SX1.

[0178] Step S305; Thereafter, overlap area adjustment unit 115B receives object information transmitted from vehicles A and D, and continues to monitor whether or not there is object information in the overlap area. If area setting unit 106B is no longer able to acquire object information in the overlap area, it transitions to step S306, and if it is still able to acquire object information in the overlap area (i.e., if an object still exists in the overlap area), it transitions to step S307.

[0179] Step S306; When there is no more object information in the overlapping area, overlapping area adjustment section 115B returns the area designation in the area designation information to the original state in order to resume transmission of object information from both vehicles A and D.

[0180] Step S307; Finally, vehicle B determines whether vehicle A has passed through the overlapping area. If vehicle B has not passed through the overlapping area, the process proceeds to step S301. If vehicle B has passed through the overlapping area, the process ends.

[0181] (Effects of the third embodiment) According to this embodiment, when the areas requested by vehicles A and D overlap, the overlap area adjustment unit 115B maintains the area designation of the vehicle closer to the overlap area and cancels the area designation of the vehicle farther away, so that the driver of vehicle B and the automatic driving system can obtain object information useful to them more accurately. Also, the amount of communication between vehicles can be reduced.

[0182] (Another example of object information and request data shown in the second embodiment) (Another example of request data sent from vehicle B to vehicle A) The request data transmitted from vehicle B to vehicle A shown in Table 2 of the second embodiment can also be realized by, for example, the data structure shown in Table 3 below.

[0183] [Table 3]

[0184] (Another example of object information transmitted from vehicle A to vehicle B) The object information transmitted from vehicle A to vehicle B shown in Table 1 of the second embodiment can also be realized by, for example, the data structure shown in Table 4 below.

[0185] [Table 4] [Explanation of symbols]

[0186] 1. Information processing device 101 Sensors 102 Position measurement unit 103 First viewpoint object detection unit 104 Second Viewpoint Object Detection Unit 105 Object Information Collection Department 106 Area setting section 107 Object Selection 108 Map and planned driving route information storage unit 109 Area correction section 110 Communications Department 111 Map information storage unit 112 Object selection area correction section 113 Communications Department 114 Third-view object detection unit 115 Overlap Area Adjustment Section 116 Object Communication Section H101 Sensor Device H102 Position measuring device H103 Communication equipment H104 Processing unit

Claims

1. An information processing device provided in a vehicle, an area setting unit that sets a priority area; an object selection unit for setting a temporary occlusion area; The Communications Department and Equipped with the priority area is an area in which a sensor installed in the vehicle cannot detect an object at a first viewpoint due to obstruction by an obstruction, the priority area being an area including at least one of a planned travel route of the vehicle and a route intersecting or adjacent to the planned travel route, the temporarily blocked area is an area in which the sensor installed in the vehicle can detect an object at a second viewpoint in the priority area, the second viewpoint being different from the first viewpoint at a time; The communication unit transmits data of the non-detection area excluding the temporarily blocked area from the priority area to another vehicle different from the vehicle or to a server.

23. An information processing apparatus comprising:

2. An information processing device provided in a server, an area setting unit that sets a priority area; an object selection unit for setting a temporary occlusion area; The Communications Department and Equipped with the priority area is an area in which a sensor installed in a vehicle cannot detect an object at a first viewpoint due to obstruction by an obstruction, the priority area being an area including at least one of a planned travel route of the vehicle and a route intersecting or adjacent to the planned travel route, the temporarily blocked area is an area in which the sensor installed in the vehicle can detect an object at a second viewpoint in the priority area, the second viewpoint being different from the first viewpoint at a time; The communication unit transmits data of a non-detection area excluding the temporarily blocked area from the priority area to another vehicle different from the vehicle.

23. An information processing apparatus comprising:

3. An information processing device provided in a vehicle, A communication unit for receiving data of a priority area; a temporary shielding area setting unit for setting a temporary shielding area; Equipped with the priority area is an area in which a sensor installed in another vehicle different from the vehicle cannot detect an object at a first viewpoint due to obstruction by an obstruction, the priority area being an area including at least one of a planned travel route of the other vehicle and a route intersecting or adjacent to the planned travel route, the temporarily blocked area is an area of ​​the priority area in which an object can be detected by a sensor installed in the vehicle at a second viewpoint different from the first viewpoint; The communication unit transmits data of non-detection areas excluding the temporarily blocked area from the priority area to the other vehicle.

23. An information processing apparatus comprising:

4. The communication unit transmits data of the temporarily blocked area to the other vehicle or the server.

2. The information processing apparatus according to claim 1,

5. The communication unit transmits data of the temporarily blocked area to the other vehicle.

4. The information processing apparatus according to claim 2, wherein the information processing apparatus is a computer.

6. An information processing method performed by an information processing device provided in a vehicle, comprising: A first step of setting a priority area; a second step of setting a temporary occlusion area; a third step of transmitting data of non-detection areas excluding the temporarily blocked area from the priority area to another vehicle different from the vehicle or to a server; Equipped with the priority area is an area in which a sensor installed in the vehicle cannot detect an object at a first viewpoint due to obstruction by an obstruction, the priority area being an area including at least one of a planned travel route of the vehicle and a route intersecting or adjacent to the planned travel route, The temporarily blocked area is an area in the priority area where the sensor installed in the vehicle can detect an object from a second viewpoint that is different from the first viewpoint at a time.

23. An information processing method comprising:

7. An information processing method performed by an information processing device provided in a server, comprising: A first step of setting a priority area; a second step of setting a temporary occlusion area; a third step of transmitting data of a non-detection area excluding the temporarily blocked area from the priority area to another vehicle different from the vehicle; Equipped with the priority area is an area in which a sensor installed in the vehicle cannot detect an object at a first viewpoint due to obstruction by an obstruction, the priority area being an area including at least one of a planned travel route of the vehicle and a route intersecting or adjacent to the planned travel route, The temporarily blocked area is an area in the priority area where the sensor installed in the vehicle can detect an object from a second viewpoint that is different from the first viewpoint at a time.

23. An information processing method comprising:

8. An information processing method performed by an information processing device provided in a vehicle, comprising: A first step of receiving priority area data; a second step of setting a temporary occlusion area; a third step of transmitting data of a non-detection area excluding the temporarily blocked area from the priority area to another vehicle different from the vehicle; Equipped with the priority area is an area in which a sensor installed in the other vehicle cannot detect an object at a first viewpoint due to obstruction by an obstruction, the area including at least one of a planned travel route of the other vehicle and a route intersecting or adjacent to the planned travel route, The temporarily blocked area is an area of ​​the priority area where an object can be detected by a sensor installed in the vehicle at a second viewpoint different from the first viewpoint.

23. An information processing method comprising:

9. In the third step, data of the temporarily blocked area is transmitted to the other vehicle or the server.

7. The information processing method according to claim 6,

10. In the third step, data of the temporarily blocked area is transmitted to the other vehicle.

9. The information processing method according to claim 7 or 8.

11. An information processing device provided in a vehicle, A first step of setting a priority area; a second step of setting a temporary shielding area; a third step of transmitting data of non-detection areas, excluding the temporarily blocked area, from the priority area to another vehicle different from the vehicle or to a server; Run the command, the priority area is an area in which a sensor installed in the vehicle cannot detect an object at a first viewpoint due to obstruction by an obstruction, the priority area being an area including at least one of a planned travel route of the vehicle and a route intersecting or adjacent to the planned travel route, The temporarily blocked area is an area in the priority area where the sensor installed in the vehicle can detect an object from a second viewpoint that is different from the first viewpoint at a time.

23. An information processing program comprising:

12. An information processing device provided in a server, A first step of setting a priority area; a second step of setting a temporary shielding area; a third step of transmitting data of a non-detection area, excluding the temporarily blocked area, from the priority area to another vehicle different from the vehicle; Run the command, the priority area is an area in which a sensor installed in the vehicle cannot detect an object at a first viewpoint due to obstruction by an obstruction, the priority area being an area including at least one of a planned travel route of the vehicle and a route intersecting or adjacent to the planned travel route, The temporarily blocked area is an area in the priority area where the sensor installed in the vehicle can detect an object from a second viewpoint that is different from the first viewpoint at a time.

23. An information processing program comprising:

13. An information processing device provided in a vehicle, a first step of receiving priority area data; a second step of setting a temporary shielding area; a third step of transmitting data of a non-detection area, excluding the temporarily blocked area, from the priority area to another vehicle different from the vehicle; Run the command, the priority area is an area in which a sensor installed in the other vehicle cannot detect an object at a first viewpoint due to obstruction by an obstruction, the area including at least one of a planned travel route of the other vehicle and a route intersecting or adjacent to the planned travel route, The temporarily blocked area is an area of ​​the priority area where an object can be detected by a sensor installed in the vehicle at a second viewpoint different from the first viewpoint.

23. An information processing program comprising:

14. In the third step, data of the temporarily blocked area is transmitted to the other vehicle or the server.

12. The information processing program according to claim 11.

15. In the third step, data of the temporarily blocked area is transmitted to the other vehicle.

14. The information processing program according to claim 12 or 13.

Images