Information Processing Apparatus and Information Processing System

Abstract

To obtain an information processing device and an information processing system that can identify dangerous locations on a traveling road over a wide range.SOLUTION: An information processing device acquires, for a predetermined ground point, a first satellite image captured by an artificial satellite and a second satellite image at the same ground point after the elapse of a predetermined time after the first satellite image was captured, identifies a changed location where a state has changed by comparing the first satellite image with the second satellite image, determines whether or not the changed location is a location of which a state changed due to traveling of a vehicle, and sets the changed location as a dangerous ground point if the changed location is due to traveling of a vehicle.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an information processing system. [Background technology]

[0002] Patent Document 1 discloses a vehicle surroundings monitoring device that places multiple cameras on the road on which a vehicle is traveling, uses these cameras to capture images of the road including other vehicles traveling around the vehicle, and creates an overhead image of the area around the vehicle based on the captured images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2008-191988 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the device described in Patent Document 1 cannot create bird's-eye images in places where cameras are not installed on the road, and therefore cannot identify dangerous areas on the road over a wide area.

[0005] An object of the present invention is to provide an information processing device and an information processing system that can grasp dangerous locations on a road over a wide area. [Means for solving the problem]

[0006] The information processing apparatus according to claim 1 acquires, for a predetermined point, a first satellite image taken by a satellite and a second satellite image at the same point after a predetermined time has elapsed since the first satellite image was taken, compares the first satellite image and the second satellite image to identify a changed location where the state has changed, determines whether the changed location is a location where the state has changed due to the running of a vehicle, and sets the changed location as a dangerous point when the changed location is due to the running of a vehicle. An information processing device that determines that a location where the state has changed due to the running of a vehicle when the changed location includes a braking mark or when the changed location is a location where a road fixture is damaged, and determines that a location where the state has changed due to the running of a vehicle is not the case when the changed location is due to a falling object, displays information on a dangerous location on a display unit provided in the vehicle interior, and sets an upper limit of the vehicle speed when the vehicle is approaching a dangerous location. 。

[0007] In the information processing apparatus according to claim 1, a first satellite image and a second satellite image taken at the same point after a predetermined time has elapsed are acquired. Further, the first satellite image and the second satellite image are compared to identify a changed location where the state has changed. In this way, by comparing satellite images to identify changed locations, changed locations can be identified over a wide range without installing cameras on roads or the like.

[0008] Also, it is determined whether the changed location is a location where the state has changed due to the running of a vehicle, and when the changed location is due to the running of a vehicle, the changed location is set as a dangerous point. Thereby, dangerous points can be identified even in areas where the infrastructure is not sufficiently developed or where the number of vehicles running is small.

[0010] Furthermore A location where a braking mark has occurred due to sudden braking of a vehicle or the like is identified as a changed location. In this way, a location where a braking mark has occurred can be set as a dangerous point. Furthermore, a location where a road fixture is damaged due to the running of a vehicle can be set as a dangerous location. Here, the fixtures widely include, for example, guardrails on the road, road signs, lighting facilities, and street trees.

[0011] The information processing apparatus according to claim 3, in claim 1, when a plurality of the dangerous points are detected within a predetermined section, sets the section as a dangerous section.

[0012] In the information processing apparatus according to claim 3, by setting a section in which a plurality of dangerous points are detected as a dangerous section, it is possible to alert the occupants of a vehicle or the like.

[0015] Claim 4The information processing system according to [claim number] includes the information processing apparatus according to any one of claims 1 to 3 and a vehicle control device that controls a vehicle. is.

[0016] In the information processing system according to claim 5, by setting a speed limit for a vehicle traveling through a changed location set as a dangerous point, it is possible to suppress the occurrence of accidents or the like at the dangerous point.

Advantages of the Invention

[0017] As described above, according to the information processing apparatus and the information processing system according to the present invention, it is possible to grasp dangerous locations on a travel route over a wide range.

Brief Description of the Drawings

[0018]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Modes for Carrying Out the Invention

[0019] An information processing system S including an information processing apparatus 10 according to the embodiment will be described with reference to the drawings.

[0020] As shown in FIG. 1, the information processing system S according to the present embodiment includes an information processing device 10, a server 12, and a vehicle 11. The information processing device 10, the server 12, and the vehicle 11 are connected via a network N and can communicate with each other.

[0021] The information processing device 10 is installed, for example, outside the vehicle 11 and is configured to transmit the information requested in response to an instruction from the vehicle 11. Further, the information processing device 10 is configured to be able to acquire various information from the server 12 via the network N. Note that the information processing device 10 may be connected to a plurality of vehicles 11 via the network N.

[0022] The vehicle 11 includes an in-vehicle device 28 as a vehicle control device. The in-vehicle device 28 of the present embodiment is, for example, an ECU (Electronic Control Unit) that performs various controls. The server 12 is installed outside the vehicle 11 and is configured to be able to receive data from the artificial satellite 13. For this reason, satellite images taken by the artificial satellite are stored in the server 12. Further, information such as map information, dangerous points, and dangerous sections is stored in the server 12, and the necessary information is transmitted to the in-vehicle device 28 via the network N in response to a request from the in-vehicle device 28 (vehicle 11).

[0023] The information processing system S of the present embodiment is configured as described above. The information processing device 10 acquires a first satellite image and a second satellite image taken before and after a predetermined time has elapsed at the same location, compares the first satellite image and the second satellite image, and identifies a changed portion where the state has changed. Further, it is determined whether or not the changed portion is a portion where the state has changed due to the running of the vehicle, and when the changed portion is due to the running of the vehicle, the changed portion is set as a dangerous point.

[0024] (Hardware Configuration of Information Processing Device 10) As shown in FIG. 2, the information processing apparatus 10 includes a CPU (Central Processing Unit), a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 34, a storage 36, and a communication interface (communication I / F) 38. Each component is communicably connected to each other via an internal bus 39.

[0025] The CPU 30 is a central processing unit that executes various programs and controls each part. That is, the CPU 30 reads a program from the ROM 32 or the storage 36 and executes the program using the RAM 34 as a work area. Also, the CPU 30 performs control of the above components and various arithmetic processes according to the programs recorded in the ROM 32 or the storage 36.

[0026] The ROM 32 stores various programs and various data. The RAM 34 temporarily stores a program or data as a work area. The storage 36 is composed of an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and is a non-temporary recording medium that stores various programs including an operating system and various data. In the present embodiment, programs for performing various processes and the like are stored in the ROM 32 or the storage 36.

[0027] The communication I / F 38 is an interface for the information processing apparatus 10 to communicate with the server 12, the in-vehicle device 28, and other devices. For example, standards such as CAN (Controller Area Network), Ethernet (registered trademark), LTE (Long Term Evolution), FDDI (Fiber Distributed Data Interface), Wi-Fi (registered trademark) are used.

[0028] (Hardware Configuration of In-Vehicle Device 28) As shown in FIG. 3, the in-vehicle device 28 includes a CPU 40, a ROM 42, a RAM 44, a storage 46, a communication interface (communication I / F) 48, and an input / output interface (input / output I / F) 50. Each component is communicably connected to each other via an internal bus 52.

[0029] The CPU 40 is a central processing unit that executes various programs and controls each part. That is, the CPU 40 reads a program from the ROM 42 or the storage 46 and executes the program using the RAM 44 as a work area. Further, the CPU 40 performs control of each of the above components and various arithmetic processes according to a program recorded in the ROM 42 or the storage 46.

[0030] The ROM 42 stores various programs and various data. The RAM 44 temporarily stores a program or data as a work area. The storage 46 is a non-temporary recording medium composed of an HDD or an SSD, and stores various programs including an operating system and various data.

[0031] The communication I / F 48 is an interface for the in-vehicle device 28 to communicate with a server and other devices. For example, standards such as CAN (Controller Area Network), Ethernet (registered trademark), LTE (Long Term Evolution), FDDI (Fiber Distributed Data Interface), Wi-Fi (registered trademark) are used.

[0032] Connected to the input / output I / F 50 are a navigation system 54, a GPS (Global Positioning System) device 56, and a display device 58. The navigation system 54 sets a driving route from the current location of the vehicle 11 to the destination and provides various guidance so that the vehicle 11 can drive along the driving route. At this time, the navigation system 54 appropriately obtains map information from the server 12. Also, when some or all of the map information is stored in the storage 46, the driving route may be set without obtaining the map information from the server 12.

[0033] The GPS device 56 is a device that measures the current position of the vehicle 11 by receiving GPS signals from GPS satellites. The display device 58 displays various information on a display unit (not shown) provided in the vehicle interior. For example, the display device 58 displays information regarding the driving route set by the navigation system 54, information regarding dangerous points and dangerous sections, etc. on the display unit.

[0034] (Functional Configuration of the Information Processing Device 10) Using the above hardware resources, the information processing device 10 realizes various functions. The functional configuration realized by the information processing device 10 will be described with reference to FIG. 4.

[0035] As shown in FIG. 4, the information processing device 10 includes, as functional components, a satellite image acquisition unit 62, a change location identification unit 64, a determination unit 66, a dangerous point setting unit 68, a dangerous section setting unit 70, a vehicle position information acquisition unit 72, and a speed limit setting unit 74. Each functional component is realized by the CPU 30 reading and executing a program stored in the ROM 32 or the storage 36.

[0036] The satellite image acquisition unit 62 acquires, for a predetermined point, a first satellite image taken by the artificial satellite 13 and a second satellite image at the same point after a predetermined time has elapsed since the first satellite image was taken. For example, the artificial satellite 13 stores the satellite images it has taken in the server 12 for each shooting point, and the artificial satellite 13 shoots the same shooting point at a predetermined cycle. At this time, the taken satellite images are sequentially stored in the server 12 for each shooting point.

[0037] If the artificial satellite 13 is a geostationary satellite, since it can shoot the same shooting point at any timing, for example, it may shoot the shooting point every few hours and store the satellite image in the server 12. If the artificial satellite 13 is a low Earth orbit satellite, since the shooting frequency is based on the number of return days, the same shooting point is shot at the timing calculated based on the number of artificial satellites 13 and the number of return days. For example, if there are two artificial satellites 13 and each has a return day of 4 days, the satellite images taken at the shooting point every 48 hours are stored in the server 12.

[0038] The satellite image acquisition unit 62 accesses the server 12 and acquires, from the satellite images at the same shooting point stored in the server 12, the first satellite image and the second satellite image after a predetermined time has elapsed since the first satellite image was taken. Note that the timing and shooting point at which the satellite image acquisition unit 62 acquires the satellite image are not particularly limited. For example, at the timing when the route is set by the passenger of the vehicle 11, the satellite image acquisition unit 62 may acquire the satellite image of the point corresponding to the driving route.

[0039] The change location identification unit 64 compares the first satellite image and the second satellite image to identify the changed locations where the state has changed. For example, the change location identification unit 64 excludes moving objects such as vehicles and people from the first satellite image and the second satellite image, and identifies the changed locations for roads and appurtenances. In addition to methods such as the image difference method, the changed locations may be identified using a deep learning model. As a method using a deep learning model, for example, there are methods such as FCN (Fully Convolutional Network).

[0040] The determination unit 66 determines whether, among the changed locations identified by the change location identification unit 64, the state has changed due to the running of the vehicle. For example, when the changed location includes a braking mark, the determination unit 66 determines that the state has changed due to the running of the vehicle. Also, when the changed location includes a location where a road accessory is damaged, the determination unit 66 may determine that the state has changed due to the running of the vehicle. On the other hand, when the changed location is caused by a fallen object, the determination unit 66 may determine that the state has not changed due to the running of the vehicle.

[0041] When the changed location is due to the running of the vehicle, the dangerous location setting unit 68 sets the changed location as a dangerous location. That is, for a location determined by the determination unit 66 to be a location where the state has changed due to the running of the vehicle, the dangerous location setting unit 68 sets it as a dangerous location. The dangerous location setting unit 68 may store the information of the dangerous location in the server 12. For example, the dangerous location setting unit 68 may store the coordinate information of the location set as the dangerous location and the satellite image when the changed location was identified in the server 12.

[0042] When a plurality of dangerous locations are detected within a predetermined section, the dangerous section setting unit 70 sets the section as a dangerous section. For example, when the route of the vehicle 11 is set by the occupant, if a plurality of dangerous locations are detected within a predetermined distance on the driving route, the dangerous section setting unit 70 sets the section as a dangerous section and stores the information of the dangerous section in the server 12. Note that when two or more dangerous locations are detected within a predetermined section, the dangerous section setting unit 70 may set the section as a dangerous section, and when five or more dangerous locations are detected within a predetermined section, the dangerous section setting unit 70 may set the section as a dangerous section.

[0043] In addition, in the present embodiment, the information on the dangerous points set by the dangerous point setting unit 68 and the information on the dangerous sections set by the dangerous section setting unit 70 are notified to the passengers of the vehicle 11 by the display device 58. For example, the display device 58 may display the positions of the dangerous points and the dangerous sections on the displayed travel route.

[0044] The vehicle position information acquisition unit 72 acquires information on the current position of the vehicle 11. Specifically, the vehicle position information acquisition unit 72 acquires the position information of the vehicle 11 measured by the GPS device 56.

[0045] The upper speed setting unit 74 sets the upper speed of the vehicle 11. Specifically, the upper speed setting unit 74 compares the current position of the vehicle 11 with the dangerous points, and when the vehicle 11 approaches a dangerous point, sets an upper limit for the vehicle speed of the vehicle 11. That is, the upper speed setting unit 74 instructs the in-vehicle device 28 to set the upper speed. The in-vehicle device 28 instructs an ECU (not shown) that controls the accelerator opening degree, etc., to control the vehicle 11 so that it does not exceed a predetermined speed. As a result, the vehicle 11 cannot travel at a speed equal to or higher than a predetermined speed until it passes through the dangerous point. Further, when it is confirmed that the vehicle 11 has passed through the dangerous point, the upper speed setting unit 74 releases the setting of the upper speed for the in-vehicle device 28. In addition, the upper speed setting unit 74 sets the upper speed of the vehicle 11 in the same manner for the dangerous section.

[0046] (Operation) Next, the operation of the present embodiment will be described.

[0047] An example of the information processing by the information processing apparatus 10 of the present embodiment will be described using the flowcharts shown in FIGS. 5 and 6. These display processes are executed by the CPU 30 reading a display program from the ROM 32 or the storage 36 and expanding and executing it in the RAM 34. In the present embodiment, as an example, the information processing is executed after the travel route is set by the passengers of the vehicle 11.

[0048] (An example of information processing) The CPU 30 acquires satellite images in step S102. Specifically, the CPU 30 acquires a first satellite image and a second satellite image for the area corresponding to the driving route by the function of the satellite image acquisition unit 62. For example, the CPU 30 acquires the latest satellite image as the second satellite image, and acquires the satellite image taken a predetermined time before the time when the second satellite image was taken as the first satellite image.

[0049] The CPU 30 identifies the changed location in step S104. Specifically, the CPU 30 identifies the changed location from the first satellite image and the second satellite image by the function of the changed location identification unit 64.

[0050] The CPU 30 determines whether the changed location is a change caused by the vehicle's driving in step S106. Specifically, when the changed location satisfies a predetermined condition by the function of the determination unit 66, the CPU 30 determines that it is caused by the vehicle's driving. In this case, the CPU 30 proceeds to the process of step S108. Also, when the CPU 30 determines in step S106 that it is not caused by the vehicle's driving, this information process is terminated.

[0051] The CPU 30 sets the changed location as a dangerous point in step S108. Specifically, the CPU 30 sets the changed location as a dangerous point by the function of the dangerous point setting unit 68. At this time, the CPU 30 may notify the occupants of the vehicle 11 of the dangerous point. For example, the display device 58 may notify the occupants of the dangerous point by displaying the information of the dangerous point in the display area inside the vehicle cabin.

[0052] The CPU 30 determines whether there are a plurality of dangerous points within a predetermined section in step S110. Specifically, in the driving route of the vehicle 11, when there are a plurality of dangerous points within a predetermined distance, the CPU 30 determines that there are a plurality of dangerous points and proceeds to the process of step S112. Also, when there is only one dangerous point within the predetermined section in step S110, this information process is terminated.

[0053] The CPU 30 sets the section as a dangerous section in step S112. Specifically, the CPU 30 sets, by the function of the dangerous section setting unit 70, a section in which a plurality of dangerous points exist as a dangerous section.

[0054] The CPU 30 notifies the occupant about the dangerous points and the dangerous section in step S114. Specifically, the CPU 30 causes the display device 58 of the vehicle 11 to display the information on the dangerous points and the information on the dangerous section in the display area. At this time, when it is determined in step S110 that there is only one dangerous point (in the case of a negative determination), the CPU 30 displays only the information on the dangerous point in step S114. Also, when it is determined in step S106 that there is no changed portion caused by the running of the vehicle (in the case of a negative determination), the CPU 30 does not display the information on the dangerous points and the dangerous section in step S114.

[0055] (Another example of information processing) Next, with reference to FIG. 6, the processing for setting the upper limit speed of the vehicle 11 will be described. This processing is executed, for example, at predetermined intervals during the running of the vehicle 11.

[0056] The CPU 30 acquires the information on the dangerous points in step S202. Specifically, the CPU 30 accesses the server 12 and acquires the information on the dangerous points and the information on the dangerous section stored in the server 12. For example, the CPU 30 may acquire only the information on the dangerous points and the information on the dangerous section at the points corresponding to the running route.

[0057] The CPU 30 acquires the current position of the vehicle 11 in step S204. Specifically, the CPU 30 acquires, by the function of the vehicle position information acquisition unit 72, information regarding the current position of the vehicle 11 from the GPS device 56.

[0058] The CPU 30 determines whether the vehicle 11 has approached a dangerous point or a dangerous section to a predetermined distance in step S206. Specifically, the CPU 30 compares the current position of the vehicle 11 with the coordinates of the dangerous point or the dangerous section acquired in step S202. If the distance between the vehicle 11 and the dangerous point or the dangerous section is less than the predetermined distance, the CPU 30 determines that the vehicle 11 has approached the dangerous point or the dangerous section and proceeds to the process of step S208. On the other hand, if the CPU 30 determines in step S206 that the vehicle 11 has not approached the dangerous point or the dangerous section to the predetermined distance, the present process ends.

[0059] The CPU 30 sets the upper speed limit in step S208. Specifically, the CPU 30 instructs the vehicle-mounted device 28 to set the upper speed limit by means of the function of the upper speed limit setting unit 74.

[0060] The CPU 30 performs a predetermined display in the display area inside the vehicle cabin in step S210. Specifically, the CPU 30 causes the display device 58 to display that the acceleration and deceleration are set in the display area and that the dangerous point or the dangerous section is near. Then, the CPU 30 ends the present process.

[0061] As described above, according to the information processing system S and the information processing apparatus 10 according to the present embodiment, the second satellite image taken after a lapse of a predetermined time at the same point as the first satellite image is acquired. Further, the changed portions where the state has changed are specified by comparing the first satellite image and the second satellite image. In this way, by comparing the satellite images and specifying the changed portions, the changed portions can be specified over a wide range without installing cameras on roads or the like.

[0062] Further, it is determined whether the changed portion is a portion where the state has changed due to the running of the vehicle. If the changed portion is caused by the running of the vehicle, the changed portion is set as a dangerous point. Thereby, even in an area where the infrastructure is not sufficiently developed or in an area where the number of running vehicles is small, the dangerous points can be specified. As a result, the dangerous portions of the road can be grasped over a wide range.

[0063] Furthermore, in the present embodiment, since the locations where brake marks are formed due to sudden braking of the vehicle and the locations where road accessories are damaged due to the running of the vehicle are specified as the changed locations, the information of these locations can be notified to the passengers.

[0064] Furthermore, in the present embodiment, by setting a section in which a plurality of dangerous locations are detected as a dangerous section, it is possible to alert the passengers of the vehicle and the like.

[0065] Also, in the present embodiment, by setting a speed limit for the vehicle 11 traveling through the changed location set as the dangerous location, it is possible to suppress the occurrence of accidents and the like at the dangerous location.

[0066] As described above, the information processing system S and the information processing apparatus 10 according to the embodiment have been described. However, it goes without saying that the present invention can be implemented in various modes without departing from the gist of the present invention. For example, in the above embodiment, when the determination unit 66 determines that the changed location includes a location with a brake mark and the changed location includes a location where a road accessory is damaged, the determination unit 66 sets the location where the state has changed due to the running of the vehicle as a dangerous location. However, the present invention is not limited to this, and other changed locations may be included in the dangerous location. For example, when an accident of the vehicle is detected from a satellite image, the location may be included in the dangerous location.

[0067] Also, in the above embodiment, when the vehicle 11 approaches a dangerous location or a dangerous section to a predetermined distance, the configuration is such that the upper limit of the vehicle speed is set. However, the present invention is not limited to this. For example, instead of setting the upper limit of the vehicle speed, the passengers may be alerted. Further, for example, a driving route that does not pass through the dangerous location and the dangerous section may be searched and proposed to the passengers.

[0068] Furthermore, in the above-described embodiment, the processing executed by the CPU 30 reading and executing a program may be executed by various processors other than the CPU 30. Examples of the processor in this case include a PLD (Programmable Logic Device) whose circuit configuration can be changed after manufacturing, such as an FPGA (Field-Programmable Gate Array), and a dedicated electric circuit which is a processor having a circuit configuration designed specifically for executing specific processing, such as an ASIC (Application Spec Integrated Circuit). Also, the above processing may be executed by one of these various processors, or may be executed by a combination of two or more processors of the same type or different types. For example, it may be executed by a plurality of FPGAs, or a combination of a CPU and an FPGA. Further, the hardware structure of these various processors is, more specifically, an electric circuit combining circuit elements such as semiconductor elements.

[0069] Furthermore, in the above-described embodiment, the configuration is such that various data is stored in the storage 36, but the present invention is not limited to this. For example, a non-temporary recording medium such as a CD (Compact Disk), a DVD (Digital Versatile Disk), or a USB (Universal Serial Bus) memory may be used as the storage unit. In this case, various programs and data and the like are stored in these recording media.

[0070] Furthermore, the processing flow described in the above embodiment is an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed within a range not departing from the gist.

Description of Reference Numerals

[0071] 10 Information processing apparatus 11 Vehicle 13 Artificial satellite S Information processing system

Claims

1. Obtain a first satellite image taken by a satellite and a second satellite image at the same location after a predetermined time has elapsed since the first satellite image was taken, with respect to a predetermined location; Compare the first satellite image and the second satellite image to identify a changed location where the state has changed; Determine whether the changed location is a location where the state has changed due to the running of a vehicle; When the changed location is due to the running of a vehicle, set the changed location as a dangerous location; An information processing apparatus, When the changed location includes a braking mark, or when the changed location is a location where a road accessory is damaged, determine that it is a location where the state has changed due to the running of a vehicle, and when the changed location is due to a falling object, determine that it is not a location where the state has changed due to the running of a vehicle; An information processing apparatus that displays information on the dangerous location on a display unit provided inside the vehicle cabin, and sets an upper limit for the vehicle speed when the vehicle is approaching a dangerous location.

2. The information processing apparatus according to Claim 1, wherein the first satellite image and the second satellite image of a location corresponding to the driving route are obtained at the timing when the driving route is set by a passenger of the vehicle.

3. The information processing apparatus according to Claim 1, wherein when a plurality of the dangerous locations are detected within a predetermined section, the section is set as a dangerous section.

4. The information processing apparatus according to any one of Claims 1 to 3, A vehicle control apparatus for controlling a vehicle, An information processing system comprising the same.

Images