Information processing device

Abstract

To control on-vehicle equipment mounted on a vehicle at timing determined by panomarically looking at the vehicle around.SOLUTION: An information processing apparatus comprises an acquisition portion acquiring a satellite image obtained by photographing the ground by an artificial satellite, and a control portion controlling on-vehicle equipment mounted on a vehicle captured in the satellite image on the basis of analysis result of the satellite image acquired by the acquisition portion.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device. [Background technology]

[0002] Patent document 1 discloses a vehicle surroundings confirmation system that can reduce the sense of discomfort felt by the user by eliminating distorted shapes in the images of the surroundings of the vehicle displayed on the screen, and can provide the user with images of the surroundings of the vehicle that do not lead to misunderstandings. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-114361 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, conventionally, images are displayed on the display of Patent Document 1 based on control by a vehicle control device, but there is still room for improvement in the method of controlling in-vehicle devices such as the display.

[0005] Therefore, an object of the present disclosure is to provide an information processing device that can control on-board devices mounted on a vehicle at timing determined by viewing the surroundings of the vehicle from a bird's-eye view. [Means for solving the problem]

[0006] The information processing device of claim 1 includes an acquisition unit that acquires satellite images of the earth taken by an artificial satellite; an analysis unit that uses image recognition technology to analyze the satellite images acquired by the acquisition unit to determine whether or not there is a danger to the vehicle shown in the satellite images; a control unit that controls on-board equipment installed in the vehicle based on the analysis results of the satellite images; and a provision unit that, when a danger to the vehicle is detected from the analysis results of the satellite images, transmits the satellite images and the current location of the vehicle to a user device that is a computer owned by the police, an insurance company, or a security company. a storage unit in which a predetermined dangerous situation is stored; and the analysis unit Note stored in memory The aforementioned When a predetermined dangerous situation is detected from the satellite image, it is detected that there is danger to the vehicle, and when the control unit detects that there is danger to the vehicle, it outputs a predetermined warning sound from a speaker as the in-vehicle equipment and lights up a lamp as the in-vehicle equipment in a predetermined pattern. The information processing device of claim 4 is in claim 1, wherein the danger to the vehicle includes both incidents corresponding to the presence of suspicious persons or dangerous objects and attempted vehicle break-ins, and accidents corresponding to hit-and-run or vehicle break-ins, and the analysis unit is capable of updating the predetermined danger situation that indicates the danger to the vehicle stored in the memory unit.

[0007] In the information processing device according to claim 1, the acquisition unit acquires satellite images. Then, the control unit controls the on-board devices mounted on the vehicle shown in the satellite images based on the analysis results of the satellite images acquired by the acquisition unit. This allows the information processing device to control the on-board devices mounted on the vehicle at a timing determined by viewing the surroundings of the vehicle from a bird's-eye view.

[0008] The information processing device according to claim 2 is the information processing device according to claim 1, wherein the control unit starts taking pictures using a camera as the in-vehicle device when a danger to the vehicle is detected from the analysis result of the satellite image.

[0009] In the information processing device according to claim 2, the control unit starts taking pictures with the camera when a danger to the vehicle is detected from the analysis result of the satellite image. This allows the information processing device to start taking pictures with the camera at the timing when a danger to the vehicle is detected by looking at the surroundings of the vehicle from a bird's-eye view.

[0010] The information processing device according to claim 3 is the information processing device according to claim 2, wherein the control unit controls the angle of view of the camera so that a position where a danger to the vehicle is detected is included in the imaging range.

[0011] In the information processing device according to claim 3, the control unit controls the angle of view of the camera so that the position where the danger to the vehicle is detected is included in the photographing range, thereby increasing the possibility that the object that triggers the detection of the danger to the vehicle will be photographed in the information processing device.

[0012] Other aspects of In any one of claims 1 to 3, the information processing device includes a providing unit that provides at least one of the satellite image and the current position of the vehicle to a predetermined user when a danger to the vehicle is detected from the analysis results of the satellite image.

[0013] Other aspects of In the information processing device, when a danger to the vehicle is detected from the analysis result of the satellite image, the providing unit provides at least one of the satellite image and the current position of the vehicle to a predetermined user. As a result, when a problem occurs to the vehicle based on the detected danger, the information processing device can contribute to solving the problem.

[0014] The information processing device according to claim 5 is any one of claims 1 to 4, wherein the control unit causes a monitor serving as the in-vehicle device to display an overhead image of the vehicle appearing in the satellite image when the vehicle is being parked in a parking lot.

[0015] In the information processing device according to claim 5, the control unit displays an overhead image of the vehicle captured in a satellite image on the monitor when the vehicle is being parked in a parking lot. This allows the information processing device to park the vehicle while viewing an image of the actual vehicle, thereby reducing any discomfort felt by the occupants regarding the content displayed on the monitor as parking assistance. [Effects of the Invention]

[0016] As described above, the information processing device according to the present disclosure can control the on-board devices mounted on the vehicle at timing determined by viewing the surroundings of the vehicle from a bird's-eye view. [Brief explanation of the drawings]

[0017] [Figure 1] FIG. 1 is a diagram illustrating a schematic configuration of a control system. [Figure 2] FIG. 2 is a block diagram showing the hardware configuration of a vehicle. [Figure 3] FIG. 2 is a block diagram illustrating an example of a functional configuration of a vehicle. [Figure 4] FIG. 2 is a block diagram showing the hardware configuration of a user device. [Figure 5] 1 is a first flowchart showing the flow of a control process. [Figure 6] 10 is a second flowchart showing the flow of the control process. DETAILED DESCRIPTION OF THE INVENTION

[0018] The control system 100 according to this embodiment will be described below. The control system 100 according to this embodiment is a system that controls on-board devices mounted on a vehicle at timing determined by viewing the surroundings of the vehicle from a bird's-eye view.

[0019] (First embodiment) First, a first embodiment of a control system 100 according to the present embodiment will be described.

[0020] FIG. 1 is a diagram showing a schematic configuration of a control system 100. As shown in FIG. As shown in FIG. 1, the control system 100 includes a vehicle 10, a satellite 50, and a user device 70.

[0021] The vehicle 10 may be any of an engine vehicle, a hybrid vehicle, and an electric vehicle, but in the first embodiment, the vehicle 10 is an engine vehicle as an example. An on-board device 20 mounted on the vehicle 10 acquires images captured by an artificial satellite 50 (hereinafter also referred to as "satellite images") from the artificial satellite 50. Note that the satellite images may be images of a ground area of, for example, 0.5 km to 20 km square. The ground includes land, lakes, ponds, seas, etc. The on-board device 20 is an example of an "information processing device."

[0022] The user device 70 is a computer owned by a specific user. The users include police, insurance companies, security companies, etc. The vehicle-mounted device 20 and the user device 70 are connected via a network N.

[0023] 1 shows only one artificial satellite 50, it is desirable that the artificial satellite 50 be made up of multiple artificial satellites that can photograph the same point on the earth. In addition, the number of times that the artificial satellite 50 orbits the earth per day, the orbital altitude of the artificial satellite 50, etc. are arbitrary.

[0024] Next, a description will be given of the hardware configuration of the vehicle 10. FIG.

[0025] As shown in FIG. 2, the vehicle 10 includes an in-vehicle device 20, an ECU (Electronic Control Unit) 30, and an in-vehicle device 40.

[0026] The vehicle-mounted device 20 includes a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, a storage unit 24, an in-vehicle communication I / F (Interface) 25, an input / output I / F 26, and a wireless communication I / F 27. The CPU 21, the ROM 22, the RAM 23, the storage unit 24, the in-vehicle communication I / F 25, the input / output I / F 26, and the wireless communication I / F 27 are connected to each other via an internal bus 28 so as to be able to communicate with each other.

[0027] The CPU 21 is a central processing unit that executes various programs and controls each part. That is, the CPU 21 reads programs from the ROM 22 or the storage unit 24 and executes the programs using the RAM 23 as a work area. The CPU 21 controls each of the above components and performs various arithmetic processing in accordance with the programs recorded in the ROM 22 or the storage unit 24.

[0028] The ROM 22 stores various programs and various data. The RAM 23 serves as a working area for temporarily storing programs or data.

[0029] The storage unit 24 is configured by a storage device such as an eMMC (embedded Multi Media Card) or a UFS (Universal Flash Storage), and stores various programs and various data. The storage unit 24 stores a control program 24A for causing the CPU 21 to execute control processing, which will be described later.

[0030] The in-vehicle communication I / F 25 is an interface for connecting to the ECU 30. The interface uses a communication standard based on the CAN protocol. The in-vehicle communication I / F 25 is connected to an external bus 29. Although not shown in the figure, multiple ECUs 30 are provided for each function of the vehicle 10.

[0031] The input / output I / F 26 is an interface for communicating with an in-vehicle device 40 mounted on the vehicle 10 .

[0032] The on-vehicle devices 40 are various devices mounted on the vehicle 10. The control system 100 according to the first embodiment includes, as examples of the on-vehicle devices 40, a camera 40A and a monitor 40B.

[0033] The camera 40A is, for example, an imaging device that captures images using an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. For example, the camera 40A includes a first camera provided at the front of the vehicle 10 to capture an image ahead of the vehicle, and a second camera provided at the rear of the vehicle 10 to capture an image behind the vehicle. In the control system 100 according to the first embodiment, the camera 40A is used as a drive recorder, and images captured by the camera 40A are stored in the storage unit 24. The number of cameras 40A is not limited, and a separate camera may be provided to capture images to the sides of the vehicle, or only a camera may be provided to capture images in one of the directions ahead, behind, or to the sides of the vehicle.

[0034] The monitor 40B is a liquid crystal monitor provided on an instrument panel, a meter panel, or the like, for displaying operation suggestions related to functions of the vehicle 10 and images related to explanations of the functions. The monitor 40B may be provided as a touch panel that also has an input function.

[0035] The wireless communication I / F 27 is a wireless communication module for communicating with the outside. The wireless communication module uses communication standards such as 5G, LTE, and Wi-Fi (registered trademark). The wireless communication I / F 27 is connected to a network N.

[0036] Next, a description will be given of the functional configuration of the vehicle 10. Fig. 3 is a block diagram showing an example of the functional configuration of the vehicle 10.

[0037] 3, the CPU 21 of the vehicle-mounted device 20 has, as functional components, an acquisition unit 21A, an analysis unit 21B, a control unit 21C, and a provision unit 21D. Each functional component is realized by the CPU 21 reading and executing a control program 24A stored in the storage unit 24.

[0038] The acquisition unit 21A acquires an image obtained by capturing an overhead view of the periphery of the vehicle 10, specifically, a satellite image obtained by an artificial satellite 50 capturing an image of the periphery of the vehicle 10 on the ground.

[0039] The analysis unit 21B analyzes the satellite image acquired by the acquisition unit 21A. As an example, the analysis unit 21B uses a known image recognition technology to analyze whether or not there is a danger to the vehicle 10 from a satellite image taken around the vehicle 10. Specifically, the analysis unit 21B detects that there is a danger to the vehicle 10 when a predetermined dangerous situation is detected from the satellite image. The predetermined dangerous situation is stored in the storage unit 24 and can be updated as appropriate. The danger to the vehicle 10 includes both incidents and accidents. For example, the incidents include the presence of a suspicious person or a dangerous object and an attempted car break-in, and the accidents include a hit-and-run or a car break-in.

[0040] Based on the analysis result of the satellite image by analysis unit 21B, control unit 21C controls camera 40A as in-vehicle device 40 mounted on vehicle 10 that appears in the satellite image. Specifically, when control unit 21C detects a danger to vehicle 10 from the analysis result of the satellite image, control unit 21C causes camera 40A to start capturing an image. In this case, control unit 21C controls the angle of view of camera 40A so that the position where the danger to vehicle 10 was detected is included in the capturing range.

[0041] When the analysis result of the satellite image by the analysis unit 21B indicates that there is a danger to the vehicle 10, the providing unit 21D transmits the satellite image and the current position of the vehicle 10 to the user device 70. The current position of the vehicle 10 can be acquired from a GPS (Global Positioning System) device (not shown) serving as the in-vehicle device 40.

[0042] Next, the hardware configuration of the user device 70 will be described. FIG. 4 is a block diagram showing the hardware configuration of the user device 70. The user device 70 can be a general-purpose computer device such as a server computer or a PC (Personal Computer), or a mobile terminal such as a smartphone or a tablet terminal. In the first embodiment, the user device 70 is a "PC."

[0043] 4, the user device 70 includes a CPU 71, a ROM 72, a RAM 73, a storage unit 74, an input unit 75, a display unit 76, and a communication unit 77. Each component is connected to each other via a bus 78 so as to be able to communicate with each other.

[0044] The CPU 71 is a central processing unit that executes various programs and controls each part. That is, the CPU 71 reads programs from the ROM 72 or the storage unit 74 and executes the programs using the RAM 73 as a work area. The CPU 71 controls each of the above components and performs various arithmetic processing in accordance with the programs recorded in the ROM 72 or the storage unit 74.

[0045] The ROM 72 stores various programs and various data. The RAM 73 serves as a working area for temporarily storing programs or data.

[0046] The storage unit 74 is configured by a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory, and stores various programs and various data.

[0047] The input unit 75 includes a pointing device such as a mouse, a keyboard, a microphone, a camera, and the like, and is used to perform various inputs.

[0048] The display unit 76 is, for example, a liquid crystal display, and displays various information. The display unit 76 may function as the input unit 75 by adopting a touch panel system.

[0049] The communication unit 77 is an interface for communicating with other devices. For this communication, for example, a wired communication standard such as Ethernet (registered trademark) or FDDI, or a wireless communication standard such as 4G, 5G, Bluetooth (registered trademark), or Wi-Fi (registered trademark) is used. The communication unit 77 is connected to a network N.

[0050] 5 is a first flowchart showing the flow of a control process in which the in-vehicle device 20 controls the in-vehicle equipment 40. The control process is performed by the CPU 21 reading the control program 24A from the storage unit 24, expanding it into the RAM 23, and executing it.

[0051] 5, the CPU 21 acquires a satellite image of the area around the vehicle 10 from the artificial satellite 50. Then, the CPU 21 proceeds to step S11. As an example, the CPU 21 periodically acquires satellite images from the artificial satellite 50.

[0052] In step S11, the CPU 21 analyzes whether there is a danger to the vehicle 10 from the satellite image acquired in step S10, and if it detects that there is a danger to the vehicle 10 (step S11: YES), it proceeds to step S12. On the other hand, if the CPU 21 detects that there is no danger to the vehicle 10 (step S11: NO), it ends the control process.

[0053] In step S12, CPU 21 controls the angle of view of camera 40A so that the position where a danger to vehicle 10 has been detected is included in the imaging range, and starts imaging by camera 40A. CPU 21 then proceeds to step S13.

[0054] In step S13, the CPU 21 transmits the satellite image acquired in step S10 and the current position of the vehicle 10 to the user device 70. Then, the CPU 21 ends the control process.

[0055] As described above, in the in-vehicle device 20 according to the first embodiment, the CPU 21 acquires a satellite image. Then, based on the analysis result of the acquired satellite image, the CPU 21 controls the in-vehicle device 40 mounted on the vehicle 10 that appears in the satellite image. This allows the in-vehicle device 20 to control the in-vehicle device 40 mounted on the vehicle 10 at a timing determined by viewing the surroundings of the vehicle 10 from a bird's-eye view.

[0056] Furthermore, in the vehicle-mounted device 20 according to the first embodiment, when a danger to the vehicle 10 is detected from the analysis result of the satellite image, the CPU 21 starts capturing images using the camera 40A. This allows the vehicle-mounted device 20 to start capturing images using the camera 40A at the timing when a danger to the vehicle 10 is detected by viewing the surroundings of the vehicle 10 from a bird's-eye view.

[0057] Furthermore, in the vehicle-mounted device 20 according to the first embodiment, the CPU 21 controls the angle of view of the camera 40A so that the position where a danger to the vehicle 10 is detected is included in the photographing range. This increases the possibility that the vehicle-mounted device 20 will photograph an object that triggers the detection of a danger to the vehicle 10.

[0058] Furthermore, in the vehicle-mounted device 20 according to the first embodiment, when a danger to the vehicle 10 is detected from the analysis results of the satellite image, the CPU 21 provides the satellite image and the current location of the vehicle 10 to a predetermined user. As a result, when a problem occurs to the vehicle 10 based on the detected danger, the vehicle-mounted device 20 can contribute to solving the problem. Specifically, the CPU 21 can transmit the satellite image and the current location of the vehicle 10 to the user device 70 held by the user, thereby preventing accidents or incidents from occurring and providing on-site materials when an accident or incident occurs.

[0059] (Second embodiment) Next, a second embodiment of the control system 100 according to the present invention will be described while omitting or simplifying parts that overlap with the above embodiment.

[0060] Based on the analysis result of the satellite image by the analysis unit 21B, the control unit 21C of the second embodiment controls the monitor 40B as the in-vehicle device 40 mounted on the vehicle 10 that appears in the satellite image. Specifically, when the vehicle 10 is in the process of parking in a parking lot, the control unit 21C causes the monitor 40B to display an overhead image of the vehicle 10 that appears in the satellite image. As an example, the control unit 21C determines whether the vehicle 10 is in the process of parking in a parking lot based on the shift position of a shift lever (not shown) as the in-vehicle device 40, the current position of the vehicle 10, and the like.

[0061] FIG. 6 is a second flowchart showing the flow of the control process. 6, the CPU 21 acquires a satellite image of the area around the vehicle 10 taken from the artificial satellite 50. Then, the CPU 21 proceeds to step S21.

[0062] In step S21, the CPU 21 determines whether the vehicle 10 is being parked in a parking lot, and if it determines that the vehicle 10 is being parked in a parking lot (step S21: YES), the process proceeds to step S22. On the other hand, if the CPU 21 determines that the vehicle 10 is not being parked in a parking lot (step S21: NO), the control process ends.

[0063] In step S22, the CPU 21 causes the monitor 40B to display an overhead image of the vehicle 10 captured in the satellite image acquired in step S20. Then, the CPU 21 ends the control process.

[0064] As described above, in the vehicle-mounted device 20 according to the second embodiment, the CPU 21 displays an overhead image of the vehicle 10 captured in a satellite image on the monitor 40B when the vehicle 10 is being parked in a parking lot. This allows the vehicle 10 to be parked while viewing an image of the actual vehicle 10, thereby reducing the sense of discomfort felt by the occupant regarding the content displayed on the monitor 40B as parking assistance.

[0065] (others) In the above embodiment, the in-vehicle device 20 is an example of an information processing device. However, the information processing device is not limited to this. Another device (e.g., a server) capable of acquiring satellite images from the artificial satellite 50 may also be an example of the information processing device. Alternatively, a combination of the in-vehicle device 20 and the other device may also be an example of the information processing device. For example, when the other device is an example of the information processing device, the control system 100 can monitor the surroundings of multiple vehicles 10 based on satellite images and control the in-vehicle equipment 40 mounted on the corresponding vehicle 10 at a timing determined by viewing the surroundings of each vehicle 10 from a bird's-eye view. Furthermore, when the other device is an example of the information processing device, the other device determines whether the vehicle 10 is parking in a parking lot based on the analysis result of the satellite image. Then, based on the determination by the other device that the vehicle 10 is parking in a parking lot, the control system 100 displays an overhead image of the vehicle 10 captured in the satellite image on the monitor 40B.

[0066] In the above embodiment, the camera 40A or the monitor 40B is used as an example of the in-vehicle device 40 that is controlled at a timing determined by viewing the surroundings of the vehicle 10 from a bird's-eye view, but the example of the in-vehicle device 40 is not limited to this. For example, if a danger to the vehicle 10 is detected from the analysis results of the satellite image, a predetermined warning sound may be output from a speaker (not shown) as the in-vehicle device 40, or a lamp (not shown) as the in-vehicle device 40 may be turned on in a predetermined pattern.

[0067] In the above embodiment, when the analysis of the satellite image detects a danger to the vehicle 10, the CPU 21 provides the satellite image and the current location of the vehicle 10 to a specified user. However, this is not limited to this, and the CPU 21 may provide either the satellite image or the current location of the vehicle 10 to a specified user.

[0068] In the above embodiment, the control processing executed by the CPU 21 after reading the software (program) may be executed by various processors other than a CPU. Examples of such processors include programmable logic devices (PLDs) such as field-programmable gate arrays (FPGAs), whose circuit configuration can be changed after fabrication, and dedicated electrical circuits such as application-specific integrated circuits (ASICs), which are processors with circuit configurations specifically designed to execute specific processing. The control processing may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0069] In the above embodiment, the control program 24A is pre-stored (installed) in the storage unit 24, but the present invention is not limited to this. The control program 24A may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. The control program 24A may also be downloaded from an external device via the network N. [Explanation of symbols]

[0070] 10 vehicles 20 In-vehicle device (information processing device) 21A Acquisition Department 21C Control Unit 21D Providing Department 40 In-vehicle equipment 40A Camera 40B Monitor 50 satellites

Claims

1. an acquisition unit that acquires satellite images of the ground taken by an artificial satellite; an analysis unit that uses image recognition technology to analyze the satellite images acquired by the acquisition unit to determine whether or not there is a risk to a vehicle captured in the satellite images; a control unit that controls an on-board device mounted on the vehicle based on the analysis result of the satellite image; a providing unit that, when a risk to the vehicle is detected from the analysis result of the satellite image, transmits the satellite image and the current location of the vehicle to a user device that is a computer owned by the police, an insurance company, or a security company; a storage unit in which a predetermined dangerous situation is stored; Equipped with the analysis unit detects that there is a danger to the vehicle when the predetermined dangerous situation stored in the storage unit is detected from the satellite image, and When a danger to the vehicle is detected, the control unit outputs a predetermined warning sound from a speaker serving as the in-vehicle device and lights up a lamp serving as the in-vehicle device in a predetermined pattern. Information processing device.

2. The control unit When a danger to the vehicle is detected from the analysis result of the satellite image, the camera serving as the in-vehicle device starts taking pictures. The information processing device according to claim 1 .

3. The control unit controlling the angle of view of the camera so that the position where a danger to the vehicle is detected is included in the photographing range; The information processing device according to claim 2 .

4. The danger to the vehicle includes both incidents corresponding to the presence of a suspicious person or a dangerous object and attempted vehicle break-in, and accidents corresponding to hit-and-run or vehicle break-in, the analysis unit is capable of updating the predetermined dangerous situation that indicates a danger to the vehicle and is stored in the storage unit. The information processing device according to claim 1 .

5. The control unit When the vehicle is being parked in a parking lot, an overhead image of the vehicle captured in the satellite image is displayed on a monitor serving as the in-vehicle device. The information processing device according to claim 1 .

Images