Information processing device

Abstract

Further streamlining of vehicle-related monitoring. [Solution] The information processing device includes a communication unit that communicates with a plurality of vehicles, each capable of imaging its surroundings, and a control unit that, when the plurality of vehicles are parked in a predetermined area, sends an instruction to a first vehicle that meets the conditions for performing monitoring to perform imaging, and to a second vehicle that does not meet the conditions to stop imaging.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus.

Background Art

[0002] In order to verify the surrounding situation after a theft or the like occurs in a parked vehicle, imaging means around the vehicle such as a drive recorder is known. For example, Patent Document 1 discloses a technique for synthesizing and displaying imaging images captured by a plurality of cameras mounted on a vehicle.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is room for rationalizing resources for monitoring the surroundings of a vehicle.

[0005] Hereinafter, an information processing apparatus and the like that enable further rationalization of monitoring the surroundings of a vehicle will be disclosed.

Means for Solving the Problems

[0006] The information processing apparatus in the present disclosure includes a communication unit that communicates with a plurality of vehicles each capable of imaging the surroundings, and a control unit that, when the plurality of vehicles are parked in a predetermined area, sends an instruction to cause a first vehicle that satisfies a condition for executing monitoring to perform imaging and to cause a second vehicle that does not satisfy the condition to stop imaging.

Effects of the Invention

[0007] According to the information processing apparatus and the like in the present disclosure, further rationalization of monitoring the surroundings of a vehicle becomes possible.

Brief Description of the Drawings

[0008] [Figure 1] This is a diagram showing an example of the configuration of an information provision system. [Figure 2] This is a sequence diagram showing an example of the operating procedure of the information provision system. [Modes for carrying out the invention]

[0009] The embodiments will be described below with reference to the drawings.

[0010] Figure 1 shows an example of the configuration of a vehicle control system in one embodiment. The vehicle control system 1 has one or more server devices 10, two or more in-vehicle devices 12, and one or more terminal devices 15 that are connected to each other via a network 11 so as to be able to communicate information with each other. The server device 10 corresponds to the "information processing device" in this embodiment and is, for example, one or more server computers that belong to a cloud computing system or other computing system and function as a server that implements various functions. The in-vehicle devices 12 are installed in two or more vehicles 13. The vehicles 13 are passenger cars, commercial vehicles, etc., and include internal combustion engine vehicles, hybrid vehicles (HEV; Hybrid Electric Vehicle), plug-in hybrid vehicles (PHEV; Plug-in Hybrid Electric Vehicle), etc. The in-vehicle devices 12 are computers having communication functions and information processing functions, and control the operation of the vehicles 13 and the operation of the imaging device 14 installed in the vehicles 13. The imaging device 14 is a so-called drive recorder device, comprising a digital camera and its control circuit, positioned to capture images of at least the surrounding area outside the vehicle 13, and operating on power supplied from a battery mounted on the vehicle 13. The terminal device 15 is an information processing device equipped with communication functions, including, for example, a personal computer or a smartphone. The network 11 includes, for example, a mobile communication network, the internet, an ad hoc network, a LAN (Local Area Network), a MAN (Metropolitan Area Network), or other networks or any combination thereof.

[0011] In this embodiment, the server device 10 includes a communication unit 101 and a control unit 103. The communication unit 101 communicates with a plurality of vehicles 13, each capable of imaging its surroundings. When the plurality of vehicles 13 are parked in a predetermined area (hereinafter referred to as the target area), the control unit 103 instructs the first vehicle 13 that satisfies the conditions for performing monitoring (hereinafter referred to as the monitoring conditions) to perform imaging, and sends an instruction to the second vehicle 13 that does not satisfy the monitoring conditions to stop imaging (hereinafter, when distinguishing between the first and second vehicles 13, they will be referred to as vehicle 13-A and 13-B, respectively). Here, the target area is any area where a plurality of vehicles 13 can be parked, such as a parking lot or parking area. Vehicle 13-A that satisfies the monitoring conditions sends the image of the target area to the server device 10 at an arbitrary interval, and the image is stored in the server device 10. The image stored in the server device 10 is acquired by a terminal device 15 during on-site inspections, etc., and can be viewed by an operator via the terminal device 15.

[0012] When multiple vehicles 13 are parked in the target area, there is a high probability that the imaging ranges of the multiple vehicles 13 will overlap, so imaging by all vehicles 13 would lead to a waste of resources. In this regard, it is possible to eliminate waste by having vehicle 13-A, which meets the monitoring conditions, perform imaging, and having the other vehicles 13-B, which do not meet the monitoring conditions, stop imaging.

[0013] The monitoring conditions are that the battery level of vehicle 13 is above a certain standard, or that vehicle 13 can receive power from an external power source. The standard for battery level is an arbitrary SOC (State of Charge) value, for example, 50% to 60%. Alternatively, the standard may be the average, maximum, or arbitrary standard deviation of the battery levels of multiple vehicles 13. Furthermore, there may be multiple vehicles 13-A that meet the monitoring criteria. In a parked vehicle 13, the imaging device 14 is powered by the battery, and power is required to continue imaging in the target area for a certain period of time. By making battery level or power supply from an external power source a monitoring condition, it becomes possible to ensure more reliable operation of the monitoring vehicle 13-A. In other words, it becomes possible to further streamline the monitoring of the area around vehicle 13.

[0014] Alternatively, the monitoring condition is that the number of other vehicles that can be imaged in the target area is above a certain threshold. The threshold for the number of other vehicles is any number between 1 and N (a natural number), where N is the number of multiple vehicles 13 parked in the target area, for example, N-1. Furthermore, there may be multiple vehicles 13-A that satisfy the monitoring criterion. Since the imageable area in the target area differs for each vehicle 13 due to factors such as the installation position of the imaging device 14 on the vehicle 13, the camera's focal length and field of view, and the parking position of the vehicle 13, setting the monitoring condition as the number of other vehicles that can be imaged in the target area being above a certain threshold makes it possible to image and monitor a larger number of other vehicles 13 in the target area using a smaller number of vehicles 13. In other words, it becomes possible to further streamline the monitoring around the vehicle 13.

[0015] An example configuration of the server device 10 will be described. The server device 10 includes a communication unit 101, a control unit 103, and a storage unit 102. The server device 10 may be a single computer, or it may consist of two or more computers that are connected and operate in coordination with each other. When the server device 10 consists of two or more computers, the configuration shown in Figure 1 is appropriately arranged on the two or more computers.

[0016] The communication unit 101 includes one or more communication interfaces. The communication interface is, for example, a LAN interface. The communication unit 101 receives information used in the operation of the control unit 103 and transmits information obtained through the operation of the control unit 103. The server device 10 is connected to the network 11 by the communication unit 101 and communicates information with the in-vehicle device 12, terminal device 15, etc. via the network 11.

[0017] The storage unit 102 includes, for example, one or more semiconductor memories, one or more magnetic memories, one or more optical memories, or a combination of at least two of these, which function as main memory, auxiliary memory, or cache memory. The semiconductor memory is, for example, RAM (Random Access Memory) or ROM (Read Only Memory). The RAM is, for example, SRAM (Static RAM) or DRAM (Dynamic RAM). The ROM is, for example, EEPROM (Electrically Erasable Programmable ROM). The storage unit 102 stores information used in the operation of the control unit 103 and information obtained by the operation of the control unit 103.

[0018] The control unit 103 includes one or more processors, one or more dedicated circuits, or a combination thereof. The processors are, for example, general-purpose processors such as CPUs (Central Processing Units) or dedicated processors such as GPUs (Graphics Processing Units) specialized for specific processing. The dedicated circuits are, for example, FPGAs (Field-Programmable Gate Arrays) or ASICs (Application Specific Integrated Circuits). The control unit 103 controls each part of the server device 10 and performs information processing related to the operation of the server device 10.

[0019] The functions of the server device 10 are realized by executing a control program on a processor included in the control unit 103. The control program is a program that causes a computer to execute the processing steps included in the operation of the server device 10, thereby realizing the functions corresponding to the processing of those steps. In other words, the control program is a program that causes a computer to function as the server device 10. Furthermore, some or all of the functions of the server device 10 may be realized by a dedicated circuit included in the control unit 103. In addition, the control program may be stored in a non-transient recording / storage medium readable by the server device 10, and the server device 10 may read it from the medium.

[0020] The configuration of the in-vehicle device 12 will now be described. The in-vehicle device 12 consists of one or more control devices and a communication device and other devices. The control device includes a microcomputer such as an ECU (Electronic Control Unit). The control device has a user interface and can receive information input by user operation and output information obtained through information processing. The communication device includes a DCM (Data Communication Module) and is connected to the network 11 by mobile communication and configured to communicate information with the server device 10 via the network 11. In addition, the in-vehicle device 12 and each part of the vehicle 13 are connected to communicate information via an in-vehicle network compliant with standards such as CAN (Controller Area Network). The in-vehicle device 12 controls the operation of the vehicle 13 by acquiring detection results from sensors such as vehicle speed and acceleration of the vehicle 13 and controlling various actuators that perform the operation of the vehicle 13, and also controls the operation of the imaging device 14 to acquire captured images from the imaging device 14. Furthermore, the in-vehicle device 12 has one or more GNSS (Global Navigation Satellite System) receivers and acquires the position information of the vehicle 13. The in-vehicle device 12 may also include information processing devices such as a navigation system, smartphone, or tablet terminal.

[0021] FIG. 2 is a sequence diagram for explaining the operation procedure of the vehicle control system 1 in the present embodiment. FIG. 2 shows the procedure related to the cooperative operation of the server device 10, the in-vehicle device 12 of the vehicle 13, and the terminal device 15. The steps related to various information processing of the server device 10 in FIG. 2 are executed by the control unit 103. Further, the steps related to the transmission and reception of various information of the server device 10 are executed by the control unit 103 transmitting and receiving information via the communication unit 101. In the server device 10, the control unit 103 appropriately stores the information to be processed, referred to, or transmitted and received in the storage unit 102. Further, the operation of the vehicle 13 in the present embodiment is realized by the operation of the in-vehicle device 12 in FIG. 2.

[0022] In S201, the server device 10 requests the in-vehicle device 12 for location information. The server device 10, for example, stores in advance the identification information for each in-vehicle device 12 necessary for transmitting and receiving information to and from one or more in-vehicle devices 12 to be coordinated. Then, the server device 10 sends information requesting location information to each in-vehicle device 12 based on the identification information. [[ID=z]]

[0023] In S202, the in-vehicle device 12 responds to the request from the server device 10 and sends the location information to the server device 10.

[0024] S201 and S202 are executed at an arbitrary cycle, for example, at a cycle of several minutes.

[0025] In S203, the server device 10 groups a plurality of vehicles 13. When the server device 10 determines that a predetermined number of vehicles 13 have parked in the monitoring target area based on the location information of each vehicle 13, the server device 10 groups the vehicles 13 parked in the monitoring target area. The server device 10 determines that a vehicle 13 has parked when the position of the vehicle 13 does not move for a certain period of time in the monitoring target area on the map based on the map information stored in advance. Then, the server device 10 stores the identification information of the grouped vehicles 13 in association with each other.

[0026] In S204, the server device 10 requests either or both power information and captured images from the on-board devices 12 of the grouped vehicles 13. The power information consists of either or both information regarding the remaining charge of the battery installed in the vehicle 13 and information indicating whether or not power is being supplied from an external source.

[0027] In S205, the in-vehicle device 12 sends either or both power information and / or captured images to the server device 10 in response to a request from the server device 10. For example, the in-vehicle device 12 acquires the remaining charge or battery status of the battery mounted on the vehicle 13 using a sensor and sends information about the remaining battery charge or information indicating that power is being supplied from an external source to the server device 10. The in-vehicle device 12 also has the imaging device 14 capture images of the area around the vehicle 13 and sends a specified number of captured images to the server device 10.

[0028] In S206, the server device 10 selects a vehicle 13-A for monitoring. Based on the captured images or power information collected from the grouped vehicles 13, the server device 10 selects a vehicle 13 that satisfies the monitoring conditions as vehicle 13-A. For example, the server device 10 selects a vehicle 13 as vehicle 13-A if its battery level is above a certain standard or if it is receiving power from an external power source. Alternatively, the server device 10 selects a vehicle 13 as vehicle 13-A if the number of other vehicles that can be imaged in the target area is above a certain standard. The server device 10 detects the number of other vehicles that are captured in the images from the captured images of each vehicle 13 by image processing such as pattern matching. Alternatively, the server device 10 may select a vehicle 13 as vehicle 13-A if its power information meets the standard and its captured images meet the standard. The server device 10 determines the other vehicles 13 that were not selected as vehicle 13-A as vehicle 13-B.

[0029] In S207, the server device 10 sends an imaging start instruction to vehicle 13-A, which has been selected as a monitoring vehicle because it meets the monitoring conditions, and an imaging stop instruction to vehicle 13-B, which has not been selected as a monitoring vehicle because it does not meet the monitoring conditions.

[0030] In S208, the on-board device 12 of vehicle 13-A instructs the imaging device 14 to start imaging in response to an imaging start instruction, and the on-board device 12 of vehicle 13-B instructs the imaging device 14 to stop imaging in response to an imaging stop instruction. As a result, imaging of the target area is started in vehicle 13-A, and surveillance for crime prevention is carried out. On the other hand, by stopping imaging in vehicle 13-B, unnecessary power consumption can be suppressed. After imaging is started by vehicle 13-A, direct crime prevention measures such as impact detection are carried out in each vehicle 13-A and 13-B, respectively. For example, when the on-board device 12 detects an impact to the vehicle body, windows, etc. using an acceleration sensor, it executes processing such as activating an alarm.

[0031] In the modified version, the server device 10 stores user information for each vehicle 13, linked to the vehicle information, and processes a system to provide economic incentives to the users of the vehicle 13 selected as the monitoring vehicle 13-A. This makes it possible to encourage user satisfaction for contributing to collective crime prevention measures, including vehicle 13-B.

[0032] According to the operation of the vehicle control system 1 as described above, it is possible to eliminate waste by having vehicle 13-A that meets the monitoring conditions perform imaging and having other vehicles 13-B that do not meet the monitoring conditions stop imaging.

[0033] As described above, embodiments have been explained based on various drawings and examples, but it should be noted that those skilled in the art will find it easy to make various modifications and alterations based on this disclosure. Therefore, it should be noted that these modifications and alterations are within the scope of this disclosure. For example, the functions, etc., included in each means, each step, etc., can be rearranged in a logically consistent manner, and multiple means, steps, etc., can be combined into one or divided. [Explanation of symbols]

[0034] 1. Information provision system, 10. Server equipment, 11. Network, 12. In-vehicle equipment, 13 Vehicle, 14 Imaging device, 15 Terminal device, 101 Communication unit, 102 Storage unit, 103 Control unit

Claims

1. Each unit communicates with multiple vehicles capable of imaging their surroundings, When the control unit determines, based on the position of each vehicle, that the plurality of vehicles are parked in a predetermined area, it sends an instruction to a first vehicle to perform imaging if the vehicle's battery level is above a certain standard, it is possible to receive power from an external power source, or the number of other vehicles that can be imaged in the predetermined area is above a certain standard, and sends an instruction to a second vehicle that does not meet the above conditions to stop imaging, and the control unit to stop imaging An information processing device having

2. Each unit communicates with multiple vehicles capable of imaging their surroundings, When the aforementioned multiple vehicles are parked in a predetermined area, a control unit sends an instruction to the first vehicle that satisfies the conditions for performing surveillance of the predetermined area to perform imaging, and to the second vehicle that does not satisfy the conditions to stop imaging. An information processing device having

3. The aforementioned conditions are that the vehicle's battery level is above a certain standard, or that it is possible to receive power from an external power source. The information processing apparatus according to claim 2.

4. The aforementioned condition is that the number of other vehicles capable of being imaged in the predetermined area is equal to or greater than the standard. The information processing apparatus according to claim 2.

5. The control unit determines whether the condition is met or not based on the captured image of each vehicle. The information processing apparatus according to claim 4.

Images