Information processing device

Abstract

To provide a technology effective for ensuring security of a vehicle.SOLUTION: An information processing device is mounted on a vehicle including a plurality of cameras. A control unit of the information processing device determines an order of priority of a plurality of pieces of recorded data recorded by the plurality of cameras in response to an occurrence of a predetermined event during parking of the vehicle. On that occasion, the control unit determines the order of priority of the plurality of pieces of recorded data such that recorded data having the highest correlation with the predetermined event among the plurality of pieces of recorded data is the highest order. The control unit uploads the plurality of pieces of recorded data to a predetermined server in an order in accordance with the determined order of priority.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present disclosure relates to an information processing device. [Background technology]

[0002] A system that issues an alarm when it detects a suspicious person in footage captured by a camera, and technology is known that changes the detection range for suspicious people depending on where the vehicle is parked (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-149088 A Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present disclosure is to provide a technology that is effective in ensuring vehicle security. [Means for solving the problem]

[0005] The present disclosure can be understood as an information processing device mounted on a vehicle equipped with a plurality of cameras. In this case, the information processing device may include, for example, determining a priority order of a plurality of pieces of recorded data recorded by the plurality of cameras in response to an occurrence of a predetermined event while the vehicle is parked; uploading the plurality of pieces of video recording data to an external server according to the determined priority order; The control unit is configured to:

[0006] The present disclosure can be regarded as an information processing method in which the processing of the above-mentioned information processing device is executed by a computer mounted on a vehicle, or as an information processing program for causing a computer mounted on a vehicle to execute the above-mentioned information processing method, or as a non-transitory storage medium for storing the information processing program. Effect of the Invention

[0007] According to the present disclosure, it is possible to provide a technique that is effective in ensuring the security of a vehicle. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an overview of a system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a software configuration of an in-vehicle device according to an embodiment. [Diagram 3] FIG. 11 is a diagram illustrating an example of a priority order according to an embodiment. [Figure 4] 4 is a flowchart showing a process flow executed by the in-vehicle device in the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] As a service to ensure the security of parked vehicles, a service that uploads recorded data from a camera to an external server when a specific event occurs in a parked vehicle is being considered. In such a service, the external server notifies the user of the occurrence of a specific event, and the user of the vehicle can check the recorded data uploaded to the server. This makes it possible.

[0010] However, when the above-mentioned service is implemented, it is expected that the amount of recorded data that can be uploaded from a vehicle to a server when a specific event occurs or the length of communication time that can be spent on uploading may be limited. Therefore, in a vehicle equipped with multiple cameras, it may become impossible to upload recorded data that is highly related to a specific event to the server. This may make it difficult to ensure the security of the vehicle.

[0011] Therefore, in the information processing device according to the present disclosure, the control unit determines the priority of the multiple recorded data recorded by the multiple cameras in response to the occurrence of a predetermined event while the vehicle is parked. As an example, in a vehicle equipped with a first camera for capturing images of the front of the vehicle, a second camera for capturing images of the rear of the vehicle, a third camera for capturing images of the surroundings of the vehicle, and a fourth camera for capturing images of the interior of the vehicle, if the predetermined event is the detection of an intrusion into the interior of the vehicle, the control unit may determine the highest priority for the recorded data of the fourth camera. Also, in a vehicle equipped with the first to fourth cameras, if the predetermined event is the detection of an impact, the control unit may determine the highest priority for the recorded data of the third camera.

[0012] In addition to the first to fourth cameras, in a vehicle equipped with a sensor (e.g., a multi-axis acceleration sensor) capable of identifying the direction in which the vehicle received an impact, the control unit may determine the direction in which the vehicle received an impact based on the detection signal of the sensor, and determine the priority order according to the determination result. As an example, when it is determined that the vehicle received an impact from the front, the control unit may determine the highest priority order for the recorded data of the first camera. Also, when it is determined that the vehicle received an impact from the rear, the control unit may determine the highest priority order for the recorded data of the second camera. Also, when it is determined that the vehicle received an impact from the side, the control unit may determine the highest priority order for the recorded data of the third camera.

[0013] When the priority order of the multiple recorded data is determined by the above-mentioned procedure, the control unit uploads the multiple recorded data to the server according to the determined priority order. That is, the control unit uploads the recorded data with the highest priority to the server first.

[0014] According to the information processing device of the present disclosure, among a plurality of recorded data recorded by a plurality of cameras, recorded data having a high relevance to a predetermined event can be preferentially uploaded to a server. As a result, even if the amount of recorded data that can be uploaded from a vehicle to a server when a predetermined event occurs or the communication time that can be spent on uploading is limited, recorded data having a high relevance to the predetermined event can be uploaded to the server more reliably.

[0015] The recording by each of the multiple cameras may be performed continuously while the vehicle is parked, or may be started when a predetermined event occurs as a trigger. When the recording by each of the multiple cameras is performed continuously while the vehicle is parked, only the recording data for a predetermined length of time including the time when the predetermined event occurs and before and after the occurrence may be uploaded to the server, or all the recording data from the start of recording to the start of uploading may be uploaded to the server.

[0016] Specific embodiments of the present disclosure will be described below with reference to the drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, and the like described in the following embodiments are not intended to limit the technical scope of the disclosure to only those.

[0017] <Embodiment> In this embodiment, an information processing device according to the present disclosure is applied to a system for monitoring parked vehicles. We will now give an example of its use.

[0018] (System Overview) 1 is a diagram showing an overview of a system according to this embodiment. The system according to this embodiment includes an in-vehicle device 100 and a server 200. The in-vehicle device 100 and the server 200 are connected to each other via a network. The network may be, for example, a WAN, which is a global public communication network such as the Internet, or another communication network.

[0019] The in-vehicle device 100 is a computer mounted on the vehicle 10, and corresponds to an "information processing device" according to the present disclosure. In one example, as shown in Fig. 1, the in-vehicle device 100 includes a processor 101, a main memory device 102, an auxiliary memory device 103, a front camera 104, a rear camera 105, an all-around camera 106, an in-vehicle camera 107, a multi-axis acceleration sensor 109, and a communication unit 110. Note that, although the example shown in Fig. 1 illustrates only the hardware configuration related to parking monitoring, the in-vehicle device 100 may include other hardware configurations.

[0020] The processor 101 is an arithmetic processing device such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The stored program is loaded into the main memory 102 and executed, and the in-vehicle device 100 is controlled through the execution.

[0021] The main memory 102 includes, for example, semiconductor memories such as a random access memory (RAM) and a read only memory (ROM). The main memory 102 provides a storage area and a working area for loading programs stored in the auxiliary memory 103. The main memory 102 is also used as a buffer for the arithmetic processing by the processor 101.

[0022] The auxiliary storage device 103 is, for example, an EPROM (Erasable Programmable ROM) or a The auxiliary storage device 103 is a removable medium, i.e. The auxiliary storage device 103 may include a portable recording medium. The removable medium is, for example, a disk recording medium such as a Universal Serial Bus (USB) memory, a Compact Disc (CD), or a Digital Versatile Disc (DVD). The auxiliary storage device 103 stores various programs and data used by the processor 101 when executing each program. The programs stored in the auxiliary storage device 103 include an OS (Operating System) as well as a dedicated program for causing the processor 101 to execute processing related to parking monitoring. The data stored in the auxiliary storage device 103 also includes recording data from the front camera 104, the rear camera 105, the all-around camera 106, and the in-vehicle camera 107.

[0023] The front camera 104 captures an image in front of the vehicle 10. The rear camera 105 captures an image behind the vehicle 10. The all-around camera 106 captures an image around the vehicle 10 (a 360° range centered on the vehicle 10 in a plan view). The in-vehicle camera 107 captures an image of the interior of the vehicle 10. Note that, hereinafter, the front camera 104, the rear camera 105, the all-around camera 106, and the in-vehicle camera 107 may be collectively referred to as cameras 104-107.

[0024] The intrusion sensor 108 detects a moving object (e.g., a person) that has intruded into the interior of the vehicle 10. The intrusion sensor 108 is, for example, an infrared sensor or an ultrasonic sensor. The multi-axis acceleration sensor 109 detects acceleration in multiple directions including the front-rear direction, the left-right direction, and the height direction of the vehicle 10. In this embodiment, the detection signal of the multi-axis acceleration sensor 109 is used to determine the direction of an impact received by the parked vehicle 10.

[0025] The communication unit 110 is a communication interface for connecting the in-vehicle device 100 to a network. In one example, the communication unit 110 communicates with the network using a mobile communication system (e.g., LTE (Long Term Evolution), LTE-Advanced, 5G (5th Generation), 6G (6th Generation), etc.) or a wireless communication system such as Wi-Fi (registered trademark). The communication unit 110 communicates with the server 200 through the network.

[0026] (Software configuration of in-vehicle device) The software configuration of the in-vehicle device 100 in this embodiment will be described with reference to Fig. 2. As shown in Fig. 2, the in-vehicle device 100 has a control unit F110 as a software module. Note that the software configuration of the in-vehicle device 100 is not limited to the example shown in Fig. 2, and components may be added or replaced as appropriate.

[0027] The control unit F110 is realized by the processor 101 of the in-vehicle device 100 loading a dedicated program stored in the auxiliary storage device 103 into the main storage device 102 and executing the program. The control unit F110 is realized by an ASIC (Application Specific Integrated Circuit) Or it is realized by hardware circuits such as FPGA (Field Programmable Gate Array). This is also fine.

[0028] When the control unit F110 detects a predetermined event while the vehicle 10 is in a parked state, it starts recording by the cameras 104-107. The parked state of the vehicle 10 means a state in which the drive system is stopped (the ignition switch or the power switch is off), the doors are locked, and the occupants have exited the vehicle. The determination as to whether the occupants have exited the vehicle may be made based on the image data of the in-vehicle camera 107, based on a detection signal of a seat occupancy sensor, or based on a determination as to whether or not a smart key is present inside the vehicle 10.

[0029] The predetermined events in this embodiment are the intrusion of a moving object (e.g., a person) into the interior of the vehicle 10 and an impact to the vehicle 10. The intrusion of a moving object into the interior of the vehicle 10 is detected via the intrusion sensor 108. The intrusion of a moving object into the interior of the vehicle 10 may be determined based on whether or not unlocking of the door by an improper method is detected. The impact to the vehicle 10 is detected via the multi-axis acceleration sensor 109.

[0030] When a predetermined event occurs while the vehicle 10 is parked, the control unit F110 starts recording by the cameras 104-107. In one example, the recording time by the cameras 104-107 at that time may be a preset fixed time length (for example, several minutes to several tens of minutes). In another example, the recording time by the cameras 104-107 may be changed depending on the type of the predetermined event. That is, if the predetermined event is an impact to the vehicle 10, recording may be performed for a preset fixed time length, and if the predetermined event is the intrusion of a moving object into the interior of the vehicle 10, recording may be performed until the moving object leaves the interior.

[0031] The control unit F110 also determines the type of the predetermined event. The "type of the predetermined event" here includes the intrusion of a moving object into the interior of the vehicle 10, an impact from the front of the vehicle 10, an impact from the rear of the vehicle 10, an impact from the side of the vehicle 10, and the like. When the predetermined event is detected by the intrusion sensor 108, the control unit F110 determines that the type of the predetermined event is "intrusion of a moving object into the interior of the vehicle 10". When the predetermined event is detected by the multi-axis acceleration sensor 109, the control unit F110 analyzes the detection signal of the multi-axis acceleration sensor 109 to determine the direction of the impact received by the vehicle 10. That is, the control unit F110 determines whether the impact was from the front of the vehicle 10, the rear of the vehicle 10, or the side of the vehicle 10.

[0032] When the type of the predetermined event is determined, the control unit F110 The control unit F110 determines the priority order of the four recorded data recorded by the four cameras 104-107 according to the type of the recorded data. At that time, the control unit F110 determines the highest priority order for the recorded data that is most related to the specified event. Here, an example of the priority order of the recorded data is shown in FIG. 3.

[0033] In the example shown in Figure 3, when the type of specified event is the intrusion of a moving object into the interior of vehicle 10 ("Intrusion" in Figure 3), the priority is set in the order from top to bottom as "recording data from in-vehicle camera 107," "recording data from all-around camera 106," "recording data from front camera 104," and "recording data from rear camera 105."

[0034] When the type of specified event is an impact from the front of the vehicle 10 ("Front impact" in Figure 3), the priority is set in the following order from top to bottom: "Recorded data from front camera 104," "Recorded data from all-around camera 106," "Recorded data from rear camera 105," and "Recorded data from in-vehicle camera 107."

[0035] When the type of specified event is an impact from the rear of the vehicle 10 ("rear impact" in Figure 3), the priority is set in the following order from top to bottom: "recorded data from rear camera 105," "recorded data from all-around camera 106," "recorded data from front camera 104," and "recorded data from in-vehicle camera 107."

[0036] When the type of specified event is an impact from the side of the vehicle 10 ("side impact" in Figure 3), the priority is set in the following order from top to bottom: "recorded data from the all-around camera 106," "recorded data from the front camera 104," "recorded data from the rear camera 105," and "recorded data from the in-vehicle camera 107."

[0037] The priority order shown in FIG. 3 is merely an example, and the priority order other than the highest-ranked recorded data (first priority order) may be changed as appropriate depending on the embodiment.

[0038] When the priority order of the four recorded data recorded by the four cameras 104-107 is determined, the control unit F110 uploads the four recorded data to the server 200 in accordance with the determined priority order. In one example, when the type of the predetermined event is the intrusion of a moving object into the interior of the vehicle 10, the recorded data is uploaded to the server 200 in the order of "recorded data of the in-vehicle camera 107", "recorded data of the all-around camera 106", "recorded data of the front camera 104", and "recorded data of the rear camera 105". When the type of the predetermined event is an impact from the front of the vehicle 10, the recorded data is uploaded to the server 200 in the order of "recorded data of the front camera 104", "recorded data of the all-around camera 106", "recorded data of the rear camera 105", and "recorded data of the in-vehicle camera 107". Furthermore, when the type of the predetermined event is an impact from the rear of the vehicle 10, the recorded data is uploaded to the server 200 in the order of "recorded data from the rear camera 105," "recorded data from the all-around camera 106," "recorded data from the front camera 104," and "recorded data from the in-vehicle camera 107." When the type of the predetermined event is an impact from the side of the vehicle 10, the recorded data is uploaded to the server 200 in the order of "recorded data from the all-around camera 106," "recorded data from the front camera 104," "recorded data from the rear camera 105," and "recorded data from the in-vehicle camera 107."

[0039] The upload of the recorded data may be performed after the recording by the cameras 104-107 is completed, or may be performed in parallel with the recording by the cameras 104-107.

[0040] In addition, the cameras 104-107 may record images continuously while the vehicle 10 is parked. In this case, the control unit F110 selects the following from the recorded data of each of the cameras 104-107: Recorded data of a predetermined length of time including the time when a predetermined event occurs and before and after the occurrence may be uploaded to the server 200 .

[0041] (Processing flow) Next, the flow of processing executed by the in-vehicle device 100 in this embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing a processing routine executed by the in-vehicle device 100 when a predetermined event occurs while the vehicle 10 is parked (the ignition switch or power switch is off). The processing routine in Fig. 4 is executed by the processor 101 of the in-vehicle device 100, but here the processing routine will be described as being executed by a software module (control unit F110) of the in-vehicle device 100.

[0042] 4, the control unit F110 detects the occurrence of a predetermined event through the intrusion sensor 108 or the multi-axis acceleration sensor 109 (step S101). After completing the process of step S101, the control unit F110 executes the process of step S102.

[0043] In step S102, the control unit F110 transmits a recording start command to each of the cameras 104 to 107, thereby starting recording by the cameras 104 to 107. After completing the process of step S102, the control unit F110 executes the process of step S103.

[0044] In step S103, the control unit F110 determines the type of the predetermined event. At that time, if the predetermined event is detected by the intrusion sensor 108, the control unit F110 determines that the type of the predetermined event is "intrusion of a moving object into the interior of the vehicle 10". Also, if the predetermined event is detected by the multi-axis acceleration sensor 109, the control unit F110 analyzes the detection signal of the multi-axis acceleration sensor 109 to determine the direction of the impact received by the vehicle 10. That is, the control unit F110 determines whether the type of the predetermined event is "impact from the front of the vehicle 10", "impact from the rear of the vehicle 10", or "impact from the side of the vehicle 10". After completing the process of step S103, the control unit F110 executes the process of step S104.

[0045] In step S104, the control unit F110 determines the priority order of the four pieces of recorded data from the four cameras 104-107 according to the type of the predetermined event determined in step S103. In one example, the control unit F110 may determine the priority order of the four pieces of recorded data according to the order illustrated in Fig. 3. After completing the process of step S104, the control unit F110 executes the process of step S105.

[0046] In step S105, the control unit F110 uploads the four pieces of video recording data from the four cameras 104-107 to the server 200 in accordance with the priority order determined in step S104. After completing the process of step S105, the control unit F110 ends the execution of this processing routine.

[0047] (Actions and Effects of the Embodiments) In the in-vehicle device 100 of the embodiment described above, when a predetermined event is detected while the vehicle 10 is parked, the type of the predetermined event is determined, and the priorities of the four recorded data from the four cameras 104-107 are determined according to the determination result. Then, in the in-vehicle device 100 of this embodiment, the four recorded data are uploaded to the server 200 according to the determined priorities.

[0048] Therefore, according to the in-vehicle device 100 of this embodiment, the recorded data that is most related to a predetermined event among the four recorded data recorded by the four cameras 104-107 is selected. The recorded data most related to the predetermined event can be uploaded to the server 200 with priority. As a result, even if the amount of recorded data that can be uploaded from the in-vehicle device 100 to the server 200 when a predetermined event occurs or the communication time that can be spent on uploading is limited, the recorded data most related to the predetermined event can be more reliably uploaded to the server 200. As a result, the security of the parked vehicle 10 can be more reliably guaranteed.

[0049] <Other> The above-described embodiment is merely an example, and the present disclosure may be modified as appropriate within the scope of the present disclosure. For example, the number of cameras mounted on the vehicle 10 is not limited to four, and may be three or less, or may be five or more. Here, when an impact is detected in a vehicle equipped with only a 360° camera and an in-car camera, the priority of the recorded data of the 360° camera may be determined to be the highest.

[0050] In addition, when an impact is detected in a vehicle that is not equipped with a multi-axis acceleration sensor, the priority of the recorded data from the all-around camera may be determined to be the highest. Alternatively, depending on whether the vehicle is parked facing forward or backward, it may be determined whether the impact is from the front or rear, and the priority may be determined according to the determination result.

[0051] Furthermore, a process described as being performed by one device may be shared and executed by multiple devices. Or, a process described as being performed by different devices may be executed by one device. In a computer system, the hardware configuration for implementing each function can be flexibly changed. [Explanation of symbols]

[0052] 10 Vehicle, 100 In-vehicle device, 101 Processor, 102 Main memory device, 103 Auxiliary memory device, 104 Front camera, 105 Rear camera, 106 All-around camera, 107 In-vehicle camera, 108 Intrusion sensor, 109 Multi-axis acceleration sensor, 110 Communication unit, 200 Server

Claims

1. An information processing device mounted on a vehicle equipped with a plurality of cameras, determining a priority order of a plurality of pieces of recorded data recorded by the plurality of cameras in response to an occurrence of a predetermined event while the vehicle is parked; uploading the plurality of pieces of video recording data to a predetermined server in an order according to the priority; A control unit configured to execute Information processing device.

2. the plurality of cameras include a first camera that captures an image of a front area of ​​the vehicle, a second camera that captures an image of a rear area of ​​the vehicle, a third camera that captures an image of an area around the vehicle, and a fourth camera that captures an image of an interior of the vehicle; When the predetermined event is detection of an intrusion into the interior of the vehicle, the control unit determines the highest priority of the recorded data of the fourth camera. The information processing device according to claim 1 .

3. When the predetermined event is impact detection, the control unit determines the priority of the recorded data of the third camera to be the highest. The information processing device according to claim 2 .

4. the vehicle is equipped with a multi-axis acceleration sensor; When the predetermined event is an impact detection, the control unit determining a direction in which the vehicle received an impact based on a detection signal from the multi-axis acceleration sensor; When it is determined that the vehicle has received an impact from the front, determining that the priority of the video recording data of the first camera is the highest; When it is determined that the vehicle has received an impact from behind, determining that the priority of the video recording data of the second camera is the highest; and When it is determined that the vehicle has received a side impact, determining the highest priority of the video recording data of the third camera; and Execute The information processing device according to claim 2 .

Images