Processing system and processing method
The processing system collects image data from vehicles within a target area using wireless communication and validation, addressing the challenge of insufficient surveillance camera coverage by efficiently gathering and storing relevant data for incident investigation.
Patent Information
- Application Number
- JP2024027218
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-27
- Publication Date
- 2025-09-08
Smart Images

Figure 2025130208000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a processing system and a processing method. [Background technology]
[0002] In recent years, various technologies have been proposed that utilize image data obtained by a camera mounted on a vehicle to capture images of the vehicle's surroundings. For example, Patent Document 1 discloses a technology that utilizes image data obtained by a camera for autonomous driving. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2017 / 208781 Summary of the Invention [Problem to be solved by the invention]
[0004] Incidentally, image data obtained by cameras can also be used as viewable records. For example, viewing image data obtained by surveillance cameras and collected as records can help solve crimes and other incidents. However, the number of surveillance cameras installed is limited, and it can be difficult to collect sufficient amounts of desired image data. Therefore, a new mechanism for collecting desired image data is desired.
[0005] In view of the above, an object of the present invention is to provide a processing system and a processing method that are capable of collecting desired image data. [Means for solving the problem]
[0006] In order to solve the above problem, the processing system includes a first processing device, a second processing device, and at least one vehicle equipped with a camera, wherein the first processing device, the second processing device, and the vehicle are capable of wireless communication with each other, wherein the vehicle transmits vehicle position information, which is information regarding the vehicle's position, to the second processing device, wherein the first processing device transmits trigger information, which is information regarding the target area, to the second processing device, and the second processing device transmits a transmission request, based on the vehicle position information and the trigger information, to a vehicle that is currently or has previously been located within the target area, requesting the transmission of image data information, which is image data obtained by capturing images using the camera, and the vehicle that receives the transmission request transmits the image data information to the second processing device based on the transmission request, and the second processing device stores the image data information, and when transmitting the vehicle position information, the trigger information, the transmission request, and the image data information, the sender transmits communication data, which includes source data indicating the sender and destination data indicating the destination, to the destination, and the destination determines the validity of the communication data based on the source data and destination data in the communication data.
[0007] In order to solve the above problem, a processing method is provided in which a first processing device, a second processing device, and at least one vehicle equipped with a camera of a processing system are capable of wireless communication with each other, the vehicles transmit vehicle position information, which is information about the vehicle's position, to the second processing device, the first processing device transmits trigger information, which is information about the target area, to the second processing device, the second processing device transmits a transmission request, based on the vehicle position information and the trigger information, to vehicles currently or previously located within the target area, requesting the transmission of image data information, which is image data acquired by imaging by the camera, the vehicles that receive the transmission request transmit the image data information to the second processing device based on the transmission request, the second processing device stores the image data information, and at the time of transmitting the vehicle position information, the trigger information, the transmission request, and the image data information, the sender transmits communication data, which includes source data indicating the sender and destination data indicating the destination, to the destination, and the destination determines the validity of the communication data based on the source data and destination data in the communication data. [Effects of the Invention]
[0008] According to the present invention, it is possible to collect desired image data. [Brief explanation of the drawings]
[0009] [Figure 1] 1 is a schematic diagram illustrating a schematic configuration of a processing system according to an embodiment of the present invention. [Figure 2] 1 is a block diagram showing an example of a functional configuration of a control device for a vehicle according to an embodiment of the present invention; [Figure 3] FIG. 2 is a block diagram showing an example of the functional configuration of an engine terminal according to an embodiment of the present invention. [Figure 4] FIG. 2 is a block diagram illustrating an example of a functional configuration of a server according to an embodiment of the present invention. [Figure 5] FIG. 1 is a diagram for explaining an overview of a first scenario according to an embodiment of the present invention. [Figure 6]FIG. 3 is a sequence diagram showing an example of the flow of processing performed in a first scenario according to an embodiment of the present invention. [Figure 7] FIG. 10 is a diagram for explaining an overview of a second scenario according to an embodiment of the present invention. [Figure 8] FIG. 10 is a sequence diagram showing an example of the flow of processing performed in a second scenario according to an embodiment of the present invention. [Figure 9] FIG. 2 is a diagram illustrating an example of a target region according to an embodiment of the present invention. [Figure 10] FIG. 10 is a diagram for explaining an overview of a third scenario according to an embodiment of the present invention. [Figure 11] FIG. 10 is a sequence diagram showing an example of the flow of processing performed in a third scenario according to an embodiment of the present invention. [Figure 12] 1 is a diagram illustrating an example of installation of a camera in a vehicle according to an embodiment of the present invention. [Figure 13] FIG. 10 is a diagram for explaining an outline of a fourth scenario according to an embodiment of the present invention. [Figure 14] FIG. 10 is a sequence diagram showing an example of the flow of processing performed in a fourth scenario according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0010] Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Dimensions, materials, and other specific values shown in the embodiments are merely examples for facilitating understanding of the invention and, unless otherwise specified, do not limit the present invention. In this specification and drawings, elements having substantially the same functions and configurations are designated by the same reference numerals to avoid redundant explanation, and elements not directly related to the present invention are not shown.
[0011] <Processing system configuration> The configuration of a processing system 1 according to an embodiment of the present invention will be described with reference to FIGS.
[0012] Fig. 1 is a schematic diagram showing the overall configuration of a processing system 1. As shown in Fig. 1, the processing system 1 includes a vehicle 10, an engine terminal 20, and a server 30. Note that, for ease of understanding, one vehicle 10 is shown in Fig. 1, but in reality, the processing system 1 includes multiple vehicles 10. However, the number of vehicles 10 included in the processing system 1 is not particularly limited, and may be at least one.
[0013] The processing system 1 is a system that performs processing to collect desired image data. Specifically, the server 30 is capable of communicating with vehicles 10 registered in the processing system 1 and with an agency terminal 20, which is a terminal such as a personal computer used by an agency such as the police, via a wireless communication network N1. When an agency such as the police sends a request to collect desired image data (specifically, trigger information, which will be described later) to the server 30 via the agency terminal 20, the server 30 collects image data obtained by the camera 11 of the vehicle 10. Thereafter, for example, the agency such as the police can view the image data stored in the server 30 via the agency terminal 20 and use the image data as a reference to solve cases such as crimes. Details of the processing performed in the processing system 1 will be described later. In the following, an example in which trigger information is transmitted from the agency terminal 20 will be mainly described, but as will be described later, the trigger information may also be transmitted from the vehicle 10.
[0014] As shown in FIG. 1, a vehicle 10 includes a camera 11 and a control device 12. The camera 11 captures images of the surroundings of the vehicle 10. The camera 11 is provided as a sensor for acquiring surrounding environment information (e.g., the relative position, relative distance, relative speed, relative acceleration, etc. between the vehicle 10 and surrounding objects) used for vehicle control such as autonomous driving. The camera 11 may also be provided as a drive recorder, for example. In the processing system 1, vehicles 10 that have consented to the provision of image data are registered in advance in the server 30. The server 30 then collects image data only from the registered vehicles 10.
[0015] 2 is a block diagram showing an example of the functional configuration of the control device 12 of the vehicle 10. The control device 12 controls the operation of the vehicle 10. The control device 12 includes a CPU (Central Processing Unit), which is an arithmetic processing device, a ROM (Read Only Memory), which is a storage element that stores programs used by the CPU, calculation parameters, etc., and a RAM (Random Access Memory), which is a storage element that temporarily stores parameters that change as appropriate during execution of the CPU. The control device 12 may be, for example, a single device or may be divided into multiple devices. Note that when the control device 12 is divided into multiple devices, some of the various functions described below may be performed by different devices.
[0016] 2, the control device 12 includes, for example, a communication unit 12a, a processing unit 12b, and a storage unit 12c. The control device 12 can acquire information from the camera 11 (for example, surrounding environment information, image data, etc.).
[0017] The communication unit 12a performs wireless communication with the server 30 via the communication network N1.
[0018] The processing unit 12b performs various processes. For example, the processing unit 12b performs processes related to the control of various devices in the vehicle 10. For example, the processing unit 12b controls the operation of the drive source, braking device, and steering mechanism of the vehicle 10. The processing unit 12b may perform autonomous driving by controlling the operation of each of these devices using surrounding environment information obtained by the camera 11. The processing unit 12b also performs other processes such as various determinations and information generation.
[0019] The storage unit 12c stores various types of information such as surrounding environment information and image data.
[0020] 3 is a block diagram showing an example of the functional configuration of the engine terminal 20. The engine terminal 20 includes a CPU, which is an arithmetic processing device, a ROM, which is a memory element that stores programs used by the CPU, calculation parameters, etc., and a RAM, which is a memory element that temporarily stores parameters, etc. that change as the CPU executes. The engine terminal 20 may be, for example, a single unit, or may be divided into multiple units. Note that when the engine terminal 20 is divided into multiple units, some of the various functions described below may be shared by different devices.
[0021] As shown in FIG. 3, the engine terminal 20 includes, for example, a communication unit 20a, a user interface unit 20b, and a storage unit 20c.
[0022] The communication unit 20a performs wireless communication with the server 30 via the communication network N1.
[0023] The user interface unit 20b has a function as an operation unit that accepts various operations and a function as a display unit that displays various information. The user of the accompaniment terminal 20 can input various commands to the accompaniment terminal 20 by performing operations using the user interface unit 20b of the accompaniment terminal 20.
[0024] The storage unit 20c stores various types of information.
[0025] 4 is a block diagram showing an example of the functional configuration of server 30. Server 30 includes a CPU, which is an arithmetic processing device, a ROM, which is a memory element that stores programs used by the CPU, calculation parameters, etc., and a RAM, which is a memory element that temporarily stores parameters, etc. that change as appropriate during execution of the CPU. Server 30 may be, for example, a single server, or may be divided into multiple servers. Note that when server 30 is divided into multiple servers, some of the various functions described below may be performed by different devices.
[0026] As shown in FIG. 4, the server 30 includes, for example, a communication unit 30a, a processing unit 30b, and a storage unit 30c.
[0027] The communication unit 30a performs wireless communication with the vehicle 10 (specifically, the control device 12) and the engine terminal 20 via the communication network N1.
[0028] The processing unit 30b performs various processes, such as various determinations and information generation.
[0029] The storage unit 30c stores various types of information.
[0030] <Processing system operation> The operation of the processing system 1 according to the embodiment of the present invention will be described with reference to FIGS.
[0031] As described above, in the processing system 1, the process for collecting desired image data is performed by the vehicle 10, the locomotive terminal 20, and the server 30. Specifically, the process for collecting desired image data is performed using wireless communication between the vehicle 10, the locomotive terminal 20, and the server 30. In this embodiment, the collection of desired image data is achieved by making improvements to the process performed by the server 30 in particular. Furthermore, in this embodiment, the collection of desired image data is more appropriately achieved by making improvements to the wireless communication performed between devices.
[0032] Below, examples of processing performed in the processing system 1 will be explained in order, dividing them into a first scenario, a second scenario, a third scenario, and a fourth scenario.
[0033] Figure 5 is a diagram for explaining an overview of the first scenario. The first scenario in Figure 5 corresponds to a scene before a request to collect desired image data (specifically, trigger information, described later) is transmitted from the engine terminal 20 to the server 30. As shown in Figure 5, in the first scenario, vehicle position information IN1, which is information relating to the position of the vehicle 10, is transmitted from each vehicle 10 registered in the processing system 1 to the server 30 at any time. This allows the server 30 to grasp the current position and past positional changes of each vehicle 10.
[0034] FIG. 6 is a sequence diagram showing an example of the flow of processing performed in the first scenario.
[0035] 6, in the first scenario, first, in step S101, the communication unit 12a of the vehicle 10 transmits communication data including vehicle position information IN1 to the communication unit 30a of the server 30. For example, the processing unit 12b of the control device 12 of the vehicle 10 can acquire information indicating the current position of the vehicle 10 as the vehicle position information IN1 based on information transmitted from a GPS (Global Positioning System) satellite. Note that the vehicle position information IN1 may be information indicating the position of the vehicle 10 with a coarse resolution, or may be information that can be substantially converted into the position of the vehicle 10.
[0036] The communication data includes source data and destination data in addition to vehicle position information IN1. The source data is data indicating the source. The source data is specifically data identifying the vehicle 10 that is the source of the communication data. The destination data is data indicating the destination. The destination data is specifically data identifying the server 30 that is the destination of the communication data. The communication data may further include other information (for example, information indicating the time, a number (frame ID) indicating the type of information included in the communication data, etc.). The communication unit 30a of the server 30 receives the communication data.
[0037] After step S101, in step S102, the processing unit 30b of the server 30 determines the validity of the communication data received in step S101. Here, the processing unit 30b determines the validity of the communication data based on the source data and destination data in the communication data.
[0038] For example, if the vehicle 10 identified by the source data is a vehicle 10 registered in the processing system 1 and the destination data is data identifying the server 30, the processing unit 30b determines that the communication data is valid. On the other hand, if the vehicle 10 identified by the source data is a vehicle 10 not registered in the processing system 1, or if the destination data is not data identifying the server 30, the processing unit 30b determines that the communication data is invalid. Note that, for example, data identifying the vehicles 10 registered in the processing system 1 is pre-stored in the storage unit 30c of the server 30, and the processing unit 30b can make the above determination using that data.
[0039] 6, it is determined that the communication data is valid (i.e., the vehicle position information IN1 transmitted as communication data from the vehicle 10 is valid), and the process proceeds to step S103. However, if it is determined that the communication data is invalid (i.e., the vehicle position information IN1 transmitted as communication data from the vehicle 10 is invalid), the subsequent processes (specifically, the processes after step S103) are not performed.
[0040] In step S103, the communication unit 30a of the server 30 transmits an acknowledgement (ACK) to the communication unit 12a of the vehicle 10 that transmitted the vehicle position information IN1. The acknowledgement is a response in which the destination of the communication data (in this case, the server 30 that is the destination of the communication data transmitted and received in step S101) notifies the source of the communication data (in this case, the vehicle 10 that is the source of the communication data transmitted and received in step S101) that the communication data has been successfully received.
[0041] The acknowledgement is communication data including source data and destination data. The source data is specifically data identifying the server 30 that is the source of the acknowledgement. The destination data is specifically data identifying the vehicle 10 that is the destination of the acknowledgement.
[0042] After step S103, in step S104, the processing unit 12b of the vehicle 10 determines the validity of the acknowledgement received in step S103. Here, the processing unit 12b determines the validity of the acknowledgement based on the source data and destination data in the acknowledgement.
[0043] For example, if the source data is data that identifies the server 30 and the vehicle 10 identified by the destination data is the subject vehicle, the processing unit 12b determines that the acknowledgment is valid. On the other hand, if the source data is not data that identifies the server 30, or if the vehicle 10 identified by the destination data is a vehicle 10 other than the subject vehicle, the processing unit 12b determines that the acknowledgment is invalid. Note that, for example, data that identifies the server 30 is pre-stored in the storage unit 12c of the vehicle 10, and the processing unit 12b can make the above determination using that data.
[0044] 6, it is determined that the positive response is valid, and the process proceeds to step S105. However, if it is determined that the positive response is invalid, the subsequent processes (specifically, the processes after step S105) are not performed.
[0045] In step S105, the communication unit 12a of the vehicle 10 transmits communication data including the vehicle position information IN1 to the communication unit 30a of the server 30, similar to step S101. Thereafter, step S105 is repeated at predetermined time intervals. That is, from step S104 onwards, the vehicle 10 does not transmit an acknowledgment again to the vehicle 10, and upon receiving the acknowledgment, the vehicle 10 continuously transmits the vehicle position information IN1 to the server 30 (specifically, repeatedly).
[0046] In addition, each time communication data including vehicle position information IN1 is transmitted in step S105, the server 30 determines the validity of the communication data based on the source data and destination data in the communication data, and if it determines that the communication data is valid, it stores the communication data in the memory unit 30c.
[0047] FIG. 7 is a diagram for explaining an overview of the second scenario. The second scenario in FIG. 7 corresponds to a situation in which an agency such as the police requests the server 30 to collect desired image data via agency terminal 20. For example, when an agency such as the police receives a report that an incident such as a crime has occurred, the agency requests the collection of image data obtained in the vicinity of the location where the incident occurred and over a period extending from before to after the incident. As shown in FIG. 7, in the second scenario, trigger information IN2, which is a request to collect desired image data, is transmitted from agency terminal 20 of the agency such as the police to server 30.
[0048] FIG. 8 is a sequence diagram showing an example of the flow of processing performed in the second scenario.
[0049] As shown in FIG. 8, in the second scenario, first, in step S201, the communication unit 20a of the engine terminal 20 transmits communication data including trigger information IN2 to the communication unit 30a of the server 30.
[0050] The trigger information IN2 includes target area information, which is information about a target area (see target area A1 in FIG. 9 described later). As will be described later, in the image data collection process by the server 30 (specifically, the process performed in the third scenario in FIG. 10 described later), the server 30 collects image data from vehicles 10 that are currently or have been located in the target area.
[0051] FIG. 9 is a diagram showing an example of a target area A1. The target area A1 is an area indicating a location desired by an agency such as the police as the acquisition location for collected image data (for example, an area surrounding the location where an incident such as a crime occurred). An agency such as the police can specify the target area information included in the trigger information IN2 transmitted to the server 30 by inputting the target area information into the agency terminal 20. The target area information may be, for example, information that directly indicates the target area A1 itself. The target area information may also be, for example, information that can be substantially converted into the target area A1. For example, the target area information may be information indicating the center position C1 and radius R1 of the target area A1. In this case, for example, a circular area with a radius R1 centered at the center position C1 may correspond to the target area A1.
[0052] The trigger information IN2 also includes imaging time information, which is information relating to the time of imaging by the camera 11 of the vehicle 10. As will be described later, in the image data collection process by the server 30 (specifically, the process performed in the third scenario of FIG. 10 , which will be described later), the server 30 collects image data obtained by imaging at the time indicated by the imaging time information. In other words, the imaging time information is information indicating the time desired by an institution such as the police to acquire the collected image data (for example, a period extending before and after the occurrence of an incident such as a crime). The imaging time information may be, for example, information that explicitly indicates the time of imaging by the camera 11 (for example, information that explicitly indicates the start time and end time). The imaging time information may also be, for example, information that roughly indicates the time of imaging by the camera 11.
[0053] The communication data including the trigger information IN2 includes source data and destination data in addition to the trigger information IN2. The source data is specifically data that identifies the institution terminal 20 that is the source of the communication data. The destination data is specifically data that identifies the server 30 that is the destination of the communication data. The communication data may further include other information (for example, a number (frame ID) that indicates the type of information included in the communication data). The communication unit 30a of the server 30 receives the communication data.
[0054] After step S201, in step S202, the processing unit 30b of the server 30 determines the validity of the communication data received in step S201. Here, the processing unit 30b determines the validity of the communication data based on the source data and destination data in the communication data.
[0055] For example, if the source data is data that identifies the engine terminal 20 and the destination data is data that identifies the server 30, the processing unit 30b determines that the communication data is valid. On the other hand, if the source data is not data that identifies the engine terminal 20 or if the destination data is not data that identifies the server 30, the processing unit 30b determines that the communication data is invalid. Note that, for example, data that identifies the engine terminal 20 is pre-stored in the memory unit 30c of the server 30, and the processing unit 30b can make the above determination using that data.
[0056] In the example of Figure 8, it is determined that the communication data is valid (i.e., the trigger information IN2 transmitted as communication data from the engine terminal 20 is valid), and the process proceeds to step S203. However, if it is determined that the communication data is invalid (i.e., the trigger information IN2 transmitted as communication data from the engine terminal 20 is invalid), the subsequent processes (specifically, the processes after step S203) are not performed.
[0057] In step S203, the communication unit 30a of the server 30 transmits an acknowledgement (ACK) to the communication unit 20a of the engine terminal 20.
[0058] The acknowledgement is communication data including source data and destination data. The source data is specifically data indicating the server 30 that is the source of the acknowledgement. The destination data is specifically data indicating the engine terminal 20 that is the destination of the acknowledgement.
[0059] After step S203, in step S204, the engine terminal 20 determines the validity of the acknowledgement received in step S203. Here, the engine terminal 20 determines the validity of the acknowledgement based on the source data and destination data in the acknowledgement.
[0060] For example, the lodging terminal 20 determines that the acknowledgment is valid if the source data is data that identifies the server 30 and the destination data is data that identifies the lodging terminal 20. On the other hand, the lodging terminal 20 determines that the acknowledgment is invalid if the source data is not data that identifies the server 30 or if the destination data is not data that identifies the lodging terminal 20. Note that, for example, data that identifies the server 30 is pre-stored in the memory unit 20c of the lodging terminal 20, and the lodging terminal 20 can make the above determination using that data.
[0061] FIG. 10 is a diagram for explaining an overview of the third scenario. The third scenario in FIG. 10 corresponds to a scene in which the server 30 collects image data in response to the server 30 receiving trigger information IN2 in the second scenario in FIG. 8 described above. As shown in FIG. 10, in the third scenario, the server 30 transmits a transmission request IN3 to a vehicle 10 (specifically, a vehicle 10 that is currently or has been located within the target area A1), requesting the transmission of image data information IN4 including image data captured by the camera 11. Then, the vehicle 10 that has received the transmission request IN3 transmits the image data information IN4 to the server 30 based on the transmission request IN3.
[0062] FIG. 11 is a sequence diagram showing an example of the flow of processing performed in the third scenario.
[0063] As shown in FIG. 11, in the third scenario, first, in step S301, the communication unit 30a of the server 30 transmits communication data including a transmission request IN3 to the communication unit 12a of a vehicle 10 that is currently or has been located within the target area A1.
[0064] The communication unit 30a transmits the transmission request IN3 based on the vehicle position information IN1 and the trigger information IN2. This allows the communication unit 30a to transmit the transmission request IN3 to vehicles 10 that are currently or have been located within the target area A1. Specifically, the communication unit 30a can grasp the target area A1 based on the target area information included in the trigger information IN2. Furthermore, the communication unit 30a can grasp the position of each vehicle 10 (specifically, the current position and the transition of past positions) based on the vehicle position information IN1. This allows the communication unit 30a to transmit the transmission request IN3 to vehicles 10 that are currently or have been located within the target area A1. Note that being located within the target area A1 in the past means, for example, that a vehicle was located within the target area A1 within a predetermined time range from the present time. For example, the communication unit 30a may transmit the transmission request IN3 to vehicles 10 that were located within the target area A1 at a time specified by the trigger information IN2 (e.g., a time indicated by the image capture time information).
[0065] Here, the processing unit 30b may adjust the size of the target area A1. Specifically, the processing unit 30b may adjust the size of the target area A1 relative to the size indicated by the target area information included in the trigger information IN2. In this case, the communication unit 30a transmits the transmission request IN3 to vehicles 10 that are currently located or have been located in the target area A1 after the size adjustment.
[0066] The processing unit 30b may change the size of the target area A1 based on the content of the trigger information IN2, for example. For example, if the trigger information IN2 includes information about an incident such as a crime that has occurred, the processing unit 30b may change the size of the target area A1 based on the information about the incident. Specifically, if the perpetrator of the incident is traveling by vehicle, the processing unit 30b may increase the size of the target area A1 because there is a greater need to expand the investigation range compared to when the perpetrator of the incident is traveling without a vehicle.
[0067] Furthermore, the processing unit 30b may change the size of the target area A1 based on, for example, the timing of acquisition of the trigger information IN2. For example, if the trigger information IN2 includes information on the time when an incident such as a crime occurred, the processing unit 30b may change the size of the target area A1 based on the time elapsed from the time when the incident occurred to the time when the trigger information IN2 was acquired. Specifically, the longer the elapsed time, the more likely it is that the investigation range needs to be expanded, and therefore the processing unit 30b may increase the size of the target area A1.
[0068] The transmission request IN3 includes imaging time information, which is information relating to the time of imaging. As described above, the imaging time information is included in the trigger information IN2 transmitted from the agency terminal 20 to the server 30 in the second scenario of FIG. 7. Therefore, the processing unit 30b of the server 30 can refer to the trigger information IN2 and generate the transmission request IN3 including the imaging time information. As will be described later, the vehicle 10 that receives the transmission request IN3 transmits image data captured at the time indicated by the imaging time information to the server 30. Therefore, it is possible to collect image data captured at the time desired by agencies such as the police.
[0069] The transmission request IN3 also includes imaging condition information, which is information related to imaging conditions (i.e., imaging conditions). The imaging condition information includes, for example, information related to image quality in imaging (e.g., image size, roughness, etc.). However, the imaging condition information is not limited to this example and may include other information (e.g., color information, information related to settings such as applying image processing such as mosaic processing to a portion, etc.). As will be described later, the vehicle 10 that has received the transmission request IN3 transmits image data captured under the imaging conditions indicated by the imaging condition information to the server 30. Therefore, it is possible to narrow down the imaging conditions for the image data to be collected.
[0070] Here, the imaging condition information may be set in advance. However, the processing unit 30b may adjust the imaging condition information. Specifically, the processing unit 30b may adjust the imaging conditions indicated by the imaging condition information relative to the preset imaging conditions. In this case, the communication unit 30a transmits to the vehicle 10 a transmission request IN3 including the imaging condition information after the imaging conditions have been adjusted.
[0071] The processing unit 30b may change the imaging condition information based on, for example, the available capacity of the storage unit 30c. As will be described later, the server 30 stores image data collected from the vehicle 10 in the storage unit 30c. Here, if the available capacity of the storage unit 30c is small, it may be difficult to store all of the image data collected from the vehicle 10 in the storage unit 30c. Therefore, the processing unit 30b may adjust the imaging condition information so that, for example, the smaller the available capacity of the storage unit 30c, the lower the image quality in imaging.
[0072] The communication data including the transmission request IN3 includes source data and destination data in addition to the transmission request IN3. The source data is specifically data that identifies the server 30 that is the source of the communication data. The destination data is specifically data that identifies the vehicle 10 that is the destination of the communication data. The communication data may further include other information (for example, information on the target area A1, a number (frame ID) that indicates the type of information included in the communication data, etc.). The communication unit 12a of the vehicle 10 receives the communication data.
[0073] After step S301, in step S302, the processing unit 12b of the vehicle 10 determines the validity of the communication data received in step S301. Here, the processing unit 12b determines the validity of the communication data based on the source data and destination data in the communication data.
[0074] For example, if the source data is data that identifies the server 30 and the vehicle 10 identified by the destination data is the subject vehicle, the processing unit 12b determines that the communication data is valid. On the other hand, if the source data is not data that identifies the server 30 or if the vehicle 10 identified by the destination data is a vehicle 10 other than the subject vehicle, the processing unit 12b determines that the communication data is invalid.
[0075] 11, it is determined that the communication data is valid (i.e., the transmission request IN3 transmitted from the server 30 as the communication data is valid), and the process proceeds to step S303. However, if it is determined that the communication data is invalid (i.e., the transmission request IN3 transmitted from the server 30 as the communication data is invalid), the subsequent processes (specifically, the processes after step S303) are not performed.
[0076] In step S303, the communication unit 12a of the vehicle 10 that has received the transmission request IN3 transmits communication data including the image data information IN4 to the communication unit 30a of the server 30.
[0077] The image data information IN4 includes image data acquired by imaging using the camera 11. For example, in the vehicle 10, the processing unit 12b causes the memory unit 12c to store image data acquired by imaging using the camera 11 as needed. As a result, image data acquired in the past is accumulated over time in the memory unit 12c. For example, the image data is associated with information indicating the acquisition time and stored in the memory unit 12c. Note that if two or more cameras 11 are installed on one vehicle 10, the image data information IN4 is generated for each camera 11.
[0078] Specifically, the processing unit 12b generates image data information IN4 including image data captured at the time indicated by the imaging time information included in the transmission request IN3. For example, if the time indicated by the imaging time information is a past time, the processing unit 12b extracts image data captured at the time indicated by the imaging time information from the storage unit 12c and generates image data information IN4 including the extracted image data. For example, if the time indicated by the imaging time information includes a future time, the processing unit 12b captures images using the camera 11 and stores the obtained image data until the time indicated by the imaging time information expires, and then generates image data information IN4 including image data captured at the time indicated by the imaging time information. The communication unit 12a transmits the image data information IN4 generated by the processing unit 12b as described above to the server 30.
[0079] The image data information IN4 includes vehicle position information IN1, which is information related to the position of the vehicle 10. As described above, for example, the control device 12 of the vehicle 10 can acquire information indicating the current position of the vehicle 10 as the vehicle position information IN1 based on information transmitted from a GPS satellite. For example, the processing unit 12b can generate image data information IN4 including the vehicle position information IN1 by linking the image data to the vehicle position information IN1.
[0080] Furthermore, the image data information IN4 includes orientation information, which is information relating to the orientation of the camera 11. Fig. 12 is a diagram showing an example of installation of the camera 11 in the vehicle 10. In the example of Fig. 12, the vehicle 10 is equipped with two cameras 11: a camera 11 provided at the left front portion of the vehicle 10 and facing the left front, and a camera 11 provided at the right front portion of the vehicle 10 and facing the right front. However, the number and arrangement of the cameras 11 provided on the vehicle 10 are not limited to the example of Fig. 12. For example, a camera 11 that captures an image behind the vehicle 10 may be provided at the rear of the vehicle 10, or a camera 11 that captures an image to the side of the vehicle 10 may be provided at the side of the vehicle 10.
[0081] Here, the processing unit 12b can identify the forward direction D10 of the vehicle 10 based on, for example, information transmitted from a GPS satellite. The relative angle of the facing direction D11 of each camera 11 with respect to the forward direction D10 of the vehicle 10 is stored in advance in, for example, the storage unit 12c. Therefore, the processing unit 12b can identify the facing direction D11 of the camera 11 as orientation information based on the forward direction D10 of the vehicle 10 and the above-mentioned relative angle. For example, the processing unit 12b can generate image data information IN4 including orientation information by linking the orientation information to image data.
[0082] The communication data including the image data information IN4 includes source data and destination data in addition to the image data information IN4. The source data is specifically data that identifies the vehicle 10 that is the source of the communication data. The destination data is specifically data that identifies the server 30 that is the destination of the communication data. The communication data may further include other information (for example, a number (frame ID) that indicates the type of information included in the communication data). The communication unit 30a of the server 30 receives the communication data.
[0083] After step S303, in step S304, the processing unit 30b of the server 30 determines the validity of the communication data received in step S303. Here, the processing unit 30b determines the validity of the communication data based on the source data and destination data in the communication data.
[0084] For example, if the vehicle 10 identified by the source data is a vehicle 10 registered in the processing system 1 and the destination data is data identifying the server 30, the processing unit 30b determines that the communication data is valid. On the other hand, if the vehicle 10 identified by the source data is a vehicle 10 that is not registered in the processing system 1, or if the destination data is not data identifying the server 30, the processing unit 30b determines that the communication data is invalid.
[0085] 11, it is determined that the communication data is valid (i.e., the image data information IN4 transmitted from the vehicle 10 as communication data is valid), and the process proceeds to step S305. However, if it is determined that the communication data is invalid (i.e., the image data information IN4 transmitted from the vehicle 10 as communication data is invalid), the subsequent processes (specifically, the processes after step S305) are not performed.
[0086] In step S305, the storage unit 30c of the server 30 stores the image data information IN4 received in step S303.
[0087] As described above, through the first, second, and third scenarios, the image data desired by the police or other agencies is stored in the server 30. After that, for example, the police or other agencies can view the image data stored in the server 30 via the agency terminal 20. This allows them to refer to the image data to help solve crimes and other cases.
[0088] As described above, in the processing system 1 according to this embodiment, the processing device (server 30 in the above example) includes an acquisition unit (communication unit 30a in the above example) that acquires trigger information IN2 including target area information, which is information related to the target area A1; an output unit (communication unit 30a and processing unit 30b in the above example) that outputs a transmission request IN3 to a vehicle 10 that is currently or previously located within the target area A1 and has a camera 11, based on the trigger information IN2, to request transmission of image data information IN4 including image data captured by the camera 11; and a storage unit 30c that stores the image data information IN4. This allows image data captured at a desired location to be selected and collected from the image data captured by the camera 11 of the vehicle 10. Therefore, desired image data can be collected.
[0089] In particular, in the processing system 1 according to this embodiment, the first processing device (in the above example, the engine terminal 20), the second processing device (in the above example, the server 30), and the vehicle 10 are capable of wireless communication with each other. The vehicle 10 transmits vehicle position information IN1, which is information about the position of the vehicle 10, to the second processing device. The first processing device transmits trigger information IN2, which includes target area information, which is information about the target area A1, to the second processing device. Based on the vehicle position information IN1 and the trigger information IN2, the second processing device transmits a transmission request IN3 to the vehicle 10 that is currently or has been located within the target area A1, requesting the transmission of image data information IN4, which includes image data captured by the camera 11. The vehicle 10 that receives the transmission request IN3 transmits the image data information IN4 to the second processing device based on the transmission request IN3. The second processing device stores the image data information IN4. As described above, image data captured at a desired location can be selected and collected from the image data captured by the camera 11 of the vehicle 10. Therefore, desired image data can be collected.
[0090] Furthermore, when transmitting vehicle position information IN1, trigger information IN2, transmission request IN3, and image data information IN4, the sender transmits communication data including sender data indicating the sender and destination data indicating the destination to the destination, and the destination determines the validity of the communication data based on the sender data and destination data in the communication data. This allows processing to proceed after determining the validity of the communication data, and unnecessary processing associated with invalid communication data can be omitted, making it possible to more appropriately collect desired image data.
[0091] The above describes an example of processing performed in the processing system 1. However, the processing performed in the processing system 1 is not limited to the above example of processing, and may be, for example, processing obtained by appropriately modifying the above example of processing.
[0092] For example, the example in which trigger information IN2 is transmitted from engine terminal 20 to server 30 has been described above with reference to the second scenario in Fig. 7. However, trigger information IN2 may also be transmitted from vehicle 10. Below, a fourth scenario corresponding to such an example will be described with reference to Figs. 13 and 14.
[0093] FIG. 13 is a diagram for explaining an outline of the fourth scenario. The fourth scenario in FIG. 13 corresponds to a situation in which the driver of the vehicle 10 requests the server 30 to collect desired image data. For example, if the vehicle 10 is damaged (e.g., broken into), the driver of the vehicle 10 desires to collect image data obtained around the current location of the vehicle 10 over a period of time before and after the current time as a clue to finding the perpetrator of the damage to the vehicle 10. As shown in FIG. 13, in the fourth scenario, trigger information IN2, which is a request to collect the desired image data, is transmitted from the vehicle 10 (specifically, the control device 12) to the server 30. For example, the driver can use an input device of the vehicle 10 to cause the control device 12 to transmit the trigger information IN2. However, the transmission of the trigger information IN2 may be performed automatically, without being operated by the driver. For example, the transmission of the trigger information IN2 may be performed automatically when the security device of the vehicle 10 detects an abnormality.
[0094] FIG. 14 is a sequence diagram showing an example of the flow of processing performed in the fourth scenario.
[0095] As shown in FIG. 14, in the fourth scenario, first, in step S401, the communication unit 12a of the vehicle 10 transmits communication data including the trigger information IN2 to the communication unit 30a of the server 30.
[0096] As described above, the trigger information IN2 includes target area information, which is information about the target area A1, and imaging time information, which is information about the time when the image was captured by the camera 11 of the vehicle 10. In this case, the target area A1 indicated by the target area information is, for example, a circular area centered on the vehicle 10 that transmits the trigger information IN2. Furthermore, the time indicated by the imaging time information is, for example, a period spanning before and after the time when the trigger information IN2 is transmitted.
[0097] The communication data including the trigger information IN2 includes source data and destination data in addition to the trigger information IN2. In the fourth scenario, the source data is specifically data that identifies the vehicle 10 that is the source of the communication data. The destination data is specifically data that identifies the server 30 that is the destination of the communication data. The communication data may further include other information (for example, a number (frame ID) that indicates the type of information included in the communication data). The communication unit 30a of the server 30 receives the communication data.
[0098] After step S401, in step S402, the processing unit 30b of the server 30 determines the validity of the communication data received in step S401. Here, the processing unit 30b determines the validity of the communication data based on the source data and destination data in the communication data.
[0099] For example, if the vehicle 10 identified by the source data is a vehicle 10 registered in the processing system 1 and the destination data is data identifying the server 30, the processing unit 30b determines that the communication data is valid. On the other hand, if the vehicle 10 identified by the source data is a vehicle 10 that is not registered in the processing system 1, or if the destination data is not data identifying the server 30, the processing unit 30b determines that the communication data is invalid.
[0100] 14, it is determined that the communication data is valid (i.e., the trigger information IN2 transmitted from the vehicle 10 as communication data is valid), and the process proceeds to step S403. However, if it is determined that the communication data is invalid (i.e., the trigger information IN2 transmitted from the vehicle 10 as communication data is invalid), the subsequent processes (specifically, the processes after step S403) are not performed.
[0101] In step S403, the communication unit 30a of the server 30 transmits an acknowledgement (ACK) to the communication unit 12a of the vehicle 10 that transmitted the trigger information IN2.
[0102] The acknowledgement is communication data including source data and destination data. The source data is specifically data identifying the server 30 that is the source of the acknowledgement. The destination data is specifically data identifying the vehicle 10 that is the destination of the acknowledgement.
[0103] After step S403, in step S404, the processing unit 12b of the vehicle 10 determines the validity of the acknowledgement received in step S403. Here, the processing unit 12b determines the validity of the acknowledgement based on the source data and destination data in the acknowledgement.
[0104] For example, if the source data is data that identifies the server 30 and the vehicle 10 identified by the destination data is the subject vehicle, the processing unit 12b determines that the acknowledgment is valid. On the other hand, if the source data is not data that identifies the server 30 or if the vehicle 10 identified by the destination data is a vehicle 10 other than the subject vehicle, the processing unit 12b determines that the acknowledgment is invalid.
[0105] 14, it is determined that the positive response is valid, and the process proceeds to step S405. However, if it is determined that the positive response is invalid, the subsequent processes (specifically, the processes after step S405) are not performed.
[0106] In step S405, the communication unit 12a of the vehicle 10 that received the positive response in step S403 transmits communication data including the image data information IN4 to the communication unit 30a of the server 30.
[0107] As described above, the image data information IN4 includes image data acquired by capturing an image using the camera 11. Here, the processing unit 12b generates image data information IN4 including image data captured at the time indicated by the capturing time information included in the trigger information IN2 transmitted to the server 30 in step S401. Then, the communication unit 12a transmits the image data information IN4 generated by the processing unit 12b as described above to the server 30.
[0108] Note that the image data information IN4 transmitted in step S405 may also include vehicle position information IN1, which is information regarding the position of the vehicle 10, and orientation information, which is information regarding the orientation of the camera 11, similar to the image data information IN4 in the third scenario described above. Also, the communication data including the image data information IN4 transmitted in step S405 may also include source data and destination data in addition to the image data information IN4, similar to the image data information IN4 in the third scenario described above. The source data is specifically data that identifies the vehicle 10 that is the source of the communication data. The destination data is specifically data that identifies the server 30 that is the destination of the communication data. Note that the communication data may further include other information (for example, a number (frame ID), etc., indicating the type of information included in the communication data). The communication unit 30a of the server 30 receives the communication data.
[0109] After step S405, in step S406, the processing unit 30b of the server 30 determines the validity of the communication data received in step S405. Here, the processing unit 30b determines the validity of the communication data based on the source data and destination data in the communication data.
[0110] For example, if the vehicle 10 identified by the source data is a vehicle 10 registered in the processing system 1 and the destination data is data identifying the server 30, the processing unit 30b determines that the communication data is valid. On the other hand, if the vehicle 10 identified by the source data is a vehicle 10 that is not registered in the processing system 1, or if the destination data is not data identifying the server 30, the processing unit 30b determines that the communication data is invalid.
[0111] 14, it is determined that the communication data is valid (i.e., the image data information IN4 transmitted from the vehicle 10 as communication data is valid), and the process proceeds to step S407. However, if it is determined that the communication data is invalid (i.e., the image data information IN4 transmitted from the vehicle 10 as communication data is invalid), the subsequent processes (specifically, the processes after step S407) are not performed.
[0112] In step S407, the storage unit 30c of the server 30 stores the image data information IN4 received in step S405.
[0113] Furthermore, even if the server 30 receives trigger information IN2 in the fourth scenario, upon receipt of the trigger information IN2 by the server 30, the process transitions to the third scenario of Figure 10, and image data is collected by the server 30.
[0114] Also, for example, in the above description, an example was described in which the trigger information IN2 includes imaging time information. However, the trigger information IN2 does not necessarily have to include imaging time information. In that case, for example, the processing unit 30b of the server 30 may generate imaging time information when generating the transmission request IN3, and generate the transmission request IN3 including the imaging time information. The time indicated by the imaging time information is, for example, a predetermined range of time spanning before and after the time the trigger information IN2 is received. Note that the transmission request IN3 does not necessarily have to include imaging time information. For example, if the vehicle 10 that has received the transmission request IN3 is configured to send to the server 30 image data information IN4 acquired within a predetermined period from the time the transmission request IN3 is received, the transmission request IN3 does not necessarily have to include imaging time information.
[0115] In the above example, the processing unit 30b of the server 30 generates imaging condition information when generating the transmission request IN3, and generates the transmission request IN3 including the imaging condition information. However, the imaging condition information may be included in the trigger information IN2. In that case, for example, the processing unit 30b of the server 30 can refer to the trigger information IN2 and generate the transmission request IN3 including the imaging condition information.
[0116] Also, for example, in the above description, an example has been described in which the image data information IN4 includes vehicle position information IN1, which is information about the position of the vehicle 10, and orientation information, which is information about the orientation of the camera 11. However, the image data information IN4 does not necessarily have to include at least one of the vehicle position information IN1 and the orientation information.
[0117] In addition, for example, in the above description, the validity of communication data is determined based on the source data and destination data in the communication data, and if the communication data is determined to be invalid, subsequent processing is not performed. However, if the communication data is determined to be invalid, additional processing may be performed. For example, if the communication data is determined to be invalid, the sender of the communication data may, for example, wait a predetermined time and then retransmit the communication data.
[0118] <Effects of the treatment system> The effects of the processing system 1 according to the embodiment of the present invention will be described.
[0119] In the processing system 1, the processing device (server 30 in the above example) includes an acquisition unit (communication unit 30a in the above example) that acquires trigger information IN2 including target area information, which is information related to target area A1; an output unit (communication unit 30a and processing unit 30b in the above example) that outputs a transmission request IN3 to a vehicle 10 that is currently or previously located within target area A1 and has a camera 11, based on the trigger information IN2, to request transmission of image data information IN4 including image data captured by the camera 11; and a storage unit 30c that stores the image data information IN4. This makes it possible to select and collect image data obtained at a desired location from the image data obtained by the camera 11 of the vehicle 10. Therefore, it is possible to collect desired image data.
[0120] Preferably, in the processing system 1, the transmission request IN3 includes image capture time information, which is information relating to the time of image capture. This makes it possible to appropriately select and collect image data obtained at a desired time from the image data obtained by the camera 11 of the vehicle 10. This makes it possible to more appropriately collect desired image data.
[0121] Preferably, in the processing system 1, the transmission request IN3 includes imaging condition information, which is information relating to imaging conditions. This makes it possible to appropriately select and collect image data obtained under desired imaging conditions from image data obtained by the camera 11 of the vehicle 10. This makes it possible to more appropriately collect desired image data.
[0122] Preferably, in the processing system 1, the output unit (the communication unit 30a and the processing unit 30b in the above example) changes the imaging condition information based on the available capacity of the storage unit 30c. This makes it possible to prevent the available capacity of the storage unit 30c from being filled up with image data transmitted from the vehicle 10.
[0123] Preferably, in the processing system 1, the output unit (the communication unit 30a and the processing unit 30b in the above example) changes the size of the target area A1 based on the content of the trigger information IN2, thereby optimizing the spatial range in which image data is collected according to the content of the trigger information IN2.
[0124] Preferably, in the processing system 1, the output unit (the communication unit 30a and the processing unit 30b in the above example) changes the size of the target area A1 based on the timing of acquiring the trigger information IN2, thereby optimizing the spatial range in which image data is collected according to the timing of acquiring the trigger information IN2.
[0125] Preferably, in the processing system 1, the image data information IN4 includes vehicle position information, which is information relating to the position of the vehicle 10. This makes it possible to understand from which position the image data included in the image data information IN4 is data showing an image. This increases the suitability of the image data as evidence in situations where the collected image data is utilized (for example, situations where the image data is used as a reference to advance the resolution of a crime or other incident).
[0126] Preferably, in the processing system 1, the image data information IN4 includes orientation information, which is information relating to the orientation of the camera 11. This makes it possible to understand from which direction the image data included in the image data information IN4 represents the image. This can further improve the suitability of the image data as evidence in situations where the collected image data is utilized (for example, situations where the image data is used as a reference to advance the resolution of a crime or other case).
[0127] Furthermore, in the processing system 1, the first processing device (mainly the engine terminal 20 in the above example), the second processing device (server 30 in the above example), and the vehicle 10 can wirelessly communicate with each other. The vehicle 10 transmits vehicle position information IN1, which is information about the position of the vehicle 10, to the second processing device. The first processing device transmits trigger information IN2, which includes target area information, which is information about the target area A1, to the second processing device. Based on the vehicle position information IN1 and the trigger information IN2, the second processing device transmits a transmission request IN3 to the vehicle 10 that is currently or has been located within the target area A1, requesting the transmission of image data information IN4, which includes image data captured by the camera 11. Upon receiving the transmission request IN3, the vehicle 10 transmits the image data information IN4 to the second processing device based on the transmission request IN3. The second processing device stores the image data information IN4. As described above, image data obtained at a desired location can be selected and collected from the image data obtained by the camera 11 of the vehicle 10. Therefore, desired image data can be collected.
[0128] Furthermore, when transmitting vehicle position information IN1, trigger information IN2, transmission request IN3, and image data information IN4, the sender transmits communication data including sender data indicating the sender and destination data indicating the destination to the destination, and the destination determines the validity of the communication data based on the sender data and destination data in the communication data. This allows processing to proceed after determining the validity of the communication data, and unnecessary processing associated with invalid communication data can be omitted, making it possible to more appropriately collect desired image data.
[0129] Preferably, in the processing system 1, when the second processing device (server 30 in the above example) determines that the vehicle position information IN1 transmitted as communication data from the vehicle 10 is valid, it transmits an acknowledgment to the vehicle 10 that transmitted the vehicle position information IN1. After transmitting the acknowledgment, the second processing device does not transmit an acknowledgment to the vehicle 10 again. Upon receiving the acknowledgment, the vehicle 10 continuously transmits the vehicle position information IN1 to the second processing device. As a result, in a scenario in which the vehicle position information IN1 of the vehicle 10 is transmitted to the server 30 (for example, the first scenario in FIG. 5), the validity of the vehicle position information IN1 is determined when the vehicle position information IN1 is transmitted for the first time, and the determination of the validity of the vehicle position information IN1 is omitted when the vehicle position information IN1 is transmitted for the second time or later. Therefore, it is possible to avoid unnecessary frequent determinations of the validity of the vehicle position information IN1 while omitting unnecessary processing associated with the transmission of invalid vehicle position information IN1.
[0130] Preferably, in the processing system 1, when the second processing device (server 30 in the above example) determines that the trigger information IN2 transmitted as communication data from the first processing device (mainly engine terminal 20 in the above example) is valid, it transmits an affirmative response to the first processing device and transmits a transmission request IN3 to vehicles 10 that are currently or have been located in the target area A1. As a result, in a situation where trigger information IN2 is transmitted to the server 30 (for example, the second scenario in FIG. 7 or the fourth scenario in FIG. 13), it is possible to transition to a situation where transmission request IN3 is transmitted from the server 30 (for example, the third scenario in FIG. 10) after confirming that trigger information IN2 is valid. Therefore, it is possible to prevent unnecessary transmission of transmission request IN3 due to transmission of invalid trigger information IN2.
[0131] Preferably, in the processing system 1, when the trigger information IN2 is transmitted by the vehicle 10 as the first processing device, the vehicle 10 that receives the positive response transmits the image data information IN4 to the second processing device (the server 30 in the above example) without being based on the transmission request IN3. As a result, in a situation where the trigger information IN2 is transmitted from the vehicle 10 to the server 30 (for example, the fourth scenario in FIG. 13), the server 30 can also collect the image data information IN4 from the vehicle 10 that transmitted the trigger information IN2.
[0132] Preferably, in the processing system 1, when the vehicle 10 determines that the transmission request IN3 transmitted as communication data from the second processing device (the server 30 in the above example) is valid, the vehicle 10 transmits the image data information IN4 to the second processing device. As a result, in a situation where the transmission request IN3 is transmitted from the server 30 (for example, the third scenario in FIG. 10), the vehicle 10 can transmit the image data information IN4 after confirming that the transmission request IN3 is valid. Therefore, it is possible to prevent the unnecessary transmission of the image data information IN4 due to the transmission of an invalid transmission request IN3.
[0133] The above describes a preferred embodiment of the present invention with reference to the accompanying drawings. However, it goes without saying that the present invention is not limited to the above-described embodiment, and various modified or altered examples within the scope of the claims also fall within the technical scope of the present invention.
[0134] For example, the processes described herein using flowcharts do not necessarily have to be performed in the order shown in the flowcharts, some process steps may be performed in parallel, additional process steps may be employed, and some process steps may be omitted.
[0135] Furthermore, for example, the series of processes performed by the control device 12 described above may be realized using software, hardware, or a combination of software and hardware. The programs constituting the software are stored in advance in, for example, a storage medium provided inside or outside the information processing device.
[0136] Furthermore, for example, the series of processes performed by the engine terminal 20 described above may be realized using software, hardware, or a combination of software and hardware. The programs constituting the software are stored in advance, for example, in a storage medium provided inside or outside the information processing device.
[0137] Furthermore, for example, the series of processes performed by the server 30 described above may be realized using software, hardware, or a combination of software and hardware. The programs constituting the software are stored in advance in a storage medium provided inside or outside the information processing device, for example. [Explanation of symbols]
[0138] 1 Processing System 10 Vehicle (first processing device) 11 Camera 12 Control device 12a Communications Department 12b Processing section 12c storage section 20 Engine terminal (first processing device) 20a Communications Department 20b User interface section 20c storage section 30 Server (processing device, second processing device) 30a Communication unit (acquisition unit, output unit) 30b Processing section (output section) 30c storage section A1 Target Area C1 center position D10 Vehicle forward direction D11 Camera direction IN1 Vehicle location information IN2 Trigger Information IN3 Request to send IN4 Image data information N1 Communications Network R1 radius
Claims
1. A processing system (1) comprising a first processing device (20), a second processing device (30), and at least one vehicle (10) equipped with a camera (11), the first processing device (20), the second processing device (30), and the vehicle (10) are capable of wireless communication with each other; The vehicle (10) transmits vehicle position information (IN1) relating to the position of the vehicle (10) to the second processing device (30); The first processing device (20) transmits trigger information (IN2) including target area information, which is information about the target area (A1), to the second processing device (30); The second processing device (30) transmits a transmission request (IN3) to the vehicle (10) currently or previously located within the target area (A1) based on the vehicle position information (IN1) and the trigger information (IN2), requesting the transmission of image data information (IN4) including image data acquired by imaging by the camera (11); The vehicle (10) that has received the transmission request (IN3) transmits the image data information (IN4) to the second processing device (30) based on the transmission request (IN3), The second processing device (30) stores the image data information (IN4), When the vehicle position information (IN1) is transmitted, when the trigger information (IN2) is transmitted, when the transmission request (IN3) is transmitted, and when the image data information (IN4) is transmitted, a source transmits communication data including source data indicating the source and destination data indicating the destination to the destination; the destination determines the validity of the communication data based on the source data and the destination data in the communication data; Processing system.
2. When the second processing device (30) determines that the vehicle position information (IN1) transmitted as the communication data from the vehicle (10) is valid, it transmits a positive response to the vehicle (10) that transmitted the vehicle position information (IN1); After transmitting the positive response, the positive response is not transmitted again to the vehicle (10), and the vehicle (10) that has received the positive response continues to transmit the vehicle position information (IN1) to the second processing device (30). The processing system of claim 1 .
3. When the second processing device (30) determines that the trigger information (IN2) transmitted as the communication data from the first processing device (20) is valid, the second processing device (30) transmits a positive response to the first processing device (20) and transmits the transmission request (IN3) to the vehicle (10) that is currently or has been located within the target area (A1). The processing system of claim 1 .
4. When the transmission of the trigger information (IN2) is performed by the vehicle (10) as the first processing device, the vehicle (10) that receives the positive response transmits the image data information (IN4) to the second processing device (30) without being based on the transmission request (IN3). The processing system of claim 3 .
5. When the vehicle (10) determines that the transmission request (IN3) transmitted as the communication data from the second processing device (30) is valid, the vehicle (10) transmits the image data information (IN4) to the second processing device (30). The processing system of claim 1 .
6. The first processing device (20), the second processing device (30) of the processing system (1), and at least one vehicle (10) equipped with a camera (11) are capable of wireless communication with each other; The vehicle (10) transmits vehicle position information (IN1) relating to the position of the vehicle (10) to the second processing device (30); The first processing device (20) transmits trigger information (IN2) including target area information, which is information about the target area (A1), to the second processing device (30); The second processing device (30) transmits a transmission request (IN3) to the vehicle (10) currently or previously located within the target area (A1) based on the vehicle position information (IN1) and the trigger information (IN2), requesting the transmission of image data information (IN4) including image data acquired by imaging by the camera (11); The vehicle (10) that has received the transmission request (IN3) transmits the image data information (IN4) to the second processing device (30) based on the transmission request (IN3), The second processing device (30) stores the image data information (IN4), When the vehicle position information (IN1) is transmitted, when the trigger information (IN2) is transmitted, when the transmission request (IN3) is transmitted, and when the image data information (IN4) is transmitted, a source transmits communication data including source data indicating the source and destination data indicating the destination to the destination; the destination determines the validity of the communication data based on the source data and the destination data in the communication data; Processing method.
Citation Information
Patent Citations
Vehicle control system, vehicle control method, and vehicle control program
WO2017208781A1