Patrol support system, patrol support method, and program

Abstract

To further improve the efficiency of patrol and verification work to check vehicles parked in parking lots, while appropriately linking the various types of information generated as a result of the verification. [Solution] The patrol support system according to the present invention captures an area of ​​a vehicle including its license plate, recognizes the license plate image data to identify the vehicle information written on the license plate, and generates vehicle information data including the recognition result. The patrol support system also captures the interior of the vehicle from the outside to generate interior image data. Subsequently, the patrol support system acquires identification information for the generated interior image data, selects one vehicle information data from the vehicle information data stored in the memory unit that has a generation date and time close to the interior image data, and generates association information by associating the selected vehicle information data, the identification information for the interior image data, and time information related to the time.

Description

Technical Field

[0001] The present invention relates to a patrol support system, a patrol support method, and a program.

Background Art

[0002] In recent years, in various business formats such as amusement facilities like amusement parks, game arcades, supermarkets, department stores, shopping malls, etc., facilities with large parking lots have been increasing. As an operator of such facilities, it is preferable that no trouble occurs to the parked vehicles (for example, leaving people or pets unattended in the vehicle, lights staying on, door windows remaining open, forgetting to lock the door, ··· etc.). Therefore, it is common practice to have facility staff members patrol the parking lot to check whether any trouble has occurred to each parked vehicle.

[0003] However, for example, the larger the total area of the parking lot and the higher the turnover rate of customers coming by vehicle, the greater the number of vehicles that need to be checked. Therefore, it is important to efficiently perform the checking work with a limited number of people within a limited time.

[0004] Conventionally, various technologies have been proposed to support the above-described patrol and checking work. For example, in Patent Document 1 below, in a patrol operation of recording information related to the license plate read from a vehicle as a confirmation result, a patrol support system for presenting to the patrol staff whether a vehicle has already been confirmed and an auxiliary tool for assisting the patrol work by the patrol staff are proposed.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

[0006] In the parking lot patrol and inspection work described above, it is preferable to keep a record that "the parking lot patrol officer thoroughly checked the parked vehicles and confirmed that no problems or issues had occurred." On the other hand, as the number of vehicles to be checked increases, it is estimated that the amount of various information generated as a result of the checks (for example, various images taken of the vehicles) will also increase. Therefore, it is considered that a mechanism for appropriately linking the various pieces of information generated as a result of the checks during the series of patrol and inspection work performed by the patrol officer will become important in the future.

[0007] However, conventional technologies for patrol support, including the technology proposed in Patent Document 1 mentioned above, have not considered the appropriate association of various types of information regarding vehicles parked in a parking lot, and there was room for further consideration in this regard.

[0008] Therefore, the present invention has been made in view of the above problems, and the object of the present invention is to provide a patrol support system, a patrol support method, and a program that can support patrols to check vehicles parked in a parking lot, thereby achieving greater efficiency in patrol and check work, and that can appropriately associate various types of information generated as a result of the check. [Means for solving the problem]

[0009] To solve the above problems, according to one aspect of the present invention, a patrol support system for assisting patrols to check vehicles parked in a parking lot comprises: an imaging unit that images the vehicle and generates imaging data; a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data or generated data generated by the data processing; and a display unit that displays information to support the patrol, wherein the imaging unit images the area including the license plate of the vehicle and generates license plate imaging data, outputs the generated license plate imaging data to the control unit, and the control unit processes the acquired license plate imaging data A patrol support system is provided, which recognizes vehicle information written on the license plate and generates vehicle information data including the recognition result, stores the generated vehicle information data in the storage unit, the imaging unit images the interior of the vehicle from outside the vehicle in response to the acquired imaging start signal and generates interior imaging data, and the control unit acquires identification information of the interior imaging data generated by the imaging unit from the imaging unit, selects one of the vehicle information data stored in the storage unit that has a generation date and time close to the interior imaging data, and generates association information that associates the selected vehicle information data, the identification information of the interior imaging data, and time information related to the time.

[0010] In such a patrol support system, the identification information for the in-vehicle image data may be a unique identification number assigned sequentially by the imaging unit to the image data captured by the imaging unit.

[0011] In such a patrol support system, it is preferable that the control unit stores the generated association information as vehicle verification result data for the vehicle in the patrol history database provided in the storage unit.

[0012] In such a patrol support system, it is preferable that the control unit further stores the in-vehicle imaging data as the vehicle confirmation result data to be stored in the patrol history database.

[0013] In such a patrol support system, when the control unit generates new association information, it is preferable to check whether the vehicle information data included in the generated association information is already recorded in the patrol history database, and if the vehicle information data included in the generated association information is already recorded in the patrol history database as vehicle confirmation result data, to display on the display unit an indication that it has already been confirmed.

[0014] In such a patrol support system, it is preferable that the vehicle verification result data further includes additional information relating to at least one of the vehicle or the user of the vehicle.

[0015] In such a patrol support system, when the control unit generates new association information, it is preferable to check whether the vehicle information data included in the generated association information is already recorded in the patrol history database, and if the vehicle information data included in the generated association information is already recorded in the patrol history database as vehicle confirmation result data, and the additional information is included in the vehicle confirmation result data, then to display a warning on the display unit indicating that the additional information regarding the vehicle being checked exists.

[0016] The patrol support system includes an information processing terminal device held by a patrol officer patrolling the parking lot, and an action camera worn by the patrol officer, wherein the information processing terminal device has a first imaging unit that functions as an imaging unit and a first storage unit that functions as a storage unit, and the action camera has a second imaging unit that functions as an imaging unit and a second storage unit that functions as a storage unit, wherein the first imaging unit may image the license plate and store the license plate image data in the first storage unit, and the second imaging unit may image the interior of the vehicle and store the interior image data in the second storage unit.

[0017] In such a patrol support system, the imaging unit and the storage unit may be provided in an information processing terminal held by a patrol officer who patrols the parking lot.

[0018] In such a patrol support system, the image capture start signal may be generated in response to an operation performed by a patrol officer patrolling the parking lot on an information processing terminal device held by the patrol officer, and transmitted to the image capture unit.

[0019] In such a patrol support system, the image capture start signal may be automatically transmitted from the control unit to the imaging unit at the time the control unit generates the vehicle information data.

[0020] Furthermore, in order to solve the above problems, according to another aspect of the present invention, a patrol support method for supporting patrols to check vehicles parked in a parking lot, comprising: an imaging unit that images the vehicle and generates imaging data; a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data or generated data generated by the data processing; and a display unit that displays information for supporting the patrol, wherein the imaging unit images the area of ​​the vehicle including the license plate and generates license plate imaging data, the generated license plate imaging data is output to the control unit, and the control unit processes the acquired license plate A patrol support method is provided, which involves recognizing vehicle information inscribed on the license plate from rate imaging data, generating vehicle information data including the recognition result, storing the generated vehicle information data in the storage unit, having the imaging unit image the interior of the vehicle from outside the vehicle in accordance with the acquired imaging start signal to generate interior imaging data, having the control unit acquire identification information of the interior imaging data generated by the imaging unit from the imaging unit, selecting one of the vehicle information data stored in the storage unit that has a generation date and time close to the interior imaging data, and generating association information that associates the selected vehicle information data, the identification information of the interior imaging data, and time information related to the time.

[0021] Furthermore, in order to solve the above problems, according to yet another aspect of the present invention, a program for causing a computer to execute a patrol support method for assisting in patrolling to check vehicles parked in a parking lot, wherein the computer is a device having an imaging unit that images the vehicle and generates imaging data, or is capable of communicating with a device having the imaging unit, and the computer and / or the device having the imaging unit are configured to function as a patrol support system having a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data, a storage unit that stores at least one of the imaging data or generated data generated by the data processing, and a display unit that displays information for assisting in the patrol, wherein the program causes the imaging unit to image an area including the license plate of the vehicle and generate license plate imaging data, and generates A program is provided which outputs the acquired license plate image data to the control unit, the control unit recognizes the vehicle information written on the license plate from the acquired license plate image data and generates vehicle information data including the recognition result, stores the generated vehicle information data in the storage unit, the imaging unit images the interior of the vehicle from outside the vehicle in response to the acquired imaging start signal and generates interior image data, the control unit obtains identification information of the interior image data generated by the imaging unit from the imaging unit, selects one of the vehicle information data stored in the storage unit that has a generation date and time close to the interior image data, and generates association information which associates the selected vehicle information data, the identification information of the interior image data, and time information related to the time. [Effects of the Invention]

[0022] As described above, the present invention supports patrols to check vehicles parked in a parking lot, thereby achieving greater efficiency in patrol and check operations, and enabling the appropriate association of various types of information generated as a result of the checks. [Brief explanation of the drawing]

[0023] [Figure 1] It is an explanatory diagram schematically showing an example of the configuration of a patrol support system according to an embodiment of the present invention. [Figure 2] It is an explanatory diagram schematically showing an example of the configuration of a patrol support system according to the embodiment. [Figure 3] It is an explanatory diagram schematically showing an example of a graphical user interface displayed on a display unit of an information processing terminal device in a patrol support system according to the embodiment. [Figure 4] It is a flowchart showing an example of the processing flow in a patrol support system according to the embodiment. [Figure 5] It is an explanatory diagram showing an example of association information generated in a patrol support system according to the embodiment. [Figure 6] It is an explanatory diagram showing an example of vehicle confirmation result data generated in a patrol support system according to the embodiment. [Figure 7] It is an explanatory diagram schematically showing an example of a display screen displayed on a display unit of an information processing terminal device in a patrol support system according to the embodiment. [Figure 8] It is a block diagram showing an example of the hardware configuration of an information processing terminal device in a patrol support system according to the embodiment.

Embodiments for Carrying Out the Invention

[0024] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

[0025] (Regarding the overall configuration of the patrol support system 10) First, referring to FIGS. 1 and 2, the overall configuration of a patrol support system 10 according to an embodiment of the present invention will be described. FIGS. 1 and 2 are explanatory diagrams schematically showing an example of the configuration of a patrol support system according to this embodiment.

[0026] The patrol support system 10 according to this embodiment consists of devices used by a patrol officer when patrolling to check vehicles parked in a parking lot. Specifically, the patrol support system 10 according to this embodiment includes an information processing terminal device 100 held by the patrol officer and an imaging device 200 held by the patrol officer.

[0027] The information processing terminal device 100 is implemented, for example, by a so-called smartphone or portable tablet device, and is a terminal device that the patrol officer can hold directly in their hand or hold via a selfie stand (so-called selfie stick, etc.).

[0028] Furthermore, the imaging device 200 is an imaging device that can be held directly in the hand of a patrol officer or held via various selfie stands (so-called selfie sticks, etc.) or gimbals. The imaging device 200 is paired with the information processing terminal device 100 using wireless communication technologies such as Wi-Fi (registered trademark) or Bluetooth (registered trademark), enabling mutual communication between the imaging device 200 and the information processing terminal device 100. Such an imaging device 200 may be, for example, various digital still cameras or digital video cameras, or so-called action cameras (also called wearable cameras) such as GoPro (registered trademark).

[0029] However, since action cameras such as GoPro® can be worn around the neck or on the head by patrol officers, they can patrol the parking lot without having to use both hands, thus reducing the burden associated with patrolling. For this reason, it is more preferable to use an action camera as the imaging device 200 in the patrol support system 10 according to this embodiment.

[0030] Furthermore, Figure 1 illustrates an example where an imaging device 200 exists separately from the information processing terminal device 100 held by the patrol officer. However, it is also possible to implement the patrol support system 10 according to this embodiment using only the information processing terminal device 100, by using the imaging unit (such as a camera built into the information processing terminal device 100) of the information processing terminal device 100 as the imaging device 200. In the following, the explanation will be given using the case where the patrol support system 10 according to this embodiment has an imaging device 200 as an example.

[0031] The patrol support system 10 according to this embodiment may be held and used by each of the multiple patrolors P who patrol the parking lot, as schematically shown in Figure 2. In such a case, it is preferable that the patrol support system 10 held by each patrolor P is connected to various networks such as the Internet 3, so that various types of information can be exchanged between the patrol support systems 10 as needed.

[0032] Furthermore, a system management server 20 or the like may be prepared to manage one or more patrol support systems 10, and it may be made possible to communicate with each patrol support system 10 via the Internet 3 as described above. By setting up such a system management server 20, for example, within a facility that manages a parking lot, it becomes possible to back up and centrally manage various information and data generated by each patrol support system 10 on the system management server 20, thereby further improving convenience for the operators of the facility that manages the parking lot.

[0033] (Regarding the configuration of the information processing terminal device 100) Next, with reference to Figure 1, an example of the configuration of the information processing terminal device 100 according to this embodiment will be briefly described.

[0034] As previously mentioned, the information processing terminal device 100 according to this embodiment is implemented by a so-called smartphone or portable tablet terminal. This information processing terminal device 100 includes, for example, an imaging unit 101 as an example of a first imaging unit, a control unit 103, a storage unit 105 as an example of a first storage unit, and a display unit 107, as schematically shown in Figure 1. Furthermore, it is preferable that such an information processing terminal device 100 also has a communication unit 109 in addition to these processing units.

[0035] The imaging unit 101 is implemented by various camera units, such as imaging lenses and image sensors. Under the control of the control unit 103, the imaging unit 101 images vehicles within the camera unit's field of view and generates imaging data. The generated imaging data is temporarily stored in a predetermined folder in the storage unit 105 and is also output to the control unit 103, where the control unit 103 performs various data processing.

[0036] Here, the imaging unit 101 is capable of generating both still images and moving images of the vehicle. In the patrol support system according to this embodiment, as will be described in detail below, both an image of the license plate of the vehicle of interest and an image of the interior of the vehicle are acquired. The image of the license plate is preferably a still image, and the image of the interior of the vehicle may be a still image or a moving image. The imaging unit 101 is controlled by the control unit 103 to generate either a still image or a moving image, and then generates imaging data of the vehicle of interest.

[0037] The control unit 103 is implemented by, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc. The control unit 103 is a processing unit that comprehensively controls the implementation status of various functions realized by the patrol support system according to this embodiment.

[0038] Furthermore, when the control unit 103 acquires image data related to a vehicle, it performs various data processing operations on the acquired image data. As an example of such data processing, it performs a series of data processing operations such as recognizing vehicle information (i.e., the regional name, classification number, hiragana characters, and serial number written on the license plate) from an image of the license plate, generating vehicle information data related to the recognized vehicle information, and associating information related to an image of the interior of a vehicle having the recognized vehicle information with the vehicle information. Details of these data processing operations will be explained in more detail below.

[0039] Furthermore, the control unit 103 according to this embodiment implements various functions to support patrol work in the parking lot, and these functions will be described in detail below.

[0040] The memory unit 105 is implemented by, for example, RAM or a storage device. The memory unit 105 records at least one of the following: various imaging data related to the vehicle, or various generated data generated by various data processing by the control unit 103. In addition, the memory unit 105 appropriately records various information such as various parameters and intermediate processing results that the information processing terminal device 100 according to this embodiment needs to save when performing some processing, history information related to the various data processing performed, and various databases and programs. The imaging unit 101, control unit 103, display unit 107, communication unit 109, etc. can freely read / write data from this memory unit 105.

[0041] The display unit 107 is implemented, for example, by a CPU, GPU, ROM, RAM, input device, output device, etc. The display screen provided on the display unit 107 displays various information to support patrols of the parking lot by the patrol officer. By referring to the contents displayed on the display unit 107 while patrolling the parking lot, the patrol officer can perform the parking lot patrol work efficiently. In addition, the display unit 107 according to this embodiment is equipped with an input device such as a touch panel, and the patrol officer can execute various patrol support functions on the information processing terminal device 100 by selecting various icons and buttons displayed on the display unit 107.

[0042] The communication unit 109 is implemented by, for example, a CPU, GPU, ROM, RAM, communication device, etc. The communication unit is a processing unit that communicates with various devices located outside the information processing terminal device 100 using various wireless communication standards such as Wi-Fi®, Bluetooth®, LTE, LTE-A, 5G, etc. In this embodiment, the information processing terminal device 100 can transmit various control signals to the imaging device 200 and receive various imaging data generated by the imaging device 200 via the communication unit 109.

[0043] Details of the parking lot patrol support realized by the information processing terminal device 100 having the above-described processing units will be explained again below.

[0044] The above describes an example of the functions of the information processing terminal device 100 according to this embodiment. Each of the above components may be composed of general-purpose materials and circuits, or it may be composed of hardware specialized for the function of each component. Furthermore, the functions of each component may all be performed by a CPU or the like. Therefore, it is possible to change the configuration used as appropriate according to the technological level at the time of implementing this embodiment.

[0045] (Regarding the configuration of the imaging device 200) Next, an example of the configuration of the imaging device 200 according to this embodiment will be briefly described. The imaging device 200 according to this embodiment captures images of vehicles within the imaging field of view and generates various imaging data related to the vehicles. As shown in Figure 1, the imaging device 200 includes an imaging unit 201 as an example of a second imaging unit, an imaging control unit 203, a storage unit 205 as an example of a second storage unit, and a communication unit 207.

[0046] The imaging unit 201 is implemented by various camera units, such as imaging lenses and image sensors. Under the control of the imaging control unit 203, the imaging unit 201 images vehicles within the imaging field of view of the camera unit and generates imaging data. Here, the control signal for the imaging unit 201 to start imaging may be output from, for example, the information processing terminal device 100. The generated imaging data is associated with unique identification information (for example, an identification number assigned sequentially) and temporarily stored in a predetermined folder in the storage unit 205. Furthermore, when the imaging unit 201 generates imaging data, it can also output a predetermined signal indicating that imaging data has been generated to the information processing terminal device 100 via the imaging control unit 203 and the communication unit 207, which will be described later.

[0047] Here, the imaging unit 201 is capable of generating both still images and moving images of the vehicle. In the patrol support system according to this embodiment, as will be described in detail below, images of the interior of the vehicle of interest are acquired, and the imaging unit 201 of the imaging device 200 according to this embodiment is mainly used to image the interior of the vehicle of interest. In this case, the images generated by the imaging unit 201 may be still images or moving images. The imaging unit 201 is controlled by the imaging control unit 203 to generate either still images or moving images, and then generates imaging data of the vehicle of interest.

[0048] The imaging control unit 203 is implemented by, for example, a CPU, GPU, ROM, RAM, etc. The imaging control unit 203 is a processing unit that controls the imaging process performed by the imaging unit 201, while also receiving control from the information processing terminal device 100 as needed. Furthermore, when the imaging control unit 203 receives, for example, a request from the information processing terminal device 100 to transmit identification information of imaging data generated by the imaging device 200 or the imaging data itself, it transmits this information, stored in the storage unit 205, etc., to the information processing terminal device 100 via the communication unit 207.

[0049] The memory unit 205 is implemented by, for example, RAM or a storage device. The memory unit 205 records various imaging data related to the vehicle and identification information associated with such imaging data. In addition, the memory unit 205 appropriately records various parameters, intermediate processing progress, history information related to various data processing performed, and various types of information such as various databases and programs that need to be saved when the imaging device 200 according to this embodiment performs some processing. The imaging unit 201, imaging control unit 203, communication unit 207, etc., can freely read / write data from this memory unit 205.

[0050] The communication unit 207 is implemented by, for example, a CPU, GPU, ROM, RAM, communication device, etc. The communication unit is a processing unit that communicates with various devices located outside the imaging device 200 using various wireless communication standards such as Wi-Fi® or Bluetooth®. In this embodiment, the imaging device 200 can send and receive various control signals to and from the information processing terminal device 100, and transmit various data generated by the imaging device 200, via the communication unit 207.

[0051] The above describes an example of the functions of the imaging device 200 according to this embodiment. Each of the above components may be composed of general-purpose materials and circuits, or it may be composed of hardware specialized for the function of each component. Furthermore, the functions of each component may all be performed by a CPU or the like. Therefore, it is possible to change the configuration used as appropriate according to the level of technology at the time of implementing this embodiment.

[0052] (Regarding the various patrol support functions realized by the patrol support system) In the patrol support system 10, which is composed of the information processing terminal device 100 as described above, or composed of the information processing terminal device 100 and the imaging device 200, appropriate association is made between vehicle information recognized from images of vehicle license plates and images of the interior of the vehicles in order to support patrols of parking lots by patrol personnel. Such association is made by a patrol support program executed on the information processing terminal device 100. The process of associating such vehicle information with images of the interior of the vehicles will be explained in detail below.

[0053] In the following, prior to explaining the association process described above, we will briefly describe the other patrol support functions implemented by the patrol support system 10 according to this embodiment, with reference to Figure 3. Figure 3 is a schematic explanatory diagram showing an example of a graphical user interface (GUI) displayed on the display unit of an information processing terminal device in the patrol support system according to this embodiment.

[0054] When a program for realizing the patrol support system according to this embodiment (for example, an application installed on the information processing terminal device 100) is executed, a GUI such as the one shown in Figure 3 is displayed in the display area 300 of the display unit 107 of the information processing terminal device 100.

[0055] When a patrol officer begins their patrol work for the day, they touch, for example, the patrol start / end icon 301 displayed in the display area 300. This causes the control unit 103 to activate, for example, the license plate reading function in the patrol support system 10, and prepare to image vehicles. At the same time, the control unit 103 creates a new file or folder, for example, in the storage unit 105, that corresponds to the daily work report. Data generated during patrol work is written to this file or folder corresponding to the daily work report.

[0056] On the other hand, when a patrol officer finishes their patrol work for the day, they touch the patrol start / end icon 301 again. This causes the control unit 103 to close the file or folder corresponding to the daily work report. Since the various data and information generated during the day's patrol work are stored in this file or folder, managing the history of patrol work becomes easier.

[0057] Furthermore, an icon for pausing / resuming patrols (patrol pause / resuming icon 303) is displayed in the display area 300. When a patrol worker touches this icon 303 to temporarily pause patrol work, the control unit 103 temporarily stops the license plate reading function. When patrolling work is temporarily paused, it is preferable that the file or folder corresponding to the above-mentioned work report be kept open (in a state where additional writing is possible). When resuming patrol work, the patrol worker touches this patrol pause / resuming icon 303. This causes the control unit 103 to restart the license plate reading function. As a result, various data generated during the patrol are written again to the file or folder corresponding to the work report.

[0058] Furthermore, it is conceivable that the parking lot to be patrolled may be divided into multiple sections before carrying out the patrol work. In that case, setting data regarding the division of the parking lot is recorded in advance in the patrol support system 10. With such settings in place, the control unit 103 can display a patrol target area designation icon 305 in the display area 300, allowing the patrolor to specify the area they are currently patrolling. If setting data regarding the division of the parking lot exists in the patrol support system 10, it is possible to add information regarding the section (area) in which the vehicle is parked (hereinafter also referred to as area information) to the "vehicle confirmation result data" generated by reading the license plate.

[0059] In Figure 3, the parking lot is shown divided into four areas, but the number of areas is not particularly limited. The number of areas to which the parking lot is divided can be easily changed by changing the settings of the patrol support system 10.

[0060] Furthermore, the control unit 103 may also provide a patrol record display area 307 within the display area 300 to display the patrol record of the patrol officer (for example, the number of license plates read between 0:00 and 23:59 on the day).

[0061] In this embodiment, the patrol support system 10 defines a number called the "unique number" in order to more accurately grasp the information regarding the number of license plates read. Preferably, this unique number is defined as the number of data entries in the "vehicle confirmation result data" that do not overlap with the already generated "vehicle confirmation result data" for the four items of vehicle information written on the license plate: "region name / classification number / hiragana / serial designation number" (or, if area information is set, five items including area information).

[0062] Furthermore, the handling of non-unique license plates (duplicate license plates) within the same day's patrol unit can be set as appropriate. For example, if a patrol officer performs patrol work in multiple time slots throughout the day, and encounters a non-unique license plate within the same time slot, it may be excluded from the total number of license plates read for the day. Conversely, if a non-unique license plate is encountered during patrols in different time slots, it should be treated as a unique license plate.

[0063] Furthermore, if the control unit 103 is in a state where it can read license plates, it displays the imaging guide 311 within the display area 300.

[0064] When a license plate NP is located within the imaging guide 311, the control unit 103 starts an analysis process to read character information from the roughly rectangular object located within the imaging guide 311. The sequence of steps from reading the license plate will be explained in detail below.

[0065] Furthermore, in patrol work using the patrol support system 10 according to this embodiment, after reading the license plate NP, the interior of the vehicle having the license plate NP is imaged. In the patrol support system 10 according to this embodiment, the image capture process of the interior may be started automatically after the license plate is recognized, or the patrol officer may start the image capture process of the interior manually. At this time, an interior image capture start / end icon 315 for starting the image capture process of the interior may be displayed in the display area 300. When the interior image capture start / end icon 315 is touched by the patrol officer, the control unit 103 transmits a control signal to the imaging device (e.g., imaging device 200 or imaging unit 101) for capturing images of the interior to start capturing. When the interior image capture start / end icon 315 is touched again, the control unit 103 transmits a control signal to the imaging device (e.g., imaging device 200 or imaging unit 101) for capturing images of the interior to end capturing.

[0066] Furthermore, it is preferable that a text display area 317 is provided at any position in the display area 300 of the patrol support system 10 according to this embodiment. The control unit 103 displays text indicating the operating status of the patrol support system 10 (for example, "Scanning," "Imaging," etc.) in this text display area 317, thereby allowing the patrol operator to understand the operating status of the patrol support system 10.

[0067] Furthermore, in the patrol support system 10 according to this embodiment, it is preferable to provide an auxiliary icon display area 321 within the display area 300 for providing the patrolor with various information to support the patrol.

[0068] This auxiliary icon display area 321 can display, for example, a warning icon 323, a parking list display icon 325, an out-of-prefecture license plate list display icon 327, a patrol history list display icon 329, a system settings icon 331, an imaging device connection settings icon 333, and the like.

[0069] The warning icon 323 is an icon used to display information in the display area 300 to alert patrol personnel, such as information set as "handover items" in the patrol support system 10, or information regarding "vehicles registered on the blacklist." In the patrol support system 10 according to this embodiment, this information regarding "handover items" and "vehicles registered on the blacklist" is stored in advance in the storage unit 105, etc. Alternatively, this information may be obtained from a system management server 20 that manages multiple patrol support systems 10. When the warning icon 323 is selected, the control unit 103 can switch the display content of the display area 300 from the state in which display content for vehicle imaging is displayed to display various types of information to alert patrol personnel.

[0070] Here, the handling policies for information set as "handover items" and information regarding "vehicles registered on the blacklist" can be set as appropriate in the patrol support system 10. For example, information set as "handover items" may be set to "become invalid after the next day" or to "remain valid even after the next day." Similarly, information regarding "vehicles registered on the blacklist" may be set to "remain valid even after the next day."

[0071] The parking list display icon 325 is an icon for displaying information about license plates that have been checked on a daily basis (i.e., information about parked vehicles). When this parking list display icon 325 is selected, the control unit 103 switches the display content of the display area 300 from the state in which the display content for imaging vehicles is displayed, and displays information about license plates, for example, for each parking area.

[0072] Here, for non-unique license plates (duplicate plates) on the same day, the display may be updated to reflect the most recent reading time when the plates are read during different work periods. Furthermore, if the same license plate is read in different areas of the parking lot, it can be treated as a unique plate.

[0073] Furthermore, when the parking list is displayed, if a patrol officer selects any of the displayed information, the control unit 103 may display the "handover information" associated with the selected license plate.

[0074] The out-of-prefecture license plate list display icon 327 is an icon used by the control unit 103 to set the regions to be treated as "out-of-prefecture license plates". When this out-of-prefecture license plate list display icon 327 is selected, the control unit 103 switches the display content of the display area 300 from the state in which the display content for capturing vehicle images is displayed and displays a setting screen for setting the regions to be treated as "out-of-prefecture license plates".

[0075] Here, the criteria for determining which regions are "out of prefecture" can be arbitrarily set by appropriately adjusting the settings of the patrol support system 10. For example, by pre-setting the location of the parking lot and the conditions for determining "out of prefecture," the control unit 103 can easily determine whether the recognized license plate is from "out of prefecture." The conditions for recognizing "out of prefecture" can be set as appropriate, for example, by "regional unit (Hokkaido / Tohoku / Kanto / Shinetsu / Hokuriku / Tokai / Kinki / Chugoku / Shikoku / Kyushu, etc.)", "prefectural unit", or "regional unit". The setting information regarding the regions to be treated as "out-of-prefecture license plates" is stored, for example, in the memory unit 105.

[0076] The patrol history list display icon 329 is an icon used to display the history of patrol work performed by the patrol officer on a given day. When this patrol history list display icon 329 is selected, the control unit 103 switches the display content of the display area 300 from the state where content for vehicle imaging is displayed to display the history of patrol work performed by the patrol officer on a given day. This allows the patrol officer to immediately grasp the status of their work on a given day, such as when and for how long they patrolled, how many vehicles they checked in each area of ​​the parking lot, and whether there were any handover items.

[0077] The system setting icon 331 is an icon for configuring the environment of the patrol support system 10 according to this embodiment. When this system setting icon 331 is selected, the control unit 103 switches the display content of the display area 300 from the state in which the display content for imaging the vehicle is displayed to display various items for system settings. The details of such items are not particularly limited and can be set as appropriate.

[0078] For example, items for configuring the system include: (1) whether to save the captured image and read content (i.e., vehicle information), (2) setting the timeout for OCR (Optical Character Recognition) to read license plates, (3) setting the reading interval (in units, e.g., milliseconds), (4) specifying the matching data, (5) enabling / disabling continuous reading, (6) setting the connection of the imaging device 200, and (7) whether to display the icon for setting the connection with the imaging device 200 (imaging device connection setting icon 333 in Figure 3).

[0079] Furthermore, by configuring the connection settings with the imaging device 200, it becomes possible to automate imaging by the imaging device 200. For example, conditions can be set to determine when automatic imaging should begin based on the type of vehicle detected. This allows for arbitrary setting of conditions for automatic imaging in accordance with the patrol work policies required by the parking lot operator, such as automatic shooting (new vehicles) normal vehicles / out-of-prefecture license plates / vehicles requiring attention, and automatic shooting (confirmed vehicles) normal vehicles / out-of-prefecture license plates / vehicles requiring attention.

[0080] The various patrol support functions realized by the patrol support system 10 according to this embodiment have been specifically described above with reference to Figure 3.

[0081] (Regarding the association between vehicle information and image data captured from the vehicle's interior) Next, with reference to Figures 4 to 7, we will explain in detail the association process between vehicle information and image data of the vehicle interior (hereinafter referred to as "in-vehicle image data"), which is one of the important processes performed in the patrol support system 10 according to this embodiment.

[0082] As mentioned earlier, during parking lot patrols, it is desirable to keep a record that "the parking lot patrol officer thoroughly checked the parked vehicles and confirmed that no problems or issues had occurred." On the other hand, as the number of vehicles to be checked increases, it is estimated that the amount of information generated as a result of the checks will also increase. Therefore, a mechanism for appropriately linking the various pieces of information generated as a result of the checks during the series of patrol and check operations performed by the patrol officer will become important in the future.

[0083] Therefore, in the patrol support system 10 according to this embodiment, as detailed below, association information is automatically generated by linking information representing vehicle information recognized from the license plate with identification information unique to the in-vehicle image data, and this association information is stored in the storage unit 105, etc. As a result, even if the number of vehicles to be checked increases, the patrol operator can perform patrol work without being aware of the association between vehicle information and in-vehicle image data. This supports patrols to check vehicles parked in parking lots, further improving the efficiency of patrol and check work, and makes it possible to appropriately associate various types of information generated as a result of the check.

[0084] Figure 4 is a flowchart showing an example of the processing flow in the patrol support system according to this embodiment. Figure 5 is an explanatory diagram showing an example of association information generated by the patrol support system according to this embodiment, and Figure 6 is an explanatory diagram showing an example of vehicle confirmation result data generated by the patrol support system according to this embodiment. Figure 7 is an explanatory diagram schematically showing an example of a display screen displayed on the display unit of the information processing terminal device in the patrol support system according to this embodiment.

[0085] As shown in Figure 4, the patrol support system 10 according to this embodiment is started when the patrol officer launches the application corresponding to the patrol support system 10 in the information processing terminal device 100 (step S101).

[0086] When a patrol officer approaches the first vehicle to be inspected in the parking lot, the officer uses the imaging unit 101 to image the area including the license plate of that vehicle, using the GUI as appropriate as shown in Figure 3 (step S103). As a result, the imaging unit 101 generates license plate image data, which is the area including the license plate, and outputs the generated license plate image data to the control unit 103.

[0087] The control unit 103, which has acquired license plate image data, recognizes the vehicle information (i.e., regional name, classification number, hiragana, and serial number) written on the license plate from the acquired license plate image data, generates vehicle information data including the recognition result (step S105), and stores the generated vehicle information data in the storage unit 105.

[0088] In this case, it is preferable that the control unit 103 processes only the image data in which the arrangement of characters is the same as that of a license plate. This allows the control unit 103 to recognize only the image data in which a license plate is captured, thereby improving processing efficiency.

[0089] Furthermore, when a patrol officer images the area including the license plate, it is conceivable that they may image the license plate not only from directly in front of it, but also from an oblique angle above, from the right, or from the left. Therefore, it is preferable for the control unit 103 to correct the angle of the image when recognizing the license plate image data.

[0090] Furthermore, when recognizing vehicle information, it is preferable to pre-set and train information regarding specific misreading patterns for strings that may be misrecognized (for example, regional names). By pre-storing such training data in the memory unit 105, the control unit 103 can correct the misread string to an appropriate state even if it makes a mistake in recognizing the license plate image data. This makes it possible to perform a correction process that corrects the misrecognized string to "Tama" even if, for example, a Tama license plate is recognized as "Taki".

[0091] Furthermore, the control unit 103 may compare the obtained recognition result with past history information, etc., and make various judgments on the recognition result based on pre-set comparison items, etc. The control unit 103 may also display the obtained comparison result in the display area 300 or output it as audio data.

[0092] Furthermore, there are no specific regulations regarding the details of the so-called OCR processing used to recognize vehicle information from license plate image data; various publicly known OCR processing technologies may be used as appropriate.

[0093] Here, it is preferable for the control unit 103 to determine whether or not the vehicle has already been identified by checking whether vehicle information data corresponding to the obtained recognition result has already been recorded (step S107). If the vehicle has already been identified (step S107-YES), the control unit 103 may, in cooperation with the display unit 107, notify the patrol officer that the vehicle has already been identified via the text display area 317 of the display area 300 or the like (step S109).

[0094] Furthermore, if the vehicle information data corresponding to the obtained recognition result is new (step S109-NO), the control unit 103 may, in cooperation with the display unit 107, guide the patrol officer through the text display area 317 of the display area 300, etc., in order to prompt the patrol officer to take images inside the vehicle.

[0095] After completing the imaging of the area including the license plate, the patrol officer then images the interior of the vehicle from the outside. More specifically, the patrol officer uses the imaging unit 201 of the imaging device 200 or the imaging unit 101 of the information processing terminal device 100 to image the interior of the vehicle from the outside. At this time, the control unit 103 transmits an imaging start signal to the imaging device 200 or imaging unit 101 to start imaging, and the imaging unit 101 or imaging unit 201 starts imaging the interior of the vehicle in response to the acquired imaging start signal (step S111). Through this imaging process, interior imaging data of the vehicle interior is generated.

[0096] Here, the above-mentioned imaging start signal is controlled based on the conditions set in the setting information of the patrol support system 10 according to this embodiment. For example, it may be generated in response to an operation performed by the patrolor on the information processing terminal device 100 (e.g., touching the in-vehicle imaging start / end icon 315) and transmitted to the imaging units 101 and 201. Alternatively, the above-mentioned imaging start signal may be automatically transmitted from the control unit 103 to the imaging units 101 and 201 at the timing when the control unit 103 generates vehicle information data. Furthermore, depending on the setting conditions of the patrol support system 10, it is also possible to set more complex imaging conditions, such as "automatically start imaging only for new license plates."

[0097] Next, the control unit 103 obtains identification information for the in-vehicle image data generated by the imaging unit 101 or imaging unit 201 from the imaging unit 101 or imaging unit 201. Such identification information is not particularly limited as long as it is unique to the acquired image data; various types of easily usable information can be used as appropriate. For example, it is preferable to use a unique identification number that the imaging units 101 and 201 automatically assign sequentially to the image data they capture. By using such a unique identification number, the control unit 103 can process the data without independently generating new identification information, thus simplifying the system.

[0098] Next, the control unit 103 selects one vehicle information data from the vehicle information data stored in the memory unit 105 that has a generation date and time close to the in-vehicle imaging data of interest. There is no specific definition of what constitutes a "close" time difference; for example, it can be set as appropriate by the administrator or other person using the patrol support system 10, such as within 1 minute, within 3 minutes, within 5 minutes, within 10 minutes, etc.

[0099] Next, the control unit 103 associates the selected vehicle information data, the identification information of the in-vehicle image data, and the time information with respect to the time, and generates association information (step S113).

[0100] Here, the detailed data structure and data types of the association information generated by the control unit 103 are not particularly limited, and a data structure and data types that are easy to handle by the device used as the information processing terminal 100 should be appropriately selected.

[0101] Figure 5 shows an example of the generated association information. In Figure 5, the association information is illustrated as an example where it is implemented in a tabular data structure, but the generated association information may also be a collection of character information, for example, recorded as a CSV file.

[0102] As shown in Figure 5, the association information includes, for example, time information related to the date and time the license plate was photographed, vehicle information data read from the license plate image data, and identification information and the date and time of the in-vehicle image data, all of which are linked to each other. Since this association information is automatically generated by the control unit 103, patrol officers can perform their patrol work without having to be aware of the association between vehicle information and in-vehicle image data.

[0103] The control unit 103 stores the association information generated as described above in the "patrol history database" provided in the storage unit 105 as vehicle verification result data for the vehicle (step S115). As a result, the patrol support system 10 according to this embodiment can automatically create and manage patrol work history information, thereby further improving the convenience of the user of the patrol support system 10.

[0104] Furthermore, depending on the capacity of the storage device available as the memory unit 105, the control unit 103 may also acquire the in-vehicle imaging data itself from the imaging units 101 and 201 and store the in-vehicle imaging data itself in the patrol history database as vehicle confirmation result data. This makes it possible to save and manage the image information itself as a record of the patrol, further improving the usefulness of the vehicle confirmation result data as evidence. The storage location of the in-vehicle imaging data itself is not particularly limited; it may remain in the memory unit 205 of the imaging device 200, or, if a system management server 20 as illustrated in Figure 2 is installed, it may be stored in the memory unit of the system management server 20.

[0105] Furthermore, the control unit 103 may add additional information about at least one of the vehicle or the vehicle's user to the vehicle confirmation result data as described above (step S117). Examples of additional information about the vehicle include information about the vehicle's condition, such as "windows left open," "engine left running," "lights left on," "pet left unattended," and "other." Such additional information about the vehicle's condition can be used as "handover information" for the vehicle under consideration.

[0106] Furthermore, additional information regarding the vehicle, such as whether or not it has an "out-of-prefecture license plate" as explained earlier, can also be adopted. The control unit 103 can easily and automatically determine whether or not it has an "out-of-prefecture license plate" based on the setting information explained earlier.

[0107] Furthermore, additional information regarding the vehicle's user can include various details such as "the license plate belongs to someone on a blacklist" or "the vehicle is being driven by a VIP customer." This kind of additional information can be used to determine whether a vehicle under consideration is one that "needs attention," and can also be used as "handover information" or "information to draw the attention of patrol officers."

[0108] As described above, in this embodiment, the control unit 103 of the patrol support system 10 can ultimately generate vehicle confirmation result data for a single vehicle of interest, such as the one shown in Figure 6, in which association information and additional information are linked. The control unit 103 can refer to the vehicle confirmation result data generated in this way at any time to obtain various information about the confirmed vehicle. In Figure 6, the vehicle confirmation result data is illustrated as an example where it is implemented in a tabular data format, but the generated vehicle confirmation result data may also be a collection of text information recorded as, for example, a CSV file.

[0109] Furthermore, the control unit 103 may determine whether or not additional information already exists for a vehicle by checking whether the vehicle information data currently under consideration is already recorded in the patrol history database (step S119). If additional information has already been provided (step S119-YES), the control unit 103, in cooperation with the display unit 107, may use the text display area 317 of the display area 300, etc., to display a warning to the patrol officer and notify the patrol officer that the vehicle has additional information (step S121).

[0110] In the patrol support system 10 according to this embodiment, the association process between vehicle information data and in-vehicle image data is performed for a single vehicle of interest, for example, in the flow described above.

[0111] If the patrol is terminated, for example by touching the patrol start / end icon 301 in the display area 300 (step S123-YES), the control unit 103 terminates the patrol support system (step S125). If the patrol by the patrolor continues, the control unit 103 returns to step S103 and waits to start the association process for the next vehicle to be focused on.

[0112] Furthermore, in the patrol support system 10 according to this embodiment, it is also possible to provide a display screen such as the one shown in Figure 7 by using the patrol history database which includes the association information generated as described above. In one example of this display screen, vehicle information data and additional information obtained as a result of the patrol can be checked. In addition, for in-vehicle image data, the actual in-vehicle image data can be checked by selecting an icon such as a play button. Moreover, it is possible to input search criteria for date, vehicle information, additional information, etc., on the display screen and search for data that matches the search criteria from the patrol history database.

[0113] Furthermore, the flow of the association process between vehicle information data and in-vehicle image data shown in Figure 4 is merely an example, and the flow of the association process between vehicle information data and in-vehicle image data according to this embodiment is not limited to the example shown in Figure 4. In the patrol support system 10 according to this embodiment, the order of the processes performed in the association process between vehicle information data and in-vehicle image data may be changed, some processes may be omitted as appropriate depending on the system settings, and processes that do not need to be performed in the example shown in Figure 4 may be performed. For example, in a patrol support system 10 where a "blacklist" is set in advance, the flow of the process may be changed to perform the additional information confirmation process shown in step S119 at an early stage, regardless of whether the vehicle has been confirmed or not, to check whether the vehicle is on the "blacklist".

[0114] The process of associating vehicle information data with in-vehicle image data, as performed in the patrol support system 10 according to this embodiment, has been described in detail above with reference to Figures 4 to 7.

[0115] Here, the association process described above can be realized by creating a computer program that enables a device having an imaging unit that images a vehicle and generates imaging data, or a device that can communicate with a device having an imaging unit, to function as a patrol support system having (a) a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data, (b) a storage unit that stores at least one of the imaging data or the generated data generated by the data processing, and (c) a display unit that displays information to support patrols, and then implementing this program on an information and communication device such as a smartphone or tablet terminal. Furthermore, a computer-readable recording medium on which such a computer program is stored can also be provided. Examples of recording media include magnetic disks, optical disks, magneto-optical disks, and flash memory. In addition, the above computer program may be distributed, for example, via a network, without using a recording medium.

[0116] (Regarding the hardware configuration of the information processing terminal device 100) Next, the hardware configuration of the information processing terminal device 100 according to this embodiment will be described in detail with reference to Figure 8. Figure 8 is a block diagram illustrating the hardware configuration of the information processing terminal device 100 according to this disclosure.

[0117] The information processing terminal device 100 mainly comprises a CPU 901, a GPU 902, a ROM 903, and a RAM 905. Furthermore, the information processing terminal device 100 also comprises a host bus 907, a bridge 909, an external bus 911, an interface 913, a sensor 914, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925.

[0118] The CPU 901 and GPU 902 function as an arithmetic processing unit and a control unit, and control all or part of the operations within the information processing terminal device 100 according to various programs recorded in ROM 903, RAM 905, storage device 919, or removable recording medium 927. ROM 903 stores programs and arithmetic parameters used by the CPU 901 and GPU 902. RAM 905 temporarily stores programs used by the CPU 901 and GPU 902, as well as parameters that change as appropriate during program execution. These are interconnected by a host bus 907, which is composed of internal buses such as the CPU bus.

[0119] The host bus 907 is connected to an external bus 911, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 909.

[0120] Sensor 914 is a detection means such as a sensor that detects the user's movements or a sensor that acquires information representing the current location. Examples of such sensors include motion sensors such as a 3-axis accelerometer including an acceleration sensor, gravity detection sensor, and fall detection sensor, and a 3-axis gyroscope including an angular velocity sensor, image stabilization sensor, and geomagnetic sensor, as well as GPS sensors. In addition to the above, sensor 914 may also be equipped with various measuring instruments such as a thermometer, illuminometer, and hygrometer.

[0121] The input device 915 is, for example, a user-operated means such as a keyboard, touch panel, various cameras, buttons, or switches. Here, the input device 915 may be, for example, a mobile phone or tablet terminal itself that is compatible with the operation of the information processing terminal device 100, or it may be an external connection device 929. Furthermore, the input device 915 is composed of, for example, an input control circuit that generates an input signal based on information input by the user using the above-mentioned operating means and outputs it to the CPU 901 and GPU 902. By operating this input device 915, the user of the information processing terminal device 100 can input various data to the information processing terminal device 100 or instruct it to perform processing operations.

[0122] The output device 917 is comprised of a device capable of visually or audibly notifying the user of the acquired information. Such devices include display devices such as liquid crystal displays and EL displays, and audio output devices such as speakers and headphones. The output device 917 outputs, for example, the results obtained from various processes performed by the information processing terminal device 100. Specifically, the display device displays the results obtained from various processes performed by the information processing terminal device 100 in text or images. On the other hand, the audio output device converts the audio signal, consisting of played-back audio data or sound data, into an analog signal and outputs it.

[0123] The storage device 919 is a data storage device configured as an example of the storage unit of the information processing terminal device 100. The storage device 919 is composed of, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device such as an SSD (Solid State Drive), an optical storage device, or a magneto-optical storage device. This storage device 919 stores programs and various data executed by the CPU 901 and GPU 902, as well as various data acquired from external sources.

[0124] The drive 921 is a reader / writer for recording media and is either built into or attached to the information processing terminal device 100. The drive 921 reads information recorded on the removable recording media 927, such as a semiconductor memory, and outputs it to the RAM 905. The drive 921 can also write data to the removable recording media 927, such as a semiconductor memory. The removable recording media 927 is, for example, CompactFlash (CF), flash memory, or an SD memory card (Secure Digital memory card). Alternatively, the removable recording media 927 may be, for example, an IC card (Integrated Circuit card) or electronic device equipped with a contactless IC chip.

[0125] The connection port 923 is a port for directly connecting equipment to the information processing terminal device 100. Examples of connection port 923 include USB (Universal Serial Bus) ports and HDMI (High-Definition Multimedia Interface) ports. By connecting an external device 929 to this connection port 923, the information processing terminal device 100 can directly acquire various data from the external device 929 or provide various data to the external device 929.

[0126] The communication device 925 is a communication interface composed of, for example, a communication device for connecting to the communication network 931. The communication device 925 is, for example, a communication card for wired or wireless LAN (Local Area Network), Bluetooth®, etc. This communication device 925 can send and receive signals, etc., to, for example, the Internet or other communication devices in accordance with a predetermined protocol such as TCP / IP. The communication network 931 connected to the communication device 925 is composed of a network connected by wire or wireless, and may be, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.

[0127] The above describes an example of a hardware configuration capable of realizing the functions of the information processing terminal device 100 according to the embodiment of this disclosure. Each of the above components may be made up of general-purpose materials, or it may be made up of hardware specialized for the function of each component. Therefore, it is possible to change the hardware configuration used as appropriate depending on the level of technology at the time of implementing this embodiment.

[0128] Although preferred embodiments of the present invention have been described in detail above with reference to the attached drawings, the present invention is not limited to these examples. It is clear to any person with ordinary skill in the art to which the present invention belongs that various modifications or alterations can be conceived within the scope of the technical idea described in the claims, and these are also understood to fall within the technical scope of the present invention.

[0129] The embodiments disclosed herein are illustrative and not restrictive in all respects. The embodiments described above may be omitted, replaced, or modified in various ways without departing from the appended claims, the technical scope of the invention as described later, and the spirit thereof. For example, the constituent elements of the embodiments described above can be combined in any way without impairing their effects. Furthermore, such any combination will naturally yield the effects and benefits of each constituent element in the combination, as well as other effects and benefits that will be obvious to those skilled in the art from the description herein.

[0130] Furthermore, the effects described herein are merely descriptive or illustrative, and not limiting. In other words, the technology according to the present invention may produce other effects that will be apparent to those skilled in the art from the description herein, in addition to or instead of the effects described above. [Explanation of Symbols]

[0131] 3. Internet 10. Patrol Support System 20 System Management Server 100 Information Processing Terminal Device 101, 201 Imaging Unit 103 Control Unit 105, 205 Storage section 107 Display section 109, 207 Communications Department 200 Imaging device 203 Imaging Control Unit 300 display area 301 Patrol Start / End Icon 303 Patrol Interruption / Resume Icon 305 Icon for specifying patrol area 307 Patrol Record Display Area 311 Imaging Guide 315 In-car recording start / end icon 317 Text display area 321 Auxiliary icon display area 323 Warning icon 325 Parking List Display Icon 327 Out-of-prefecture license plate list display icon 329 Browsing History List Display Icon 331 System Settings Icon 333 Imaging device connection settings icon P patroller NP Number Plate

Claims

1. A patrol support system that assists in patrolling to check on vehicles parked in a parking lot, An imaging unit that images the vehicle and generates imaging data, A control unit that acquires the generated imaging data and performs data processing on the acquired imaging data, A storage unit that stores at least one of the aforementioned imaging data or generated data generated by the aforementioned data processing, A display unit that displays information to support the aforementioned patrol, It has, The imaging unit captures an image of the area including the vehicle's license plate, generates license plate image data, and outputs the generated license plate image data to the control unit. The control unit recognizes the vehicle information inscribed on the license plate from the acquired license plate image data, generates vehicle information data including the recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit, in response to the acquired imaging start signal, images the interior of the vehicle from outside the vehicle to generate interior imaging data. The control unit acquires identification information of the in-vehicle image data generated by the imaging unit from the imaging unit, selects one of the vehicle information data stored in the storage unit that has a generation date and time close to the in-vehicle image data, and generates association information that associates the selected vehicle information data, the identification information of the in-vehicle image data, and time information related to the time, in a patrol support system.

2. The patrol support system according to claim 1, wherein the identification information of the in-vehicle image data is a unique identification number assigned sequentially by the imaging unit to the image data captured by the imaging unit.

3. The patrol support system according to claim 1, wherein the control unit stores the generated association information as vehicle verification result data for the vehicle in the patrol history database provided in the storage unit.

4. The patrol support system according to claim 3, wherein the control unit further stores the in-vehicle imaging data as the vehicle confirmation result data to be stored in the patrol history database.

5. The control unit, When the aforementioned association information is newly generated, it is checked whether the vehicle information data included in the generated association information is already recorded in the patrol history database. The patrol support system according to claim 3, wherein if the vehicle information data included in the generated association information is already recorded in the patrol history database as the vehicle confirmation result data, the display unit displays a message indicating that it has already been confirmed.

6. The patrol support system according to claim 3, wherein the vehicle verification result data further includes additional information relating to at least one of the vehicle or the user of the vehicle.

7. The control unit, When the aforementioned association information is newly generated, it is checked whether the vehicle information data included in the generated association information is already recorded in the patrol history database. The patrol support system according to claim 6, wherein if the vehicle information data included in the generated association information is already recorded in the patrol history database as the vehicle confirmation result data, and the additional information is included in the vehicle confirmation result data, the display unit is instructed to display a warning message indicating that the additional information regarding the vehicle being confirmed exists.

8. The aforementioned patrol support system is, An information processing terminal device held by a patrol officer patrolling the aforementioned parking lot, The action camera worn by the aforementioned patrol officer, Includes, The information processing terminal device has a first imaging unit that functions as an imaging unit and a first storage unit that functions as a storage unit. The action camera has a second imaging unit that functions as the imaging unit, and a second storage unit that functions as the storage unit. The first imaging unit images the license plate and stores the license plate image data in the first storage unit. The patrol support system according to claim 1, wherein the second imaging unit images the interior of the vehicle and stores the interior imaging data in the second storage unit.

9. The patrol support system according to claim 1, wherein the imaging unit and the storage unit are provided in an information processing terminal held by a patrol officer who patrols the parking lot.

10. The patrol support system according to claim 1, wherein the imaging start signal is generated in response to an operation performed by a patrol officer patrolling the parking lot on an information processing terminal device held by the patrol officer, and transmitted to the imaging unit.

11. The patrol support system according to claim 1, wherein the imaging start signal is automatically transmitted from the control unit to the imaging unit at the timing when the control unit generates the vehicle information data.

12. A patrol support method that assists in patrolling to check vehicles parked in a parking lot, A patrol support system comprising: an imaging unit that images the vehicle and generates imaging data; a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data or the generated data produced by the data processing; and a display unit that displays information to support the patrol, The imaging unit captures an image of the area including the vehicle's license plate, generates license plate image data, and outputs the generated license plate image data to the control unit. The control unit recognizes the vehicle information inscribed on the license plate from the acquired license plate image data, generates vehicle information data including the recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit, in accordance with the acquired imaging start signal, images the interior of the vehicle from outside the vehicle to generate interior imaging data. A patrol support method comprising: a control unit that obtains identification information of the in-vehicle image data generated by the imaging unit from the imaging unit; a control unit that selects one of the vehicle information data stored in the storage unit whose generation date and time are close to the in-vehicle image data; and generates association information that associates the selected vehicle information data, the identification information of the in-vehicle image data, and time information related to the time.

13. A program that causes a computer to execute a patrol support method to assist in patrolling to check vehicles parked in a parking lot, The computer is either a device having an imaging unit that images the vehicle and generates imaging data, or a device that is capable of communicating with the device having the imaging unit. The computer and / or the equipment having the imaging unit, A control unit that acquires the generated imaging data and performs data processing on the acquired imaging data, A storage unit that stores at least one of the aforementioned imaging data or generated data generated by the aforementioned data processing, A display unit that displays information to support the aforementioned patrol, It will function as a patrol support system that has the following features: The aforementioned program, The imaging unit captures an image of the area including the vehicle's license plate, generates license plate image data, and outputs the generated license plate image data to the control unit. The control unit recognizes the vehicle information inscribed on the license plate from the acquired license plate image data, generates vehicle information data including the recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit generates interior imaging data by imaging the interior of the vehicle from outside the vehicle in accordance with the acquired imaging start signal. A program that causes the control unit to obtain identification information of the in-vehicle image data generated by the imaging unit from the imaging unit, to select one of the vehicle information data stored in the storage unit that has a generation date and time close to the in-vehicle image data, and to generate association information that associates the selected vehicle information data, the identification information of the in-vehicle image data, and time information related to the time.

Images