Patrol Support System, Patrol Support Method, and Program

Abstract

Regarding the patrol and confirmation work for checking vehicles parked in a parking lot, while achieving further efficiency, appropriately associating various types of information generated as a result of the confirmation. 【Solution means】In the patrol support system according to the present invention, an area including the license plate of a vehicle is imaged, and by recognizing the license plate imaging data, the vehicle information described on the license plate is specified, and vehicle information data including the recognition result is generated. Further, in the patrol support system, the interior of the vehicle is imaged from the outside to generate interior imaging data. Then, the patrol support system acquires the identification information of the generated interior imaging data, and selects one piece of vehicle information data from the vehicle information data stored in the storage unit that is close in generation date and time to the interior imaging data, and generates association information in which the selected vehicle information data, the identification information of the interior imaging data, and time information regarding time are associated with each other.

Description

Technical Field

[0001] The present invention relates to a patrol support system, a patrol support method, and a program.

Background Art

[0002] In recent years, in various business formats such as amusement facilities like amusement parks, game arcades, supermarkets, department stores, shopping malls, etc., there has been an increasing number of facilities equipped with large parking lots. As an operator of such a facility, since it is preferable that no trouble occurs to the parked vehicles (for example, leaving people or pets unattended in the vehicle, leaving the lights on, leaving the door window open, forgetting to lock the door, etc.), it is common practice to have the relevant personnel of the facility patrol the parking lot to check whether any trouble has occurred to each parked vehicle.

[0003] However, for example, the larger the total area of the parking lot and the higher the turnover rate of customers coming by car, the greater the number of vehicles that need to be checked. Therefore, it is important to efficiently perform the checking work with a limited number of people within a limited time.

[0004] Conventionally, various technologies have been proposed to support the above-mentioned patrol and checking work. For example, in Patent Document 1 below, in a patrol operation where information regarding the license plate read from a vehicle is recorded as a confirmation result, a patrol support system for presenting to the patrol personnel whether the vehicle has already been confirmed and an auxiliary tool for assisting the patrol work by the patrol personnel are proposed.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] Here, in the patrol and confirmation work of the parking lot as described above, it is preferable to save, as a record, that "the patrol person of the parking lot has carefully confirmed the parked vehicles and recognized that no troubles or the like have occurred". On the other hand, as the number of vehicles to be confirmed increases, it is estimated that various types of information generated as a result of the confirmation (for example, various imaging images obtained by imaging the vehicles) also increase. Therefore, in the series of patrol and confirmation work performed by the patrol person, a mechanism for appropriately associating various types of information generated as a result of the confirmation will become important in the future.

[0007] However, among the conventionally proposed technologies for patrol support, such as the technology proposed in Patent Document 1 above, there is no technology that has been studied from the viewpoint of appropriately associating various types of information regarding vehicles parked in a parking lot as described above, and there is room for study on such a viewpoint.

[0008] Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to support the patrol for confirming vehicles parked in a parking lot, realize further efficiency improvement of the patrol and confirmation work, and provide a patrol support system, a patrol support method, and a program capable of appropriately associating various types of information generated as a result of the confirmation.

Means for Solving the Problems

[0009] In order to solve the above problems, according to an aspect of the present invention, there is provided a patrol support system for assisting a patrol to check vehicles parked in a parking lot, the system including: an imaging unit configured to image the vehicle to generate imaging data; a control unit configured to acquire the generated imaging data and perform data processing on the acquired imaging data; a storage unit configured to store at least one of the imaging data or generated data generated by the data processing; and a display unit configured to display information for assisting the patrol. The imaging unit images an area including the license plate of the vehicle to generate license plate imaging data, and outputs the generated license plate imaging data to the control unit. The control unit recognizes vehicle information described on the license plate from the acquired license plate imaging data, generates vehicle information data including the recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit images the interior of the vehicle from outside the vehicle in response to an acquired imaging start signal to generate interior imaging data. The control unit acquires identification information of the interior imaging data generated by the imaging unit from the imaging unit, and selects one piece of vehicle information data from the vehicle information data stored in the storage unit, the generation date and time of which is close to that of the interior imaging data. The control unit generates association information associating the selected vehicle information data, the identification information of the interior imaging data, and time information regarding time with each other. Then, the control unit stores the generated association information in the patrol history database provided in the storage unit as vehicle confirmation result data for the vehicle. A patrol support system is provided. Also, in order to solve the above problems, according to another aspect of the present invention, there is provided a patrol support system for supporting a patrol for confirming a vehicle parked in a parking lot, including: an imaging unit that images the vehicle and generates imaging data; a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data or generated data generated by the data processing; and a display unit on which information for supporting the patrol is displayed. The imaging unit images an area including the license plate of the vehicle to generate license plate imaging data, and outputs the generated license plate imaging data to the control unit. The control unit recognizes vehicle information described on the license plate from the acquired license plate imaging data, and generates vehicle information data including the recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit images the interior of the vehicle from the outside of the vehicle in response to the acquired imaging start signal to generate interior imaging data. The control unit acquires the identification information of the interior imaging data generated by the imaging unit from the imaging unit, and selects one piece of the vehicle information data in the vehicle information data stored in the storage unit that is close to the interior imaging data in terms of the generation date and time. The control unit generates association information in which the selected vehicle information data, the identification information of the interior imaging data, and time information regarding time are associated with each other. The imaging start signal is automatically transmitted from the control unit to the imaging unit at the timing when the control unit generates the vehicle information data. A patrol support system is provided.

[0010] In such a patrol support system, the identification information of the interior imaging data may be a unique identification number sequentially assigned by the imaging unit to the image data imaged by the imaging unit.

[0011] In such a patrol support system, it is preferable that the control unit stores the generated association information in a patrol history database provided in the storage unit as vehicle confirmation result data for the vehicle.

[0012] In such a patrol support system, it is preferable that the control unit further stores the in-vehicle imaging data as the vehicle confirmation result data to be stored in the patrol history database.

[0013] In such a patrol support system, when the control unit newly generates the association information, the control unit checks whether the vehicle information data included in the generated association information has already been recorded in the patrol history database. When the vehicle information data included in the generated association information has already been recorded in the patrol history database as the vehicle confirmation result data, it is preferable that the display unit displays a message indicating that the vehicle has already been confirmed.

[0014] In such a patrol support system, it is preferable that the vehicle confirmation result data further includes additional information regarding at least one of the vehicle or the user of the vehicle.

[0015] In such a patrol support system, when the control unit newly generates the association information, the control unit checks whether the vehicle information data included in the generated association information has already been recorded in the patrol history database. When the vehicle information data included in the generated association information has already been recorded in the patrol history database as the vehicle confirmation result data and the additional information is included in the vehicle confirmation result data, it is preferable that the display unit displays a warning message indicating that there is additional information regarding the vehicle being checked.

[0016] Such a patrol support system includes an information processing terminal device held by a patroller who patrols the parking lot, and an action camera worn by the patroller. The information processing terminal device has a first imaging unit that functions as the imaging unit and a first storage unit that functions as the storage unit. The action camera has a second imaging unit that functions as the imaging unit and a second storage unit that functions as the storage unit. The first imaging unit may image the license plate and store the license plate imaging data in the first storage unit, and the second imaging unit may image the interior of the vehicle and store the interior imaging data in the second storage unit.

[0017] In such a patrol support system, the imaging unit and the storage unit may be provided in one information processing terminal held by a patroller who patrols the parking lot.

[0018] In such a patrol support system, the imaging start signal may be generated in response to an operation performed by a patroller who patrols the parking lot on the information processing terminal device held by the patroller and transmitted to the imaging unit.

[0019] In such a patrol support system, the imaging start signal may be automatically transmitted from the control unit to the imaging unit at the timing when the control unit generates the vehicle information data.

[0020] Also, in order to solve the above problems, according to another aspect of the present invention, there is provided a patrol support method for assisting a patrol for checking a vehicle parked in a parking lot, the method comprising: an imaging unit that images the vehicle to generate imaging data; a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data or generated data generated by the data processing; and a display unit on which information for assisting the patrol is displayed. Using the patrol support system, the imaging unit images an area including the license plate of the vehicle to generate license plate imaging data, and outputs the generated license plate imaging data to the control unit. The control unit recognizes vehicle information described on the license plate from the acquired license plate imaging data, and generates vehicle information data including the recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit images the interior of the vehicle from the outside of the vehicle in response to an acquired imaging start signal to generate interior imaging data. The control unit acquires identification information of the interior imaging data generated by the imaging unit from the imaging unit, and selects one piece of vehicle information data from the vehicle information data stored in the storage unit that is closest in generation date and time to the interior imaging data, and generates association information associating the selected vehicle information data, the identification information of the interior imaging data, and time information regarding time with each other. Then, the imaging start signal is automatically transmitted from the control unit to the imaging unit at the timing when the control unit generates the vehicle information data. A patrol support method is provided. Also, in order to solve the above problems, according to another aspect of the present invention, there is provided a patrol support method for assisting a patrol for checking a vehicle parked in a parking lot, the method including: an imaging unit that images the vehicle to generate imaging data; a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data or generated data generated by the data processing; and a display unit on which information for assisting the patrol is displayed. Using the patrol support system, the imaging unit images an area including the license plate of the vehicle to generate license plate imaging data, and outputs the generated license plate imaging data to the control unit. The control unit recognizes vehicle information described on the license plate from the acquired license plate imaging data, and generates vehicle information data including a recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit images the interior of the vehicle from the outside of the vehicle in response to an acquired imaging start signal to generate interior imaging data. The control unit acquires identification information of the interior imaging data generated by the imaging unit from the imaging unit, and selects one piece of vehicle information data from the vehicle information data stored in the storage unit that is close in generation date and time to the interior imaging data. Association information is generated by associating the selected vehicle information data, the identification information of the interior imaging data, and time information regarding time with each other. The imaging start signal is automatically transmitted from the control unit to the imaging unit at the timing when the control unit generates the vehicle information data. A patrol support method is provided.

[0021] Also, in order to solve the above problems, according to still another aspect of the present invention, there is provided a program for causing a computer to execute a patrol support method for assisting a patrol for checking a vehicle parked in a parking lot, wherein the computer is a device having an imaging unit that images the vehicle to generate imaging data, or is capable of communicating with a device having the imaging unit, and functions as a patrol support system having a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data, a storage unit that stores at least one of the imaging data or generated data generated by the data processing, and a display unit on which information for assisting the patrol is displayed. The program causes the imaging unit to image a region including the license plate of the vehicle to generate license plate imaging data, outputs the generated license plate imaging data to the control unit, causes the control unit to recognize vehicle information described on the license plate from the acquired license plate imaging data, generates vehicle information data including a recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit images the interior of the vehicle from the outside of the vehicle in response to an acquired imaging start signal to generate interior imaging data, and the control unit acquires identification information of the interior imaging data generated by the imaging unit from the imaging unit, and selects one piece of vehicle information data from the vehicle information data stored in the storage unit that is close to the interior imaging data in terms of generation date and time, and generates association information associating the selected vehicle information data, the identification information of the interior imaging data, and time information regarding time with each other. , the control unit stores the generated association information in a patrol history database provided in the storage unit as vehicle confirmation result data for the vehicle A program is provided. Also, in order to solve the above problems, according to still another aspect of the present invention, there is provided a program for causing a computer to execute a patrol support method for assisting a patrol for checking a vehicle parked in a parking lot, wherein the computer is a device having an imaging unit that images the vehicle to generate imaging data, or is capable of communicating with a device having the imaging unit, and the computer and / or the device having the imaging unit are caused to function as a patrol support system having a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data, a storage unit that stores at least one of the imaging data or generated data generated by the data processing, and a display unit on which information for assisting the patrol is displayed. The program causes the imaging unit to image an area including the license plate of the vehicle to generate license plate imaging data, outputs the generated license plate imaging data to the control unit, causes the control unit to recognize vehicle information described on the license plate from the acquired license plate imaging data, generates vehicle information data including a recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit images the interior of the vehicle from the outside of the vehicle in response to an imaging start signal acquired by the imaging unit to generate interior imaging data. The control unit acquires identification information of the interior imaging data generated by the imaging unit from the imaging unit, and selects one piece of the vehicle information data whose generation date and time are close to those of the interior imaging data from among the vehicle information data stored in the storage unit, and generates association information associating the selected vehicle information data, the identification information of the interior imaging data, and time information regarding time with each other. The program automatically transmits the imaging start signal from the control unit to the imaging unit at the timing when the control unit generates the vehicle information data.

Advantages of the Invention

[0022] As described above, according to the present invention, it is possible to assist a patrol for checking a vehicle parked in a parking lot, further improve the efficiency of the patrol and confirmation work, and appropriately associate various pieces of information generated as a result of the confirmation.

Brief Description of the Drawings

[0023]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0024] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

[0025] (Regarding the overall configuration of the patrol support system 10) First, with reference to FIGS. 1 and 2, the overall configuration of the patrol support system 10 according to an embodiment of the present invention will be described. FIGS. 1 and 2 are explanatory diagrams schematically showing an example of the configuration of the patrol support system according to the present embodiment.

[0026] The patrol support system 10 according to the present embodiment is configured by devices used by a patroller during a patrol to check vehicles parked in a parking lot. Specifically, the patrol support system 10 according to the present embodiment includes an information processing terminal device 100 held by the patroller and an imaging device 200 held by the patroller.

[0027] The information processing terminal device 100 is realized by, for example, a so-called smartphone, a portable tablet terminal, or the like, and is a terminal device that a patroller can directly hold in hand or hold via a selfie stick (so-called self-timer stick, etc.).

[0028] In addition, the imaging device 200 is an imaging device that a patroller can directly hold in hand or hold via various selfie sticks (so-called self-timer sticks, etc.) or a gimbal. The imaging device 200 is paired with the information processing terminal device 100 using a wireless communication technology such as Wi-Fi (registered trademark) or Bluetooth (registered trademark), and can communicate with the information processing terminal device 100 mutually. Such an imaging device 200 may be, for example, various digital still cameras or digital video cameras, or may be a so-called action camera (also called a wearable camera) such as GoPro (registered trademark).

[0029] However, since an action camera such as GoPro (registered trademark) can be hung from the patroller's neck or worn on the head, the patroller can patrol the parking lot without blocking both hands, and the burden associated with the patrol can be reduced. Therefore, in the patrol support system 10 according to the present embodiment, it is more preferable to use an action camera as the imaging device 200.

[0030] Also, in FIG. 1, a case where an imaging device 200 exists separately from the information processing terminal device 100 held by a patrolman is illustrated as an example. However, it is also possible to use the imaging unit (an imaging unit such as a camera built into the information processing terminal device 100) of the information processing terminal device 100 as the imaging device 200, and realize the patrol support system 10 according to the present embodiment only with the information processing terminal device 100. Hereinafter, the patrol support system 10 according to the present embodiment will be described by taking as an example the case where it has the imaging device 200.

[0031] As schematically shown in FIG. 2, the patrol support system 10 according to the present embodiment may be held and used by each of a plurality of patrolmen P who patrol a parking lot. In such a case, it is preferable that the patrol support system 10 held by each patrolman P is connected to various networks such as the Internet 3, and various information can be exchanged between the patrol support systems 10 as necessary.

[0032] Also, a system management server 20 or the like for managing one or more patrol support systems 10 may be prepared so as to be able to communicate with each patrol support system 10 via the Internet 3 as described above. By providing such a system management server 20, for example, in a facility that manages a parking lot, it is also possible to back up or collectively manage various information and various data generated by each patrol support system 10 in the system management server 20, which can further improve the convenience for the operator of the facility that manages the parking lot.

[0033] (Regarding the configuration of the information processing terminal device 100) Next, with reference to FIG. 1, an example of the configuration of the information processing terminal device 100 according to the present embodiment will be briefly described.

[0034] As mentioned above, the information processing terminal device 100 according to the present embodiment is realized by a so-called smartphone, a portable tablet terminal, or the like. As schematically shown in FIG. 1, for example, this information processing terminal device 100 includes an imaging unit 101 as an example of a first imaging unit, a control unit 103, a storage unit 105 as an example of a first storage unit, and a display unit 107. In addition, it is preferable that such an information processing terminal device 100 further includes a communication unit 109 in addition to these processing units.

[0035] The imaging unit 101 is realized by various camera units having, for example, an imaging lens, an image sensor, and the like. Under the control of the control unit 103, the imaging unit 101 images a vehicle existing within the imaging field of view of the camera unit and generates imaging data. The generated imaging data is temporarily stored in a predetermined folder in the storage unit 105 and output to the control unit 103, where various data processes are performed by the control unit 103.

[0036] Here, the imaging unit 101 is capable of generating both a still image and a moving image related to the vehicle. In the patrol support system according to the present embodiment, as will be described in detail below, both an imaging image of a license plate related to the vehicle of interest and an image of the interior of the vehicle are acquired. The imaging image of the license plate is preferably a still image, and the image of the interior of the vehicle may be a still image or a moving image. The imaging unit 101 generates imaging data of the vehicle of interest after being controlled by the control unit 103 to generate either a still image or a moving image.

[0037] The control unit 103 is realized by, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The control unit 103 is a processing unit that comprehensively controls the implementation states of various functions realized by the patrol support system according to the present embodiment.

[0038] Also, when the control unit 103 acquires imaging data related to the vehicle, it performs various data processes on the acquired imaging data. As an example of such data processes, a process of recognizing vehicle information (i.e., region name, classification number, hiragana, series designation number described on the license plate) from an image of the license plate, a process of generating vehicle information data related to the recognized vehicle information, a process of associating information about an image of the interior of the vehicle having the recognized vehicle information with the vehicle information, and a series of data processes such as these are performed. Details of these data processes will be described in detail again below.

[0039] Furthermore, the control unit 103 according to the present embodiment realizes various functions for assisting the patrol work of the parking lot, and such functions will also be described in detail again below.

[0040] The storage unit 105 is realized by, for example, a RAM, a storage device, or the like. In the storage unit 105, at least one of various imaging data related to the vehicle or various generated data generated by various data processes by the control unit 103 is recorded. Also, in the storage unit 105, various parameters that need to be saved when the information processing terminal device 100 according to the present embodiment performs some process, the progress of the process, history information related to various data processes performed, and various information such as various databases and programs are appropriately recorded. This storage unit 105 enables the imaging unit 101, the control unit 103, the display unit 107, the communication unit 109, etc. to freely perform read / write processing of data.

[0041] The display unit 107 is realized by, for example, a CPU, a GPU, a ROM, a RAM, an input device, an output device, etc. On the display screen provided in the display unit 107, various kinds of information for assisting the patrol of the parking lot by the patroller are displayed. The patroller can efficiently perform the patrol operation of the parking lot by patrolling the parking lot while referring to the content displayed on such a display unit 107. Further, an input device typified by a touch panel or the like is mounted on the display unit 107 according to the present embodiment, and the patroller can cause the information processing terminal device 100 to execute various patrol support functions by selecting various icons, buttons, etc. displayed on the display unit 107.

[0042] The communication unit 109 is realized by, for example, a CPU, a GPU, a ROM, a RAM, a communication device, etc. The communication unit is a processing unit that communicates with various devices existing outside the information processing terminal device 100 using various wireless communication standards such as Wi-Fi (registered trademark) wireless LAN, Bluetooth (registered trademark), LTE, LTE-A, 5G, etc. The information processing terminal device 100 according to the present embodiment can transmit various control signals to the imaging device 200 or receive various imaging data generated by the imaging device 200 via such a communication unit 109.

[0043] Details of the parking lot patrol support realized by the information processing terminal device 100 having the above-described respective processing units will be described again below.

[0044] As described above, an example of the functions of the information processing terminal device 100 according to the present embodiment has been shown. Each of the above-described components may be configured using general-purpose members or circuits, or may be configured by hardware specialized for the functions of each component. Further, the CPU or the like may perform all of the functions of each component. Therefore, it is possible to appropriately change the configuration to be used according to the technical level at the time of implementing the present embodiment.

[0045] (Regarding the configuration of the imaging device 200) Next, an example of the configuration of the imaging device 200 according to the present embodiment will be briefly described. The imaging device 200 according to this embodiment images a vehicle existing within the imaging field of view and generates various imaging data regarding the vehicle. As shown in FIG. 1, this imaging device 200 includes an imaging unit 201 as an example of a second imaging unit, an imaging control unit 203, a storage unit 205 as an example of a second storage unit, and a communication unit 207.

[0046] The imaging unit 201 is realized by various camera units having, for example, an imaging lens, an imaging element, and the like. Under the control of the imaging control unit 203, the imaging unit 201 images a vehicle existing within the imaging field of view of the camera unit and generates imaging data. Here, the control signal for the imaging unit 201 to start imaging may be output from, for example, the information processing terminal device 100. The generated imaging data is temporarily stored in a predetermined folder in the storage unit 205 after being associated with unique identification information (for example, an identification number assigned in a serial number). Also, when the imaging unit 201 generates imaging data, it is also possible to output a predetermined signal indicating that the imaging data has been generated to the information processing terminal device 100 via the imaging control unit 203 and the communication unit 207 described later.

[0047] Here, the imaging unit 201 is capable of generating both still images and moving images regarding the vehicle. In the patrol support system according to this embodiment, as will be described in detail below, an image of the interior of the vehicle of interest is acquired, but the imaging unit 201 of the imaging device 200 according to this embodiment is mainly used to image the interior of the vehicle of interest. At this time, the image generated by the imaging unit 201 may be a still image or a moving image. The imaging unit 201 generates imaging data of the vehicle of interest after being controlled by the imaging control unit 203 as to whether to generate a still image or a moving image.

[0048] The imaging control unit 203 is realized by, for example, a CPU, a GPU, a ROM, a RAM, etc. The imaging control unit 203 is a processing unit that controls the imaging process by the imaging unit 201 while also receiving control by the information processing terminal device 100 as necessary. Further, when the imaging control unit 203 receives, for example, from the information processing terminal device 100, the identification information of the imaging data generated by the imaging device 200 or a transmission request for the imaging data itself, it transmits this information stored in the storage unit 205 etc. to the information processing terminal device 100 via the communication unit 207.

[0049] The storage unit 205 is realized by, for example, a RAM, a storage device, etc. In the storage unit 205, various imaging data related to the vehicle, identification information associated with such imaging data, etc. are recorded. Also, in the storage unit 205, various parameters that need to be saved when the imaging device 200 according to the present embodiment performs some process, the progress of the process, history information regarding various data processes performed, etc., and various information such as various databases and programs are appropriately recorded. This storage unit 205 enables the imaging unit 201, the imaging control unit 203, the communication unit 207, etc. to freely perform data read / write processes.

[0050] The communication unit 207 is realized by, for example, a CPU, a GPU, a ROM, a RAM, a communication device, etc. The communication unit is a processing unit that communicates with various devices existing outside the imaging device 200 using various wireless communication standards such as Wi-Fi (registered trademark) and Bluetooth (registered trademark). The imaging device 200 according to the present embodiment can transmit and receive various control signals to and from the information processing terminal device 100 and transmit various data generated by the imaging device 200 via such a communication unit 207.

[0051] The above has shown an example of the functions of the imaging device 200 according to the present embodiment. Each of the above-described components may be configured using general-purpose members or circuits, or may be configured by hardware specialized for the functions of each component. Further, the CPU or the like may perform all of the functions of each component. Therefore, it is possible to appropriately change the configuration to be used according to the technical level at the time of implementing the present embodiment.

[0052] (Regarding various patrol support functions realized by the patrol support system) In the patrol support system 10 configured by the information processing terminal device 100 as described above, or configured by the information processing terminal device 100 and the imaging device 200, in order to support the patrol of the parking lot by the patroller, appropriate association between the vehicle information recognized from the image of the vehicle number plate captured and the image of the interior of the vehicle is realized. Such association is realized by the patrol support program executed by the information processing terminal device 100. The association process between such vehicle information and the image of the interior of the vehicle will be described in detail again below.

[0053] Below, prior to the explanation of the above-described association process, the patrol support functions other than the above-described association process realized by the patrol support system 10 according to the present embodiment will be briefly described with reference to FIG. 3. FIG. 3 is an explanatory diagram schematically showing an example of a graphical user interface (GUI) displayed on the display unit of the information processing terminal device in the patrol support system according to the present embodiment.

[0054] When a program for realizing the patrol support system according to the present embodiment (for example, an application installed in the information processing terminal device 100) is executed, a GUI as shown in FIG. 3, for example, is displayed in the display area 300 of the display unit 107 of the information processing terminal device 100.

[0055] When the inspector starts the inspection work for the day, for example, the inspector touches the inspection start / end icon 301 displayed within the display area 300. As a result, the control unit 103 activates, for example, the license plate reading function in the inspection support system 10 to enable imaging of the vehicle. At the same time, the control unit 103 creates, for example, a new file or folder or the like corresponding to the work report within the storage unit 105 or the like. Data and the like generated during the inspection work will be written into the file or folder corresponding to this work report.

[0056] On the other hand, when the inspector ends the inspection work for the day, the inspector touches the inspection start / end icon 301 again. As a result, the control unit 103 closes the file or folder or the like corresponding to the above work report. Since various data and information generated along with the inspection work for the day are stored in this file or folder, the history management of the inspection work becomes easier.

[0057] Also, an icon for interrupting / resuming the inspection (inspection interruption / resumption icon 303) is displayed in the display area 300. When the inspector touches this icon 303 when temporarily interrupting the inspection work, the control unit 103 temporarily stops the license plate reading function. When temporarily interrupting the inspection work, it is preferable that the file or folder or the like corresponding to the above work report be held, for example, in an open state (a state where additional writing is possible). When resuming the inspection work, the inspector touches this inspection interruption / resumption icon 303. As a result, the control unit 103 restarts the license plate reading function. Thereby, various data and the like generated along with the inspection are written again into the file or folder or the like corresponding to the work report.

[0058] In addition, it is also conceivable to perform a patrol operation after dividing the parking lot to be patrolled into a plurality of sections. In that case, setting data regarding the division of the parking lot is recorded in the patrol support system 10 in advance. By performing such settings, the control unit 103 can display a patrol target area designation icon 305 within the display area 300, enabling the patroller to designate the area that is the patrol target at that time. In the patrol support system 10, when there is setting data regarding the division of the parking lot, it is possible to add information regarding the section (area) in which the vehicle is parked (hereinafter, also referred to as area information) to the "vehicle confirmation result data" generated by reading the license plate for the vehicle.

[0059] In addition, in FIG. 3, the case where the parking lot is divided into four areas is illustrated, but the number of such areas is not particularly limited. Regarding the number of areas into which the parking lot is divided, it can be easily changed by changing the setting state of the patrol support system 10.

[0060] Further, the control unit 103 may provide a patrol result display area 307 within the display area 300 to display the patrol results of the patroller (for example, the number of license plates read between 0:00 and 23:59 on the same day, etc.).

[0061] Here, in the patrol support system 10 according to the present embodiment, in order to more accurately grasp the information regarding the number of license plates read, a number called the "unique number" is defined. This unique number is preferably defined as the number of data in which the four items of "region name / classification number / hiragana / serial designation number", which are the vehicle information described on the license plate (or, when area information is set, five items including the area information) do not overlap with the already generated "vehicle confirmation result data".

[0062] Also, regarding the handling of non-unique license plates (duplicate license plates) within the same day's patrol unit, it can be set as appropriate. For example, assuming that the patroller conducts patrol operations in multiple time slots in a day, if a non-unique license plate is encountered within the same time slot, it may not be counted in the total number of readings for that day. Also, in the patrols of different time slots, if a non-unique license plate is encountered, it can be treated as a unique license plate.

[0063] Also, when the license plate can be read, the control unit 103 causes the imaging guide 311 to be displayed within the display area 300.

[0064] When the license plate NP is positioned within the imaging guide 311, the control unit 103 starts an analysis process for reading character information about the substantially rectangular object existing within the imaging guide 311. Here, a series of processes from the reading of the license plate will be described in detail again below.

[0065] Also, in the patrol operation using the patrol support system 10 according to the present embodiment, after reading the license plate NP, the interior of the vehicle having such a license plate NP is imaged. In the patrol support system 10 according to the present embodiment, such interior imaging processing may be automatically started after the recognition of the license plate, or the patroller may manually start the interior imaging processing. At this time, an in-vehicle imaging start / end icon 315 for starting the interior imaging processing may be displayed within the display area 300. When the in-vehicle imaging start / end icon 315 is touched by the patroller, the control unit 103 transmits a control signal for starting imaging to the imaging device (for example, the imaging device 200 or the imaging unit 101) for imaging the interior of the vehicle. Also, when the in-vehicle imaging start / end icon 315 is touched again, the control unit 103 transmits a control signal for ending imaging to the imaging device (for example, the imaging device 200 or the imaging unit 101) for imaging the interior of the vehicle.

[0066] In addition, it is preferable that a text display area 317 is provided at an arbitrary position in the display area 300 of the patrol support system 10 according to the present embodiment. By causing the control unit 103 to display a sentence indicating the operating status of the patrol support system 10 (for example, "Scanning...", "Imaging...", etc.) in this text display area 317, the patroller can be made aware of the operating status of the patrol support system 10.

[0067] In addition, in the patrol support system 10 according to the present embodiment, it is preferable to provide an auxiliary icon display area 321 in the display area 300 for providing various pieces of information for assisting the patrol to the patroller.

[0068] For example, a caution icon 323, a parking list display icon 325, an out-of-prefecture number list display icon 327, a patrol history list display icon 329, a system setting icon 331, an imaging device connection setting icon 333, etc. can be displayed in this auxiliary icon display area 321.

[0069] The caution icon 323 is an icon for causing the control unit 103 to display information for alerting the patroller, such as information set as "items to be postponed" or information regarding "vehicles registered as blacklist" in the patrol support system 10, in the display area 300. In the patrol support system 10 according to the present embodiment, information regarding these "items to be postponed" or "vehicles registered as blacklist" is stored in advance in the storage unit 105 or the like. Further, this information may be acquired from a system management server 20 that manages a plurality of patrol support systems 10. When the caution icon 323 is selected, the control unit 103 can switch the display content of the display area 300 from the state where the display content for imaging a vehicle is displayed, and display various pieces of information for alerting the patroller.

[0070] Here, regarding the handling policies for information set as "items to be postponed" and information related to "vehicles registered on the blacklist", etc., in the patrol support system 10, they may be set as appropriate. For example, for the information set as "items to be postponed", it may be set to "become invalid when crossing a day" or "remain valid even when crossing a day". Also, for the information related to "vehicles registered on the blacklist", for example, it may be set to "remain valid even when crossing a day".

[0071] The parking list display icon 325 is an icon for displaying information about license plates confirmed on a daily basis (that is, information about vehicles parked). When this parking list display icon 325 is selected, the control unit 103 switches the display content of the display area 300 from the state where the display content for imaging the vehicle is displayed, and displays the information about the license plate, for example, for each area of the parking lot.

[0072] Here, for non-unique numbers (duplicate numbers) on the same daily basis, when they are read in different working time zones, the display may be updated to the latest reading time. Also, when the same number is read in different areas within the parking lot, it can be treated as a unique number.

[0073] Also, when the parking list is being displayed and any of the displayed information is selected by the patroller, the control unit 103 may display the "items to be postponed" associated with the selected license plate.

[0074] The out-of-prefecture number list display icon 327 is an icon for setting areas to be treated as "out-of-prefecture numbers" by the control unit 103. When this out-of-prefecture number list display icon 327 is selected, the control unit 103 switches the display content of the display area 300 from the state where the display content for imaging the vehicle is displayed, and displays a setting screen for setting areas to be treated as "out-of-prefecture numbers".

[0075] Here, regarding which areas are determined as "out-of-prefecture", it can be arbitrarily set by appropriately adjusting the setting conditions of the patrol support system 10. For example, by setting in advance the location of the parking lot and the conditions for determining "out-of-prefecture", the control unit 103 can easily determine whether the recognized license plate is "out-of-prefecture". Note that such conditions for recognizing as "out-of-prefecture" can be appropriately set, for example, as "local units (such as Hokkaido / Tohoku / Kanto / Shinetsu / Hokuriku / Tokai / Kinki / Chugoku / Shikoku / Kyushu, etc.)", "prefectural units", "regional units", etc. The setting information regarding the areas to be treated as "out-of-prefecture numbers" set in this way is stored in, for example, the storage unit 105.

[0076] The patrol history list display icon 329 is an icon for displaying the history of patrol work performed by the patroller on the current day. When this patrol history list display icon 329 is selected, the control unit 103 switches the display content of the display area 300 from the state where the display content for imaging the vehicle is displayed, and displays the history of patrol work performed by the patroller on the current day. As a result, the patroller can grasp on-site the work situation on the current day, such as at which time zone and for how long patrols were conducted on the current day, how many vehicles were checked in each area of the parking lot, and whether there are any items to be postponed.

[0077] The system setting icon 331 is an icon for performing environment settings of the patrol support system 10 according to the present embodiment. When this system setting icon 331 is selected, the control unit 103 switches the display content of the display area 300 from the state where the display content for imaging the vehicle is displayed, and displays various items for system settings. The details of such items are not particularly limited and can be set as appropriate.

[0078] For example, as items for setting the system, (1) whether to save the captured image and the read content (i.e., vehicle information), (2) the timeout setting of OCR (Optical Character Recognition) for reading the license plate, (3) the setting of the reading interval (unit: for example, milliseconds), (4) the designation of collation data, (5) the enable / disable of continuous reading, (6) the connection setting of the imaging device 200, (7) whether to display an icon for the connection setting with the imaging device 200 (the imaging device connection setting icon 333 in FIG. 3), etc. can be mentioned.

[0079] Regarding the connection setting with the imaging device 200, by setting such items, it is also possible to realize the automation of imaging by the imaging device 200. For example, conditional settings such as when to start automatic imaging when reading a certain vehicle can be made. Thereby, for example, it is possible to arbitrarily make conditional settings for automatic imaging in accordance with the guidelines of the patrol work required by the operator of the parking lot, such as automatic shooting (new vehicle) normal vehicle / outside prefecture number / vehicle requiring attention, automatic shooting (confirmed vehicle) normal vehicle / outside prefecture number / vehicle requiring attention.

[0080] As described above, with reference to FIG. 3, various patrol support functions realized by the patrol support system 10 according to the present embodiment have been specifically described.

[0081] (Regarding the association between vehicle information and imaging data obtained by imaging the interior of the vehicle) Next, with reference to FIGS. 4 to 7, a detailed description will be given of the association process, which is one of the important processes implemented in the patrol support system 10 according to the present embodiment, between vehicle information and imaging data obtained by imaging the interior of the vehicle (hereinafter referred to as in-vehicle imaging data).

[0082] As mentioned above, in the patrol operation in the parking lot, it is preferable to save, as a record, that "the patrol person in the parking lot has carefully checked the parked vehicles and recognized that no trouble or the like has occurred". On the other hand, as the number of vehicles to be checked increases, it is estimated that the various types of information generated as a result of the check will also increase. Therefore, in the series of patrol and check operations performed by the patrol person, a mechanism for appropriately associating the various types of information generated as a result of the check will become important in the future.

[0083] Therefore, in the patrol support system 10 according to the present embodiment, as will be described in detail below, association information in which information representing vehicle information recognized from the license plate and identification information unique to the in-vehicle imaging data are associated is automatically generated, and such association information is stored in the storage unit 105 or the like. Thereby, even if the number of vehicles to be checked increases, the patrol person can perform the patrol operation without being conscious of the association between the vehicle information and the in-vehicle imaging data. Thereby, it supports the patrol for checking the vehicles parked in the parking lot, realizes further efficiency of the patrol and check operation, and enables appropriate association of the various types of information generated as a result of the check.

[0084] FIG. 4 is a flowchart showing an example of the processing flow in the patrol support system according to the present embodiment. FIG. 5 is an explanatory diagram showing an example of the association information generated by the patrol support system according to the present embodiment, and FIG. 6 is an explanatory diagram showing an example of the vehicle check result data generated by the patrol support system according to the present embodiment. FIG. 7 is an explanatory diagram schematically showing an example of the display screen displayed on the display unit of the information processing terminal device in the patrol support system according to the present embodiment.

[0085] As shown in FIG. 4, the patrol support system 10 according to the present embodiment is started when a patroller activates an application corresponding to the patrol support system 10 in the information processing terminal device 100 (step S101).

[0086] When the patroller approaches the vehicle to be first confirmed in the parking lot, the patroller uses the GUI as shown in FIG. 3 as appropriate and images the area including the license plate of the vehicle using the imaging unit 101 (step S103). As a result, the imaging unit 101 generates license plate imaging data obtained by imaging the area including the license plate, and outputs the generated license plate imaging data to the control unit 103.

[0087] The control unit 103 that has acquired the license plate imaging data recognizes vehicle information (that is, region name, classification number, hiragana, series designation number) described on the license plate from the acquired license plate imaging data, and generates vehicle information data including the recognition result (step S105), and stores the generated vehicle information data in the storage unit 105.

[0088] Here, it is preferable that the control unit 103 targets for processing those in the imaging data in which the arrangement of characters is the same as that of the license plate. Thereby, since the control unit 103 only needs to recognize the imaging data in which the license plate is imaged, it is possible to improve the processing efficiency.

[0089] In addition, when the patroller images the area including the license plate, it is also assumed that imaging is performed not only when imaging from the front of the license plate, but also when viewing the license plate obliquely from above, obliquely from the right side, and obliquely from the left side. Therefore, it is preferable that the control unit 103 corrects the angle of the image when recognizing the license plate imaging data.

[0090] In addition, when recognizing vehicle information, for strings that may be misrecognized (such as region names, etc.), it is preferable to preset information regarding specific misreading patterns and perform learning in advance. By pre-storing such learning data and the like in the storage unit 105 or the like, even when a misrecognition occurs during the recognition of license plate imaging data, the control unit 103 can correct the misread string to an appropriate state. Thereby, for example, even when "Tama license number" is recognized as "Toki", a correction process can be realized to correct the misrecognized string to "Tama".

[0091] In addition, the control unit 103 may perform various determinations on the recognition result based on preset collation items and the like by collating the obtained recognition result with past history information and the like. Further, the control unit 103 may display the obtained collation result in the display area 300 or output it as audio data.

[0092] Note that the details of the so-called OCR processing for recognizing vehicle information from license plate imaging data are not particularly specified, and various known OCR processing technologies can be appropriately used.

[0093] Here, the control unit 103 preferably determines whether the vehicle is already confirmed by checking whether the vehicle information data corresponding to the obtained recognition result has already been recorded (step S107). If it is a vehicle that has already been confirmed (step S107 - YES), the control unit 103 may cooperate with the display unit 107 to notify the patroller that it has already been confirmed via the text display area 317 or the like in the display area 300 (step S109).

[0094] If the vehicle information data corresponding to the obtained recognition result is new (step S109 - NO), the control unit 103 may cooperate with the display unit 107 to guide the patroller through the work procedure via the text display area 317 or the like in the display area 300 in order to prompt the patroller to image the interior of the vehicle.

[0095] The patrolman who has finished imaging the area including the license plate then images the interior of the vehicle from outside the vehicle. More specifically, the patrolman images the interior of the vehicle from outside using the imaging unit 201 of the imaging device 200 or the imaging unit 101 of the information processing terminal device 100. At this time, an imaging start signal for starting imaging is transmitted from the control unit 103 to the imaging device 200 or the imaging unit 101, and the imaging unit 101 or the imaging unit 201 starts imaging the interior of the vehicle in response to the acquired imaging start signal (step S111). By performing such imaging processing, in-vehicle imaging data obtained by imaging the interior of the vehicle is generated.

[0096] Here, the above imaging start signal is controlled based on the conditions set in the setting information of the patrol support system 10 according to the present embodiment. For example, it may be generated according to an operation (for example, touching the in-vehicle imaging start / end icon 315, etc.) performed by the patrolman on the information processing terminal device 100 and transmitted to the imaging units 101 and 201. Further, the above imaging start signal may be automatically transmitted from the control unit 103 to the imaging units 101 and 201 at the timing when the control unit 103 generates vehicle information data. Further, depending on the setting conditions of the patrol support system 10, it is also possible to set more complicated imaging conditions such as "automatically start imaging only for new license plates".

[0097] Next, the control unit 103 acquires the identification information of the in-vehicle imaging data generated by the imaging unit 101 or the imaging unit 201 from the imaging unit 101 or the imaging unit 201. Such identification information is not particularly limited as long as it is information unique to the acquired imaging data, and various types of information that are easy to use may be appropriately used. As such identification information, for example, it is preferable to mention a unique identification number that is set so that the imaging units 101 and 201 automatically assign consecutive numbers to the image data imaged by the imaging units 101 and 201. By using such a unique identification number, the control unit 103 can perform processing without newly generating identification information independently, so that the system can be simplified.

[0098] Subsequently, the control unit 103 selects one piece of vehicle information data from the vehicle information data stored in the storage unit 105, which is close in generation date and time to the in-vehicle imaging data being focused on. Here, there is no particular regulation regarding what time difference is recognized as "close". For example, it may be appropriately set by an administrator or the like when using the patrol support system 10, such as within 1 minute, within 3 minutes, within 5 minutes, within 10 minutes, and so on.

[0099] Subsequently, the control unit 103 associates the selected vehicle information data, the identification information of the in-vehicle imaging data, and the time information regarding the time, with each other to generate association information (step S113).

[0100] Here, the detailed data configuration, data type, etc. of the association information generated by the control unit 103 are not particularly limited, and a data configuration and data type that are easy to handle by the device used as the information processing terminal device 100 may be appropriately selected.

[0101] An example of the generated association information is shown in FIG. 5. In FIG. 5, the case where such association information is realized in a tabular data configuration is illustrated as an example, but the generated association information may be, for example, a collection of character information recorded as a csv file.

[0102] As shown in FIG. 5, in the association information, for example, the time information regarding the date and time when the license plate was imaged, the vehicle information data read from the license plate imaging data, and the identification information and imaging date and time of the in-vehicle imaging data are associated with each other. By automatically generating such association information by the control unit 103, the patroller can perform the patrol work without being conscious of the association between the vehicle information and the in-vehicle imaging data.

[0103] The control unit 103 stores the association information generated as described above in the "patrol history database" provided in the storage unit 105 as vehicle confirmation result data for the vehicle (step S115). Thereby, in the patrol support system 10 according to the present embodiment, it is possible to automatically create and manage the history information of the patrol work, and it is possible to further improve the convenience for the user of the patrol support system 10.

[0104] Also, depending on the capacity of the storage device or the like that can be used as the storage unit 105, the control unit 103 may acquire the in-vehicle imaging data itself from the imaging units 101 and 201 and store the in-vehicle imaging data itself as the vehicle confirmation result data to be stored in the patrol history database. Thereby, it becomes possible to store and manage the image information itself as a record of the patrol, and it is possible to further improve the usefulness of the vehicle confirmation result data as evidence. Note that the storage location of the in-vehicle imaging data itself is not particularly limited, and it may remain in the storage unit 205 of the imaging device 200, or when the system management server 20 as illustrated in FIG. 2 is installed, it may be the storage unit of the system management server 20.

[0105] Further, the control unit 103 may further add additional information regarding at least one of the vehicle or the vehicle user to the vehicle confirmation result data as described above (step S117). Examples of the additional information regarding the vehicle include additional information about the state of the vehicle such as "window left open", "engine left running", "light left on", "pet left unattended", "others". Such additional information about the state of the vehicle can be utilized as "matters to be reported" for the vehicle being focused on.

[0106] In addition, as additional information regarding the vehicle, it is also possible to adopt additional information such as whether it is an "out-of-prefecture number" as described above. Whether it is an "out-of-prefecture number" can be easily and automatically determined by the control unit 103 based on the setting information as described above.

[0107] In addition, examples of additional information regarding the vehicle user include various types of information such as "the license plate is on the blacklist" and "the vehicle is carrying an excellent customer (VIP)". Such additional information is information that can be used when determining whether the vehicle of interest is a "vehicle requiring inspection", and can also be utilized as "items to be postponed" or "information for alerting the patrol person".

[0108] As described above, the control unit 103 of the patrol support system 10 in the present embodiment can finally generate vehicle confirmation result data in which association information and additional information are associated, for example, as shown in FIG. 6, for one vehicle of interest. By referring to the vehicle confirmation result data generated in this way at any time, the control unit 103 can obtain various information regarding the confirmed vehicles. Although FIG. 6 illustrates an example in which such vehicle confirmation result data is realized in a tabular data configuration, the generated vehicle confirmation result data may be a collection of character information recorded as, for example, a csv file.

[0109] Furthermore, the control unit 103 may determine whether the vehicle is already a vehicle with additional information by checking whether the current vehicle information data of interest is already recorded in the patrol history database (step S119). Here, when additional information has already been given (step S119 - YES), the control unit 103 may cooperate with the display unit 107 and use the text display area 317 of the display area 300 to display an alert to the patrol person and notify the patrol person that the vehicle has additional information (step S121).

[0110] In the patrol support system 10 according to the present embodiment, for example, in the above flow, the association process between the vehicle information data and the in-vehicle imaging data is performed for one vehicle of interest.

[0111] Here, when the patrol is ended (step S123 - YES), for example, by touching the patrol start / end icon 301 within the display area 300, the control unit 103 terminates the patrol support system (step S125). When the patrol by the patroller is continued, the control unit 103 returns to step S103 and waits for the start of the association process for the next vehicle of interest.

[0112] Note that in the patrol support system 10 according to the present embodiment, it is also possible to provide a display screen as shown in FIG. 7, for example, by using the patrol history database including the association information generated as described above. In an example of this display screen, it is possible to check the vehicle information data and additional information obtained as a result of the patrol. Regarding the in-vehicle imaging data, the actual in-vehicle imaging data can be checked by selecting an icon such as a playback button. Furthermore, a search condition input field regarding the date, vehicle information, additional information, etc. is provided in the display screen, and it is also possible to search for data that matches the search conditions from the patrol history database.

[0113] Also, the flow of the association process between the vehicle information data and the in-vehicle imaging data shown in FIG. 4 is merely an example, and the flow of the association process between the vehicle information data and the in-vehicle imaging data according to the present embodiment is not limited to the example shown in FIG. 4. In the patrol support system 10 according to the present embodiment, the flow of the association process between the vehicle information data and the in-vehicle imaging data may be changed in the order of the processes to be performed, some processes may be appropriately omitted according to the system setting information, etc., or processes that do not need to be performed in the example shown in FIG. 4 may be deliberately performed. For example, in the patrol support system 10 in which a "blacklist" is set in advance, regardless of whether the vehicle has been confirmed, the confirmation process of additional information as shown in step S119 is performed at an early stage to confirm whether the vehicle corresponds to the "blacklist", etc., and the flow of the process may be changed.

[0114] As described above, with reference to FIGS. 4 to 7, the association process between the vehicle information data and the in-vehicle imaging data performed in the patrol support system 10 according to the present embodiment has been described in detail.

[0115] Here, the above-described association process can be realized by creating a computer program that can function as a patrol support system having (a) a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data, (b) a storage unit that stores at least one of the imaging data or the generated data generated by the data processing, and (c) a display unit on which information for supporting patrol is displayed, for a device having an imaging unit that images a vehicle to generate imaging data or a device capable of communicating with a device having an imaging unit, and installing it on an information communication device such as a smartphone or a tablet terminal. In addition, a computer-readable recording medium storing such a computer program can also be provided. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. Also, the above computer program may be distributed via a network, for example, without using a recording medium.

[0116] (Hardware Configuration of Information Processing Terminal Device 100) Next, with reference to FIG. 8, the hardware configuration of the information processing terminal device 100 according to the present embodiment will be described in detail. FIG. 8 is a block diagram for explaining the hardware configuration of the information processing terminal device 100 according to the embodiment of the present disclosure.

[0117] The information processing terminal device 100 mainly includes a CPU 901, a GPU 902, a ROM 903, and a RAM 905. Further, the information processing terminal device 100 further includes a host bus 907, a bridge 909, an external bus 911, an interface 913, a sensor 914, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925.

[0118] The CPU 901 and the GPU 902 function as arithmetic processing units and control units, and control all or part of the operations within the information processing terminal device 100 according to various programs recorded in the ROM 903, the RAM 905, the storage device 919, or the removable recording medium 927. The ROM 903 stores programs, arithmetic parameters, etc. used by the CPU 901 and the GPU 902. The RAM 905 temporarily stores programs used by the CPU 901 and the GPU 902, and parameters that change as appropriate during program execution. These are interconnected by a host bus 907 constituted by an internal bus such as a CPU bus.

[0119] The host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.

[0120] The sensor 914 is a detection means such as a sensor that detects the movement of the user or a sensor that acquires information representing the current position. Examples of such sensors include motion sensors such as a three-axis acceleration sensor including an acceleration sensor, a gravity detection sensor, a drop detection sensor, etc., a three-axis gyro sensor including an angular velocity sensor, a hand tremor correction sensor, a geomagnetic sensor, etc., and a GPS sensor. In addition to the above, the sensor 914 may be equipped with various measuring devices such as a thermometer, an illuminometer, and a hygrometer.

[0121] The input device 915 is an operation means operated by the user, such as a keyboard, a touch panel, various cameras, buttons, switches, etc. Here, the input device 915 may be, for example, a mobile phone, a tablet terminal, etc. itself corresponding to the operation of the information processing terminal device 100, or may be an external connection device 929. Further, the input device 915 is composed of, for example, an input control circuit that generates an input signal based on the information input by the user using the above operation means and outputs it to the CPU 901 and the GPU 902. The user of the information processing terminal device 100 can input various data to the information processing terminal device 100 or instruct a processing operation by operating this input device 915.

[0122] The output device 917 is composed of a device capable of visually or auditorily notifying the acquired information to the user. Such devices include display devices such as a liquid crystal display device and an EL display device, and audio output devices such as a speaker and headphones. The output device 917 outputs, for example, the results obtained by various processes performed by the information processing terminal device 100. Specifically, the display device displays the results obtained by various processes performed by the information processing terminal device 100 in text or image. On the other hand, the audio output device converts an audio signal composed of reproduced audio data, acoustic data, etc. into an analog signal and outputs it.

[0123] The storage device 919 is a data storage device configured as an example of the storage unit of the information processing terminal device 100. The storage device 919 is composed of, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device such as an SSD (Solid State Drive), an optical storage device, or a magneto-optical storage device. This storage device 919 stores programs executed by the CPU 901 and GPU 902, various data, and various data acquired from the outside.

[0124] The drive 921 is a reader / writer for a recording medium, and is built in or externally attached to the information processing terminal device 100. The drive 921 reads the information recorded on the removable recording medium 927 such as a semiconductor memory that is mounted, and outputs it to the RAM 905. Also, the drive 921 can write a recording to the removable recording medium 927 such as a semiconductor memory that is mounted. The removable recording medium 927 is, for example, a CompactFlash (registered trademark) (CF), a flash memory, or an SD memory card (Secure Digital memory card). Also, the removable recording medium 927 may be, for example, an IC card (Integrated Circuit card) or an electronic device equipped with a non-contact type IC chip.

[0125] The connection port 923 is a port for directly connecting a device to the information processing terminal device 100. Examples of the connection port 923 include a USB (Universal Serial Bus) port, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, and the like. By connecting the external connection device 929 to this connection port 923, the information processing terminal device 100 can directly acquire various data from the external connection device 929 or provide various data to the external connection device 929.

[0126] The communication device 925 is a communication interface composed of, for example, a communication device for connecting to a communication network 931. The communication device 925 is, for example, a wired or wireless LAN (Local Area Network), a communication card for Bluetooth (registered trademark), etc. This communication device 925 can transmit and receive signals, etc. in accordance with a predetermined protocol such as TCP / IP, for example, between the Internet and other communication devices. Further, the communication network 931 connected to the communication device 925 is composed of a network connected by wire or wirelessly, etc., and may be, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication, etc.

[0127] As described above, an example of the hardware configuration capable of realizing the functions of the information processing terminal device 100 according to the embodiment of the present disclosure has been shown. Each of the above-described components may be configured using general-purpose members, or may be configured by hardware specialized for the functions of each component. Therefore, it is possible to appropriately change the hardware configuration to be used according to the technical level at the time of implementing this embodiment.

[0128] As described above, the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that those having ordinary knowledge in the technical field to which the present invention pertains can conceive of various modification examples or correction examples within the scope of the technical idea described in the claims, and it is naturally understood that these also belong to the technical scope of the present invention.

[0129] The embodiments disclosed this time are illustrative in all respects and not restrictive. The above embodiments may be omitted, substituted, or changed in various forms without departing from the scope of the invention as defined in the appended claims and the gist of the invention as described below. For example, the constituent elements of the above embodiments can be arbitrarily combined within the range that does not impair their effects. Further, from such an arbitrary combination, the actions and effects of each constituent element involved in the combination can be naturally obtained, and other actions and other effects that are obvious to those skilled in the art from the description of this specification can also be obtained.

[0130] Also, the effects described in this specification are merely illustrative or exemplary and not limiting. That is, the technology according to the present invention can exhibit other effects that are obvious to those skilled in the art from the description of this specification, together with or instead of the above effects.

Explanation of Reference Numerals

[0131] 3 Internet 10 Patrol Support System 20 System Management Server 100 Information Processing Terminal Device 101, 201 Imaging Unit 103 Control Unit 105, 205 Storage Unit 107 Display Unit 109, 207 Communication Unit 200 Imaging Device 203 Imaging Control Unit 300 Display Area 301 Patrol Start / End Icon 303 Patrol Interruption / Resume Icon 305 Patrol Target Area Designation Icon 307 Patrol Result Display Area 311 Imaging Guide 315 In-Vehicle Imaging Start / End Icon 317 Text Display Area 321 Auxiliary Icon Display Area 323 Attention Call Icon 325 Parking list display icon 327 Out-of-prefecture number list display icon 329 Patrol history list display icon 331 System settings icon 333 Imaging device connection settings icon P Patroller NP Number plate

Claims

1. A patrol support system that supports patrols to check vehicles parked in a parking lot, an imaging unit that captures an image of the vehicle and generates imaging data; a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data and generated data generated by the data processing; A display unit on which information for supporting the tour is displayed; It has The imaging unit captures an image of an area including a license plate of the vehicle to generate license plate image data, and outputs the generated license plate image data to the control unit; The control unit recognizes vehicle information described on the license plate from the acquired license plate image data, generates vehicle information data including a recognition result, and stores the generated vehicle information data in the storage unit. the imaging unit captures an image of an interior of the vehicle from outside the vehicle in response to the acquired imaging start signal, and generates interior imaging data; the control unit acquires, from the imaging unit, identification information of the interior image data generated by the imaging unit, and selects, from the vehicle information data stored in the storage unit, one of the vehicle information data whose generation date and time is close to that of the interior image data, and generates association information that associates the selected vehicle information data with the identification information of the interior image data and time information related to time; The control unit stores the generated association information in a tour history database provided in the storage unit as vehicle confirmation result data for the vehicle.

2. A patrol support system that supports patrols to check vehicles parked in a parking lot, an imaging unit that captures an image of the vehicle and generates imaging data; A control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data and generated data generated by the data processing; A display unit on which information for supporting the tour is displayed; It has The imaging unit captures an image of an area including a license plate of the vehicle to generate license plate image data, and outputs the generated license plate image data to the control unit; The control unit recognizes vehicle information described on the license plate from the acquired license plate image data, generates vehicle information data including a recognition result, and stores the generated vehicle information data in the storage unit. the imaging unit captures an image of an interior of the vehicle from outside the vehicle in response to the acquired imaging start signal, and generates interior imaging data; the control unit acquires, from the imaging unit, identification information of the interior image data generated by the imaging unit, and selects, from the vehicle information data stored in the storage unit, one of the vehicle information data whose generation date and time is close to that of the interior image data, and generates association information that associates the selected vehicle information data with the identification information of the interior image data and time information related to time; The imaging start signal is automatically transmitted from the control unit to the imaging unit at a timing when the control unit generates the vehicle information data.

3. The travel assistance system according to claim 1 or 2, wherein the identification information of the in-vehicle image data is a unique identification number that is sequentially assigned by the imaging unit to the image data captured by the imaging unit.

4. 3. The tour assistance system according to claim 2, wherein the control unit stores the generated association information in a tour history database provided in the storage unit as vehicle confirmation result data for the vehicle.

5. The tour assistance system according to claim 1 or 4, wherein the control unit further stores the in-vehicle image data as the vehicle confirmation result data to be stored in the tour history database.

6. The control unit is When the association information is newly generated, a check is made to see whether the vehicle information data included in the generated association information has already been recorded in the tour history database; A patrol support system as described in claim 1 or 4, wherein, when the vehicle information data included in the generated association information has already been recorded in the patrol history database as the vehicle confirmation result data, the display unit is caused to display a message indicating that the data has already been confirmed.

7. 5. The travel assistance system according to claim 1, wherein the vehicle confirmation result data further includes additional information relating to at least one of the vehicle and a user of the vehicle.

8. The control unit is When the association information is newly generated, a check is made to see whether the vehicle information data included in the generated association information has already been recorded in the tour history database; The patrol support system of claim 7, wherein, when the vehicle information data included in the generated association information has already been recorded in the patrol history database as the vehicle inspection result data and the additional information is included in the vehicle inspection result data, the display unit is caused to display a warning message indicating that the additional information exists regarding the vehicle being inspected.

9. The travel support system includes: an information processing terminal device carried by a patrolman who patrols the parking lot; An action camera worn by the patrolman; Including, the information processing terminal device has a first imaging unit functioning as the imaging unit and a first storage unit functioning as the storage unit, The action camera has a second imaging unit that functions as the imaging unit and a second storage unit that functions as the storage unit, The first imaging unit captures an image of the license plate and stores the license plate image data in the first storage unit; The navigation assistance system according to claim 1 , wherein the second imaging unit captures an image of the interior of the vehicle and stores the interior image data in the second storage unit.

10. 3. The patrol support system according to claim 1, wherein the imaging unit and the storage unit are provided in a single information processing terminal carried by a patrolman patrolling the parking lot.

11. The patrol support system of claim 1 or 2, wherein the imaging start signal is generated in response to an operation performed by a patrolman patrolling the parking lot on an information processing terminal device held by the patrolman, and transmitted to the imaging unit.

12. The tour support system according to claim 1 , wherein the imaging start signal is automatically transmitted from the control unit to the imaging unit at a timing when the control unit generates the vehicle information data.

13. A method for assisting in patrol to check vehicles parked in a parking lot, comprising: a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data and generated data generated by the data processing; and a display unit that displays information for supporting the patrol, The imaging unit captures an image of an area including the license plate of the vehicle to generate license plate image data, and outputs the generated license plate image data to the control unit; The control unit recognizes vehicle information described on the license plate from the acquired license plate image data, generates vehicle information data including a recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit captures an image of the interior of the vehicle from outside the vehicle in response to the acquired imaging start signal, and generates interior imaging data; the control unit acquires, from the imaging unit, identification information of the interior image data generated by the imaging unit, and selects, from the vehicle information data stored in the storage unit, one of the vehicle information data whose generation date and time is close to that of the interior image data, and generates association information that associates the selected vehicle information data with the identification information of the interior image data and time information related to time; The control unit stores the generated association information in a tour history database provided in the storage unit as vehicle confirmation result data for the vehicle.

14. A method for assisting in patrol to check vehicles parked in a parking lot, comprising: a control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data and generated data generated by the data processing; and a display unit that displays information for supporting the patrol, The imaging unit captures an image of an area including the license plate of the vehicle to generate license plate image data, and outputs the generated license plate image data to the control unit; The control unit recognizes vehicle information described on the license plate from the acquired license plate image data, generates vehicle information data including a recognition result, and stores the generated vehicle information data in the storage unit. The imaging unit captures an image of the interior of the vehicle from outside the vehicle in response to the acquired imaging start signal, and generates interior imaging data; the control unit acquires, from the imaging unit, identification information of the interior image data generated by the imaging unit, and selects, from the vehicle information data stored in the storage unit, one of the vehicle information data whose generation date and time is close to that of the interior image data, and generates association information that associates the selected vehicle information data with the identification information of the interior image data and time information related to time; The imaging start signal is automatically transmitted from the control unit to the imaging unit at a timing when the control unit generates the vehicle information data.

15. A program for causing a computer to execute a patrol assistance method for assisting in patrol to check vehicles parked in a parking lot, comprising: The computer is a device having an imaging unit that captures an image of the vehicle and generates imaging data, or is capable of communicating with a device having the imaging unit, An apparatus having the computer and / or the imaging unit, A control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data and generated data generated by the data processing; A display unit on which information for supporting the tour is displayed; It functions as a mobile support system with The program is The imaging unit captures an image of an area including the license plate of the vehicle to generate license plate image data, and outputs the generated license plate image data to the control unit. The control unit recognizes vehicle information described on the license plate from the acquired license plate image data, generates vehicle information data including a recognition result, and stores the generated vehicle information data in the storage unit. causing the imaging unit to capture an image of the interior of the vehicle from outside the vehicle in response to the acquired imaging start signal, thereby generating interior imaging data; and causing the control unit to acquire, from the imaging unit, identification information of the interior image data generated by the imaging unit, and to select, from the vehicle information data stored in the storage unit, one of the vehicle information data whose generation date and time is close to that of the interior image data, and to generate association information that associates the selected vehicle information data, the identification information of the interior image data, and time information related to time with each other. A program that causes the control unit to store the generated association information in a patrol history database provided in the storage unit as vehicle confirmation result data for the vehicle.

16. A program for causing a computer to execute a patrol assistance method for assisting in patrol to check vehicles parked in a parking lot, comprising: The computer is a device having an imaging unit that captures an image of the vehicle and generates imaging data, or is capable of communicating with a device having the imaging unit, An apparatus having the computer and / or the imaging unit, A control unit that acquires the generated imaging data and performs data processing on the acquired imaging data; a storage unit that stores at least one of the imaging data and generated data generated by the data processing; A display unit on which information for supporting the tour is displayed; It functions as a mobile support system with The program is The imaging unit captures an image of an area including the license plate of the vehicle to generate license plate image data, and outputs the generated license plate image data to the control unit. The control unit recognizes vehicle information described on the license plate from the acquired license plate image data, generates vehicle information data including a recognition result, and stores the generated vehicle information data in the storage unit. causing the imaging unit to capture an image of the interior of the vehicle from outside the vehicle in response to the acquired imaging start signal, thereby generating interior imaging data; and causing the control unit to acquire, from the imaging unit, identification information of the interior image data generated by the imaging unit, and to select, from the vehicle information data stored in the storage unit, one of the vehicle information data whose generation date and time is close to that of the interior image data, and to generate association information that associates the selected vehicle information data, the identification information of the interior image data, and time information related to time with each other. a program that automatically transmits the imaging start signal from the control unit to the imaging unit at a timing when the control unit generates the vehicle information data;

Images