Image data processing device, image data processing method, program, and image data processing system

Abstract

To properly execute an image data reception and accumulation process and an image data retrieval process by sharing a resource.SOLUTION: An image data processing device comprises: a first process execution unit which executes a first process of receiving image data expressing a static image captured with a predetermined camera when a predetermined image capturing condition is satisfied, from a plurality of cameras via a communication line, and accumulating the image data in a predetermined storage unit; a second process execution unit which executes a second process of retrieving image data matching with a predetermined retrieval condition out of the accumulated image data, by sharing a resource with the first process execution unit; and a process execution restriction unit which restricts execution of the first process by the first process execution unit when a value related with use of the resource exceeds a predetermined threshold.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an image data processing apparatus, an image data processing method, a program, and an image data processing system.

Background Art

[0002] Patent Document 1 describes the following control device for the purpose of preliminarily grasping whether there is an impact on resources by restoring a service. That is, the control device described in Patent Document 1 is a control device that controls an information processing device in a control system having an information processing device including one or a plurality of self-mobile devices, and calculates a resource amount of the control system used when the information processing device provides a service. A resource monitoring unit, and a service monitoring unit that determines whether the resource amount used when the information processing device provides a service is within the range of the resource amount that the control system can provide. In the control device described in Patent Document 1, when the resource amount to be used is within the range of the resource amount that the control system can provide, the information processing device is made to execute the provision of the service.

[0003] Note that Patent Document 1 describes that when it is necessary to provide a plurality of services simultaneously, the start order of the services to be provided is changed based on the priority of the services, but does not show how to change the start order. For example, when the start of providing a service with a higher priority than the currently provided service is requested during the provision of a service, it is unclear how to respond.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Incidentally, in a device (hereinafter also referred to as an image data processing device) that receives and stores image data representing still images captured by a predetermined camera via a communication line from multiple cameras when predetermined shooting conditions are met, and also performs a search process on the stored image data using shared resources, it is sometimes required that the time required for the search process be kept within a predetermined value. In this case, for example, when the start of the search process is requested while image data transmission from multiple cameras is occurring intensively, it is conceivable that the control device described in Patent Document 1 may not be able to appropriately keep the time required for the search process within a predetermined value.

[0006] This disclosure is made in view of the above circumstances and aims to provide an image data processing device, an image data processing method, a program, and an image data processing system that can appropriately perform image data reception and storage processing and image data retrieval processing by sharing resources. [Means for solving the problem]

[0007] To solve the above problems, the image data processing device according to the present disclosure includes: a first processing execution unit that performs a first processing to receive image data representing still images taken by a predetermined camera via a communication line from a plurality of cameras when predetermined shooting conditions are met and store it in a predetermined storage unit; a second processing execution unit that performs a second processing to search for image data that matches predetermined search conditions from the stored image data, sharing resources with the first processing execution unit; and a processing execution restriction unit that restricts the execution of the first processing by the first processing execution unit when the value related to the use of the resources exceeds a predetermined threshold.

[0008] The image data processing method according to this disclosure includes: a first step of receiving image data representing still images taken by a predetermined camera via a communication line from a plurality of cameras when predetermined shooting conditions are met and storing it in a predetermined storage unit; a second step of searching for image data that matches predetermined search conditions from the stored image data, sharing resources with the first step; and a third step of restricting the execution of the first step when the value related to the use of the resources exceeds a predetermined threshold.

[0009] The program relating to this disclosure causes a computer to perform the following steps: a first step of receiving image data representing still images taken by a predetermined camera via a communication line from a plurality of cameras when predetermined shooting conditions are met and storing it in a predetermined storage unit; a second step of searching for image data that matches predetermined search conditions from the stored image data, sharing resources with the first step; and a third step of restricting the execution of the first step when the value related to the use of the resources exceeds a predetermined threshold.

[0010] The image data processing system according to this disclosure includes an image data processing device comprising: a first processing execution unit that performs a first processing to receive image data representing still images taken by a predetermined camera via a communication line from a plurality of cameras when predetermined shooting conditions are met and store it in a predetermined storage unit; a second processing execution unit that performs a second processing to search for image data that matches predetermined search conditions from the stored image data, sharing resources with the first processing execution unit; and a processing execution restriction unit that restricts the execution of the first processing by the first processing execution unit when the value related to the use of the resources exceeds a predetermined threshold; and a plurality of cameras. [Effects of the Invention]

[0011] According to the image data processing device, image data processing method, program, and image data processing system of this disclosure, the reception and storage of image data and the retrieval of image data can be appropriately performed by sharing resources. [Brief explanation of the drawing]

[0012] [Figure 1] This is a block diagram showing an example configuration of an image data processing system according to an embodiment of this disclosure. [Figure 2] This is a schematic diagram showing an example of information contained in image data according to the embodiments of this disclosure. [Figure 3] This flowchart shows an example of the camera's operation during image capture according to the embodiment of this disclosure. [Figure 4] This flowchart shows an example of the operation of the transmission control unit according to the embodiment of this disclosure. [Figure 5] This flowchart shows an example of the operation of the processing execution restriction unit according to the embodiment of this disclosure. [Figure 6] This flowchart shows an example of the operation of the first processing execution unit according to an embodiment of this disclosure. [Figure 7] This flowchart shows an example of the operation of the search processing unit according to the embodiment of this disclosure. [Figure 8] This flowchart shows an example of the operation of the second processing execution unit and the processing execution restriction unit according to an embodiment of this disclosure. [Figure 9] This is a sequence diagram showing an example of the operation (under normal conditions) of the image data processing system according to the present disclosure. [Figure 10] This is a sequence diagram showing an example of the operation of an image data processing system according to the present disclosure (in the event of a communication failure). [Figure 11] This is a schematic block diagram showing the configuration of a computer according to the embodiments of this disclosure. [Modes for carrying out the invention]

[0013] Hereinafter, an image data processing device, image data processing method, program, and image data processing system according to the embodiments of this disclosure will be described with reference to Figures 1 to 11. Figure 1 is a block diagram showing an example configuration of an image data processing system according to the embodiments of this disclosure. Figure 2 is a schematic diagram showing an example of information contained in image data according to the embodiments of this disclosure. Figure 3 is a flowchart showing an example of operation of a camera when capturing an image according to the embodiments of this disclosure. Figure 4 is a flowchart showing an example of operation of a transmission control unit according to the embodiments of this disclosure. Figure 5 is a flowchart showing an example of operation of a processing execution limiting unit according to the embodiments of this disclosure. Figure 6 is a flowchart showing an example of operation of a first processing execution unit according to the embodiments of this disclosure. Figure 7 is a flowchart showing an example of operation of a search processing unit according to the embodiments of this disclosure. Figure 8 is a flowchart showing an example of operation of a second processing execution unit and a processing execution limiting unit according to the embodiments of this disclosure. Figure 9 is a sequence diagram showing an example of operation of an image data processing system according to the embodiments of this disclosure (normal operation). Figure 10 is a sequence diagram showing an example of operation of an image data processing system according to the embodiments of this disclosure (when a communication failure occurs). Figure 11 is a schematic block diagram showing the configuration of a computer according to at least one embodiment. In each figure, the same or corresponding components are used with the same reference numerals, and explanations are omitted as appropriate.

[0014] (Configuration of the image data processing system) As shown in FIG. 1, an image data processing system 100 according to an embodiment of the present disclosure includes one image server 1, a plurality of cameras 2, one terminal 3, and a communication line 4. The communication line 4 is, for example, a public communication network or a virtual private network configured within the Internet. In the present embodiment, the image data processing system 100 accumulates a plurality of still images (hereinafter, also simply referred to as "images") captured by a plurality of cameras 2 that capture vehicles passing through each tollgate at a plurality of tollgates on a toll road, and according to an instruction from a user of the terminal 3, searches for and extracts an image (image data) of a vehicle that matches a predetermined search condition from the plurality of accumulated images. However, the image data to be processed by the image data processing system 100 is not limited to the image data of vehicles passing through tollgates, and may be, for example, image data captured by cameras installed around roads other than toll roads. Hereinafter, the present embodiment will be described by taking as an example the case where a plurality of cameras 2 capture vehicles passing through each tollgate at a plurality of tollgates on a toll road. Note that the number of terminals 3 is not limited to one, and a plurality of terminals may be provided. Further, the terminal 3 may be connected to the image server 1 without passing through the communication line 4. Note that the still image captured by the camera 2 may be one of a group of still images constituting a moving image.

[0015] (Configuration of Image Server) The image server 1 is an example of a configuration of an image data processing apparatus according to the present disclosure, and can be configured using, for example, a computer such as a server or a personal computer, and its peripheral devices. Further, the image server 1 includes the following components as a functional configuration composed of a combination of hardware such as a computer constituting the image server 1 and software such as a program executed by the computer. That is, the image server 1 includes, as a functional configuration, a first processing execution unit 11, a second processing execution unit 12, a processing execution restriction unit 13, a storage unit 14, and a communication unit 15. Note that the image server 1 may be configured using a plurality of computers, or may be configured using a computer virtually configured on a communication network.

[0016] When a predetermined shooting condition is satisfied, the first processing execution unit 11 executes a first process of receiving, via the communication line 4, image data representing a still image captured by a predetermined camera 2 from a plurality of cameras 2 and storing the image data in a predetermined storage unit 14. Here, satisfying the predetermined shooting condition means that the shooting becomes necessary. For example, it means a state where the vehicle has passed through a predetermined shooting position (shooting range) at each tollgate that each camera 2 targets for shooting. Also, the "predetermined" in the "predetermined" camera 2 means that, for example, the shooting position, shooting direction, etc. are determined. In the present embodiment, the first process corresponds to the reception and storage process of the image data. Further, the image data is stored in the storage unit 14 in a state including information representing the shooting time, tollgate ID (identification information), camera ID, license plate information (also referred to as NP information), etc. (or in a state associated with such information). The license plate information is, for example, information recognized from an image of the vehicle's license plate (automobile registration number plate) and includes information representing characters, symbols (numbers), the size of the plate, etc.

[0017] The second processing unit 12 performs a second process, sharing resources with the first processing unit 11, to search for image data that matches predetermined search conditions from the image data stored in the storage unit 14 by the first processing unit 11. The predetermined search conditions are information specified by the terminal 3, and are information that identifies the shooting location, shooting time, etc., for example, information that identifies the entrance toll gate, exit toll gate, shooting time (year, month, day, hour, minute, second), etc. One or more entrance or exit toll gates can be specified, and the shooting time can be specified with a time range. The larger the number of search locations and the range of the search time, the greater the load required for the search process. The resources shared with the first processing unit 11 are components of the image server 1 used when executing the process, and include, for example, the CPU (central processing unit), main memory (volatile memory), communication network (communication line), storage (non-volatile memory), etc. In this embodiment, the second process corresponds to the image data search process. If the second processing unit 12 has executed the second processing, it sends the search results (image data that matches the search criteria or a notification that no matching image data was found) which are the result of the second processing to the terminal 3.

[0018] The processing execution restriction unit 13 restricts the execution of the first process by the first processing execution unit 11 when the resource utilization rate exceeds a predetermined threshold. In this case, the image server 1 can prioritize allocating the remaining resources to the second process and execute the second process by restricting the execution of the first process. The processing execution restriction unit 13 can, for example, restrict the execution of the first process by comparing the resource utilization rate with a threshold before the first processing execution unit 11 starts executing the first process, and by not starting the execution of the first process if the utilization rate exceeds the threshold. The processing execution restriction unit 13 can also restrict the execution of the first process by the first processing execution unit 11 for each camera 2 when the resource utilization rate exceeds a predetermined threshold. The following explanation will describe an example where the restriction of the execution of the first process is performed by not starting the execution for each camera 2. However, the restriction of the execution of the first process is not limited to not starting the execution or to performing it for each camera 2; for example, it may be a restriction such as extending the interval for receiving image data before executing the first process. Furthermore, the resource utilization rate used for comparison against the threshold can be, for example, CPU utilization, main memory utilization, or both CPU utilization and main memory utilization. For example, if the resource utilization rate is both CPU utilization and main memory utilization, two types of thresholds may be set as the comparison standard for utilization rates, or one type of threshold may be set for a predetermined index value calculated from CPU utilization and main memory utilization. In addition, utilization rate may be a percentage or an amount of usage that corresponds to a predetermined utilization rate. In this embodiment, values ​​such as resource utilization rate, utilization rate percentage, amount of usage that corresponds to a predetermined utilization rate, and index calculated from utilization rate are referred to as "values ​​related to resource utilization." However, in the following explanation, resource utilization rate will be used as a representative value. Furthermore, execution restrictions may include not only preventing the start of processing, but also specifying a later time to start processing, for example, after a predetermined time.

[0019] Furthermore, there are no limitations on how the threshold can be set; for example, it can be set based on the performance required for the second process and the resource specifications of the image server 1. The threshold can also be set to correspond to a value obtained by adding the resource utilization rate at which the desired performance can be obtained in the second process and the resource utilization rate at which the first process would be used if, for example, processing of image data from one more camera 2 were added to the current first process. In this case, even if the first process is not restricted when the resource utilization rate is below the threshold but very close to it, the desired resources can be reserved for the second process.

[0020] Furthermore, when the processing execution restriction unit 13 restricts (holds) the transmission of image data for each camera 2, it manages the cameras 2 whose image data transmission has been restricted (held) by using a list (hereinafter referred to as the hold list) that displays a list of cameras 2 whose image data transmission has been restricted (held). The hold list is a table in which information (camera ID, etc.) indicating one or more cameras 2 whose execution of the first process has been restricted (held) is registered. The processing execution restriction unit 13 registers the cameras 2 whose transmission has been restricted in the hold list, and removes the camera 2 from the hold list when the restriction is lifted.

[0021] Furthermore, the processing execution restriction unit 13 may adjust the threshold according to the search conditions in the second processing if the search conditions specify the time period and the toll booth through which the vehicle passed. In this case, the processing execution restriction unit 13 adjusts the threshold according to the search conditions each time a search is performed. For example, when a search is performed, the processing execution restriction unit 13 can determine to some extent the resources required for the search from the search conditions (time period to be searched, target toll booth, etc.), and can dynamically change the threshold so as to reserve the resources required for the search.

[0022] Furthermore, the processing execution limiting unit 13 may adjust the threshold according to the current time. Since image data searches are performed within the scope of the normal operations of, for example, highway operators, there is a clear tendency for searches to be concentrated during the daytime. For this reason, by adjusting the threshold to be lower during the daytime (reserving more resources) and higher at night (reserving fewer resources), resources can be appropriately allocated to the first and second processes.

[0023] Furthermore, the processing execution restriction unit 13 may adjust the threshold according to the current time and the settings for time-of-day discounts of the electronic toll collection system (settings for toll discounts). When making adjustments, the threshold is calculated based on the settings for time-of-day discounts currently in operation on the target road (discount rate, applicable time period, applicable toll booths, etc.) and set based on this. In addition, since the settings for time-of-day discounts are changed according to, for example, weekdays / holidays or seasons (Obon / New Year's holidays, etc.), it is desirable to dynamically adjust the threshold in accordance with changes in the settings for time-of-day discounts. For example, immediately after the start time or immediately before the end time of application of a time-of-day discount with a high discount rate, it is expected that the number of vehicles passing through the highway entrances and exits will be higher than at other times, and in that case, it is naturally expected that the amount of image data transmitted from camera 2 to image server 1 will also be higher. For this reason, it is desirable to set the threshold in a way that takes into account that the overall network traffic will not become excessive.

[0024] The memory unit 14 stores image data and a hold list received from the camera 2.

[0025] The communication unit 15 transmits and receives predetermined information via the communication line 4 between the multiple cameras 2 and the terminal 3 in response to instructions from the first processing execution unit 11, the second processing execution unit 12, the processing execution restriction unit 13, etc.

[0026] (Camera configuration) Camera 2 is configured, for example, using one or more imaging devices and an embedded system, and has the following functional components, which are a combination of hardware such as one or more imaging devices and an embedded system, and software such as a program executed by a processor or the like in the embedded system. Camera 2 has the following functional components, which include an imaging unit 21, an imaging condition determination unit 22, an NP information recognition unit 23, a transmission control unit 24, a storage unit 25, and a communication unit 26.

[0027] The shooting unit 21 is equipped with one or more imaging devices and, in response to instructions from the shooting condition determination unit 22, captures one or more still images and stores the image data representing the captured images in the storage unit 25. Figure 2 shows an example of the configuration of the image data stored in the storage unit 25. In the example shown in Figure 2, the image data 5 includes the shooting time 51, tollbooth ID 52, camera ID 53, NP information 54, and one or more pixel information 55. The pixel information 55 includes information representing the pixel value of each pixel constituting the captured image, as well as information representing, for example, the image format, compression format, shooting conditions, etc.

[0028] The shooting condition determination unit 22 determines whether predetermined shooting conditions are met, and if the conditions are met, it instructs the shooting unit 21 to take a still image. Based on the results of measuring the vehicle's position using, for example, a vehicle detection device that utilizes reflected or transmitted light (not shown), the shooting condition determination unit 22 outputs a predetermined instruction to the shooting unit 21 so that an image is taken when the vehicle passes a predetermined position. There are no limitations on how the vehicle's position is measured; for example, the vehicle's position may be recognized based on the results of capturing a moving image.

[0029] The NP information recognition unit 23 receives the image captured by the imaging unit 21, performs image recognition, and recognizes NP information. The recognized NP information is stored in the storage unit 25 as NP information 54, included in the image data 5, as shown in Figure 2.

[0030] When the image data 5 is stored in the storage unit 25, the transmission control unit 24 sends a request for permission to transmit the image data to the image server 1. If it receives a transmission permission notification from the image server 1, it transmits the image data 5 to the image server 1. If the transmission control unit 24 receives a transmission denial notification from the image server 1 in response to the request for permission to transmit the image data, it suspends the transmission of the image data 5 until it receives a transmission permission notification.

[0031] The memory unit 25 stores image data 5, which includes pixel information 55 representing the image captured by the imaging unit 21, NP information 54 recognized by the NP information recognition unit 23, and so on.

[0032] The communication unit 26 transmits and receives predetermined information to and from the image server 1 via the communication line 4, in response to instructions from the transmission control unit 24, etc.

[0033] (Terminal configuration) Terminal 3 can be composed of, for example, a combination of a computer and its peripheral devices, such as a personal computer or tablet terminal. Furthermore, terminal 3 has the following functional components, which are composed of a combination of hardware such as a computer that constitutes terminal 3 and software such as a program executed by the computer. Specifically, terminal 3 has a search processing unit 31, a storage unit 32, and a communication unit 33 as its functional components.

[0034] The search processing unit 31 sets search conditions in response to user input, requests the image server 1 to search for image data that matches the set search conditions, and receives the search results from the image server 1. The search processing unit 31 displays the search results on the display device of the terminal 3, and for example, saves the image data 5 included in the search results to the storage unit 32. The search processing unit 31 also prints still images or NP information using a printer (not shown) or records the image data 5 to an external storage medium in response to user input.

[0035] The memory unit 32 stores image data 5, etc.

[0036] The communication unit 33 transmits and receives predetermined information to and from the image server 1 via the communication line 4, in response to instructions from the search processing unit 31, etc.

[0037] (Example of image data processing system operation) Referring to Figures 3 to 10, an example of the operation of the image data processing system 100 shown in Figure 1 will be explained.

[0038] Figure 3 shows an example of the operation of camera 2 when capturing an image. The process shown in Figure 3 starts when camera 2 is powered on. In the process shown in Figure 3, first, the shooting condition determination unit 22 repeatedly determines whether the shooting conditions are met until the shooting conditions are met (repeating step S11:N). When the shooting conditions are met (step S11:Y), the shooting unit 21 captures a still image (step S12). Next, the NP information recognition unit 23 recognizes the NP information (step S13). Next, the storage unit 25 stores the image data 5 (step S14), and the shooting condition determination unit 22 determines again whether the shooting conditions are met (step S11).

[0039] Following the above procedure, camera 2 takes a still image each time the shooting conditions are met and stores the image data 5 in the storage unit 25.

[0040] Figure 4 shows an example of the operation of the transmission control unit 24. The process shown in Figure 4 is executed repeatedly at a predetermined cycle. When the process shown in Figure 4 starts, the transmission control unit 24 first determines whether or not there are any untransmitted image data 5 (step S21). If there are untransmitted image data 5 (step S21:Y), the transmission control unit 24 determines whether or not a request for permission to transmit image data 5 (hereinafter also referred to as a transmission permission request) has been sent to the image server 1 in connection with the occurrence of untransmitted image data 5 (step S22). On the other hand, if there are no untransmitted image data 5 (step S21:N), the transmission control unit 24 terminates the process shown in Figure 4. Note that in step S22, the transmission control unit 24 determines that the transmission has been sent if the transmission permission request has been successfully sent to the image server 1 (it determines that the transmission has been sent if there is any response from the image server 1 to the transmission permission request).

[0041] If a request for permission to transmit image data 5 has not been sent to image server 1 (step S22:N), the transmission control unit 24 sends a request for permission to transmit image data 5 to image server 1 (step S23). If a request for permission to transmit image data 5 has already been sent to image server 1 (step S22:Y), or if a request for permission to transmit image data 5 has been sent to image server 1 (step S23), the transmission control unit 24 determines whether or not it has received a transmission permission notification from image server 1 (step S24).

[0042] If a transmission permission notification is received from image server 1 (step S24:Y), the transmission control unit 24 sends all unsent image data to image server 1 (step S25), sends a transmission completion notification to image server 1 (step S26), and then terminates the process shown in Figure 4. On the other hand, if a transmission permission notification is not received from image server 1 (or if a transmission denial notification is received) (step S24:N), the transmission control unit 24 terminates the process shown in Figure 4.

[0043] In the above sequence, when the image data 5 is stored in the storage unit 25, the transmission control unit 24 sends a request for permission to transmit the image data 5 to the image server 1. Upon receiving a transmission permission notification from the image server 1, it transmits all untransmitted image data 5 to the image server 1, and when transmission is complete, it sends a transmission completion notification to the image server 1. Furthermore, if the image server 1 does not send a transmission permission notification in response to the transmission permission request for the image data 5, the transmission control unit 24 suspends the transmission of the image data 5.

[0044] Figure 5 shows an example of the operation of the processing execution restriction unit 13. The process shown in Figure 5 is started when the image server 1 is started. In the process shown in Figure 5, first, the processing execution restriction unit 13 determines whether or not it has received a transmission permission request from camera 2 (step S31). If it has not received a transmission permission request (step S31:N), the processing execution restriction unit 13 determines whether or not camera 2 is registered in the hold list (step S32). If camera 2 is not registered in the hold list (step S32:N), the processing execution restriction unit 13 determines again whether or not it has received a transmission permission request, for example, after a predetermined time (step S31).

[0045] If a transmission permission request has been received (step S31:Y), or if camera 2 is registered in the pending list (step S32:Y), the processing execution restriction unit 13 adjusts the threshold (resource usage rate determination criterion) based, for example, the current time or the current time and the setting of the fee discount (indicated as discount details in Figure 5) (step S33). Next, the processing execution restriction unit 13 determines whether a predetermined resource usage rate is below the threshold (step S34).

[0046] If the resource utilization rate is below a threshold (step S34:Y), the processing execution limiting unit 13 sends a transmission permission notification to, for example, camera 2 that sent the transmission permission request first if camera 2 is registered in the hold list, or to camera 2 that sent the transmission permission request last if camera 2 is not registered in the hold list (step S35), updates the hold list as necessary (step S36), and, for example, after a predetermined time, determines again whether or not a transmission permission request has been received (step S31).

[0047] On the other hand, if the resource utilization rate is not below a threshold (step S34:N), the processing execution restriction unit 13 determines whether or not camera 2 (camera 2 that sent the transmission permission request) is registered in the hold list (step S37). If camera 2 is not registered in the hold list (step S37:N), the processing execution restriction unit 13 registers camera 2 in the hold list (step S38), sends a transmission denial notice to camera 2 (step S39), and then, for example after a predetermined time, determines again whether or not the transmission permission request has been received (step S31). If camera 2 is already registered in the hold list (step S37:Y), the processing execution restriction unit 13 determines again, for example after a predetermined time, whether or not the transmission permission request has been received (step S31).

[0048] In the above sequence, the processing execution limiting unit 13 restricts the execution of the first process, which receives and stores image data 5 from the camera 2, if the resource usage rate exceeds a threshold, thereby ensuring that the resources necessary for the second process, which is the image data 5 search process, are always available. Note that the threshold adjustment in step S33 can be performed by, for example, adopting a threshold adjusted according to the search conditions, or a threshold adjusted based on the current time, if the threshold adjustment based on the search conditions described later has been performed. Furthermore, the threshold adjustment in step S33 may be omitted.

[0049] Figure 6 shows an example of the operation of the first processing execution unit 11. The process shown in Figure 6 is started when the image server 1 (communication unit 15) receives image data 5 from the camera 2. In the process shown in Figure 6, the first processing execution unit 11 receives the image data 5 (step S41), stores the received image data 5 in the storage unit 14 (step S42), and then terminates the process shown in Figure 6.

[0050] Figure 7 shows an example of the operation of the search processing unit 31. The process shown in Figure 7 is started, for example, when a user of terminal 3 performs a predetermined input operation to instruct the start of the search process. In the process shown in Figure 7, the search processing unit 31 first inputs search conditions based on the user's input operation (step S51). Next, the search processing unit 31 sends a search request containing information representing the search conditions to the image server 1 (step S52). Next, the search processing unit 31 receives the search results from the image server 1 (step S53). Next, the search processing unit 31 outputs the search results by displaying them on the display device of terminal 3 (step S54), and then terminates the process shown in Figure 7.

[0051] Figure 8 shows an example of the operation of the second processing execution unit 12 and the processing execution restriction unit 13. The process shown in Figure 8 is started when the image server 1 is started. In the process shown in Figure 8, first, the second processing execution unit 12 determines whether or not it has received a search request from terminal 3 (step S61). If it has not received a search request from terminal 3 (step S61:N), the second processing execution unit 12 determines again, for example, after a predetermined time, whether or not it has received a search request from terminal 3 (step S61).

[0052] If a search request has been received from terminal 3 (step S61:Y), the processing execution limiting unit 13 adjusts the threshold based on the search conditions (step S62). Next, the second processing execution unit 12 executes the search process (second process) (step S63). Next, the second processing execution unit 12 sends the search results to terminal 3 (step S64). Next, the processing execution limiting unit 13 makes adjustments, such as returning the threshold to its initial value (step S65), and then, for example, after a predetermined time, determines again whether or not a search request has been received from terminal 3 (step S61).

[0053] Note that the adjustment of the threshold based on the search conditions in step S62 and the adjustment of the threshold in step S65 may be omitted.

[0054] Figure 9 shows an example of the operation of the image data processing system 100 (under normal conditions). In the operation example shown in Figure 9, first, the shooting conditions are met at camera 2a (corresponding to camera 2), and image capture and image saving are performed (step S101). Next, camera 2a sends a request for permission to send image data to image server 1 (step S102). Next, image server 1 performs a threshold determination for resource usage (step S103). If the resource usage is below the threshold, image server 1 sends a transmission permission notification to camera 2a (step S104). Next, image data is sent from camera 2a to image server 1 (step S105). Next, image data is received and stored at image server 1 (step S106). Next, camera 2a sends a transmission completion notification to image server 1 (step S107).

[0055] Figure 10 shows another example of operation of the image data processing system 100 (when a communication failure occurs). The example of operation shown in Figure 10 is an example of operation when a communication failure occurs within the dashed block B1, and communication between camera 2 (camera 2a and camera 2b in Figure 10) and image server 1 is interrupted.

[0056] In the example shown in Figure 10, first, the shooting conditions are repeatedly met in camera 2a, and image capture and image saving are performed (step S201), and a request for permission to transmit image data is repeatedly sent from camera 2a to image server 1 (step S202). Similarly, the shooting conditions are repeatedly met in camera 2b, and image capture and image saving are performed (step S203), and a request for permission to transmit image data is repeatedly sent from camera 2b to image server 1 (step S204).

[0057] After the communication failure is resolved, when camera 2a sends a request for permission to send image data to image server 1 (step S205), image server 1 performs a threshold check on the resource usage rate (step S206). If the resource usage rate is below the threshold, image server 1 sends a transmission permission notification to camera 2a (step S207).

[0058] In the example shown in Figure 10, a request for permission to transmit image data is sent from camera 2b to image server 1 (step S208). Next, image server 1 performs a threshold check on the resource usage rate (step S209). If the resource usage rate is not below the threshold, image server 1 sends a transmission denial notice to camera 2b, and camera 2b is registered in the hold list (step S210).

[0059] Next, image data is transmitted from camera 2a to image server 1 (step S211), and the image data is received and stored at image server 1 (step S212). Steps S211 and S212 are repeated until all untransmitted image data has been transmitted. Once transmission is complete, camera 2a sends a transmission completion notification to image server 1 (step S213).

[0060] Next, the image server 1 performs a threshold check on the resource utilization rate (step S2014). If the resource utilization rate is below the threshold, the image server 1 sends a transmission permission notification to the camera 2b (step S215).

[0061] Next, image data is transmitted from camera 2b to image server 1 (step S216), and the image data is received and stored at image server 1 (step S217). Steps S216 and S217 are repeated until all untransmitted image data has been transmitted. Once transmission is complete, camera 2b sends a transmission completion notification to image server 1 (step S218).

[0062] (Effects / Actions) The image server 1 (image data processing device) of this embodiment includes a first processing execution unit 11 that performs a first processing to receive image data 5 representing still images captured by a predetermined camera 2 from multiple cameras 2 via a communication line 4 when predetermined shooting conditions are met and store them in a predetermined storage unit 14; a second processing execution unit 12 that performs a second processing to search for image data 5 that matches predetermined search conditions from the stored image data 5, sharing resources with the first processing execution unit 11; and a processing execution limiting unit 13 that restricts the execution of the first processing by the first processing execution unit 11 when the value related to resource usage exceeds a predetermined threshold. With this configuration, the value related to resource usage by the first processing, which receives and stores image data representing still images captured when shooting conditions are met, is limited based on a threshold, and a certain amount of resources can always be secured for the second processing, which is a search processing of the stored image data. Therefore, even when image capture occurs intensively with multiple cameras 2, the time required for the search processing can easily be kept within a predetermined value. In this case, the reception and storage of image data from multiple cameras 2 will be limited, but the amount of resources in the image server 1 can be set based on, for example, the amount of resources required under normal circumstances. As described above, according to this embodiment, the image data reception and storage process and the image data search process can be appropriately executed by sharing resources.

[0063] In addition, situations in which image data is transmitted intensively from multiple cameras 2 include, for example, the initial startup of image server 1, recovery from power outages such as during maintenance, recovery from communication failures, immediately after the start of time-of-day discount periods, and immediately before the end of time-of-day discount periods.

[0064] Furthermore, the following is an example of the purpose of using the image data processing system 100 of this embodiment. Specifically, it can be used by road operators to confirm whether or not a vehicle with certain license plate information (NP information) has traveled through a toll booth where images are stored. In addition, a more specific example of the above purpose is the following case. In the case of wireless billing results from an electronic toll collection system for a certain vehicle, for example, there is an exit statement but no entry statement (due to wireless communication failure, etc.), it is conceivable that staff would search the images to verify (confirm) the fact that the vehicle traveled to the entry point and confirm that the vehicle did travel through.

[0065] (Other embodiments) Although embodiments of this disclosure have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments and may include design changes and the like that do not depart from the gist of this disclosure.

[0066] (Computer configuration) Figure 11 is a schematic block diagram showing the configuration of a computer according to at least one embodiment. The computer 90 includes a processor 91, main memory 92, storage 93, and an interface 94. The image server 1, camera 2, and terminal 3 described above are implemented in the computer 90. The operation of each processing unit described above is stored in storage 93 in the form of a program. The processor 91 reads the program from storage 93, loads it into main memory 92, and executes the above processing according to the program. The processor 91 also allocates memory areas in main memory 92 corresponding to each of the above-mentioned storage units according to the program.

[0067] The program may be for implementing some of the functions that the computer 90 is to perform. For example, the program may perform functions in combination with other programs already stored in storage, or in combination with other programs implemented in other devices. In other embodiments, the computer may include a custom LSI (Large Scale Integrated Circuit) such as a PLD (Programmable Logic Device) in addition to, or instead of, the above configuration. Examples of PLDs include PAL (Programmable Array Logic), GAL (Generic Array Logic), CPLD (Complex Programmable Logic Device), FPGA (Field Programmable Gate Array), etc. In this case, some or all of the functions implemented by the processor may be implemented by the integrated circuit.

[0068] Examples of storage 93 include HDDs (Hard Disk Drives), SSDs (Solid State Drives), magnetic disks, magneto-optical disks, CD-ROMs (Compact Disc Read Only Memory), DVD-ROMs (Digital Versatile Disc Read Only Memory), and semiconductor memory. Storage 93 may be an internal medium directly connected to the bus of the computer 90, or an external medium connected to the computer 90 via an interface 94 or a communication line. Furthermore, if this program is distributed to the computer 90 via a communication line, the computer 90 that receives the program may expand it into main memory 92 and execute the above processing. In at least one embodiment, storage 93 is a tangible storage medium that is not temporary.

[0069] <Note> The image server 1 (corresponding to the image data processing device related to this disclosure) described in each embodiment can be identified, for example, as follows:

[0070] (1) The image server 1 (image data processing device) according to the first embodiment includes: a first processing execution unit 11 that performs a first process of receiving image data 5 representing still images taken by a predetermined camera 2 from a plurality of cameras 2 via a communication line 4 when predetermined shooting conditions are met and storing it in a predetermined storage unit 14; a second processing execution unit 12 that performs a second process of searching for image data that matches predetermined search conditions from the stored image data 5, sharing resources with the first processing execution unit 11; and a processing execution restriction unit 13 that restricts the execution of the first process by the first processing execution unit 11 when the value related to the use of the resources exceeds a predetermined threshold. According to this embodiment and each of the following embodiments, the image data reception and storage process and the image data search process can be appropriately executed by sharing resources.

[0071] (2) The image server 1 (image data processing device) according to the second embodiment is the image server 1 of (1), wherein the processing execution restriction unit 13 compares the value related to use with the threshold before the first processing execution unit 11 starts executing the first processing, and restricts the execution of the first processing by not starting the execution of the first processing if the value related to use exceeds the threshold. According to this embodiment, the execution of the first processing is restricted by prohibiting the execution of the first processing, so the threshold can be easily adjusted.

[0072] (3) The image server 1 (image data processing device) according to the third embodiment is the image server 1 according to (1) or (2), wherein the processing execution limiting unit 13 limits the execution of the first processing by the first processing execution unit 11 for each camera 2 when the value related to the use of the resource exceeds a predetermined threshold. According to this embodiment, since the execution of the first processing is limited for each camera 2, the threshold can be easily adjusted.

[0073] (4) The image server 1 (image data processing device) according to the fourth embodiment is the image server 1 according to (1) to (3), wherein the plurality of cameras 2 photograph vehicles passing through each of the plurality of toll booths on a toll road, the search conditions specify the time period in which the vehicle passed and the toll booth, and the processing execution limiting unit 13 adjusts the threshold according to the search conditions. According to this embodiment, the threshold can be appropriately adjusted according to the search conditions.

[0074] (5) The image server 1 (image data processing device) according to the fifth embodiment is the image server 1 according to (1) to (4), wherein the plurality of cameras 2 photograph vehicles passing through each of the toll booths at a plurality of toll booths on a toll road, and the processing execution limiting unit 13 adjusts the threshold according to the current time. According to this embodiment, the threshold can be appropriately adjusted according to the current time.

[0075] (6) The image server 1 (image data processing device) according to the sixth embodiment is the image server 1 according to (1) to (4), wherein the plurality of cameras 2 photograph vehicles passing through each of the toll booths at a plurality of toll booths on a toll road, and the processing execution limiting unit 13 adjusts the threshold according to the current time and the toll discount settings. According to this embodiment, the threshold can be appropriately adjusted according to the current time and the toll discount settings. [Explanation of Symbols]

[0076] 100...Image data processing system 1…Image server 2…Camera 3… Terminal 4…Communication lines 5…Image data 11...First Processing Execution Unit 12...Second Processing Execution Unit 13... Processing execution limiting unit 14...Storage section 15… Communications Department

Claims

1. A first processing execution unit performs a first process in which, when predetermined shooting conditions are met, it receives image data representing still images taken by a predetermined camera from multiple cameras via a communication line and stores it in a predetermined storage unit. A second processing execution unit performs a second process of searching for image data that matches predetermined search conditions from the accumulated image data, sharing resources with the first processing execution unit. A processing execution restriction unit restricts the execution of the first processing by the first processing execution unit when the value related to the use of the resource exceeds a predetermined threshold, An image data processing device equipped with the following features.

2. The processing execution limiting unit compares the value related to use with the threshold before the first processing execution unit starts executing the first processing, and if the value related to use exceeds the threshold, it prevents the execution of the first processing, thereby limiting the execution of the first processing. The image data processing apparatus according to claim 1.

3. The processing execution limiting unit restricts the execution of the first processing by the first processing execution unit for each camera when the value related to the use of the resource exceeds a predetermined threshold. The image data processing apparatus according to claim 1 or 2.

4. The aforementioned multiple cameras are used to photograph vehicles passing through multiple toll booths on a toll road. The aforementioned search conditions specify the time period during which the vehicle passed and the toll booth. The processing execution limiting unit adjusts the threshold according to the search conditions. The image data processing apparatus according to claim 3.

5. The aforementioned multiple cameras are used to photograph vehicles passing through multiple toll booths on a toll road. The processing execution limiting unit adjusts the threshold according to the current time. The image data processing apparatus according to claim 3.

6. The aforementioned multiple cameras are used to photograph vehicles passing through multiple toll booths on a toll road. The processing execution limiting unit adjusts the threshold according to the current time and the settings for the fee discount. The image data processing apparatus according to claim 3.

7. The first step involves receiving image data representing still images captured by a predetermined camera via a communication line from multiple cameras when predetermined shooting conditions are met, and storing it in a predetermined storage unit. A second step involves sharing resources with the first step to search for image data from the stored image data that matches predetermined search conditions, A third step which restricts the execution of the first step if the value related to the use of the resource exceeds a predetermined threshold, Image data processing method including [specific details omitted].

8. The first step involves receiving image data representing still images captured by a predetermined camera via a communication line from multiple cameras when predetermined shooting conditions are met, and storing it in a predetermined storage unit. A second step involves sharing resources with the first step to search for image data from the stored image data that matches predetermined search conditions, A third step which restricts the execution of the first step if the value related to the use of the resource exceeds a predetermined threshold, A program that causes a computer to execute something.

9. A first processing execution unit performs a first process in which, when predetermined shooting conditions are met, it receives image data representing still images taken by a predetermined camera from multiple cameras via a communication line and stores it in a predetermined storage unit. A second processing execution unit performs a second process of searching for image data that matches predetermined search conditions from the accumulated image data, sharing resources with the first processing execution unit. A processing execution restriction unit restricts the execution of the first processing by the first processing execution unit when the value related to the use of the resource exceeds a predetermined threshold, Image data processing device comprising, The aforementioned multiple cameras, An image data processing system equipped with the following features.

Images