Information processing apparatus, information processing method, and information processing system

Abstract

A camera includes an image sensor, and processing circuitry configured to recognize a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of the plurality of images processed by an image signal processor included in the image sensor, transmit, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein t0 is earlier than t1, wherein when a size of the license plate at t1 is larger than a size of the license plate at t0, the vehicle enters the parking space, and wherein in a case that the size of the license plate at t1 is smaller than the size of the license plate at t0, the vehicle exits the parking space.

Description

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND INFORMATION PROCESSING SYSTEM

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and an information processing system.

[0002] In recent years, technologies for recognizing the state of a vehicle have been known. For example, PTL 1 discloses a technology for recognizing the type of a vehicle on the basis of captured images of a license plate of the vehicle that are obtained by cameras.

[0003] JP 2020-135535ASummary

[0004] However, it is desired that a technology of recognizing entering of a vehicle into a parking space or exiting of a vehicle from a parking space with high accuracy be provided.

[0005] An information processing system including an image sensor configured to capture a plurality of images; and first processing circuitry configured to recognize a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of the plurality of images processed by an image signal processor included in the image sensor, transmit, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein the first time t0 is earlier than the second time t1, wherein in a case that a size of the license plate at the second time t1 is larger than a size of the license plate at the first time t0, the vehicle enters the parking space, and wherein in a case that the size of the license plate at the second time t1 is smaller than the size of the license plate at the first time t0, the vehicle exits the parking space.

[0006] A method, comprising recognizing a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of a plurality of images processed by an image signal processor included in an image sensor; transmitting, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein the first time t0 is earlier than the second time t1; wherein in a case that a size of the license plate at the second time t1 is larger than a size of the license plate at the first time t0, the vehicle enters the parking space; and wherein in a case that the size of the license plate at the second time t1 is smaller than the size of the license plate at the first time t0, the vehicle exits the parking space.

[0007] A non-transitory computer-readable storage medium storing computer-readable instructions thereon which, when executed by a computer, cause the computer to perform a method, the method comprising recognizing a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of a plurality of images processed by an image signal processor included in an image sensor; transmitting, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein the first time t0 is earlier than the second time t1; wherein in a case that a size of the license plate at the second time t1 is larger than a size of the license plate at the first time t0, the vehicle enters the parking space; and wherein in a case that the size of the license plate at the second time t1 is smaller than the size of the license plate at the first time t0, the vehicle exits the parking space.

[0008] Fig. 1 is a diagram illustrating a configuration example of an information processing system according to an embodiment of the present disclosure.Fig. 2 is a diagram illustrating an example of a positional relation between a camera 10A-1 and a vehicle TA-1 parked at a berth PA-1.Fig. 3 is a diagram illustrating an example of a positional relation between a camera 10A-11 and a camera 10A-12 and a vehicle TA-11 and a vehicle TA-12 parked at the berth PA-1.Fig. 4 is a diagram illustrating a functional configuration example of a camera 10 according to the embodiment of the present disclosure.Fig. 5 is a diagram illustrating a functional configuration example of a server 20 according to the embodiment of the present disclosure.Fig. 6 is a diagram illustrating a configuration example of reservation information 231.Fig. 7 is a diagram illustrating a configuration example of contact information 232.Fig. 8 is a diagram illustrating a configuration example of staying time information 233.Fig. 9 is a diagram for describing an example of recognizing entering of a vehicle TA-1 into a berth PA-n.Fig. 10 is a diagram for describing an example of recognizing exiting of the vehicle TA-1 from the berth PA-n.Fig. 11 is a flowchart illustrating an example of manual reservation processing executed by the server 20 according to the embodiment of the present disclosure.Fig. 12 is a flowchart illustrating an example of berth-related processing executed by the server 20 according to the embodiment of the present disclosure.Fig. 13 is a flowchart illustrating an example of entering-related processing executed by the server 20 according to the embodiment of the present disclosure.Fig. 14 is a flowchart illustrating an example of exiting-related processing executed by the server 20 according to the embodiment of the present disclosure.Fig. 15 is a flowchart illustrating an example of automated reservation processing executed by the server 20 according to the embodiment of the present disclosure.Fig. 16 is a flowchart illustrating an example of staying time-related processing executed by the server 20 according to the embodiment of the present disclosure.Fig. 17 is a block diagram illustrating a hardware configuration example of an information processing apparatus 900.

[0009] Referring to the accompanying drawings, exemplary embodiments of the present disclosure are described in detail below. Note that, in this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference symbols, and overlapping descriptions are omitted.

[0010] Note that the descriptions are given in the following order. 1. Details of Embodiment 1.1. Configuration Example of Information Processing System 1.2. Functional Configuration Example of Camera 1.3. Functional Configuration Example of Server 1.4. Operation Example of Server 2. Hardware Configuration Example 3. Conclusion

[0011] <1. Details of Embodiment> Subsequently, the embodiment of the present disclosure is described in detail.

[0012] (1.1. Configuration Example of Information Processing System) Fig. 1 is a diagram illustrating a configuration example of an information processing system according to the embodiment of the present disclosure. As illustrated in Fig. 1, an information processing system 1 according to the embodiment of the present disclosure includes cameras 10A-1 to 10A-n (n is an integer of 1 or more) located at a base A, cameras 10B-1 to 10B-n located at a base B, a server 20, a network 30, an administrator terminal 60, and a driver terminal 70.

[0013] (Base A and Base B) Here, the base A has berths PA-1 to PA-n. Each of the berths PA-1 to PA-n is a space (parking space) where a vehicle is parked, and the vehicle parked in the space can be unloaded. As an example, a vehicle TA-1 is parked at the berth PA-1. For example, a situation where the vehicle TA-1 is parked at the berth PA-1 means a situation where the vehicle TA-1 is stopped at the berth PA-1, and a time period during which the vehicle TA-1 is parked at the berth PA-1 is not particularly limited. Note that the camera 10A-1 and the berth PA-1 are associated with each other by the server 20 in advance. For example, correspondence information in which identification information on the camera 10A-1 and identification information on the berth PA-1 are associated with each other is stored in the server 20 in advance, and the server 20 can acquire, from the correspondence information, the identification information on the berth PA-1 corresponding to the identification information on the camera 10A-1 transmitted from the camera 10A-1, thereby recognizing the berth PA-1 associated with the camera 10A-1. Similarly, the server 20 recognizes the berth PA-2 associated with the camera 10A-2, ..., and recognizes the berth PA-n associated with the camera 10A-n.

[0014] The cameras 10A-1 to 10A-n are provided behind or diagonally behind vehicles to be parked at the berths PA-1 to PA-n. As an example, the camera 10A-1 is behind the vehicle TA-1 parked at the berth PA-1. Now, an example of a positional relation between the camera 10A-1 and the vehicle TA-1 parked at the berth PA-1 is described in detail with reference to Fig. 2 and Fig. 3.

[0015] Fig. 2 is a diagram illustrating an example of the positional relation between the camera 10A-1 and the vehicle TA-1 parked at the berth PA-1. Referring to Fig. 2, the berth PA-2 and the berth PA-1 included in the base A are enlarged. At the berth PA-1, the vehicle TA-1 is parked.

[0016] Here, an example of the positional relation between the camera 10A-1 and the vehicle TA-1 parked at the berth PA-1 is mainly described. However, positional relations between the cameras 10A-2 to 10A-n and vehicles parked at the berths PA-2 to PA-n may be the same as the positional relation between the camera 10A-1 and the vehicle TA-1 parked at the berth PA-1.

[0017] As illustrated in Fig. 2, the camera 10A-1 may be provided behind or diagonally behind the vehicle TA-1. More specifically, the camera 10A-1 may be provided at a position inside an angle of view θ of the camera 10A-1 so as to cover a license plate attached to a back surface E of the vehicle TA-1 parked at the berth PA-1. Alternatively, the camera 10A-1 may be provided at a position inside the angle of view θ of the camera 10A-1 so as to cover the license plate attached to the back surface E of the vehicle TA-1 that moves before entering into the berth PA-1 (for example, moves in front-back direction).

[0018] In general, a camera is provided ahead of the vehicle TA-1. In this case, moving images of a license plate attached to a front surface F of the vehicle TA-1 parked at the berth PA-1 are obtained by the camera. Then, on the basis of the moving images thus obtained, the entering of the vehicle TA-1 into the berth PA-1 or the exiting of the vehicle TA-1 from the berth PA-1 is recognized.

[0019] However, the space ahead of the vehicle TA-1 parked at the berth PA-1 is a location where the vehicle TA-1 passes, and hence a camera sometimes needs to be provided far away from the vehicle TA-1. Thus, the accuracy of recognition of the entering of the vehicle TA-1 into the berth PA-1 or the exiting of the vehicle TA-1 from the berth PA-1 is not improved.

[0020] On the other hand, in the example illustrated in Fig. 2, the camera 10A-1 is provided behind or diagonally behind the vehicle TA-1. In this case, moving images of the license plate attached to the back surface E of the vehicle TA-1 parked at the berth PA-1 are obtained by the camera 10A-1. Then, on the basis of the obtained moving images thus obtained, the entering of the vehicle TA-1 into the berth PA-1 or the exiting of the vehicle TA-1 from the berth PA-1 is recognized.

[0021] The space behind or diagonally behind the vehicle TA-1 parked at the berth PA-1 is a location where the vehicle TA-1 does not pass, and hence it is easy to provide the camera 10A-1 near the vehicle TA-1. In this manner, the accuracy of recognition of the entering of the vehicle TA-1 into the berth PA-1 or the exiting of the vehicle TA-1 from the berth PA-1 can be improved.

[0022] Note that it is desired that the height of the camera 10A-1 be substantially equal to the height of the license plate attached to the back surface E of the vehicle TA-1. In this manner, the license plate is photographed by the camera 10A-1 from near the front, and hence the accuracy of recognition of the entering of the vehicle TA-1 into the berth PA-1 and the exiting of the vehicle TA-1 from the berth PA-1 can be improved.

[0023] Furthermore, a wall WA-1 may be provided between the camera 10A-1 and the vehicle TA-1 in the horizontal direction. The wall WA-1 may be provided at a height that prevents the vehicle TA-1 from contacting the camera 10A-1, but in order to enable the camera 10A-1 to image the license plate of the vehicle TA-1, the wall WA-1 is not necessarily required to be provided at a position low from the ground surface.

[0024] Fig. 3 is a diagram illustrating and example of positional relations between the camera 10A-11 and the camera 10A-12 and the vehicle TA-11 and the vehicle TA-12 parked at the berth PA-1. Referring to Fig. 3, the vehicle TA-11 and the vehicle TA-12 are parked at the berth PA-1. In this manner, a plurality of vehicles may be parked at each of the berths PA-1 to PA-n.

[0025] Here, an example of the positional relations between the camera 10A-11 and the camera 10A-12 and the vehicle TA-1 and the vehicle TA-12 parked at the berth PA-1 is mainly described. However, positional relations between other cameras (such as cameras 10A-21 to 10A-22 illustrated in Fig. 3) and vehicles parked at another berth (for example, berth PA-2) may be the same as the positional relations between the camera 10A-11 and the camera 10A-12 and the vehicle TA-1 and the vehicle TA-12 parked at the berth PA-1.

[0026] As illustrated in Fig. 3, the camera 10A-11 may be provided behind or diagonally behind the vehicle TA-11 parked at the berth PA-1, and the camera 10A-12 may be provided behind or diagonally behind the vehicle TA-12 parked at the berth PA-1.

[0027] More specifically, the camera 10A-11 may be provided at a position inside an angle of view θ of the camera 10A-11 so as to cover a license plate attached to a back surface E11 of the vehicle TA-11 parked at the berth PA-1. Furthermore, the camera 10A-12 may be provided at a position inside an angle of view θ of the camera 10A-12 so as to cover a license plate attached to a back surface E12 of the vehicle TA-12 parked at the berth PA-1.

[0028] As in the example illustrated in Fig. 3, a plurality of vehicles may be parked at the berth PA-1. Similarly, a plurality of vehicles may be parked at each of the berths PA-2 to PA-n. Also in such a case, matters that are applied to a single vehicle parked at each of the berths PA-1 to PA-n can be applied to each of a plurality of vehicles parked at each of the berths PA-1 to PA-n. However, in the following description, the case where a single vehicle can be parked at each of the berths PA-1 to PA-n is mainly assumed for the sake of simple description.

[0029] The description continues with reference back to Fig. 1. Similarly to the base A, the base B has berths PB-1 to PB-n. As an example, a vehicle TB-n is parked at the berth PB-n. The cameras 10B-1 to 10B-n are provided behind or diagonally behind vehicles parked at the berths PB-1 to PB-n. As an example, the camera 10B-n is provided behind the vehicle TB-n parked at the berth PB-n.

[0030] In the following description, when describing the contents applied to all of the cameras 10A-1 to 10A-n, the cameras 10A-1 to 10A-n are sometimes referred to as "camera 10A" without particularly distinguishing the cameras. Similarly, the vehicles TA-1 to TA-n are sometimes referred to as "vehicle TA". Furthermore, the berths PA-1 to PA-n are sometimes referred to as "berth PA".

[0031] Similarly, the cameras 10B-1 to 10B-n are sometimes referred to as "camera 10B" without particularly distinguishing the cameras. The vehicles TB-1 to TB-n are sometimes referred to as "vehicle TB". Furthermore, the berths PB-1 to PB-n are sometimes referred to as "berth PB". Furthermore, the cameras 10A-1 to 10A-n and the cameras 10B-1 to 10B-n are sometimes referred to as "camera 10" without particularly distinguishing the cameras.

[0032] In the example illustrated in Fig. 1, the number of berths PA included in the base A and the number of berths PB included in the base B are the same number n, but the number of berths PA included in the base A and the number of berths PB included in the base B may be different numbers. Furthermore, Fig. 1 illustrates the case where the number of bases is two (that is, base A and base B), but the number of bases may be one or three or more.

[0033] (Server 20) The server 20 is implemented by a computer, and functions as an example of an information processing apparatus. Note that, in the following description, functions of the camera 10, the server 20, the administrator terminal 60, and the driver terminal 70 are described in more detail, but the sharing of the functions of the server 20, the camera 10, the administrator terminal 60, and the driver terminal 70 is not limited. For example, a part of the functions of the camera 10 may be included in the server 20 instead of the camera 10.

[0034] (Network 30) The network 30 replays communications among devices connected to the network 30. Here, the type of the network 30 is not limited.

[0035] As a specific example, the network 30 may be constructed by what is called a wireless network such as a network based on Wi-Fi (registered trademark) standards. Furthermore, as another example, the network 30 may be constructed by the Internet, a dedicated line, a LAN (Local Area Network), or a WAN (Wide Area Network). Furthermore, the network 30 may include a plurality of networks, and at least a part of the networks may be constructed by a wired network.

[0036] (Administrator Terminal 60) The administrator terminal 60 is implemented by a computer, and is a terminal used by an administrator of a base. Here, the case where the administrator terminal 60 is a terminal used by an administrator of the base A is mainly assumed. However, the information processing system 1 may include an administrator terminal used by an administrator of the base B. The administrator terminal 60 may be a PC (Personal Computer) provided in a control room in a base, or may be a terminal that can be carried out by an administrator (for example, smartphone).

[0037] The administrator terminal 60 may have an input device (not shown), and may acquire, from the input device, information input from the administrator to the input device. Note that the input device may be a touch panel, a mouse, a keyboard, a microphone, or another input device.

[0038] The administrator terminal 60 may have a presentation device (not shown), and may present information transmitted from the server 20 to the administrator by the presentation device. In this manner, the administrator can perceive information presented by the presentation device. Note that the presentation device may be a display configured to present visual information, a speaker configured to present voice information, or a haptic presentation device configured to present the sense of force.

[0039] (Driver Terminal 70) The driver terminal 70 is implemented by a computer, and is a terminal used by a driver of a vehicle. Here, the case where the driver terminal 70 is a terminal used by a driver of the vehicle TA-1 is mainly assumed. However, the information processing system 1 may include a driver terminal used by a driver of another vehicle. The driver terminal 70 may be a terminal provided in a room of the vehicle TA-1, or may be a terminal that can be carried out by a driver (for example, smartphone).

[0040] The driver terminal 70 may have an input device (not shown), and may acquire, from the input device, information input to the input device from the driver. Note that the input device may be a touch panel, a mouse, a keyboard, a microphone, or another input device.

[0041] The driver terminal 70 may have a presentation device (not shown), and may present information transmitted from the server 20 to the driver by the presentation device. In this manner, the driver can perceive information presented by the presentation device. Note that the presentation device may be a display configured to present visual information, a speaker configured to present voice information, or a haptic presentation device configured to present the sense of force.

[0042] The configuration example of the information processing system 1 according to the embodiment of the present disclosure has been described above.

[0043] (1.2. Functional Configuration Example of Camera) Subsequently, a functional configuration example of the camera 10 according to the embodiment of the present disclosure is described with reference to Fig. 4.

[0044] Fig. 4 is a diagram illustrating a functional configuration example of the camera 10 according to the embodiment of the present disclosure. As illustrated in Fig. 4, the camera 10 according to the embodiment of the present disclosure includes an image sensor 110, a CIS signal processing unit 120, an ISP unit 130, and a recognition model 140. Note that CIS is an abbreviation for a CMOS (Complementary Metal Oxide Semiconductor) image sensor, but the type of the image sensor is not particularly limited. ISP is an abbreviation for Image Signal Processor.

[0045] (Image Sensor 110) The image sensor 110 receives light from a real space, and converts the intensity of the received light into an electric signal. The image sensor 110 sequentially outputs electric signals to the CIS signal processing unit 120. Note that the image sensor 110 may be a CMOS image sensor as described above, but the type of the image sensor is not particularly limited.

[0046] (CIS Signal Processing Unit 120) The CIS signal processing unit 120 performs various kinds of signal processing on an electric signal input from the image sensor 110. For example, the CIS signal processing unit 120 performs remosaic processing and defect correction on signals input from the image sensor 110, exposure time control of the image sensor 110, and analog gain adjustment of the image sensor 110.

[0047] Note that parameters are set to the CIS signal processing unit 120. Then, the parameters are adjusted for adjustment of remosaic processing and defect correction on signals input from the image sensor 110, exposure time control of the image sensor 110, and analog gain adjustment of the image sensor 110.

[0048] (ISP Unit 130) The ISP unit 130 performs various kinds of image signal processing on image signals that have been subjected to signal processing by the CIS signal processing unit 120. For example, the ISP unit 130 performs demosaic processing, sharpening processing, noise removal, resolution conversion, digital gain adjustment, tone mapping, color correction, color conversion, normalization processing, and quantization on image signals that have been subjected to signal processing by the CIS signal processing unit 120.

[0049] (Recognition Model 140) The recognition model 140 is a model generated by learning, and performs recognition on the basis of images that have been processed by the ISP unit 130. For example, the recognition model 140 is constructed by a learned DNN (Deep Neural Network). In the following description, images that have been processed by the ISP unit 130 are sometimes referred to as "frames".

[0050] More specifically, the recognition model 140 includes a CNN (Convolution Neural Network), and recognizes a license plate on the basis of frames. As an example of recognition results of a license plate, the recognition model 140 recognizes, from frames, the position of a license plate region surrounding the license plate (that is, a bounding box corresponding to the license plate) and a car number written on the license plate.

[0051] For example, the license plate region may be a rectangular region. Furthermore, the position of the license plate region may be expressed by coordinates of the upper left corner and coordinates of the lower right corner of the license plate region in a frame. Alternatively, the position of the license plate region may be expressed by coordinates of the upper right corner and coordinates of the lower left corner of the license plate region in a frame.

[0052] The car number may be a part or whole of numbers written on the license plate. Here, the case where the last four figures (for example, "12-34") of a number written on a license plate are used as a car number is mainly assumed. The recognition model 140 outputs the position of the license plate region and the car number to the server 20.

[0053] The recognition model 140 outputs a car number on the basis of car numbers recognized from the plurality of frames. Here, the recognition model 140 may output a recognized car number itself. Alternatively, in a case where, among car numbers recognized from i (i is an integer of 1 or more) frames, car numbers recognized from j (j is an integer of 1 or more and i or less) frames or more are the same, the recognition model 140 may output car numbers recognized from the j frames or more as true values. In this manner, the accuracy of a car number output from the recognition model 140 is improved.

[0054] Note that the recognition model 140 may output, in addition to the position of a license plate region and a car number, an image obtained by clipping a license plate region from a frame (that is, clipped image) and the frame to the server 20. In this case, in the server 20, the clipped image and the frame may be received by a communication unit 240 (Fig. 5) and saved in a storage unit 230 (Fig. 5).

[0055] Note that Fig. 4 illustrates the case where the recognition model 140 is present inside the camera 10 and outside the image sensor 110, and the recognition model 140 recognizes the position of a license plate region and a car number written on a license plate. However, one or both of the recognition of the position of a license plate region and the recognition of a car number written on a license plate may be performed inside the image sensor 110 (for example, by an AI (Artificial Intelligence) processing unit (not shown) built in the image sensor 110). For example, the AI processing unit may be implemented by a DSP (Digital Signal Processor) (not shown) built in the image sensor 110.

[0056] For example, both of the recognition of the position of a license plate region and the recognition of a car number written on a license plate may be performed inside the image sensor 110. In this case, the output from the image sensor 110 may include the position of a license plate region and a car number that have been recognized inside the image sensor 110. Furthermore, the output from the image sensor 110 may include, in addition to the position of a license plate region and a car number that have been recognized inside the image sensor 110, an image obtained by clipping a license plate region from a frame and the frame.

[0057] Alternatively, the recognition of the position of a license plate region may be performed inside the image sensor 110, and the recognition of a car number written on a license plate may be performed by the recognition model 140 that is present inside the camera 10 and outside the image sensor 110.

[0058] The functional configuration example of the camera 10 according to the embodiment of the present disclosure has been described above.

[0059] (1.3. Functional Configuration Example of Server) Subsequently, mainly referring to Fig. 5, a functional configuration example of the server 20 according to the embodiment of the present disclosure is described.

[0060] Fig. 5 is a diagram illustrating a functional configuration example of the server 20 according to the embodiment of the present disclosure. As illustrated in Fig. 5, the server 20 according to the embodiment of the present disclosure includes a control unit 220, a storage unit 230, and the communication unit 240.

[0061] (Control Unit 220) The control unit 220 may be configured by, for example, one or a plurality of CPUs (Central Processing Units). When the control unit 220 is configured by a processing device such as a CPU, the processing device may be configured by an electronic circuit. The control unit 220 may be implemented when a program is executed by the processing device.

[0062] The control unit 220 includes an acquisition unit 221, a processing unit 222, and a transmission control unit 223. Functions of the acquisition unit 221, the processing unit 222, and the transmission control unit 223 are described in detail later.

[0063] (Storage Unit 230) The storage unit 230 is configured to include a memory, and is a recording medium configured to store programs executed by the control unit 220 therein and store data necessary for executing the programs therein. Furthermore, the storage unit 230 temporarily stores therein data for arithmetic calculation by the control unit 220. The storage unit 230 is configured by a magnetic storage unit device, a semiconductor storage device, an optical storage device, or a magneto-optical storage device.

[0064] The storage unit 230 stores reservation information 231, contact information 232, and staying time information 233 therein. Now, configuration examples of the reservation information 231, the contact information 232, and the staying time information 233 are described with reference to Fig. 6 to Fig. 8.

[0065] (Reservation Information 231) Fig. 6 is a diagram illustrating a configuration example of the reservation information 231. As illustrated in Fig. 6, the reservation information 231 is configured by associating a berth included in a base, a time, a car number, and a status with one another. In the example illustrated in Fig. 6, the width per unit time is 1 hour, but the width per unit time is not limited to 1 hour. For example, the width per unit time may be 30 minutes.

[0066] The car number is a car number of a vehicle that has a reservation for a berth and a time. For example, referring to Fig. 6, a car number "12-34" is registered for the berth "PA-1" and the time "20 August 7:00-8:00". This indicates that a vehicle having the car number "12-34" has reserved the use of the berth "PA-1" at the time "20 August 7:00-8:00".

[0067] The status indicates a reservation status for a berth and a time. For example, a status before reservation is "unreserved". A status after reservation and before arrival of a vehicle is "unarrived". A status after arrival of a vehicle and before departure of the vehicle is "arrived". A status after departure of a vehicle is "departed".

[0068] For example, referring to Fig. 6, the car number "12-34" and the status "arrived" are registered for the berth "PA-1" and the time "20 August 7:00-8:00". This indicates that a vehicle having the car number "12-34" has reserved the use of the berth "PA-1" at the time "20 August 7:00-8:00" and the vehicle has arrived at the berth at that time.

[0069] The configuration example of the reservation information 231 has been described above.

[0070] (Contact Information 232) Fig. 7 is a diagram illustrating a configuration example of the contact information 232. As illustrated in Fig. 7, the contact information 232 is constructed by associating a car number and contact information with each other. For example, the contact information 232 is input by a driver of a vehicle and is registered in the storage unit 230. For example, the contact information may be contact information on a driver of a vehicle. For example, as illustrated in Fig. 7, the contact information may be an e-mail address of the driver terminal 70 of the driver.

[0071] For example, referring to Fig. 7, a car number "12-34" and contact information "abc@def.jp" are associated with each other. This indicates that contact information on a driver of a vehicle having the car number "12-34" is the e-mail address "abc@def.jp". Note that the contact information is not limited to an e-mail address of the driver terminal 70, and may be a phone number of the driver terminal 70.

[0072] The configuration example of the contact information 232 has been described above.

[0073] (Staying Time Information 233) Fig. 8 is a diagram illustrating a configuration example of the staying time information 233. As illustrated in Fig. 8, the staying time information 233 is constructed by associating a berth included in a base, a time, an arrival time, a departure time, and a staying time with one another.

[0074] The arrival time is a time at which a vehicle having a reservation for a berth and a time arrived at the berth. For example, Fig. 8 indicates that a vehicle having a reservation for the berth "PA-1" and the time "20 August 7:00-8:00" has arrived at the berth at the arrival time "7:10".

[0075] The departure time is a time at which a vehicle having a reservation for a berth and a time departed from the berth. For example, Fig. 8 indicates that a vehicle having a reservation for the berth "PA-n" and the time "20 August 7:00-8:00" has departed from the berth at the departure time "7:50".

[0076] The staying time is a time period during which a vehicle having a reservation for a berth and a time stays at the berth. For example, Fig. 8 indicates that a vehicle having a reservation for the berth "PA-n" and the time "20 August 7:00-8:00" has stayed at the berth for a staying time "0:45" from an arrival time "7:05" to a departure time "7:50".

[0077] Furthermore, Fig. 8 indicates that a vehicle having a reservation for the berth "PA-1" and the time "20 August 7:00-8:00" has not departed from the berth. Furthermore, Fig. 8 indicates that, when the current time is "8:20", the vehicle has stayed at the berth for a staying time "1:10" from an arrival time "7:10" to the current time "8:20".

[0078] The configuration example of the staying time information 233 has been described above. The description continues with reference back to Fig. 5.

[0079] (Communication Unit 240) The communication unit 240 is configured to include a communication interface, and communicates with the camera 10, the administrator terminal 60, and the driver terminal 70 through the network 30.

[0080] The functional configuration example of the server 20 according to the embodiment of the present disclosure has been described above.

[0081] (1.4. Operation Example of Server) Subsequently, mainly referring to Fig. 9 to Fig. 16, an operation example of the server 20 according to the embodiment of the present disclosure is described. Fig. 9 is a diagram for describing an example of recognizing entering of the vehicle TA-1 into the berth PA-n. Fig. 10 is a diagram for describing an example of recognizing exiting of the vehicle TA-1 from the berth PA-n.

[0082] (Manual Reservation Processing) Fig. 11 is a flowchart illustrating an example of manual reservation processing executed by the server 20 according to the embodiment of the present disclosure. More specifically, the flowchart illustrated in Fig. 11 is a flowchart illustrating an example of manual reservation processing executed by the server 20 when a driver of a vehicle manually makes a reservation for a berth and a time. Here, the case where a driver of the vehicle TA-1 makes a reservation for the base A and a time "20 August 7:00-8:00" is mainly assumed.

[0083] First, when the driver of the vehicle TA-1 inputs the "base A" and the time "20 August 7:00-8:00" to be reserved to an input device of the driver terminal 70, the "base A" and the time "20 August 7:00-8:00" are transmitted from the driver terminal 70 to the server 20. In the server 20, the acquisition unit 221 acquires the "base A" and the time "20 August 7:00-8:00" transmitted from the driver terminal 70 through the communication unit 240 (S111).

[0084] The processing unit 222 determines, on the basis of the reservation information 231, whether there is an unreserved berth at the base A and the time "20 August 7:00-8:00" acquired by the acquisition unit 221 (S112). When there is no unreserved berth at the base A and the time "20 August 7:00-8:00" ("NO" at S112), the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the reservation has failed is transmitted by the communication unit 240 to the administrator terminal 60 of the base A and the driver terminal 70 of the driver of the vehicle TA-1 as a reservation failure notification (S117).

[0085] On the other hand, when there is an unreserved berth at the base A and the time "20 August 7:00-8:00" ("YES" at S112), a car number "12-34" of the vehicle TA-1 is input by the driver to the input device of the driver terminal 70, and is transmitted from the driver terminal 70 to the server 20, and the acquisition unit 221 acquires the car number transmitted from the driver terminal 70 (S113).

[0086] Here, the case where a car number corresponding to the berth PA-1 included in the base A and the time "20 August 7:00-8:00" has not been registered in the reservation information 231 and the status is "unreserved" is assumed. In this case, the processing unit 222 registers the car number "12-34" of the vehicle TA-1, which has been input by the driver to the input device of the driver terminal 70, as a car number corresponding to the berth PA-1 included in the base A and the time "20 August 7:00-8:00" (S114).

[0087] The processing unit 222 updates the status that corresponds to the berth PA-1 included in the base A and the time "20 August 7:00-8:00" from "unreserved" to "unarrived" (S115). Then, the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the reservation has completed is transmitted by the communication unit 240 to the administrator terminal 60 of the base A and the driver terminal 70 of the driver of the vehicle TA-1 as a reservation completion notification (S116).

[0088] The example of the manual reservation processing executed by the server 20 according to the embodiment of the present disclosure has been described above.

[0089] (Berth-related Processing) Fig. 12 is a flowchart illustrating an example of berth-related processing executed by the server 20 according to the embodiment of the present disclosure. More specifically, the flowchart illustrated in Fig. 12 is a flowchart illustrating an example of berth-related processing repeatedly executed by the server 20 during the operation of the server 20.

[0090] As illustrated in Fig. 12, in the berth-related processing, entering-related processing S20 is executed, exiting-related processing S30 is executed, and staying time-related processing S50 is executed. Then, when the operation of the server 20 is not finished ("NO" at S60), the operation proceeds to S20. On the other hand, when the operation of the server 20 is finished ("YES" at S60), the berth-related processing is finished.

[0091] The example of the berth-related processing executed by the server 20 according to the embodiment of the present disclosure has been described above.

[0092] (Entering-related Processing) Fig. 13 is a flowchart illustrating an example of entering-related processing executed by the server 20 according to the embodiment of the present disclosure. More specifically, the flowchart illustrated in Fig. 13 is a flowchart illustrating an example of entering-related processing executed by the server 20 when called from the berth-related processing illustrated in Fig. 12. Here, the case where the vehicle TA-1 enters the berth PA-1 is mainly assumed.

[0093] As described above, the position of a license plate region and a car number are transmitted from each of the cameras 10A-1 to 10A-n and 10B-1 to 10B-n to the server 20. In the server 20, the acquisition unit 221 acquires, through the communication unit 240, the position of the license plate region and the car number transmitted from each of the cameras 10A-1 to 10A-n and 10B-1 to 10B-n.

[0094] The processing unit 222 calculates the size of a license plate in a frame (hereinafter sometimes simply referred to as "size of license plate") on the basis of the position of the license plate region transmitted from each of the cameras 10A-1 to 10A-n and 10B-1 to 10B-n. Here, the case where the size of the license plate is the area of the license plate is mainly assumed. It is considered that an error caused in the area of a license plate due to fluctuations of the license plate is small, and hence the recognition accuracy can be expected to improve. However, the size of the license plate may be the vertical length of the license plate, or may be the horizontal length of the license plate.

[0095] For example, when the position of the license plate region is expressed by coordinates of the upper left corner and coordinates of the lower right corner of the license plate region, the processing unit 222 can calculate the horizontal length of the license plate by subtracting the horizontal axis coordinate of the upper left corner from the horizontal axis coordinate of the lower right corner of the license plate region, and calculate the vertical length of the license plate by subtracting the vertical axis coordinate of the lower right coordinate from the vertical axis coordinate of the upper left corner of the license plate region. Furthermore, the processing unit 222 can calculate the area of the license plate by multiplying the horizontal length of the license plate and the vertical length of the license plate.

[0096] The processing unit 222 determines, on the basis of the sizes of the license plate calculated from a plurality of frames, whether there is a berth where a vehicle has entered (S211). When there is no berth where a vehicle has entered ("NO" at S211), the entering-related processing is finished. On the other hand, when there is a berth where a vehicle has entered ("YES" at S211), the operation of the processing unit 222 proceeds to S212. Here, the case where the vehicle TA-1 has entered the berth PA-1 is mainly assumed.

[0097] Referring to Fig. 9, an example of recognizing the entering of the vehicle TA-1 into the berth PA-1 is described. Referring to Fig. 9, a frame M0 and a frame M1 are illustrated. The frame M1 is a frame (second frame) obtained by the camera 10A-1 at a current time t1. The frame M0 is a frame (first frame) obtained by the camera 10A-1 at a time t0, which is earlier than the current time t1 by a predetermined time.

[0098] A vertical length H0 is the vertical length of a license plate N0 recognized from the frame M0. Furthermore, a horizontal length W0 is the horizontal length of the license plate N0 recognized from the frame M0. For example, the processing unit 222 can calculate the size (first size) of the license plate N0 by multiplying the vertical length H0 and the horizontal length W0.

[0099] Similarly, a vertical length H1 is the vertical length of a license plate N1 recognized from the frame M1. Furthermore, a horizontal length W1 is the horizontal length of the license plate N1 recognized from the frame M1. For example, the processing unit 222 can calculate the size (second size) of the license plate N1 by multiplying the vertical length H1 and the horizontal length W1. Here, the vehicle TA-1 enters the berth PA-1, and hence the size of the license plate N1 is larger than the size of the license plate N0.

[0100] The processing unit 222 compares the size of the license plate N0 recognized from the frame M0 obtained by the camera 10A-1 at the time earlier than the current time by the predetermined time with the size of the license plate N1 recognized from the frame M1 obtained by the camera 10A-1 at the current time to obtain a comparison result. The comparison result can include a comparison result indicating that the size of the license plate N1 is larger than the size of the license plate N0 by a first threshold or more (hereinafter sometimes referred to as "comparison result indicating size increase"), a comparison result indicating that the size of the license plate N1 is smaller than the size of the license plate N0 by a second threshold or more (hereinafter sometimes referred to as "comparison result indicating size decrease"), or a comparison result other than the size increase and the size decrease (hereinafter sometimes referred to as "comparison result indicating that the size is unchanged").

[0101] Note that the first threshold may be set to any positive value or may be set to zero. In the case where the first threshold is a positive value, when an increase amount from the size of the license plate N0 to the size of the license plate N1 (that is, an amount obtained by subtracting the size of the license plate N0 from the size of the license plate N1) is smaller than the first threshold, the comparison result indicates that the size has unchanged. Similarly, the second threshold may be set to any positive value or may be set to zero. In the case where the second threshold is a positive value, when a decrease amount from the size of the license plate N0 to the size of the license plate N1 (that is, an amount obtained by subtracting the size of the license plate N1 from the size of the license plate N0) is smaller than the second threshold, the comparison result indicates that the size has unchanged. The first threshold and the second threshold may be the same value or may be different values.

[0102] Then, when a condition that a phenomenon where the comparison result indicates the size increase has been detected at least once (that is, once or sequentially twice or more) (hereinafter sometimes referred to as "first entering condition") is satisfied, the processing unit 222 may recognize the entering of the vehicle TA-1 into the berth PA-1. In this manner, the entering of the vehicle TA-1 into the berth PA-1 can be recognized by the processing unit 222 with high accuracy.

[0103] Alternatively, there may be a case where a driver of the vehicle TA-1 performs driving of moving the vehicle TA-1 in the front-back direction (what is called turning driving)) in order to adjust the position and orientation of the vehicle TA-1 at the berth PA-1. In such a case, although the vehicle TA-1 is turned, the processing unit 222 may erroneously recognize the entering of the vehicle TA-1 into the berth PA-1.

[0104] Accordingly, in consideration that the recognition of a license plate may be dropped during the turning driving of the vehicle TA-1, the processing unit 222 may recognize the entering of the berth PA-1 into the vehicle TA-1 when the first entering condition is satisfied and when a condition that a time period during which the license plate is continuously recognized becomes equal to or larger than a predetermined first time period (second entering condition) is satisfied. In this manner, the possibility that the entering of the vehicle TA-1 is erroneously recognized can be reduced in such a case where, even when the size of the license plate of the vehicle TA-1 increases once, the vehicle TA-1 moves forward for turning driving so that the license plate is not recognized for a time period shorter than the first time period, and hence the entering of the vehicle TA-1 into the berth PA-1 can be recognized with higher accuracy.

[0105] Alternatively, the processing unit 222 may recognize the entering of the vehicle TA-1 into the berth PA-1 when the first entering condition is satisfied and when a condition that a time period during which the size of the license plate or the position of a license plate region does not change becomes equal to or larger than a predetermined second time period (third entering condition) is satisfied. In this manner, the possibility that the entering of the vehicle TA-1 is erroneously recognized can be reduced in such a case where, even when the size of the license plate of the vehicle TA-1 increases once, the vehicle TA-1 moves forward for turning driving so that the license plate moves for a time period shorter than the second time period, and hence the entering of the vehicle TA-1 into the berth PA-1 can be recognized with higher accuracy.

[0106] Alternatively, a case where the license plate of the vehicle TA-1 is not covered in the angle of view of the camera 10A-1 at a point at which the vehicle TA-1 is stopped at the berth PA-1 or a point immediately before the stop so that the license plate is not recognized is possible. Thus, the berth processing unit 222 may recognize the entering of the vehicle TA-1 into the berth PA-1 when the first entering condition is satisfied and when a condition that a time period during which the license plate is not recognized continues for a predetermined third time period or more (fourth entering condition) is satisfied. In this manner, the possibility that the entering of the vehicle TA-1 is erroneously recognized can be reduced in such a case where, even when the size of the license plate of the vehicle TA-1 increases once, the vehicle TA-1 moves forward for turning driving so that the license plate is not recognized for a time period shorter than the third time period, and hence the entering of the vehicle TA-1 into the berth PA-1 can be recognized with higher accuracy.

[0107] The description continues with reference back to Fig. 13. The processing unit 222 determines, on the basis of the reservation information 231, whether a status corresponding to the berth PA-1 where the vehicle TA-1 has entered and a time period to which the current time belongs indicates "unarrived" (S212).

[0108] When the status does not indicate "unarrived" ("NO" at S212), the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the status is abnormal is transmitted by the communication unit 240 to the administrator terminal 60 of the base A and the driver terminal 70 of the driver of the vehicle TA-1 as a status abnormality notification (S213).

[0109] On the other hand, when the status indicates "unarrived" ("YES" at S212), the acquisition unit 221 acquires a car number of the vehicle TA-1 output from the camera 10A-1. Here, the case where the acquisition unit 221 acquires the car number "12-34" of the vehicle TA-1 output from the camera 10A-1 is assumed.

[0110] Then, the processing unit 222 acquires a car number corresponding to the berth PA-1 and a time period to which the current time belongs that has been registered in the reservation information 231. Here, the case where the acquisition unit 221 acquires the car number "12-34" as a car number corresponding to the berth PA-1 and a time period to which the current time belong that has been registered in the reservation information 231 is assumed.

[0111] The processing unit 222 collates the car number of the vehicle TA-1 acquired from the camera 10A-1 with the car number acquired from the reservation information 231 (S214). Note that whether the collation has succeeded may be determined by whether all of corresponding four figures of the car numbers match. Alternatively, the collation may be determined to have succeeded when a part of corresponding four figures of the car numbers match. When the collation has not succeeded ("NO" at S214), the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the collation of the car numbers has failed is transmitted to the administrator terminal 60 of the base A and the driver terminal 70 of the driver of the vehicle TA-1 as a car number collation failure notification (S215).

[0112] On the other hand, when the collation has succeeded ("YES" at S214), the processing unit 222 updates a status corresponding to the berth PA-1 and the time period to which the current time belongs in the reservation information 231 from "unarrived" to "arrived" (S216). Then, the processing unit 222 registers the current time to an arrival time corresponding to the berth PA-1 and the time period to which the current time belongs in the staying time information 233 (S217). Furthermore, the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the collation of the car numbers has succeeded is transmitted to the administrator terminal 60 of the base A and the driver terminal 70 of the driver of the vehicle TA-1 as a car number collation success notification.

[0113] Note that, in Fig. 13, the case where the determinations are made in the order of S211, S212, and S214 is illustrated as an example. However, the determinations at S211, S212, and S214 are not necessarily required to be executed in the order illustrated in Fig. 13.

[0114] Furthermore, a case where the license plate of the vehicle TA-1 is not recognized though the vehicle TA-1 has entered the berth PA-1 is possible. Thus, when the license plate is not recognized even a predetermined time (for example, 10 minutes) has elapsed from the start time "7:00" of the reservation time "20 August 7:00-8:00" of the berth PA-1, the transmission control unit 223 may control the communication unit 240 such that a notification indicating that a vehicle does not arrive at the reserved berth is transmitted to the administrator terminal 60 of the base A and the driver terminal 70 of the driver of the vehicle TA-1.

[0115] The example of the entering-related processing executed by the server 20 according to the embodiment of the present disclosure has been described above.

[0116] (Exiting-related Processing) Fig. 14 is a flowchart illustrating an example of exiting-related processing executed by the server 20 according to the embodiment of the present disclosure. More specifically, the flowchart illustrated in Fig. 14 is a flowchart illustrating an example of exiting-related processing executed by the server 20 when called from the berth-related processing illustrated in Fig. 12. Here, the case where the vehicle TA-1 exits from the berth PA-1 is mainly assumed.

[0117] The processing unit 222 determines, on the basis of the sizes of a license plate calculated from a plurality of frames, whether there is a berth where a vehicle has exited (S311). When there is no berth where a vehicle has exited ("NO" at S311), the exiting-related processing is finished. On the other hand, when there is a berth where a vehicle has exited ("YES" at S311), the operation of the processing unit 222 proceeds to S312. Here, the case where the vehicle TA-1 has exited from the berth PA-1 is mainly assumed.

[0118] Referring to Fig. 10, an example of recognizing the exiting of the vehicle TA-1 from the berth PA-1 is described. Referring to Fig. 10, a frame M2 and a frame M3 are illustrated. The frame M3 is a frame (fourth frame) obtained by the camera 10A-1 at a current time t3. The frame M2 is a frame (third frame) obtained by the camera 10A-1 at a time t2 that is earlier than the current time t3 by a predetermined time.

[0119] A vertical length H2 is the vertical length of a license plate N2 recognized from the frame M2. Furthermore, a horizontal length W2 is the horizontal length of the license plate N2 recognized from the frame M2. For example, the processing unit 222 can calculate the size (third size) of the license plate N2 by multiplying the vertical length H2 and the horizontal length W2.

[0120] Similarly, a vertical length H3 is the vertical length of a license plate N3 recognized from the frame M3. Furthermore, a horizontal length W3 is the horizontal length of the license plate N3 recognized from the frame M3. For example, the processing unit 222 can calculate the size (fourth size) of the license plate N3 by multiplying the vertical length H3 and the horizontal length W3. Here, the vehicle TA-1 exits from the berth PA-1, and hence the size of the license plate N3 is smaller than the size of the license plate N2.

[0121] The processing unit 222 compares the size of the license plate N2 recognized from the frame M2 obtained by the camera 10A-1 at the time earlier than the current time by the predetermined time with the size of the license plate N3 recognized from the frame M3 obtained by the camera 10A-1 at the current time to obtain a comparison result. Then, the processing unit 222 may recognize the exiting of the vehicle TA-1 from the berth PA-1 when a condition that a situation where the size of the license plate N3 recognized from the frame M3 is smaller than the size of the license plate N2 recognized from the frame M2 obtained by the camera 10A-1 at a time earlier than the current time by a predetermined time by a second threshold or more is detected at least once (that is, once or consecutively twice or more) (exiting condition) is satisfied. In this manner, the exiting of the vehicle TA-1 from the berth PA-1 can be recognized by the processing unit 222 with high accuracy.

[0122] The description continues with reference back to Fig. 14. The processing unit 222 determines, on the basis of the reservation information 231, whether a status corresponding to the berth PA-1 where the vehicle TA-1 has exited and a time period to which the current time belongs indicates "arrived" (S312).

[0123] When the status does not indicates "arrived" ("NO" at S312), the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the status is abnormal is transmitted by the communication unit 240 to the administrator terminal 60 of the base A and the driver terminal 70 of the driver of the vehicle TA-1 as a status abnormality notification (S313).

[0124] On the other hand, when the status indicates "arrived" ("YES" at S312), the acquisition unit 221 acquires a car number of the vehicle TA-1 output from the camera 10A-1. Here, the case where the acquisition unit 221 has acquired the car number "12-34" of the vehicle TA-1 output from the camera 10A-1 is assumed.

[0125] Then, the processing unit 222 acquires a car number corresponding to the berth PA-1 and the time period to which the current time belongs that has been registered in the reservation information 231. Here, the case where the acquisition unit 221 has acquired the car number "12-34" as a car number corresponding to the berth PA-1 and the time period to which the current time belongs that has been registered in the reservation information 231 is assumed.

[0126] The processing unit 222 collates the car number of the vehicle TA-1 acquired from the camera 10A-1 with the car number acquired from the reservation information 231 (S314). When the collation has not succeeded ("NO" at S314), the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the collation of the car numbers has failed is transmitted to the administrator terminal 60 of the base A and the driver terminal 70 of the driver of the vehicle TA-1 as a car number collation failure notification (S315).

[0127] On the other hand, when the collation has succeeded ("YES" at S314), the processing unit 222 updates a status corresponding to the berth PA-1 and the time period to which the current time belongs in the reservation information 231 from "arrived" to "departed" (S316). Then, the processing unit 222 registers the current time to a departure time corresponding to the berth PA-1 and the time period to which the current time belongs in the staying time information 233 (S317).

[0128] The example of the exiting-related processing executed by the server 20 according to the embodiment of the present disclosure has been described above.

[0129] (Automated Reservation Processing) Fig. 15 is a flowchart illustrating an example of automated reservation processing S40 executed by the server 20 according to the embodiment of the present disclosure. More specifically, the flowchart illustrated in Fig. 15 is a flowchart illustrating an example of automated reservation processing executed by the server 20 when called from the exiting-related processing illustrated in Fig. 14. Here, the case where a reservation for the base B next to the base A where the vehicle TA-1 has departed and a time for staying of the vehicle TA-1 at the next base B is automatically made is assumed.

[0130] First, the processing unit 222 predicts the base B as a movement destination of the vehicle TA-1 that has departed from the base A and a time for staying of the vehicle TA-1 at the base B as the movement destination (S411). Here, the base B as the movement destination of the vehicle TA-1 and the time for staying of the vehicle TA-1 at the base B as the movement destination may be predicted in any manner.

[0131] For example, when a route indicating that a base as a movement destination of the vehicle TA-1 from the base A is the base B has been registered in the storage unit 230 in advance, the base B as a movement destination may be predicted from the route registered in the storage unit 230. Furthermore, the time for staying of the vehicle TA-1 at the base B as the movement destination may be a time after a time belonging to the departure time of the vehicle TA-1 from the base A (for example, time next to time to which the departure time belongs).

[0132] Here, the case where a time period to which a departure time of the vehicle TA-1 from the base A belongs is "20 August 8:00-9:00" and a time "20 August 9:00-10:00" next to the time "20 August 8:00-9:00" to which the departure time belongs is predicted to be a time period during which the vehicle TA-1 stays at the base B as the movement destination is mainly assumed.

[0133] The processing unit 222 determines, on the basis of the reservation information 231, whether there is an unreserved berth at the predicted base B and the predicted time "20 August 9:00-10:00" (S412). When there is no unreserved berth at the base B and in the time "20 August 9:00-10:00" ("NO" at S412), the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the reservation has failed is transmitted by the communication unit 240 to the administrator terminal 60 of the base B and the driver terminal 70 of the driver of the vehicle TA-1 as a reservation failure notification (S417).

[0134] On the other hand, when there is an unreserved berth at the base B and in the time "20 August 9:00-10:00" ("YES" at S412), a car number "12-34" of the vehicle TA-1 that has already been input by the driver is acquired.

[0135] Here, the case where a car number corresponding to the berth PB-1 included in the base B and the time "20 August 9:00-10:00" in the reservation information 231 is not registered and its status is "unreserved" is assumed. In this case, the processing unit 222 registers the recognized car number "12-34" of the vehicle TA-1 as a car number corresponding to the berth PB-1 included in the base B and the time "20 August 9:00-10: 00" (S414).

[0136] The processing unit 222 updates a status corresponding to the berth PB-1 included in the base B and the time "20 August 9:00-10:00" from "unreserved" to "unarrived" (S415). Then, the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the reservation has completed is transmitted by the communication unit 240 to the administrator terminal 60 of the base B and the driver terminal 70 of the driver of the vehicle TA-1 as a reservation completion notification (S416).

[0137] The example of the automated reservation processing executed by the server 20 according to the embodiment of the present disclosure has been described above.

[0138] (Staying Time-related Processing) Fig. 16 is a flowchart illustrating an example of staying time-related processing executed by the server 20 according to the embodiment of the present disclosure. More specifically, the flowchart illustrated in Fig. 16 is a flowchart illustrating an example of staying time-related processing executed by the server 20 when called from the berth-related processing illustrated in Fig. 12. Here, the case where the current time is "8:20" is mainly assumed.

[0139] First, the processing unit 222 determines whether a predetermined time has elapsed (S511). For example, the predetermined time may elapse at a predetermined cycle (for example, 5 minutes). When the predetermined time has not elapsed ("NO" at S511), staying time-related processing is finished. On the other hand, when the predetermined time has elapsed ("YES" at S511), the processing unit 222 calculates staying times of vehicles at each of the berths PA-1 to PA-n and PB-1 to PB-n (S512).

[0140] Referring to the staying time information 233 (Fig. 8), in regard to the berth PA-n and the time "20 August 7:00-8:00", the arrival time of the vehicle TA-n is "7:05", and the departure time of the vehicle TA-n is "7:50". In such a case where the departure time has been registered, the processing unit 222 can calculate a staying time "0:45" of the vehicle TA-n at the berth PA-n by subtracting the arrival time "7:05" from the departure time "7:50".

[0141] Furthermore, referring to the staying time information 233 (Fig. 8), in regard to the berth PA-1 and the time "20 August 7:00-8:00", the arrival time of the vehicle TA-1 is "7:10", and a departure time of the vehicle TA-n has not been registered. In such a case where the departure time has not been registered, the processing unit 222 can calculate a staying time "1:10" of the vehicle TA-1 at the berth PA-1 by subtracting the arrival time "7:10" from the current time "8:20".

[0142] The processing unit 222 determines whether staying times of vehicles at the berths PA-1 to PA-n and PB-1 to PB-n exceed a threshold (third threshold) (S513). When all of the staying times of vehicles at the berths PA-1 to PA-n and PB-1 to PB-n are equal to or smaller than the threshold ("NO" at S513), the staying time-related processing is finished.

[0143] On the other hand, when at least one of the staying times of vehicles at the berths PA-1 to PA-n and PB-1 to PB-n exceeds the threshold ("YES" at S513), the transmission control unit 223 controls the communication unit 240 such that a notification indicating that the staying time of the vehicle at the berth exceeds the threshold is transmitted by the communication unit 240 to the administrator terminal 60 and the driver terminal 70 of a driver of a vehicle whose staying time at the berth exceeds the threshold as a staying time exceed notification (S514).

[0144] For example, when the threshold is 1 hour, referring to the staying time information 233 (Fig. 8), in regard to the berth PA-1 and the time "20 August 7:00-8:00", the staying time "1:10" of the vehicle TA-1 exceeds 1 hour as the threshold. Then, the transmission control unit 223 may control the communication unit 240 such that a notification indicating that the staying time of the vehicle TA-1 at the berth PA-1 exceeds the threshold is transmitted by the communication unit 240 to the administrator terminal 60 of the base A and the driver terminal 70 of the driver of the vehicle TA-1 as a staying time exceed notification.

[0145] On the other hand, referring to the staying time information 233 (Fig. 8), in regard to the berth PA-n and the time "20 August 7:00-8:00", the staying time "0:45" of the vehicle TA-n is equal to or smaller than 1 hour as the threshold. Then, a notification indicating that the staying time of the vehicle TA-n at the berth PA-n exceeds the threshold is not required to be transmitted.

[0146] Furthermore, in regard to the berth PB-n and the time "20 August 7:00-8:00", the staying time "1:20" of the vehicle TB-1 exceeds 1 hour as the threshold. Then, the transmission control unit 223 may control the communication unit 240 such that a notification indicating that the staying time of the vehicle TB-n at the berth PB-n exceeds the threshold is transmitted by the communication unit 240 to the administrator terminal 60 of the base B and the driver terminal 70 of the driver of the vehicle TB-n as a staying time exceed notification.

[0147] The example of the staying time-related processing executed by the server 20 according to the embodiment of the present disclosure has been described above.

[0148] <2. Hardware Configuration Example> Subsequently, a hardware configuration example of the information processing apparatus 900 as an example of the server 20 according to the embodiment of the present disclosure is described with reference to Fig. 17. Fig. 17 is a block diagram illustrating a hardware configuration example of the information processing apparatus 900. Note that the server 20 is not necessarily required to have the entire hardware configuration illustrated in Fig. 17, and a part of the hardware configuration illustrated in Fig. 17 may be omitted in the server 20.

[0149] As illustrated in Fig. 17, the information processing apparatus 900 includes a CPU (Central Processing unit) 901, a ROM (Read Only Memory) 902, and a RAM (Random Access Memory) 903. Furthermore, the information processing apparatus 900 may include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925. The information processing apparatus 900 may have, instead of or together with the CPU 901, a processing circuit called DSP (Digital Signal Processor) or ASIC (Application Specific Integrated Circuit).

[0150] The CPU 901 functions as an arithmetic processing unit and a control device, and controls the whole or part of operations in the information processing apparatus 900 in accordance with various kinds of programs recorded in the ROM 902, the RAM 903, the storage device 919, or a removable recording medium 927. The ROM 902 stores therein programs and arithmetic parameters used by the CPU 901. The RAM 903 temporarily stores therein programs used for the execution of the CPU 901 and parameters that change as appropriate in the execution. The CPU 901, the ROM 902, and the RAM 903 are mutually connected by the host bus 907 configured by an internal bus such as a CPU bus. Furthermore, the host bus 907 is connected to the external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus through the bridge 909.

[0151] The input device 915 is, for example, a device such as a button to be operated by a user. The input device 915 may include a mouse, a keyboard, a touch panel, a switch, and a lever. Furthermore, the input device 915 may include a microphone configured to detect voice of a user. The input device 915 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device 929 such as a mobile phone that supports the operation of the information processing apparatus 900. The input device 915 includes an input control circuit configured to generate an input signal on the basis of information input by a user and output the input signal to the CPU 901. By operating the input device 915, the user inputs various kinds of data and instructs processing operations to the information processing apparatus 900. Furthermore, an imaging device 933 to be described later may function as an input device by imaging the motion of a hand of a user or a finger of the user. In this case, a pointing position may be determined in accordance with the motion of a hand or the orientation of a finger.

[0152] The output device 917 is configured by a device capable of notifying a user of the acquired information visually or auditorily. The output device 917 may be, for example, a display device such as an LCD (Liquid Crystal Display) and an organic EL (Electro-Luminescence) display or a sound output device such as a speaker and headphones. Furthermore, the output device 917 may include a PDP (Plasma Display Panel), a projector, a hologram, and a printer device. The output device 917 outputs results obtained by processing in the information processing apparatus 900 as video such as text and images and as sound such as voice and audio. Furthermore, the output device 917 may include a light for brightening the surroundings.

[0153] The storage device 919 is a device for data storage, which is configured as an example of a storage unit in the information processing apparatus 900. For example, the storage device 919 is configured by a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. The storage device 919 stores therein programs and various kinds of data executed by the CPU 901 and various kinds of data acquired from the outside.

[0154] The drive 921 is a reader / writer for the removable recording medium 927 such as a magnetic disk, an optical disc, a magneto-optical disk, or a semiconductor memory, and is built in or externally connected to the information processing apparatus 900. The drive 921 reads information recorded in the mounted removable recording medium 927, and outputs the information to the RAM 903. Furthermore, the drive 921 writes records in the mounted removable recording medium 927.

[0155] The connection port 923 is a port for connecting a device directly to the information processing apparatus 900. The connection port 923 may be, for example, a USB (Universal Serial Bus) port, an IEEE1394 port, or an SCSI (Small Computer System Interface) port. Furthermore, the connection port 923 may be an RS-232C port, an optical audio terminal, or an HDMI (registered trademark) (High-Definition Multimedia Interface) port. By connecting the external connection device 929 to the connection port 923, various kinds of data can be exchanged between the information processing apparatus 900 and the external connection device 929.

[0156] The communication device 925 is, for example, a communication interface configured by a communication device for connection to the network 931. The communication device 925 may be, for example, a communication card for a wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), or WUSB (Wireless USB). Furthermore, the communication device 925 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a model for various kinds of communications. For example, the communication device 925 transmits and receives signals to and from the Internet and other communication devices by using a predetermined protocol such as TCP / IP. Furthermore, the network 931 connected to the communication device 925 is a network connected in a wired or wireless manner, and is, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.

[0157] <3. Conclusion> According to the embodiment of the present disclosure, the server 20 including the processing unit 222 configured to recognize, on the basis of the size of a license plate recognized from each of a plurality of frames, entering of a vehicle into a berth or exiting of a vehicle from a berth is provided. With such a configuration, the entering of a vehicle into a berth or the exiting of a vehicle from a berth can be recognized with high accuracy.

[0158] While the exemplary embodiment of the present disclosure has been described in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to the examples. It should be understood that a person having ordinary skills in the technical field of the present disclosure could conceive of various kinds of changes and modifications within the range of the technical concept as recited in the claims, and such changes and modifications should belong to the technical concept of the present disclosure.

[0159] For example, in the entering-related processing S20 (Fig. 13), an example in which in a case where there is a berth where a vehicle has entered, when the status indicates "unarrived" ("YES" at S212) and when the collation of car numbers has succeeded ("YES" at S214), the updating of the status (S216) and the registration of the arrival time (S217) are performed has been described. However, there may be a case where there is no status in the reservation information 231. Alternatively, there may be a case where there is no car number in the reservation information 231.

[0160] For example, when there is no status in the reservation information 231, the operation of determining whether a status indicates "unarrived" (S212) may be omitted. Alternatively, when there is no car number in the reservation information 231, the operation of determining whether collation of car numbers has succeeded (S214) may be omitted.

[0161] Similarly, in the exiting-related processing S30 (Fig. 14), an example in which in a case where there is a berth where a vehicle has exited, when the status indicates "arrived" ("YES" at S312) and when the collation of car numbers has succeeded ("YES" at S314), the updating of the status (S316) and the registration of the departure time (S317) are performed has been described.

[0162] However, when there is no status in the reservation information 231, the operation of determining whether a status indicates "arrived" (S312) may be omitted. Alternatively, when there is no car number in the reservation information 231, the operation of determining whether collation of car numbers has succeeded (S314) may be omitted.

[0163] Furthermore, the server 20 may adjust the parameters of the camera 10 as appropriate. For example, when the processing unit 222 detects that the brightness of a frame output from the camera 10 is lower than a threshold or when the processing unit 222 detects backlight from a frame output from the camera 10, the transmission control unit 223 may output an instruction to increase an exposure time of the image sensor 110 to the CIS signal processing unit 120. The CIS signal processing unit 120 may increase the exposure time of the image sensor 110 in accordance with such an instruction.

[0164] Furthermore, the processing unit 222 may learn the recognition model 140 again on the basis of frames output from the camera 10. For example, a case where the detection rate of a license plate based on frames output from the camera 10 in the processing unit 222 is outside a predetermined range may be assumed. In such a case, the processing unit 222 may generate a frame for relearning by using simulation technology such that the recognition model 140 is learned again by using the generated frame for relearning.

[0165] Furthermore, the effects described herein are merely explanatory and illustrative and are not limited. In other words, the technology according to the present disclosure could exhibit, together with the above-mentioned effects or instead of the above-mentioned effects, other effects that are obvious to a person skilled in the art from the description of the specification.

[0166] Note that the following configurations also belong to the technical scope of the present disclosure. (1) An information processing system, comprising: an image sensor configured to capture a plurality of images; and first processing circuitry configured to recognize a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of the plurality of images processed by an image signal processor included in the image sensor, transmit, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein the first time t0 is earlier than the second time t1, wherein in a case that a size of the license plate at the second time t1 is larger than a size of the license plate at the first time t0, the vehicle enters the parking space, and wherein in a case that the size of the license plate at the second time t1 is smaller than the size of the license plate at the first time t0, the vehicle exits the parking space. (2) The information processing system of (1), further comprising: the server, wherein the server includes second processing circuitry configured to generate a comparison result based on comparing the size of the license plate in the second frame with the first frame. (3) The information processing system of (2), wherein the second processing circuitry is further configured to in a case that the comparison result indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is less than a first threshold, determine that a size of the license plate is unchanged. (4) The information processing system of (2), wherein the second processing circuitry is further configured to in a case that the comparison result indicating that a decrease amount of the size of the license plate in the first frame compared to the second frame is less than a second threshold, determine that a size of the license plate is unchanged. (5) The information processing system of (2), wherein the second processing circuitry is further configured to in a case that the comparison result satisfies a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once, determine that the vehicle enters the parking space. (6) The information processing system of (2), wherein the second processing circuitry is further configured to in a case that a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once is satisfied and a second entering condition indicating that a time period during which the license plate is continuously recognized for at least a first time period is satisfied, determine that the vehicle enters the parking space. (7) The information processing system of (2), wherein the second processing circuitry is further configured to in a case that a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once is satisfied and a third entering condition indicating that a time period during which the size of the license plate does not change during a second time period is satisfied, determine that the vehicle enters the parking space. (8) The information processing system of (2), wherein the second processing circuitry is further configured to in a case that a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once is satisfied and a fourth entering condition indicating that a time period during which the license plate is not recognized continues for a third time period, determine that the vehicle enters the parking space. (9) The information processing system of (2), wherein the second processing circuitry is further configured to in a case that an exiting condition indicating a decrease amount of the size of the license plate in a fourth frame compared to a third frame obtained earlier than the fourth frame is detected at least once is satisfied, determine that the vehicle exits the parking space. (10) The information processing system of (2), wherein the second processing circuitry is further configured to determine whether a license plate number recognized by a trained model matches a reservation information license plate number stored in a memory of the server, and in response to a determination that the license plate number matches the reservation information license plate number, register a current time as an arrival time. (11) The information processing system of (10), wherein the second processing circuitry is further configured to in response to a determination that the license plate number matches the reservation information license plate number, update an arrival status in the reservation information to indicate that the vehicle arrived. (12) The information processing system of (2), wherein, in response to the vehicle exiting the parking space, the second processing circuitry is further configured to determine a next parking destination of the vehicle and an amount of time that the vehicle stays at the next parking destination, determine whether there is an unreserved parking space at the determined next parking destination, in a case that there is an unreserved parking space at the determined next parking destination, automatically reserve the unreserved parking space for the vehicle. (13) The information processing system of (1), wherein the first processing circuitry is further configured to in a case that a brightness of a frame of the plurality of frames is lower than a threshold or a backlight is detected, receive instructions from the server to increase an exposure time of the image sensor. (14) The information processing system of (1), wherein the first processing circuitry is included in the image sensor. (15) A method, comprising: recognizing a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of a plurality of images processed by an image signal processor included in an image sensor; transmitting, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein the first time t0 is earlier than the second time t1; wherein in a case that a size of the license plate at the second time t1 is larger than a size of the license plate at the first time t0, the vehicle enters the parking space; and wherein in a case that the size of the license plate at the second time t1 is smaller than the size of the license plate at the first time t0, the vehicle exits the parking space. (16) The method of (14), further comprising: generating a comparison result based on comparing the size of the license plate in the second frame with the first frame. (17) The method of (15), further comprising: in a case that the comparison result satisfies a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once, determining that the vehicle enters the parking space. (18) The method of (15), further comprising: in a case that an exiting condition indicating a decrease amount of the size of the license plate in a fourth frame compared to a third frame obtained earlier than the fourth frame is detected at least once is satisfied, determining that the vehicle exits the parking space. (19) The method of (15), further comprising: determining whether a license plate number recognized by a trained model matches a reservation information license plate number stored in a memory of the server; and in response to a determination that the license plate number matches the reservation information license plate number, registering a current time as an arrival time. (20) The method of (18), further comprising: in response to a determination that the license plate number matches the reservation information license plate number, updating an arrival status in the reservation information to indicate that the vehicle arrived. (21) A non-transitory computer-readable storage medium storing computer-readable instructions thereon which, when executed by a computer, cause the computer to perform a method, the method comprising: recognizing a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of a plurality of images processed by an image signal processor included in an image sensor; transmitting, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein the first time t0 is earlier than the second time t1; wherein in a case that a size of the license plate at the second time t1 is larger than a size of the license plate at the first time t0, the vehicle enters the parking space; and wherein in a case that the size of the license plate at the second time t1 is smaller than the size of the license plate at the first time t0, the vehicle exits the parking space.

[0167] Note that the following configurations also belong to the technical scope of the present disclosure. (1) An information processing apparatus, including a processing unit configured to recognize, on the basis of a size of a license plate, which is recognized from each of a plurality of images obtained by a camera, in each of the plurality of images, entering of a vehicle into a parking space associated with the camera or exiting of the vehicle from the parking space. (2) The information processing apparatus according to the item (1), in which, when the processing unit recognizes the entering of the vehicle into the parking space or the exiting of the vehicle from the parking space, the processing unit acquires a car number of the vehicle, the car number being output on the basis of the plurality of images. (3) The information processing apparatus according to the item (2), in which the processing unit collates the acquired car number with a car number registered in reservation information on the parking space. (4) The information processing apparatus according to the item (3), in which the information processing apparatus includes a transmission control unit configured to control, on the basis of a fact that the collation has failed, transmission of a notification indicating that the collation has failed. (5) The information processing apparatus according to the item (3), in which, when the processing unit recognizes the entering of the vehicle into the parking space, the processing unit registers, on the basis of a fact that the collation has succeeded, a current time as a time of arrival of the vehicle at the parking space. (6) The information processing apparatus according to the item (1), in which, when the processing unit recognizes the entering of the vehicle into the parking space, the processing unit determines whether a status of the parking space indicates "unarrived". (7) The information processing apparatus according to the item (6), in which the processing unit registers, on the basis of a fact that the status of the parking space has been determined to indicate "unarrived", a current time as a time of arrival of the vehicle at the parking space. (8) The information processing apparatus according to the item (6), in which the information processing apparatus includes a transmission control unit configured to control, on the basis of a fact that the status has been determined not to indicate "unarrived", transmission of a notification indicating that the status is abnormal. (9) The information processing apparatus according to the item (5), in which, when the processing unit recognizes the exiting of the vehicle from the parking space, the processing unit registers, on the basis of a fact that the collation has succeeded, a current time as a time of departure of the vehicle from the parking space. (10) The information processing apparatus according to the item (7), in which, when the processing unit recognizes the exiting of the vehicle from the parking space, the processing unit determines whether a status of the parking space indicates "arrived". (11) The information processing apparatus according to the item (10), in which the processing unit registers, on the basis of a fact that the status of the parking space has been determined to indicate "arrived", a current time as a departure time of the vehicle from the parking space. (12) The information processing apparatus according to the item (9) or (11), in which the processing unit calculates a staying time of the vehicle at the parking space by subtracting the time of arrival of the vehicle at the parking space from the current time or the time of departure of the vehicle from the parking space. (13) The information processing apparatus according to the item (12), in which the processing unit determines whether the staying time exceeds a third threshold. (14) The information processing apparatus according to the item (2), in which, when the processing unit recognizes the exiting of the vehicle from the parking space, the processing unit registers the recognized car number to information on reservation for an unreserved parking space located at a base, which is destination of the vehicle, at a time after a time of departure of the parking space. (15) The information processing apparatus according to the item (1), in which the plurality of images include a first image and a second image posterior to the first image, and the processing unit recognizes the entering of the vehicle into the parking space on the basis of a fact that a condition, under which a situation where a second size of the license plate recognized from the second image is larger than a first size of the license plate recognized from the first image by a first threshold or more is detected at least once, is satisfied. (16) The information processing apparatus according to the item (15), in which the processing unit recognizes the entering of the vehicle into the parking space when the condition is satisfied and when a time period during which the license plate is continuously recognized becomes equal to or larger than a predetermined first time period. (17) The information processing apparatus according to the item (15), in which the processing unit recognizes the entering of the vehicle into the parking space when the condition is satisfied and when a time period during which a size of the license plate or a position of a license plate region does not change becomes equal to or larger than a predetermined second time period. (18) The information processing apparatus according to the item (15), in which the processing unit recognizes the entering of the vehicle into the parking space when the condition is satisfied and when a time period during which the license plate is not recognized continues for a predetermined third time period or more. (19) The information processing apparatus according to the item (1), in which the plurality of images include a third image and a fourth image posterior to the third image, and the processing unit recognizes the exiting of the vehicle from the parking space on the basis of a fact under which a condition that a fourth size of the license plate recognized from the fourth image is smaller than a third size of the license plate recognized from the third image by a second threshold or more, is satisfied. (20) The information processing apparatus according to the item (1), in which the camera is provided behind or diagonally behind a vehicle to be parked in the parking space. (21) An information processing method, including, recognizing, by a processor, on the basis of a size of a license plate, which is recognized from each of a plurality of images obtained by a camera, in each of the plurality of images, entering of a vehicle into a parking space associated with the camera or exiting of the vehicle from the parking space. (22) An information processing system, including: a camera configured to obtain a plurality of images by image-capturing; and an information processing apparatus including a processing unit configured to recognize, on the basis of a size of a license plate, which is recognized from each of the plurality of images, in each of the plurality of images, entering of a vehicle into a parking space associated with the camera or exiting of the vehicle from the parking space.

[0168] 1 Information processing system 10 Camera 110 Image sensor 120 CIS signal processing unit 130 ISP unit 140 Recognition model 20 Server 220 Control unit 221 Acquisition unit 222 Processing unit 223 Transmission control unit 230 Storage unit 231 Reservation information 232 Contact information 233 Staying time information 240 Communication unit 30 Network 60 Administrator terminal 70 Driver terminal

Claims

1. An information processing system, comprising: an image sensor configured to capture a plurality of images; and first processing circuitry configured to recognize a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of the plurality of images processed by an image signal processor included in the image sensor, transmit, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein the first time t0 is earlier than the second time t1, wherein in a case that a size of the license plate at the second time t1 is larger than a size of the license plate at the first time t0, the vehicle enters the parking space, and wherein in a case that the size of the license plate at the second time t1 is smaller than the size of the license plate at the first time t0, the vehicle exits the parking space.

2. The information processing system of claim 1, further comprising: the server, wherein the server includes second processing circuitry configured to generate a comparison result based on comparing the size of the license plate in the second frame with the first frame.

3. The information processing system of claim 2, wherein the second processing circuitry is further configured to in a case that the comparison result indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is less than a first threshold, determine that a size of the license plate is unchanged.

4. The information processing system of claim 2, wherein the second processing circuitry is further configured to in a case that the comparison result indicating that a decrease amount of the size of the license plate in the first frame compared to the second frame is less than a second threshold, determine that a size of the license plate is unchanged.

5. The information processing system of claim 2, wherein the second processing circuitry is further configured to in a case that the comparison result satisfies a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once, determine that the vehicle enters the parking space.

6. The information processing system of claim 2, wherein the second processing circuitry is further configured to in a case that a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once is satisfied and a second entering condition indicating that a time period during which the license plate is continuously recognized for at least a first time period is satisfied, determine that the vehicle enters the parking space.

7. The information processing system of claim 2, wherein the second processing circuitry is further configured to in a case that a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once is satisfied and a third entering condition indicating that a time period during which the size of the license plate does not change during a second time period is satisfied, determine that the vehicle enters the parking space.

8. The information processing system of claim 2, wherein the second processing circuitry is further configured to in a case that a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once is satisfied and a fourth entering condition indicating that a time period during which the license plate is not recognized continues for a third time period, determine that the vehicle enters the parking space.

9. The information processing system of claim 2, wherein the second processing circuitry is further configured to in a case that an exiting condition indicating a decrease amount of the size of the license plate in a fourth frame compared to a third frame obtained earlier than the fourth frame is detected at least once is satisfied, determine that the vehicle exits the parking space.

10. The information processing system of claim 2, wherein the second processing circuitry is further configured to determine whether a license plate number recognized by a trained model matches a reservation information license plate number stored in a memory of the server, and in response to a determination that the license plate number matches the reservation information license plate number, register a current time as an arrival time.

11. The information processing system of claim 10, wherein the second processing circuitry is further configured to in response to a determination that the license plate number matches the reservation information license plate number, update an arrival status in the reservation information to indicate that the vehicle arrived.

12. The information processing system of claim 2, wherein, in response to the vehicle exiting the parking space, the second processing circuitry is further configured to determine a next parking destination of the vehicle and an amount of time that the vehicle stays at the next parking destination, determine whether there is an unreserved parking space at the determined next parking destination, in a case that there is an unreserved parking space at the determined next parking destination, automatically reserve the unreserved parking space for the vehicle.

13. The information processing system of claim 1, wherein the first processing circuitry is further configured to in a case that a brightness of a frame of the plurality of frames is lower than a threshold or a backlight is detected, receive instructions from the server to increase an exposure time of the image sensor.

14. The information processing system of claim 1, wherein the first processing circuitry is included in the image sensor.

15. A method, comprising: recognizing a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of a plurality of images processed by an image signal processor included in an image sensor; transmitting, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein the first time t0 is earlier than the second time t1; wherein in a case that a size of the license plate at the second time t1 is larger than a size of the license plate at the first time t0, the vehicle enters the parking space; and wherein in a case that the size of the license plate at the second time t1 is smaller than the size of the license plate at the first time t0, the vehicle exits the parking space.

16. The method of claim 14, further comprising: generating a comparison result based on comparing the size of the license plate in the second frame with the first frame.

17. The method of claim 15, further comprising: in a case that the comparison result satisfies a first entering condition indicating that an increase amount of the size of the license plate in the first frame compared to the second frame is detected at least once, determining that the vehicle enters the parking space.

18. The method of claim 15, further comprising: in a case that an exiting condition indicating a decrease amount of the size of the license plate in a fourth frame compared to a third frame obtained earlier than the fourth frame is detected at least once is satisfied, determining that the vehicle exits the parking space.

19. The method of claim 15, further comprising: determining whether a license plate number recognized by a trained model matches a reservation information license plate number stored in a memory of the server; and in response to a determination that the license plate number matches the reservation information license plate number, registering a current time as an arrival time.

20. The method of claim 18, further comprising: in response to a determination that the license plate number matches the reservation information license plate number, updating an arrival status in the reservation information to indicate that the vehicle arrived.

21. A non-transitory computer-readable storage medium storing computer-readable instructions thereon which, when executed by a computer, cause the computer to perform a method, the method comprising: recognizing a position of a license plate of a vehicle in a plurality of frames, wherein each of the plurality of frames corresponds to an image of a plurality of images processed by an image signal processor included in an image sensor; transmitting, to a server, a second frame of the plurality of frames corresponding to a second time (t1) and a first frame of the plurality of frames corresponding to a first time (t0), wherein the first time t0 is earlier than the second time t1; wherein in a case that a size of the license plate at the second time t1 is larger than a size of the license plate at the first time t0, the vehicle enters the parking space; and wherein in a case that the size of the license plate at the second time t1 is smaller than the size of the license plate at the first time t0, the vehicle exits the parking space.

Images