Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device, an information processing method and an information processing program capable of providing a user with a situation of a parking lot.SOLUTION: An information processing device includes an acquisition unit for acquiring image information on an image of a parking lot at each different time, a reception unit for receiving use information on retrieval and use of the parking lot by a user, an identification unit for identifying any of pieces of image information acquired by the acquisition unit in accordance with each stage of retrieval, reservation and use of the parking lot by the user on the basis of the use information received by the reception unit, and a provision unit for providing the user with the image information identified by the identification unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, vehicle drivers have sometimes requested to improve the security of their own vehicles parked in parking lots. The parking lot monitoring system described in Patent Document 1 uses a monitoring camera installed in the parking lot to capture an image of the parking state of a vehicle parked in the parking lot to generate a first image. The parking lot monitoring system also uses an in-vehicle camera mounted on the vehicle to capture an image of the parking state of the vehicle to generate a second image. The parking lot monitoring system monitors the vehicle using the first image and the second image as monitoring images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2021-118473 A Summary of the Invention [Problem to be solved by the invention]

[0004] The parking monitoring system described in Patent Document 1 needs to obtain the second image captured by the vehicle-mounted camera as the monitoring image, but not all vehicles are equipped with vehicle-mounted cameras. Therefore, the parking monitoring system described in Patent Document 1 may not be able to adequately monitor the parking lot.

[0005] In recent years, there are also systems that allow drivers to reserve parking spaces near their destinations. When a parking space is available for reservation, drivers may want to know about the security of the parking space. However, in this case, it is necessary to consider the privacy of the vehicles and users of the parking space.

[0006] The present disclosure provides an information processing device, an information processing method, and an information processing program capable of providing a user with the status of a parking lot. [Means for solving the problem]

[0007] One embodiment of an information processing device includes an acquisition unit that acquires image information regarding images of parking lots at different times, a reception unit that accepts usage information regarding users' searches and use of parking lots, an identification unit that identifies one of the image information acquired by the acquisition unit according to each stage of the user's search, reservation, and use of the parking lot based on the usage information accepted by the reception unit, and a provision unit that provides the image information identified by the identification unit to the user. Effect of the Invention

[0008] According to one aspect, based on usage information regarding the user's search for and use of a parking space, one of the image information can be identified depending on each stage of the user's search, reservation, and use of the parking space, and the identified image information can be provided to the user. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an information processing device 1 according to an embodiment. [Diagram 2] FIG. 1 is a block diagram illustrating an information processing device 1 according to an embodiment. [Diagram 3] 1 is a flowchart illustrating an information processing method according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] An embodiment will be described below.

[0011] [Overview of information processing device 1] First, an overview of an information processing device 1 according to an embodiment will be described. FIG. 1 is a diagram illustrating an information processing device 1 according to an embodiment.

[0012] The information processing device 1 may be configured, for example, as a monitoring device that monitors the parking lot P. The information processing device 1 may also be configured, for example, as a status providing device that provides various statuses in the parking lot P. The information processing device 1 may also be configured, for example, as a search and reservation device that is capable of searching for the parking lot P and performing reservation processing for the use of the parking lot P. The information processing device may be a computer such as a server, a desktop, a laptop, or a tablet.

[0013] The information processing device 1 acquires image information generated by an imaging unit 21 disposed in a parking lot P. The imaging unit 21, for example, captures an image of the parking lot P to generate image information. The imaging unit 21 may capture images continuously in time or at predetermined timings, for example. This allows the information processing device 1 to acquire image information generated at different times, for example. That is, the information processing device 1 can acquire image information related to images of the parking lot P at different times, for example.

[0014] For example, when the information processing device 1 acquires image information, the information processing device 1 may store the image information in the storage unit 23 (see FIG. 2). In addition, when the information processing device 1 acquires image information, the information processing device 1 may perform a predetermined process on an image based on the image information, and store the processed image (processed image information) in the storage unit 23.

[0015] The information processing device 1 may receive usage information related to the search and use of a parking lot P from a user 101 (e.g., a user terminal 102, etc.) who wishes to use a parking lot P. The usage information may include search information used when the user 101 searches for a parking lot P that the user wishes to use, and reservation information used when the user 101 reserves the use of the parking lot P. The usage information may also include various parking lot usage information related to the use of the parking lot P when the user 101 actually uses the parking lot P.

[0016] For example, based on the usage information, the information processing device 1 identifies which stage the user 101 is at regarding the use of the parking lot P. As an example, the information processing device 1 identifies which stage the user 101 is at based on the usage information from among a plurality of stages, including a stage in which the user 101 is searching for the parking lot P, a stage in which the user 101 has reserved the parking lot P, and a stage in which the user 101 is using the parking lot P.

[0017] The information processing device 1, for example, identifies image information corresponding to the identified stage as described above. Here, the storage unit 23 of the information processing device 1 may store correspondence information that associates the stage of the user 101's use of the parking lot P with image information corresponding to each stage. Alternatively, the storage unit 23 of the information processing device 1 may store image information associated with the stage of the user 101's use of the parking lot P. In other words, the information processing device 1 may be capable of identifying image information corresponding to each stage.

[0018] The information processing device 1 provides the image information specified as described above to the user 101 (e.g., the user terminal 102, etc.). That is, the information processing device 1 may provide the user 101 with image information specified according to the stage at which the user 101 uses the parking lot P (e.g., different image information for each stage of use, etc.).

[0019] [Details of information processing device 1] Next, the information processing device 1 according to an embodiment will be described in detail. FIG. 2 is a block diagram illustrating the information processing device 1 according to an embodiment.

[0020] The information processing device 1 includes, for example, an imaging unit 21, a communication unit 22, a storage unit 23, a display unit 24, and a control unit 11. The communication unit 22, the storage unit 23, and the display unit 24 may be an embodiment of the output unit. The control unit 11 includes, for example, an acquisition unit 12, a reception unit 13, a specification unit 14, a parking estimation unit 15, a behavior estimation unit 16, and a provision unit 17. The control unit 11 may be configured, for example, by an arithmetic processing device of the information processing device 1. The control unit 11 (for example, an arithmetic processing device) may realize the functions of each unit (for example, the acquisition unit 12, the reception unit 13, the specification unit 14, the parking estimation unit 15, the behavior estimation unit 16, and the provision unit 17) by, for example, appropriately reading and executing various programs stored in the storage unit 23.

[0021] The imaging unit 21 may be, for example, a camera that captures an image of the parking lot and the surroundings of the parking lot. For example, one or more imaging units 21 are arranged in a parking lot. Here, for example, when multiple imaging units 21 are arranged in one parking lot, each imaging unit 21 may image the parking lot from a different direction, or may image the parking lot with different wavelengths. The multiple imaging units 21 that image with different wavelengths may be, for example, an imaging unit 21 capable of imaging with visible light, and an imaging unit 21 capable of imaging with wavelengths including infrared light. The imaging unit 21 capable of imaging with infrared light can image the situation of the parking lot, for example, even at night.

[0022] The imaging unit 21 can capture, for example, still images or moving images. When capturing still images, the imaging unit 21 may capture images at predetermined timings. The predetermined timings may be various timings, such as at predetermined times and when a moving object is detected in a parking lot. The moving object may be a person, an animal, a vehicle, etc. Here, the imaging unit 21 may, for example, place an object detection sensor or the like in a parking lot, and capture an image of the parking lot when the object detection sensor detects an object (for example, a moving object, etc.). This enables the imaging unit 21 to capture an image of, for example, an object (for example, a moving object, etc.).

[0023] For example, when capturing a still image or a moving image, the imaging unit 21 generates image information and transmits it to the information processing device 1 (for example, the control unit 11, etc.). The imaging unit 21 may transmit image information to, for example, a device (external device) (not shown) outside the information processing device 1. The external device may be, for example, a server. In this case, the information processing device 1 may obtain image information from the external device (for example, a server) continuously in time or at a predetermined timing.

[0024] The communication unit 22 is, for example, a communication interface capable of transmitting and receiving various information to and from a device (external device) outside the information processing device 1. The external device may be, for example, a server (not shown) and a user terminal 102. The user terminal 102 may be, for example, a terminal used by the user 101, and may be a desktop, a laptop, a tablet, a smartphone, or the like.

[0025] The storage unit 23 may store, for example, various information and programs. Examples of the storage unit 23 may be a memory, a solid state drive, a hard disk drive, etc. Note that the storage unit 23 may be, for example, a storage area and a server on a cloud.

[0026] The display unit 24 is, for example, a display capable of displaying various characters, symbols, images, and the like.

[0027] The acquisition unit 12 acquires image information. That is, the acquisition unit 12 acquires, for example, image information related to an image of a parking lot at different times. When acquiring at different times, for example, when a video is captured by the imaging unit 21, the video may be acquired. That is, the imaging unit 21 captures, for example, a video at different times (captures images continuously in time). Therefore, the acquisition unit 12 can acquire, for example, video (image information) captured at different times (captured continuously in time). Even when the imaging unit 21 captures a still image at each predetermined timing, the multiple still images can be considered as still images captured at different times. Therefore, for example, in the case of still images, the acquisition unit 12 can acquire still images (image information) captured at different times (captured at each predetermined timing) by acquiring the still images at different times in the same manner as in the case of the above-mentioned moving images. Furthermore, the acquisition unit 12 may be capable of acquiring image information corresponding to each of a plurality of stages regarding the use of the parking lot by the user 101, for example, by acquiring image information at different times. As one example, the plurality of stages may be various stages including a stage in which the user 101 is searching for a parking lot, a stage in which the user 101 has reserved a parking lot, and a stage in which the user 101 is using the parking lot, as described above.

[0028] The reception unit 13 receives usage information related to the search and use of parking lots by the user 101. The usage information may include, for example, search information used when the user 101 searches for a parking lot that he or she wishes to use, and reservation information used when the user 101 reserves use of the parking lot. The usage information may also include, for example, various parking lot usage information related to the use of the parking lot when the user 101 actually uses the parking lot.

[0029] The reception unit 13 may receive the usage information from, for example, a terminal (such as a user terminal 102) used by a parking lot user 101. The reception unit 13 may also receive the usage information from, for example, a management system (not shown) that manages devices arranged in the parking lot. The reception unit 13 may, for example, receive a part of the usage information (for example, search information and reservation information, etc.) from the user terminal 102, or may receive the information from various other devices and terminals, etc., other than the user terminal 102. The reception unit 13 may, for example, receive a part of the usage information (for example, parking lot usage information, etc.) from the management system, or may receive the information from various other devices and terminals, etc., other than the management system.

[0030] The identification unit 14 identifies one of the image information acquired by the acquisition unit 12 according to each stage of searching, reserving, and using a parking lot by the user 101 based on the usage information received by the reception unit 13. As an example, when the usage information includes search information, the identification unit 14 identifies the stage as the stage where the user 101 is searching for a parking lot (search stage). Similarly, as an example, when the usage information includes reservation information, the identification unit 14 identifies the stage as the stage where the user 101 has reserved a parking lot (reservation stage). Similarly, as an example, when the usage information includes parking lot usage information, the identification unit 14 identifies the stage as the stage where the user 101 is using the parking lot (usage stage).

[0031] For example, when the identification unit 14 identifies the search stage as described above, it may identify first image information from among image information generated by the imaging unit 21 arranged in the parking lot being searched. The first image information may be, for example, image information on at least one of an image that does not include a vehicle using the parking lot and a user 101, and an image that includes a vehicle using the parking lot or a user 101 but has been subjected to privacy-conscious processing. The privacy-conscious processing may be, for example, a processing (masking processing) in which the user 101 is masked so that the individual user cannot be identified. Similarly, the privacy-conscious processing may be, for example, a processing (masking processing) in which the license plate (vehicle registration number plate) of the vehicle is masked so that the individual vehicle cannot be identified. The masking processing may be, for example, various processing such as a processing of adding blur, a processing of adding filling, and a processing of erasing from the image. That is, for example, at the stage of searching for a parking lot by user 101, the identification unit 14 may identify image information (first image information) corresponding to at least one image selected from a group of images of parking lots in which no vehicle is recorded and images of parking lots in which the vehicle has been masked. The first image information may be stored in the storage unit 23, for example, when an image that does not include vehicles using the parking lot and users 101 is acquired, or after the image has been subjected to the above-mentioned example of privacy-conscious processing in advance. In this case, the storage unit 23 may store the first image information in association with the parking lot from which the image based on the first image information is acquired.

[0032] For example, when the usage information received by the reception unit 13 includes time information related to the planned time of use for using the parking lot, the identification unit 14 may identify the following image information (first image information). The identified image information may be, for example, at the stage of search and reservation by the user 101, image information corresponding to at least one image selected from a group of images based on the image information acquired by the acquisition unit 12. The images constituting the group may be, for example, images captured at a time corresponding to the planned time of use recorded in the time information, and images captured on a day of the week corresponding to the planned time of use. That is, for example, when a user 101 searches for parking information by specifying a planned date and time of use (including concepts such as a time period and day of the week), the identification unit 14 identifies the first image information based on a past image captured during the time period or day of the week corresponding to the planned date and time of use.

[0033] As a specific example, when the date and time when the user 101 plans to use the parking lot is 10:00 a.m., the identification unit 14 may identify the first image information based on an image captured at a time relatively close to 10:00 a.m. or a time period including 10:00 a.m., among the image information based on images captured in advance at the parking lot. The relatively close time may be, for example, the time closest to 10:00 a.m., or may be another time period considered to be close to 10:00 a.m. For example, the time closest to 10:00 a.m. is 9:50 a.m. when there are images captured at 9:20, 9:50, and 10:20 a.m. The time period may be, for example, a time period such as morning, afternoon, or night, or a time period for each predetermined time period (for example, 1 hour, 2 hours, 3 hours, 5 hours, 6 hours, and 8 hours). As another specific example, when the date and time that user 101 plans to use the parking lot is Monday, the identification unit 14 may identify the first image information based on an image captured on Monday from among the image information based on images previously captured in the parking lot. Furthermore, when identifying the first image information as in the above-described example, the identifying unit 14 may identify image information (first image information) based on an image captured most recently.

[0034] In addition, when the identification unit 14 identifies the reservation stage as described above, for example, the identification unit 14 may identify the second image information from among the image information generated by the imaging unit 21 arranged in the reserved parking lot. The second image information may be, for example, similar to the above-mentioned first image information, image information relating to at least one of an image not showing a vehicle using the parking lot and a user 101, and an image showing a vehicle using the parking lot or a user 101 but having been subjected to processing that takes privacy into consideration. That is, for example, at the stage of reserving the parking lot by the user 101, the identification unit 14 may identify image information (second image information) corresponding to at least one image selected from a group of images of parking lots in which no vehicle is recorded and images of parking lots in which a vehicle has been subjected to masking processing.

[0035] Furthermore, similarly to the identification of the first image information described above, for example, when the usage information received by the reception unit 13 includes time information related to the planned usage time for using the parking lot, the identification unit 14 may identify the following image information (second image information). For example, at the stage of reservation by the user 101, the identified image information may be image information corresponding to at least one image selected from a group of images based on the image information acquired by the acquisition unit 12. The images constituting the group may be, for example, images captured at a time corresponding to the planned usage time recorded in the time information, and images captured on a day of the week corresponding to the planned usage time.

[0036] For example, when a reservation for use of a parking lot is made based on the usage information received by the reception unit 13, the identification unit 14 may identify image information (second image information) corresponding to the most recent image in terms of time among images based on the image information acquired by the acquisition unit 12 on the day of planned use based on the time information. That is, for example, when the user 101 completes the reservation of a parking lot (reservation is established) and on the day the parking lot is to be used, the identification unit 14 may identify image information (second image information) based on the most recent image among images captured in the parking lot. Alternatively, the identification unit 14 may identify the latest image information (e.g., image information updated every predetermined time) for every predetermined time (e.g., 5 minutes, 10 minutes, 15 minutes, 20 minutes, 30 minutes, and 1 hour). In this case, the identifying unit 14 may identify image information (second image information) based on the most recent image, for example, before the start time of the date and time when the usage reservation is made.

[0037] For example, when the parking position used by the user 101 is a charging position where an electric vehicle can be charged, the identification unit 14 may identify image information (second image information) corresponding to an image including the reserved charging position among images based on image information acquired by the acquisition unit 12. That is, for example, when there is a charging position in the parking lot where an electric vehicle can be charged and the user 101 reserves the charging position, the identification unit 14 may identify second image information of an image generated by the imaging unit 21 capable of capturing an image of the charging position. In this case, for example, when the usage information (reservation information) includes information regarding the reservation of the charging position, the identification unit 14 may identify second image information related to the charging position. Also, the identification unit 14 may identify second image information related to the charging position based on correspondence information that is previously associated with the charging position and image information generated by the imaging unit 21 capable of capturing an image of the charging position. The correspondence information may be stored in the storage unit 23, for example.

[0038] Furthermore, when the identification unit 14 identifies the usage stage as described above, for example, the identification unit 14 may identify third image information from among the image information generated by the imaging unit 21 disposed in the parking lot being used. For example, based on the usage information received by the reception unit 13, the identification unit 14 may identify image information (third image information) corresponding to a chronologically latest image, which is an image including the parking position of the vehicle in the parking lot, among images based on image information acquired by the acquisition unit 12 during the use of the parking lot. That is, for example, when the parking lot usage information includes information regarding a parking position (position where the vehicle is parked) used by the user 101, the identification unit 14 may identify third image information of an image generated by the imaging unit 21 capable of imaging the parking position. Also, the identification unit 14 may identify the third image information related to each parking position in the parking lot based on correspondence information that is previously associated with each parking position in the parking lot and image information generated by the imaging unit 21 capable of imaging the parking position. The correspondence information may be stored in the storage unit 23, for example.

[0039] For example, when the time information includes a planned time of exit from the parking lot, the identification unit 14 may identify image information corresponding to an image including an exit of the parking lot among images based on image information acquired by the acquisition unit 12, after a predetermined time before the planned exit time. That is, when the usage information (at least one of the reservation information and the parking lot usage information) includes information regarding a planned time of exit from the parking lot, the identification unit 14 may identify third image information of an image generated by the imaging unit 21 capable of capturing an image of the exit of the parking lot, after a predetermined time before the planned exit time. In this case, the identification unit 14 may identify the third image information related to the exit of the parking lot based on correspondence information that is previously associated with the exit of the parking lot and the image information generated by the imaging unit 21 capable of capturing an image of the exit. The correspondence information may be stored in the storage unit 23, for example. The predetermined time may be, for example, a time before the expected exit (for example, a time period, etc.) based on the planned time of exit registered when making a reservation and when starting to use the parking lot. As a specific example, the predetermined time may be various times registered in advance, such as 10 minutes, 15 minutes, 20 minutes, 30 minutes, 45 minutes, etc. That is, for example, when the planned exit time is 11:00, the identification unit 14 may identify the third image information related to the exit of the parking lot from 20 minutes before the planned exit time (from 10:40 onwards), which is an example of the predetermined time.

[0040] The predetermined time may be set according to the time from the start time to the end time (exit time) when the reservation is made (planned parking time zone). As an example, if the planned parking time zone is relatively long, the predetermined time may be relatively long. Similarly, as an example, if the planned parking time zone is relatively short, the predetermined time may be relatively short. As a more specific example, if the start time of using the parking lot is 8:00 and the end time is 9:00 (if the parking time slot is one hour), the predetermined time may be relatively short, 15 minutes. That is, in this case, the identification unit 14 may identify the third image information related to the exit of the parking lot after 8:45. Similarly, as a more specific example, if the start time of using the parking lot is 8:00 and the end time is 11:00 (if the parking time period is 3 hours), the predetermined time may be relatively long and set to 45 minutes. That is, in this case, the identification unit 14 may identify the third image information related to the exit of the parking lot after 10:15.

[0041] For example, when the parking lot used by the user 101 is a parking lot where entry and exit are free within a predetermined time for which use is reserved, the identification unit 14 may identify image information (third image information) corresponding to an image including the reserved parking position among images based on image information acquired by the acquisition unit 12. That is, for example, when the parking lot is a parking lot where entry and exit are free during a time period for which a reservation is made (within a predetermined time period from a start time to an end time), the identification unit 14 may identify third image information of an image generated by the imaging unit 21 capable of capturing an image of the reserved parking position during that time period (within the predetermined time period). In this case, the identification unit 14 may identify, for example, the time period and the parking position for which a reservation is made based on usage information (for example, reservation information and parking lot usage information, etc.). Also, the identification unit 14 may identify, for example, the third image information related to each parking position in the parking lot based on correspondence information that is previously associated with each parking position in the parking lot and image information generated by the imaging unit 21 capable of capturing an image of the parking position, as in the above-mentioned case.

[0042] For example, when the parking lot is in use, the identification unit 14 may identify image information (third image information) of an image that has been subjected to the above-mentioned privacy-conscious processing for other vehicles other than the user's own vehicle and the user 101. The privacy-conscious processing may be the same processing as that used when identifying the above-mentioned first image information. That is, for example, when the user 101 is using the parking lot, the identification unit 14 may identify image information corresponding to an image of the parking lot that includes the parking position of the user's own vehicle in the parking lot and has been subjected to masking processing for other vehicles. As an example of this case, the identification unit 14 may identify third image information of an image generated by the imaging unit 21 capable of capturing an image of the parking position of the vehicle when the vehicle is using a parking lot, and may perform the above-mentioned privacy-conscious processing on other vehicles other than the vehicle and the user 101 in the image. The identification unit 14 may identify the parking position of the vehicle based on the usage information (e.g., reservation information and parking lot usage information, etc.) in the same manner as described above. In addition, the identification unit 14 may estimate that other vehicles are parked at positions other than the parking position of the vehicle, for example. The control unit 11 of the identification unit 14 or the like may be configured to be able to identify the parking position in the image in advance by using, for example, a publicly known technology, and may also be able to perform object recognition, person recognition, and the like. That is, the control unit 11 of the identification unit 14 or the like may be configured to identify an image (image information) of the parking position of the vehicle based on, for example, the usage information, and to recognize the vehicle, other vehicles, and the user 101, etc. in the image. The control unit 11 of the identification unit 14 or the like may generate an image of the vehicle that takes privacy into consideration based on, for example, the result of the recognition. That is, the identification unit 14 may identify image information (third image information) related to the image of the vehicle that takes privacy into consideration.

[0043] Furthermore, for example, when the imaging unit 21 captures an image of another vehicle and the user 101, the identifying unit 14 may temporarily suspend the provision of image information to the user 101 of the vehicle.

[0044] The parking estimation unit 15 may estimate whether an electric vehicle that is the other vehicle is being charged based on, for example, image information. That is, the parking estimation unit 15 may estimate whether a vehicle is parked at the charging position based on image information acquired by the acquisition unit 12. The parking estimation unit 15 may estimate whether a vehicle (here, another vehicle, etc.) is parked at the charging position during a time other than the time period (from the start time to the end time) reserved by the user 101, for example, a time period before the time period. In this case, the parking estimation unit 15 may estimate a vehicle (another vehicle, etc.) by identifying an image (image information) of the charging position using, for example, the above-mentioned correspondence information, and performing object recognition, etc. on the image.

[0045] At the stage when the user 101 uses the parking lot, the behavior estimation unit 16 may estimate whether there is a person behaving suspiciously in the parking lot based on a trained model that has previously learned suspicious behavior by people and image information acquired by the acquisition unit 12. That is, the behavior estimation unit 16 may estimate whether a person behaving suspiciously (suspicious person) is recorded in the image information using the trained model. In this case, the behavior estimation unit 16 may estimate a suspicious person using, for example, image information acquired in real time and the latest image information.

[0046] Here, the trained model may be, for example, a model generated by learning in advance non-suspicious behavior (normal behavior) of a person. In this case, the behavior estimation unit 16 may use the trained model to estimate whether a person who does not behave normally, in other words, a suspicious person, is recorded in the image information.

[0047] The providing unit 17 provides the image information identified by the identifying unit 14 to the user 101. That is, the providing unit 17 may provide the first to third image information identified as described above to the user 101, for example, via an output unit. Here, the output unit may be, for example, the communication unit 22, the storage unit 23, the display unit 24, etc. That is, the providing unit 17 may transmit the first to third image information to the user terminal 102 used by the user 101 via the communication unit 22, for example. Alternatively, the providing unit 17 may transmit the first to third image information to a server (not shown) via the communication unit 22, for example. The providing unit 17 may store the first to third image information in the storage unit 23, for example. The providing unit 17 may display, on the display unit 24, images based on each of the first to third image information, for example. In this case, when the user terminal 102 accesses the storage unit 23 or the above-mentioned server, the information processing device 1 or the server may transmit the first to third image information to the user terminal 102. Alternatively, when the user terminal 102 accesses the information processing device 1, images based on the first to third image information, respectively, may be displayed on the display unit 24.

[0048] The providing unit 17 may provide charging information related to the result of estimation by the parking estimation unit 15. That is, the providing unit 17 may provide the charging information to the user 101 (e.g., the user terminal 102, etc.) via the output unit, for example, in the same manner as in the case of providing the image information described above. The charging information may be at least one estimation result by the parking estimation unit 15 selected from a group including a vehicle (other vehicle) parked at the charging position, a vehicle (other vehicle) not parked at the charging position, and an image (image information) of the charging position.

[0049] When the behavior estimation unit 16 estimates that there is a suspicious person, the providing unit 17 may provide suspicious person information regarding the presence of a suspicious person. In this case, when it is estimated that there is a suspicious person in the parking lot, for example, the providing unit 17 may immediately provide the suspicious person information via the output unit to at least one selected from a group of a user 101 currently using the parking lot, a user who is planning to use the parking lot, a management company that manages the parking lot, a security company that guards the parking lot, and a police force that has jurisdiction over the parking lot. The suspicious person information may be, for example, at least one estimation result by the behavior estimation unit 16 selected from a group of a suspicious person being present in the parking lot, an image (image information) captured of the parking lot, an image (image information) in which the suspicious person is recorded, and the like. For example, as a method of providing the estimation result by the behavior estimation unit 16, the providing unit 17 may perform at least one selected from a group of transmission using the communication unit 22, storage in the storage unit 23, and display on the display unit 24, as in the case of providing the image information described above.

[0050] The providing unit 17 may, for example, limit at least one of the provision time and the number of times of providing image information to the user 101. That is, when the user 101 uses the parking lot, the providing unit 17 may limit the time of providing image information to the user terminal 102 used by the user 101 to a predetermined time (upper limit time), or may limit the number of times of providing to a predetermined number (upper limit time). The provision time may be set, for example, when the image information is a video or the like. The provision time and the number of times of providing may be set, for example, according to. That is, the provision time and the number of times of providing may be set relatively longer as the usage time of the parking lot becomes relatively longer. Also, the provision time and the number of times of providing may be set relatively shorter as the usage time of the parking lot becomes relatively shorter. The usage time of the parking lot may, for example, be recorded in the usage information. That is, the usage information may include, for example, information on the entry time (scheduled entry time) to the parking lot and the exit time (scheduled exit time) from the parking lot.

[0051] In addition, the information processing device 1 (e.g., the control unit 11, etc.) may control the provision of image information to the user 101 (user terminal 102) when, for example, information identifying the identity of the user 101, such as identification information when subscribing to a non-life insurance service, is received from the user terminal 102, etc. by the reception unit 13.

[0052] [Information processing method] Next, an information processing method according to an embodiment will be described. FIG. 3 is a flowchart illustrating an information processing method according to an embodiment.

[0053] In step ST101, the acquisition unit 12 acquires image information related to images of parking lots at different times. The acquisition unit 12 may acquire image information from an imaging unit 21 arranged in each parking lot, or may acquire image information generated by the imaging unit 21 via a server (not shown). For example, one or more imaging units 21 may be arranged in the parking lot. The acquisition unit 12 may acquire image information so as to identify each imaging unit 21 (each image information) or the imaging range of the parking lot imaged by each imaging unit 21. In this case, the acquisition unit 12 may acquire image information in which identification information for identifying each imaging unit 21 is recorded, and may identify which parking lot (which area of ​​the parking lot) is imaged by the acquired image information based on correspondence information that associates the identification information with the parking lot (imaging range of the parking lot).

[0054] In step ST102, the reception unit 13 receives usage information related to the search, reservation, and use of a parking lot by the user 101.

[0055] In step ST103, the identification unit 14 identifies one of the image information acquired in step ST101 according to each stage of the parking lot search, reservation, and use by the user 101 based on the usage information received in step ST103.

[0056] For example, when a user 101 searches for a parking lot, the identification unit 14 may identify image information (first image information) corresponding to at least one image selected from a group of images of parking lots in which no vehicle is recorded and images of parking lots in which the vehicle has been masked.

[0057] For example, when the use information received in step ST102 includes time information related to the planned time of use for the parking lot, the identification unit 14 may identify the following image information (first image information). For example, at the stage of search and reservation by the user 101, the identified image information may be image information corresponding to at least one image selected from a group of images based on the image information acquired in step ST101. The images constituting the group may be, for example, images captured at a time corresponding to the planned time of use recorded in the time information, and images captured on a day of the week corresponding to the planned time of use.

[0058] For example, when the identification unit 14 identifies the reservation stage as described above, the identification unit 14 may identify second image information from among the image information generated by the imaging unit 21 disposed in the reserved parking lot. That is, for example, at the stage of reserving the parking lot by the user 101, the identification unit 14 may identify image information (second image information) corresponding to at least one image selected from a group of images of the parking lot in which no vehicle is recorded and images of the parking lot in which a vehicle has been masked.

[0059] For example, when the use information received in step ST102 includes time information related to the scheduled use time, the identification unit 14 may identify the following image information (second image information). For example, at the stage of reservation by the user 101, the identified image information may be image information corresponding to at least one image selected from a group of images among images based on the image information acquired in step ST101. The images constituting the group may be, for example, images captured at a time corresponding to the scheduled use time recorded in the time information, images captured on a day of the week corresponding to the scheduled use time, etc.

[0060] For example, when a reservation for use of the parking lot is made based on the usage information received in step ST102, the identification unit 14 may identify image information (second image information) corresponding to the most recent image in terms of time among images based on the image information acquired in step ST101 on the day of planned use based on the time information.

[0061] For example, when the parking position used by the user 101 is a charging position where an electric vehicle can be charged, the identification unit 14 may identify image information (second image information) corresponding to an image including the reserved charging position from among images based on the image information acquired in step ST101.

[0062] For example, based on the usage information received in step ST102, when the parking lot is in use, the identification unit 14 may identify image information (third image information) that corresponds to the most recent image in terms of time, among images based on the image information acquired in step ST101, which includes the parking position of the vehicle in the parking lot.

[0063] For example, when the time information includes the planned exit time for leaving the parking lot, the identification unit 14 may identify image information corresponding to an image including the exit of the parking lot from among images based on the image information acquired in step ST101, after a predetermined time before the planned exit time.

[0064] For example, when the parking lot used by the user 101 is a parking lot where entry and exit are free within the specified time period for which the reservation has been made, the identification unit 14 may identify image information (third image information) corresponding to an image including the reserved parking location from among the images based on the image information acquired in step ST101.

[0065] For example, when the user 101 uses a parking lot, the identification unit 14 may identify image information corresponding to an image of the parking lot in which other vehicles have been masked and which includes the parking position of the user's vehicle in the parking lot.

[0066] In step ST104, the parking estimation unit 15 may estimate whether a vehicle is parked at the charging position based on the image information acquired in step ST101.

[0067] In step ST105, when the user 101 uses the parking lot, the behavior estimation unit 16 may estimate whether there is a person behaving suspiciously in the parking lot based on a learned model that has previously learned suspicious behavior by people and the image information acquired in step ST101.

[0068] In step ST106, the providing unit 17 provides various information to, for example, the user 101 (for example, the user terminal 102) or the like. That is, the providing unit 17 may provide, for example, the image information identified in step ST103 to the user 101. The providing unit 17 may provide, for example, charging information related to the result of the estimation in step ST104. For example, when the providing unit 17 estimates that there is a suspicious person in step ST105, the providing unit 17 may provide suspicious person information related to the presence of the suspicious person.

[0069] Each unit of the information processing device 1 described above may be realized as a function of a computer arithmetic processing device, etc. That is, the acquisition unit 12, the reception unit 13, the identification unit 14, the parking estimation unit 15, the behavior estimation unit 16, and the provision unit 17 (control unit 11) of the information processing device 1 may be realized as an acquisition function, a reception function, an identification function, a parking estimation function, a behavior estimation function, and a provision function (control function) by a computer arithmetic processing device, etc. The information processing program can cause a computer to realize each of the above-mentioned functions. The information processing program may be recorded in a non-transitory computer-readable recording medium, such as a memory, a solid-state drive, a hard disk drive, or an optical disk. As described above, each unit of the information processing device 1 may be realized by an arithmetic processing device of a computer or the like. The arithmetic processing device or the like is configured by, for example, an integrated circuit or the like. Therefore, each unit of the information processing device 1 may be realized as a circuit constituting the arithmetic processing device or the like. That is, the acquisition unit 12, the reception unit 13, the identification unit 14, the parking estimation unit 15, the behavior estimation unit 16, and the provision unit 17 (control unit 11) of the information processing device 1 may be realized as an acquisition circuit, a reception circuit, an identification circuit, a parking estimation circuit, a behavior estimation circuit, and a provision circuit (control circuit) constituting the arithmetic processing device of a computer or the like. The imaging unit 21, the communication unit 22, the storage unit 23, and the display unit 24 (output unit) of the information processing device 1 may be realized as an imaging function including the functions of an arithmetic processing device, as well as a communication function, a storage function, and a display function (output function). The imaging unit 21, the communication unit 22, the storage unit 23, and the display unit 24 (output unit) of the information processing device 1 may be realized as an imaging circuit, as a communication circuit, a storage circuit, and a display circuit (output circuit) by being configured by, for example, an integrated circuit, etc. The imaging unit 21, the communication unit 22, the storage unit 23, and the display unit 24 (output unit) of the information processing device 1 may be realized as an imaging device, as a communication device, a storage device, and a display device (output device) by being configured by, for example, a plurality of devices.

[0070] The information processing device 1 can include one or any combination of the above-mentioned multiple units. In this disclosure, the term "information" is used, but the term "information" can be replaced with "data" and the term "data" can be replaced with "information."

[0071] [Aspects and Effects of the Present Embodiment] Next, one aspect of this embodiment and the effects of each aspect will be described. Note that this embodiment is not limited to each aspect described below, and may be realized by appropriately combining each of the above-mentioned parts. Also, the effects described below are examples, and the effects of each aspect are not limited to those described below. Also, each aspect may, for example, achieve at least one of the effects described below.

[0072] (Aspect 1) One embodiment of an information processing device includes an acquisition unit that acquires image information regarding images of parking lots at different times, a reception unit that accepts usage information regarding users' searches and use of parking lots, an identification unit that identifies one of the image information acquired by the acquisition unit according to each stage of the user's search, reservation, and use of the parking lot based on the usage information accepted by the reception unit, and a provision unit that provides the image information identified by the identification unit to the user. The information processing device specifies image information according to a time axis of multiple stages from searching for a parking lot to using the parking lot. Therefore, since the information processing device uses image information generated by an imaging unit or the like disposed in the parking lot, the situation of the parking lot can be reliably provided to the user. The information processing device can provide the status of the parking lot to the user even if the user can reserve the parking lot before using the parking lot. In this case, the information processing device selects (specifies) image information according to each stage of the user's search, reservation, and use of the parking lot, so that the privacy of the vehicle and the user using the parking lot can be taken into consideration. Furthermore, since the information processing device can provide the user with the status of the parking lot, the user can use the parking lot with peace of mind, and an increase in the utilization rate of the parking lot can be expected. In addition, the imaging unit that generates the image information can use, for example, a surveillance camera that is installed in advance in a parking lot. Therefore, the information processing device can use, for example, existing facilities, and can provide image information to users at a relatively low cost.

[0073] (Aspect 2) In one embodiment of an information processing device, when the usage information received by the reception unit includes time information related to the planned time of use for using the parking lot, at the stage of search and reservation by the user, the identification unit may identify image information corresponding to at least one image selected from a group of images based on the image information acquired by the acquisition unit that were captured at a time corresponding to the planned time of use recorded in the time information and images captured on the day of the week corresponding to the planned time of use. Depending on the parking lot, various conditions within the lot, including congestion, may change depending on the date and time. This allows the information processing device to provide the user with the status of the parking lot according to the date and time that the user plans to use the parking lot.

[0074] (Aspect 3) In one embodiment of an information processing device, when a reservation for use of a parking lot is made based on the usage information received by the reception unit, the identification unit may identify image information that corresponds to the most recent image in terms of time among images based on the image information acquired by the acquisition unit on the day of planned use based on the time information. This allows the information processing device to provide the user with the latest parking lot situation on the day the user plans to use the parking lot. That is, the information processing device can allow the user to grasp, for example, the current parking lot situation.

[0075] (Aspect 4) In one embodiment of the information processing device, when the time information includes the planned exit time for leaving a parking lot, the identification unit may identify image information corresponding to an image including the exit of the parking lot among images based on the image information acquired by the acquisition unit, after a predetermined time before the planned exit time. As a result, the information processing device can provide the user with the exit status near the time when the user is scheduled to leave the parking lot, thereby enabling the user to smoothly leave the parking lot. In other words, the information processing device provides the user with image information so that the user can take measures such as speeding up or delaying the exit depending on the congestion status of the exit, thereby improving user convenience.

[0076] (Aspect 5) In one embodiment of the information processing device, the identification unit may, based on the usage information received by the reception unit, identify image information that corresponds to the most recent image in terms of time among images based on image information acquired by the acquisition unit during the stage when the parking lot is being used, which includes the parking position of the vehicle in the parking lot. This allows the information processing device to provide the user with the status of the vehicle while parked, thereby providing the user with a sense of security so that the user can leave the vehicle without worry. The information processing device can also provide the user with real-time information about the status of the vehicle parked in the parking lot (vehicle information recorded for the vehicle), for example, while the parking lot is in use. In other words, if the user is concerned about the status of the vehicle, the user can view an image of the current status of the vehicle by accessing the information processing device using a user terminal and viewing image information, or by receiving image information from the information processing device.

[0077] (Aspect 6) In one embodiment of the information processing device, when the parking lot used by the user is a parking lot where entry and exit are free within the specified time period for which usage is reserved, the identification unit may identify image information corresponding to an image including the reserved parking location from among images based on the image information acquired by the acquisition unit. This allows the information processing device to provide information (image information) that enables a user to determine whether or not the user can easily re-enter a parking lot even after the user has once left the parking lot.

[0078] (Aspect 7) In one embodiment of the information processing device, the identification unit may, at the stage of searching for and reserving a parking space by a user, identify image information corresponding to at least one image selected from a group of images of parking spaces where no vehicle is recorded and images of parking spaces where the vehicle has been masked. This allows the information processing device to provide users with image information that takes privacy into consideration, thereby reducing the possibility that the privacy of users who use the parking lot will be revealed to others. In other words, users can use the parking lot without worrying about their privacy.

[0079] (Aspect 8) In one embodiment of the information processing device, when a user uses a parking lot, the identification unit may identify image information corresponding to an image of the parking lot in which other vehicles have been masked, and which includes the parking position of the user's vehicle in the parking lot. This allows the information processing device to provide users with image information that takes privacy into consideration, thereby reducing the possibility that the privacy of users using the parking lot will be revealed to others. In other words, users can use the parking lot without worrying about their privacy.

[0080] (Aspect 9) In one embodiment of the information processing device, when the parking position used by the user is a charging position where an electric vehicle can be charged, the identification unit may identify image information corresponding to an image that includes the reserved charging position from among images based on the image information acquired by the acquisition unit. As a result, for example, when a user desires to immediately use a charging position, the information processing device can provide the user with information about the usage status of the charging position, thereby improving convenience for the user.

[0081] (Aspect 10) An information processing device of one embodiment may include a parking estimation unit that estimates whether a vehicle is parked at a charging position based on image information acquired by the acquisition unit, and the providing unit may provide charging information regarding the result of the estimation by the parking estimation unit. As a result, for example, when a user desires to immediately use a charging position, the information processing device can provide the user with information about the usage status of the charging position, thereby improving convenience for the user.

[0082] (Aspect 11) An information processing device of one embodiment, when a user uses a parking lot, is equipped with a behavior estimation unit that estimates whether there is a person behaving suspiciously in the parking lot based on a learned model that has previously learned suspicious behavior by people and image information acquired by the acquisition unit, and when the behavior estimation unit estimates that there is a suspicious person, the providing unit may provide suspicious person information regarding the presence of a suspicious person. This allows the information processing device to estimate suspicious people in the parking lot, so that users can use the parking lot with peace of mind.

[0083] (Aspect 12) In one aspect of the information processing method, a computer executes an acquisition step in which image information regarding images of parking lots is acquired at different times, a reception step in which usage information regarding searches and use of parking lots by users is accepted, a determination step in which one of the image information acquired by the acquisition step is identified according to each stage of the user's search, reservation and use of the parking lot based on the usage information accepted by the reception step, and a provision step in which the image information identified by the determination step is provided to the user. As a result, the information processing method can achieve the same effects as the information processing device according to the above-described aspect.

[0084] (Aspect 13) One embodiment of an information processing program enables a computer to implement an acquisition function that acquires image information regarding images of parking lots at different times, a reception function that accepts usage information regarding users' searches and use of parking lots, a determination function that identifies one of the image information acquired by the acquisition function according to each stage of the user's search, reservation, and use of the parking lot based on the usage information accepted by the reception function, and a provision function that provides the image information identified by the determination function to the user. As a result, the information processing program can achieve the same effects as the information processing device according to the above-described aspect. [Explanation of symbols]

[0085] 1. Information processing device 11 Control section 12 Acquisition Department 13 Reception 14 Specific section 15 Parking Estimation Department 16 Behavior estimation section 17 Providing Department 21 Imaging unit 22 Communications Department 23 Memory section 24 Display section 101 User 102 User terminal P Parking lot

Claims

1. An acquisition unit that acquires image information relating to an image of the parking lot at different times; A reception unit that receives information regarding a user's search for and use of a parking lot; a determination unit that determines one of the pieces of image information acquired by the acquisition unit according to each stage of a user's search, reservation, and use of a parking lot based on the usage information received by the reception unit; a providing unit that provides a user with the image information identified by the identifying unit; An information processing device comprising:

2. When the usage information received by the reception unit includes time information related to a planned time for using the parking lot, the identification unit, at the stage of search and reservation by the user, identifies, among images based on the image information acquired by the acquisition unit, image information corresponding to at least one image selected from a group of images captured at a time corresponding to the planned time of use recorded in the time information and images captured on a day of the week corresponding to the planned time of use. The information processing device according to claim 1 .

3. When a reservation for use of the parking lot is established based on the use information received by the reception unit, the identification unit identifies image information corresponding to the most recent image in terms of time among images based on the image information acquired by the acquisition unit on the day of the planned use based on the time information. The information processing device according to claim 2 .

4. When the time information includes a planned time of exit from the parking lot, the identification unit identifies image information corresponding to an image including an exit of the parking lot from among images based on the image information acquired by the acquisition unit, after a predetermined time before the planned time of exit.

4. The information processing device according to claim 2 or 3.

5. The identification unit, during the stage in which the parking lot is being used, identifies image information that includes the parking position of the vehicle in the parking lot and corresponds to the most recent image in terms of time, among images based on the image information acquired by the acquisition unit, based on the usage information received by the acceptance unit. The information processing device according to any one of claims 1 to 4.

6. When the parking lot used by the user is a parking lot where entry and exit is free within a specified time period for which use is reserved, the identification unit identifies image information corresponding to an image including the reserved parking position from among images based on the image information acquired by the acquisition unit. The information processing device according to any one of claims 1 to 5.

7. The identification unit, at the stage of searching and reserving a parking lot by a user, identifies image information corresponding to at least one image selected from a group of images of parking lots in which no vehicle is recorded and images of parking lots in which a vehicle has been masked. The information processing device according to any one of claims 1 to 6.

8. The identification unit, at the stage of the user using the parking lot, identifies image information corresponding to an image of the parking lot in which other vehicles are masked and which includes the parking position of the user's vehicle in the parking lot. The information processing device according to any one of claims 1 to 7.

9. When the parking position used by the user is a charging position where an electric vehicle can be charged, the identification unit identifies image information corresponding to an image including the reserved charging position from among images based on the image information acquired by the acquisition unit. The information processing device according to any one of claims 1 to 8.

10. a parking estimation unit that estimates whether a vehicle is parked at a charging position based on the image information acquired by the acquisition unit, The providing unit provides charging information related to a result of the estimation by the parking estimation unit. The information processing device according to claim 9.

11. The system further includes a behavior estimation unit that, when a user uses the parking lot, estimates whether a person is behaving suspiciously in the parking lot based on a trained model that has previously trained suspicious behavior of a person and image information acquired by the acquisition unit; The providing unit provides suspicious person information regarding the presence of a suspicious person when the behavior estimating unit estimates that a suspicious person is present. The information processing device according to any one of claims 1 to 10.

12. The computer An acquisition step of acquiring image information relating to an image of a parking lot at different times; A receiving step of receiving information regarding a user's search for and use of a parking lot; a step of identifying one of the pieces of image information acquired in the step of acquiring the image information according to each stage of the user's search, reservation, and use of the parking lot based on the usage information received in the step of receiving the image information; a providing step of providing the image information identified by the identifying step to a user; An information processing method for performing the above.

13. On the computer, An acquisition function for acquiring image information relating to images of the parking lot at different times; A reception function for receiving information regarding a user's search for and use of a parking lot; a determining function for determining which of the image information acquired by the acquiring function is selected according to each step of a user's search, reservation, and use of a parking lot based on the usage information received by the receiving function; a providing function for providing a user with the image information specified by the specifying function; An information processing program that realizes this.

Images