Information processing device, information processing system, information processing method, and program

Abstract

The purpose of the present disclosure is to provide an information processing device capable of reducing the possibility that a vehicle is damaged. An information processing device (100) according to the present disclosure comprises: an acquisition unit (101) that acquires sensor information relating to a vehicle during parking, the sensor information being obtained by a sensor; an estimation unit (102) that, on the basis of the sensor information, estimates a parking status including a regulation compliance status of the vehicle; a calculation unit (103) that, on the basis of the parking status, calculates the degree of risk that the vehicle will be damaged; and a notification control unit (104) that, on the basis of the degree of risk, notifies a user terminal regarding the risk for the vehicle.

Description

Information processing device, information processing system, information processing method, and non-transitory computer-readable medium

[0001] The present disclosure relates to an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium.

[0002] In recent years, technology related to a recording device (drive recorder) that uses a camera mounted on a vehicle to record video of the vehicle's surroundings has become known. By using such a recording device, it is possible to record video of accidents that occur on or around the vehicle while the vehicle is stopped or moving.

[0003] As a related technique, Patent Document 1 discloses an image recording device including a recording unit, a determination unit, and an operation control unit. In the image recording device, the recording unit records images captured by a camera mounted on a vehicle. The determination unit determines the risk of the vehicle being damaged while parked based on the surrounding conditions of the parking space. The operation control unit controls the operation of the recording unit while the vehicle is parked according to the risk determined by the determination unit. For example, the operation control unit stops the image recording operation of the recording unit when the risk is less than a predetermined risk. This allows the image recording device to stop capturing and recording unnecessary images while parked, thereby reducing battery power consumption. In this way, the image recording device can extend the recording time of images captured by the camera capturing images in a direction requiring vigilance as much as possible.

[0004] Japanese Patent Application Laid-Open No. 2019-022063

[0005] When there is a possibility that a vehicle may be damaged by a burglar or the like, it is desirable to prevent such damage before it occurs. The technology disclosed in Patent Document 1 does not sufficiently consider preventing damage to a vehicle before it occurs.

[0006] In view of the above-mentioned problems, an object of the present disclosure is to provide an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium that can reduce the possibility of harm to a vehicle.

[0007] The information processing device according to the present disclosure includes an acquisition means for acquiring sensor information relating to a parked vehicle obtained by a sensor; an estimation means for estimating the parking situation including the compliance status of the vehicle with regulations based on the sensor information; a calculation means for calculating the degree of risk of harm to the vehicle based on the parking situation; and a notification control means for notifying a user terminal of danger to the vehicle based on the degree of risk.

[0008] The information processing system according to the present disclosure comprises a sensor that detects sensor information relating to a parked vehicle; and an information processing device, wherein the information processing device has: an acquisition means that acquires the sensor information obtained by the sensor; an estimation means that estimates the parking situation including the compliance status of the vehicle with regulations based on the sensor information; a calculation means that calculates the risk of harm to the vehicle based on the parking situation; and an alert control means that alerts a user terminal to a danger to the vehicle based on the risk.

[0009] The information processing device method according to the present disclosure acquires sensor information about a parked vehicle obtained by a sensor, estimates the parking situation including the compliance status of the vehicle with regulations based on the sensor information, calculates a risk of harm to the vehicle based on the parking situation, and notifies a user terminal of the danger to the vehicle based on the risk.

[0010] The non-transitory computer-readable medium according to the present disclosure stores a program that causes a computer to execute the following operations: an acquisition process that acquires sensor information about a parked vehicle obtained by a sensor; an estimation process that estimates the parking situation, including the compliance status of the vehicle with regulations, based on the sensor information; a calculation process that calculates the risk of harm to the vehicle based on the parking situation; and a notification control process that notifies a user terminal of a danger to the vehicle based on the risk.

[0011] The information processing device, information processing system, information processing method, and non-transitory computer-readable medium according to the present disclosure can reduce the possibility of harm being inflicted on a vehicle.

[0012] FIG. 1 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 2 is a flowchart showing processing performed by an information processing device according to the present disclosure. FIG. 3 is a diagram showing an overall configuration of an information processing system according to the present disclosure. FIG. 4 is a block diagram showing a configuration of a vehicle according to the present disclosure. FIG. 5 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 6 is a diagram showing definition information as an example of a definition of a risk level according to the present disclosure. FIG. 7 is a diagram showing risk level information as an example of a specific example of a parking situation and a risk level according to the present disclosure. FIG. 8 is a diagram showing an example of determination condition information for determining whether to notify a user terminal according to the present disclosure. FIG. 9 is a flowchart showing processing performed by an information processing device according to the present disclosure. FIG. 10 is a block diagram showing an example of a hardware configuration of a computer that realizes an information processing device etc. according to the present disclosure.

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals. For clarity of explanation, duplicated explanations will be omitted as necessary. Note that in this disclosure, the drawings relate to one or more embodiments.

[0014] First Embodiment An information processing device 100 according to the present disclosure will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the information processing device 100 according to the present disclosure. The information processing device 100 includes an acquisition unit 101, an estimation unit 102, a calculation unit 103, and a notification control unit 104.

[0015] The acquisition unit 101 acquires sensor information about a parked vehicle obtained by a sensor. The estimation unit 102 estimates the parking situation, including the vehicle's compliance with regulations, based on the sensor information. The calculation unit 103 calculates the degree of risk of harm to the vehicle based on the parking situation. The notification control unit 104 notifies the user terminal of the danger to the vehicle based on the degree of risk.

[0016] The information processing device 100 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program that implements the processing according to this embodiment. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of an acquisition unit 101, an estimation unit 102, a calculation unit 103, and a notification control unit 104.

[0017] Alternatively, the acquisition unit 101, the estimation unit 102, the calculation unit 103, and the notification control unit 104 may each be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by a general-purpose or dedicated circuit, processor, etc., or a combination thereof. These may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program.

[0018] Next, the process performed by the information processing device 100 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing the process performed by the information processing device 100.

[0019] First, the acquisition unit 101 acquires sensor information about a parked vehicle obtained by a sensor (S1). Next, the estimation unit 102 estimates the parking situation, including the compliance status of the vehicle with regulations, based on the sensor information acquired by the acquisition unit 101 (S2). Next, the calculation unit 103 calculates the degree of risk of harm to the vehicle based on the parking situation estimated by the estimation unit 102 (S3). Then, the notification control unit 104 notifies the user terminal of the danger to the vehicle based on the degree of risk calculated by the calculation unit 103 (S4).

[0020] As described above, the information processing device 100 according to the present embodiment notifies the user terminal of a danger, allowing the user to recognize that the vehicle is in danger. The user can then take action, such as heading to a parking spot or honking the vehicle horn. Therefore, the information processing device 100 can reduce the possibility of the vehicle being harmed.

[0021] <Embodiment 2> Embodiment 2 is a specific example of the above-described embodiment 1. Fig. 3 is a diagram showing the overall configuration of an information processing system 1 according to the present disclosure. The information processing system 1 includes an information processing device 10, a vehicle 2, and a user terminal 8.

[0022] The information processing device 10, the in-vehicle device 4 of the vehicle 2, and the user terminal 8 are connected via a network N. The network N is a wired or wireless communication line. The network N may be, for example, the Internet, a dedicated line, a telephone line, a mobile communication network, or other communication line, and the type of communication is not limited. The network N may also be a combination of these.

[0023] Although the figure shows an example in which one in-vehicle device 4 and one user terminal 8 are connected to one information processing device 10, the numbers of in-vehicle devices 4 and user terminals 8 are not limited to those shown in the figure. That is, the number of in-vehicle devices 4 may be any number greater than or equal to one. The number of user terminals 8 may also be any number greater than or equal to one.

[0024] Here, we will explain the overview of the information processing system 1. The information processing system 1 is a system that performs predetermined processing using sensor information acquired from a sensor that detects information about the vehicle 2, and when there is a possibility that harm may be inflicted on the vehicle 2, notifies the user terminal 8 of this fact.

[0025] The vehicle 2 includes a sensor unit 3, a notification unit 5, and an on-board device 4. The sensor unit 3 detects sensor information related to the vehicle 2 and outputs the detection results to the on-board device 4. The sensor information detected by the sensor unit 3 includes, for example, captured images of the area around the vehicle 2, position information indicating the position of the vehicle 2, information indicating the brightness of the area around the vehicle 2, or sound information indicating sounds generated around the vehicle 2. While FIG. 3 illustrates the position of a front camera that captures images of the area ahead of the vehicle 2 as an example of the sensor unit 3, the sensor unit 3 may be composed of multiple sensors. Details of the sensor unit 3 and the sensor information will be described later.

[0026] The in-vehicle device 4 transmits the sensor information acquired from the sensor unit 3 to the information processing device 10. The information processing device 10 receives the sensor information from the in-vehicle device 4 and performs predetermined processing based on the sensor information to estimate the parking situation of the vehicle 2. Here, the parking situation indicates where the vehicle 2 is parked. The parking situation is information that may affect the risk of harm to the vehicle 2. The parking situation includes, for example, information regarding compliance with regulations, visibility from the surroundings, the time of parking, or surrounding sounds.

[0027] Furthermore, the information processing device 10 calculates the degree of risk that harm will be inflicted on the vehicle 2 based on the estimated parking situation. The degree of risk indicates the likelihood that harm will be inflicted on the vehicle 2. The higher the likelihood that harm will be inflicted on the vehicle 2, the higher the degree of risk. For example, if the vehicle 2 is parked in a no-parking location or in a location surrounded by a fence or the like that has low visibility from the surrounding area, there is a high possibility that harm will be inflicted on the vehicle 2 by a suspicious person or the like. Therefore, the information processing device 10 calculates a high degree of risk when the vehicle 2 is parked in such a location.

[0028] The information processing device 10 then notifies the user terminal 8 of the danger to the vehicle 2 based on the calculated degree of danger. The user terminal 8 is a terminal used by the user. The user terminal 8 may be, for example, a smartphone or a tablet terminal. The user is, for example, the owner of the vehicle 2. The user may also be a family member of the owner of the vehicle 2. If the vehicle 2 is a rental car, the user may be a rental car operator or a user. If the vehicle 2 is a shared car, the user may be the owner or user of the shared car. By being notified of the danger to the user terminal 8, the user can recognize that there is a possibility that the vehicle 2 may be harmed in the parking lot.

[0029] Furthermore, the information processing device 10 may cause the notification unit 5 to output a warning regarding the surroundings of the vehicle 2 based on an instruction from the user terminal 8. The instruction from the user terminal 8 may be issued in response to a danger being notified to the user terminal 8. For example, when the information processing device 10 notifies the user terminal 8 of a danger, the user terminal 8 may display details of the danger on a screen and further allow the user to select whether to output a warning regarding the surroundings of the vehicle 2. When the user selects to output a warning, the user terminal 8 may transmit an instruction to the information processing device 10 to output a warning regarding the surroundings of the vehicle 2.

[0030] The notification unit 5 outputs a warning using, for example, a lamp or a horn, thereby enabling the notification unit 5 to warn a suspicious person approaching the vehicle 2. The notification unit 5 can also notify people in the vicinity of the possibility that harm may be inflicted on the vehicle 2.

[0031] (Vehicle 2) Next, the configuration of the vehicle 2 will be described in detail with reference to Fig. 4. Fig. 4 is a block diagram showing the configuration of the vehicle 2 according to the present disclosure. The vehicle 2 includes a sensor unit 3, an in-vehicle device 4, and a notification unit 5.

[0032] The sensor unit 3 detects information related to the parked vehicle 2. For example, the sensor unit 3 detects sensor information related to the situation around the parked vehicle 2. The sensor unit 3 outputs the detected sensor information to the in-vehicle device 4. Note that the sensor unit 3 may detect information related to the vehicle 2 that is stopped or moving, not limited to when the vehicle 2 is parked.

[0033] The sensor unit 3 may be configured with one sensor or multiple sensors. In this embodiment, an example in which the sensor unit 3 is configured with multiple sensors will be described. For example, the sensor unit 3 includes a front camera 31, a rear camera 32, a position sensor 33, an illuminance sensor 34, and a microphone 35.

[0034] The front camera 31 and the rear camera 32 are imaging devices that photograph the surroundings of the vehicle 2 and acquire photographed images of the surroundings of the vehicle 2. The front camera 31 photographs the area in front of the vehicle 2 and outputs the photographed images to the in-vehicle device 4. The front camera 31 is provided in a position where it can photograph the area in front of the vehicle 2. The front camera 31 is provided, for example, above the front of the driver's seat or above the front of the passenger seat of the vehicle 2. The rear camera 32 photographs the area behind the vehicle 2 and outputs the photographed images to the in-vehicle device 4. The rear camera 32 is provided in a position where it can photograph the area behind the vehicle 2. The rear camera 32 is provided, for example, in the rear of the passenger compartment.

[0035] Here, the front camera 31 and the rear camera 32 are used, but the present invention is not limited to this. The sensor unit 3 may also include a camera that captures images of the right or left side of the vehicle 2. In the following description, the front camera 31 and the rear camera 32 may be collectively referred to simply as the "camera."

[0036] Although an example in which the camera is provided in the vehicle 2 has been described here, the camera may be provided elsewhere than in the vehicle 2. For example, the camera may be provided in infrastructure such as equipment provided near a road. For example, a camera provided in a traffic light may be used. The camera provided in the infrastructure is connected to the network N via a predetermined server and transmits the captured image to the information processing device 10. The camera provided in the infrastructure may transmit the captured image to the information processing device 10 by road-to-vehicle communication via a roadside device. The camera may also be configured as a surveillance camera provided in a parking lot or the like with which the user has a contract. Note that various sensors such as the microphone 35 described below may also be provided in the infrastructure.

[0037] The position sensor 33 detects position information indicating the position of the vehicle 2. The position sensor 33 detects the position of the parked vehicle 2, thereby detecting position information indicating the parking location of the vehicle 2. The position sensor 33 outputs the detected position information to the in-vehicle device 4. The position sensor 33 performs positioning using technology such as GNSS (Global Navigation Satellite System). The position sensor 33 can be configured, for example, with a GPS (Global Positioning System) receiver or the like.

[0038] The illuminance sensor 34 detects illuminance information indicating the brightness around the vehicle 2. The illuminance sensor 34 outputs the illuminance information to the in-vehicle device 4. As the illuminance sensor 34, for example, an infrared sensor or an ultraviolet sensor may be used.

[0039] The microphone 35 acquires sound information indicating sounds generated around the vehicle 2. The microphone 35 detects, for example, environmental sounds including sounds emitted from the vehicle 2 and sounds emitted from around the vehicle 2. The microphone 35 may also detect sound information indicating the voices of people around the vehicle 2. The microphone 35 outputs the acquired sound information to the in-vehicle device 4.

[0040] The above-described configuration of the sensor unit 3 is an example. The sensor unit 3 may include some of the above-described multiple sensors. The sensor unit 3 may also include a sensor other than the above-described multiple sensors. For example, the sensor unit 3 may include a distance measurement sensor. The distance measurement sensor is a sensor that measures the distance to an object present in the vicinity of the vehicle 2. The distance measurement sensor may be, for example, a LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) sensor. The distance measurement sensor may also be a stereo camera, a ToF (Time of Flight) camera, a millimeter-wave radar, or the like. The distance measurement sensor may also have the functions of the above-described front camera 31 and rear camera 32.

[0041] The sensor unit 3 may also include an impact detection sensor for detecting an impact and a human presence sensor for detecting a person approaching the vehicle 2. In this way, the sensor unit 3 includes multiple types of sensors, so that the information processing device 10 can acquire many types of sensor information. This allows the information processing device 10 to estimate the parking situation with high accuracy.

[0042] The notification unit 5 issues a notification to those around the vehicle 2. The notification unit 5 includes a lamp 51 and a horn 52. The lamp 51 issues a notification by turning on, and the horn 52 issues a notification by outputting a warning sound.

[0043] The in-vehicle device 4 includes an acquisition unit 41, a communication unit 42, and a vehicle control unit 43. The acquisition unit 41 acquires sensor information from the sensor unit 3. The acquisition unit 41 transmits the acquired sensor information to the information processing device 10 via the communication unit 42. The acquisition unit 41 may transmit the sensor information at predetermined time intervals. The in-vehicle device 4 may be realized by a drive recorder.

[0044] The communication unit 42 communicates between the information processing device 10 and the user terminal 8. The communication unit 42 may be configured with a communication interface for wireless communication. The vehicle control unit 43 controls the operation of the vehicle 2. The vehicle control unit 43 may be configured with an ECU (Electronic Control Unit) for controlling the operation of the vehicle 2, etc. The vehicle control unit 43 controls the notification unit 5 in accordance with instructions from the information processing device 10. For example, the information processing device 10 performs control such as turning on a lamp 51 and sounding a horn 52.

[0045] (Information processing device 10) Next, the information processing device 10 will be described in detail with reference to Fig. 5. Fig. 5 is a block diagram showing the configuration of the information processing device 10 according to the present disclosure. The information processing device 10 is an example of the information processing device 100 described above. The information processing device 10 includes an acquisition unit 11, an estimation unit 12, a calculation unit 13, a notification control unit 14, a communication unit 17, and a storage unit 19.

[0046] The acquisition unit 11 is an example of the acquisition unit 101 described above. The acquisition unit 11 acquires sensor information related to the parked vehicle 2 obtained by the sensor unit 3. The acquisition unit 11 may acquire the sensor information at predetermined time intervals. For example, the acquisition unit 11 acquires, as sensor information, information related to the parking location of the vehicle 2, captured images of the area around the vehicle 2, information indicating the brightness of the area around the vehicle 2, or sound information indicating sounds generated around the vehicle 2. The information related to the parking location is images captured by the front camera 31 and the rear camera 32 and position information of the vehicle 2. The acquisition unit 11 may acquire part of this sensor information. The acquisition unit 11 may also acquire information other than these as sensor information.

[0047] The estimation unit 12 is an example of the estimation unit 102 described above. The estimation unit 12 estimates the parking situation including the compliance status of regulations in the vehicle 2 based on sensor information. The compliance status of regulations is information indicating whether the parking state of the vehicle 2 complies with parking regulations. The compliance status of regulations may be information indicating the degree of compliance with regulations that should be complied with. For example, the estimation unit 12 may calculate the proportion of regulations that are complied with among multiple regulations that should be complied with, and estimate the compliance status of regulations using this proportion.

[0048] Parking regulations are stipulated by laws and regulations such as the Road Traffic Act. Parking regulations include regulations regarding parking locations. For example, the Road Traffic Act stipulates areas where parking and stopping of vehicles are prohibited, and areas where parking is prohibited. In areas where parking and stopping are prohibited, both parking and stopping are prohibited. In areas where parking is prohibited, parking is prohibited, but stopping is allowed.

[0049] Examples of places where parking is prohibited include the following: (A1) Places where parking is prohibited by road signs or road markings prohibiting parking (A2) Intersections, pedestrian crossings, bicycle crossings, railroad crossings, within the tracks, near the top of a slope, a steep slope or tunnel (A3) Areas within 5m from the side edge of an intersection or a bend in the road (A4) Areas within 5m in front and behind the front and rear edges of a pedestrian crossing or bicycle crossing (A5) Areas on the left side of a safety zone on roads where such a zone is provided, and areas within 10m in front and behind the front and rear edges of such an area (A6) Areas within 10m from the location of a signpost or signboard indicating a bus, trolleybus or streetcar stop, etc. (only during the operating hours of a public bus, trolleybus or streetcar belonging to the route related to the stop, etc.) (A7) Areas within 10m in front and behind the front and rear edges of a railroad crossing

[0050] In addition, places where parking is prohibited include, for example, the following: (B1) Places where parking is prohibited by road signs or road markings indicating no parking (B2) Within a 3m radius of a car entrance / exit for vehicles such as a parking lot or garage (B3) Within 5m from the side edge of a road construction area (B4) Within 5m from the side edge of a fire-fighting equipment storage area or a fire-fighting fire tank, or an entrance / exit adjacent to these roads (B5) Within 5m from the location of a fire hydrant or designated fire water supply sign, or from the intake or suction pipe insertion hole of a fire-fighting fire tank (B6) Within 1m from a fire alarm (B7) Places where there is no more than 3.5m of space on the road to the right of the vehicle

[0051] In the following description, both places where parking is prohibited and places where parking and stopping are prohibited will be collectively referred to simply as "no parking zones." Note that no parking zones are not limited to areas defined by laws and regulations as described above. No parking zones may also include areas where parking vehicle 2 constitutes nuisance parking, causing inconvenience to the manager or user of the parking space. No parking zones include, for example, areas where only vehicles of specific persons can park. No parking zones may be set arbitrarily using conditions such as whether or not there is one or more lanes in each direction. The estimation unit 12 estimates the parking situation, including whether or not the parking space is a no parking zone.

[0052] The estimation unit 12 determines whether the vehicle 2 is parked in a no-parking zone based on the sensor information. For example, the estimation unit 12 makes this determination using an image captured by the front camera 31 or the rear camera 32. The estimation unit 12 uses known image recognition to extract road signs or road markings indicating no parking or stopping from the captured image, and determines whether the parking location of the vehicle 2 is in a no-parking zone.

[0053] The estimation unit 12 may make the determination using an image taken from the parking location of the vehicle 2, or may make the determination using an image taken from the travel route to the parking location. This allows the estimation unit 12 to correctly determine whether the parking location is in a no-parking zone even if road signs and the like are not included in the shooting range of the camera at the parking location.

[0054] Furthermore, the estimation unit 12 may make the determination using the position information of the vehicle 2. When the position information of the parked vehicle 2 indicates that the vehicle is in a no-parking zone, the estimation unit 12 determines that the vehicle 2 is parked in a no-parking zone. The estimation unit 12 may also make the determination taking into account the operating hours of buses or streetcars. For example, when the vehicle 2 is parked in a location where parking is prohibited only during specified operating hours, the estimation unit 12 makes the determination taking into account whether the parking time falls within the specified operating hours. When it is determined that the vehicle 2 is parked in a no-parking zone, the estimation unit 12 estimates that the vehicle 2 is not complying with regulations.

[0055] The estimation unit 12 may estimate the parking situation further including a situation regarding the visibility of the vehicle 2 from the surroundings, based on the sensor information. For example, the estimation unit 12 extracts objects present around the vehicle 2 from the captured image, and estimates the level of visibility of the vehicle 2 from the surroundings based on the objects. The estimation unit 12 extracts objects present around the vehicle 2 from the captured image using a known image recognition technique. The estimation unit 12 determines whether or not any of the extracted objects reduces the visibility of the vehicle 2 from the surroundings.

[0056] An example of an object that reduces visibility from the surroundings is an object whose height from the ground is equal to or greater than a predetermined value. An example of an object that reduces visibility from the surroundings is a gate or a fence. When such an object is present, visibility from the surroundings is poor, making it difficult for the vehicle 2 to be seen from the surroundings. Furthermore, suspicious individuals who wish to harm the vehicle 2 can easily hide behind the object. This increases the risk of harm to the vehicle 2. When an object whose height is equal to or greater than a predetermined value is present in the surroundings, the estimation unit 12 determines that the visibility of the vehicle 2 from the surroundings is low. The estimation unit 12 may make this determination by taking into account the width of the object.

[0057] Furthermore, the estimation unit 12 may estimate the level of visibility of the vehicle 2 from the surroundings based on the brightness of the surroundings of the vehicle 2. For example, if the vehicle 2 is parked in a dark place even during the daytime, the vehicle 2 and any suspicious person approaching the vehicle 2 are unlikely to be seen by those around. This increases the risk of harm to the vehicle 2. For example, this applies to a multi-story parking garage. The estimation unit 12 estimates the level of visibility based on illuminance information acquired by the illuminance sensor 34. If the illuminance is less than a predetermined value, the estimation unit 12 determines that the visibility of the vehicle 2 from the surroundings is low. The estimation unit 12 may make this determination taking into account the time of day.

[0058] The estimation unit 12 may also determine whether the parking space is accessible to an unspecified number of people and determine the level of visibility based on the determination result. For example, suppose vehicle 2 is parked in a parking space that has no gate or fence and is accessible to an unspecified number of people. In this case, vehicle 2 is easily visible from the surroundings, but it is difficult for those around to distinguish whether a person approaching vehicle 2 is a legitimate user or a suspicious person. Therefore, in such a case, there is a high risk of harm to vehicle 2.

[0059] The estimation unit 12 uses the location information to determine whether the parking space is accessible to an unspecified number of people, and if it is determined that the parking space is accessible, determines that the visibility from the surroundings of the vehicle 2 is low. The estimation unit 12 may also use an image captured by a camera to determine whether the parking space is a place without a gate or the like, thereby determining whether the parking space is accessible to an unspecified number of people.

[0060] Furthermore, the estimation unit 12 may estimate the number of people around the vehicle 2 based on the time period during which the vehicle 2 is parked, and estimate the parking situation based on the estimation result. For example, the estimation unit 12 obtains the current time using a timer (not shown) and identifies the time period corresponding to the current time. Examples of the time period include, but are not limited to, morning, daytime, and nighttime. The time period may be set using a specific time. The time period may be divided into any time periods corresponding to the level of risk of harm to the vehicle 2.

[0061] In many cases, there are fewer people on the roads in the morning and at night than during the day. Therefore, in the morning and at night, the vehicle 2 and suspicious individuals are less likely to be seen by people in the vicinity, increasing the risk of harm to the vehicle 2. The estimation unit 12 determines whether the parking time is during the day, and estimates the number of people on the roads around the vehicle 2 based on the determination result. If it is determined that the parking time is during the day, the estimation unit 12 estimates that there is a lot of people on the roads around the vehicle 2. Furthermore, if it is determined that the parking time is other than during the day, the estimation unit 12 estimates that there is a small number of people on the roads around the vehicle 2. The time period during which harm is more likely to occur may be set appropriately depending on the parking location.

[0062] Furthermore, the estimation unit 12 may estimate the number of people passing by around the vehicle 2 based on the sound information, and estimate the parking situation based on the estimation result. For example, in a quiet place where there are always few people passing by, the risk of harm to the vehicle 2 is high. On the other hand, in a place where noise is always generated, such as a factory, the risk of harm to the vehicle 2 is low. The estimation unit 12 uses known voice recognition technology to analyze sound information indicated by environmental sounds acquired from the microphone 35 and estimate the number of people passing by. The estimation unit 12 estimates the number of people passing by by detecting, for example, human voices or the sound of vehicles running from environmental sounds.

[0063] The calculation unit 13 is an example of the above-mentioned calculation unit 103. The calculation unit 13 calculates the degree of risk of harm to the vehicle 2 based on the parking situation estimated by the estimation unit 12. For example, the calculation unit 13 calculates the degree of risk corresponding to the parking situation by referring to definition information that defines the degree of risk.

[0064] 6 is a diagram showing definition information 191 as an example of a definition of the risk level. The definition information 191 is information that associates the degree of risk with the likelihood that harm will be inflicted on the vehicle 2. In this embodiment, the definition information 191 is stored in advance in the storage unit 19. In this example, the risk level is set in four stages from "0" to "3." The risk level is set so that it is smaller the lower the likelihood that harm will be inflicted on the vehicle 2 and is larger the higher the likelihood that harm will be inflicted on the vehicle 2.

[0065] For example, if the possibility of harm to vehicle 2 is extremely low, the parking situation of vehicle 2 is not dangerous. In this case, the risk level is set to the lowest level of "0." When the risk level is "0," the user does not need to be particularly vigilant about the parking situation.

[0066] Furthermore, if the possibility of harm to vehicle 2 is higher than when the risk level is "0," the parking situation of vehicle 2 is slightly dangerous. In this case, the risk level is set to "1." If the risk level is "1," it is desirable for the user to be cautious about the parking situation of vehicle 2, for example by considering moving vehicle 2.

[0067] Furthermore, if the possibility of harm to vehicle 2 is even higher than when the risk level is "1," the parking situation of vehicle 2 is considered somewhat dangerous. In this case, the risk level is set to "2." If the risk level is "2," it is recommended that the user be more vigilant about the parking situation. For example, it is recommended that the user move vehicle 2 to another location.

[0068] If the possibility of harm to vehicle 2 is even higher than when the risk level is "2," the parking situation of vehicle 2 is very dangerous. In this case, the highest risk level, "3," is set. If the risk level is "3," it is recommended that the user further increase vigilance regarding the parking situation. For example, it is recommended that the user immediately move vehicle 2 to another location.

[0069] Although the example in which the risk level is set in four stages has been shown here, the risk level may be set in any number of stages. Furthermore, the risk level is not limited to being expressed in the form of stages, and may be expressed in the form of, for example, a numerical value.

[0070] The calculation unit 13 may calculate the risk level each time depending on the parking situation, or may calculate the risk level by referring to a predetermined data table and acquiring the risk level corresponding to the parking situation. Here, the risk level information 192 shown in FIG. 7 is used as an example of the data table. FIG. 7 is a diagram showing the risk level information 192 as an example of a specific example of a parking situation and an example of the risk level. In this embodiment, the risk level information 192 is stored in the storage unit 19 in advance.

[0071] The risk level information 192 is information that associates specific examples of parking situations with risk levels. In the figure, the risk level information 192 is shown for each type of parking situation. The types of parking situations include, but are not limited to, compliance with regulations, visibility from the surroundings, parking time zone, and surrounding sounds.

[0072] For example, suppose that the estimation unit 12 estimates that the vehicle 2 is parked in a no-parking zone. The calculation unit 13 refers to the risk level information 192 and calculates the risk level to be "3." Note that while FIG. 7 shows only examples of risk levels 1 to 3, the risk level information 192 may also include examples of a risk level of 0.

[0073] In the risk level information 192, a parking situation in which regulations are not observed is set to a higher risk level than a parking situation in which regulations are observed. In addition, in the risk level information 192, a parking situation in which visibility from the surroundings of the vehicle 2 is low is set to a higher risk level than a parking situation in which visibility is high. In addition, in the risk level information 192, a parking situation in which there is little pedestrian traffic is set to a higher risk level than a parking situation in which there is a lot of pedestrian traffic.

[0074] When the parking situation includes multiple pieces of information, the calculation unit 13 calculates a risk level corresponding to each of the multiple pieces of information. The calculation unit 13 may calculate an aggregate value of the risk level based on the risk levels corresponding to each of the multiple pieces of information. For example, suppose the parking location is in a no-parking zone and has poor visibility. In this case, the calculation unit 13 calculates risk levels of 3 and 2, respectively. The calculation unit 13 may also calculate the aggregate value as 5, which is the total value of the risk levels. The aggregate value is not limited to a simple sum. For example, the aggregate value may be a value obtained by adding up the risk levels corresponding to each of the multiple pieces of information with a predetermined weighting.

[0075] Returning to Fig. 5, the explanation will be continued. The notification control unit 14 is an example of the notification control unit 104 described above. The notification control unit 14 notifies the user terminal 8 of a risk to the vehicle 2 based on the risk level calculated by the calculation unit 13. For example, the notification control unit 14 determines whether to notify the user terminal 8 using a predetermined determination condition. The predetermined determination condition may be set in advance by a user or the like. Here, it is assumed that determination condition information 193 indicating the predetermined determination condition is stored in the storage unit 19.

[0076] 8 is a diagram showing an example of the judgment condition information 193 for determining whether to notify the user terminal 8. The judgment condition information 193 includes information on the overall risk level, which can be "high," "medium," "low," or "not applicable." The overall risk level is a comprehensive assessment of the risk level of the parking situation of the vehicle 2. The overall risk level is associated with the risk level for each type.

[0077] For example, suppose the risk level is 2 or higher for all types of regulatory compliance, visibility from the surroundings, parking time zone, and surrounding sounds. In this case, the overall risk level is "high." If the overall risk level does not fall under "high" and there is at least one type with a risk level of 2 or higher, the overall risk level is "medium." If the overall risk level does not fall under either "high" or "medium" and the risk level for all types is 1 or higher, the overall risk level is "low." If the overall risk level does not fall under any of the above-mentioned "high," "medium," or "low," the overall risk level is "not applicable." This indicates that the risk is low enough that it does not need to be subject to notification.

[0078] The notification control unit 14 refers to the determination condition information 193 to calculate a total risk level corresponding to the parking situation of the vehicle 2, and determines whether or not to notify the user terminal 8 based on the total risk level. Specifically, the notification control unit 14 determines to notify the user terminal 8 if the total risk level is "high," "medium," or "low," and determines not to notify the user terminal 8 if the total risk level is "not applicable." Without being limited to this, the notification control unit 14 may determine to notify only if the total risk level is "high," for example.

[0079] If it is determined that the user terminal 8 should be notified, the notification control unit 14 generates notification information for notifying the user of the danger. The notification control unit 14 transmits the generated notification information to the user terminal 8 via the communication unit 17. The notification information may include text information, image information, etc. The text information may be, for example, information indicating the nature and level of danger. The image information may be an image captured by the front camera 31 or the rear camera 32. As a result, the notification control unit 14 outputs the notification information from an output unit (not shown) of the user terminal 8. The output unit is, for example, a display unit such as a display, or an audio output unit such as a speaker. This makes the user aware that there is a risk of harm to the vehicle 2.

[0080] Note that the above-described determination condition information 193 is an example, and the notification control unit 14 may determine whether or not to notify using other conditions. For example, the notification control unit 14 may make this determination using an aggregated value of the risk level. The notification control unit 14 determines to notify the user terminal 8 if the aggregated value is equal to or greater than a predetermined value, and determines not to notify if the aggregated value is less than the predetermined value.

[0081] Furthermore, the notification control unit 14 issues a warning to those around the vehicle 2 based on an instruction from the user terminal 8. For example, the notification control unit 14 receives an instruction to issue a warning to those around the vehicle 2 from the user terminal 8. For example, the user terminal 8 transmits the instruction to the information processing device 10 via an input unit (not shown). The input unit (not shown) may be, for example, a touch panel.

[0082] The notification control unit 14 generates warning information for causing the notification unit 5 of the vehicle 2 to output a warning, and transmits the warning information to the in-vehicle device 4. The in-vehicle device 4 receives the warning information at the communication unit 42. The vehicle control unit 43 controls the notification unit 5 in accordance with the warning information. As a result, for example, the lamp 51 is turned on, or the horn 52 outputs a warning sound. Both the lamp 51 and the horn 52 may output a warning.

[0083] The notification control unit 14 may automatically issue a notification using a predetermined condition. The predetermined condition may be, for example, that the overall risk level is "high," "medium," or "low." The predetermined condition is not limited to this, and may be set arbitrarily by the user, etc. The notification control unit 14 automatically issues a warning when the predetermined condition is satisfied. This allows the notification control unit 14 to automatically issue a warning even without an instruction from the user terminal 8.

[0084] Continuing the explanation, returning to Fig. 5, the communication unit 17 communicates between the in-vehicle device 4 and the user terminal 8. The communication unit 17 may be configured with a communication interface for performing wired or wireless communication.

[0085] The storage unit 19 is configured with a semiconductor memory or the like, and stores various data and programs. At least a part of the storage unit 19 is configured with a non-volatile memory so that data is retained even when the power of the information processing device 10 is turned off. In addition to the program according to this embodiment, the storage unit 19 stores the definition information 191, risk level information 192, and judgment condition information 193 described above.

[0086] The above describes the configuration of the information processing system 1. Note that the configuration of the information processing system 1 described above is merely an example and may be modified as appropriate. For example, when some or all of the components of the sensor unit 3, the in-vehicle device 4, and the information processing device 10 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each is connected via a communication network. Furthermore, for example, the functions of the information processing device 10 may be provided in a SaaS (Software as a Service) format.

[0087] Furthermore, for example, in the above description, an example is shown in which the definition information 191, the risk level information 192, and the judgment condition information 193 are stored in the storage unit 19 of the information processing device 10, but these pieces of information may be stored in a device other than the information processing device 10. Furthermore, the vehicle 2 may be configured to include the information processing device 10. For example, the in-vehicle device 4 may be configured to include the functions of the information processing device 10.

[0088] Furthermore, in the above description, an example has been described in which the information processing device 10 issues a warning based on the overall risk level. However, the information processing device 10 may also perform processing other than reporting. For example, the information processing device 10 may perform processing to detect a suspicious person according to the overall risk level. For example, when the overall risk level is "high," the information processing device 10 uses known image recognition technology to identify a person exhibiting a specific behavior or a specific posture from a captured image. In this way, the information processing device 10 detects a suspicious person in the vicinity of the vehicle 2. When a suspicious person is detected, the information processing device 10 transmits information about the suspicious person to the user terminal 8. This allows the user to recognize the presence of the suspicious person before harm is caused to the vehicle 2.

[0089] (Processing of Information Processing Device 10) Next, processing performed by the information processing device 10 according to the present disclosure will be described with reference to FIG. 9 . FIG. 9 is a flowchart showing processing performed by the information processing device 10. First, the acquisition unit 11 acquires sensor information obtained by the sensor unit 3 from the in-vehicle device 4 (S11). The sensor information includes, for example, information about the parking location of the vehicle 2, a captured image of the area around the vehicle 2, information indicating the brightness of the area around the vehicle 2, or sound information indicating sounds generated around the vehicle 2. Next, the estimation unit 12 estimates the parking situation, including the compliance status with regulations, based on the sensor information (S12). The parking situation includes, for example, information about the compliance status with regulations, visibility from the surroundings, the time period during parking, or surrounding sounds.

[0090] Next, the calculation unit 13 calculates the degree of risk of harm to the vehicle based on the parking situation (S13). For example, the calculation unit 13 refers to the definition information 191 and the risk level information 192 to calculate the risk level corresponding to the parking situation. Next, the notification control unit 14 determines whether or not to notify the user terminal 8 of a risk to the vehicle 2 based on the risk level (S14). For example, the notification control unit 14 refers to the determination condition information 193 to calculate a total risk level corresponding to the parking situation, and determines whether or not to notify the user terminal 8 based on the total risk level.

[0091] If it is determined that no notification should be issued (NO in S14), the information processing device 10 returns to the process of S11 and repeats the subsequent processes. If it is determined that a notification should be issued (YES in S14), the notification control unit 14 notifies the user terminal 8 of the danger to the vehicle 2 (S15). Specifically, the notification control unit 14 generates notification information including text information, image information, etc., and transmits the notification information to the user terminal 8.

[0092] Next, the notification control unit 14 determines whether or not there is an instruction to issue a warning from the user terminal 8 (S16). If it is determined that there is an instruction from the user terminal 8 (YES in S16), the notification control unit 14 issues a warning from the vehicle 2 (S17). Specifically, the notification control unit 14 generates warning information for outputting a warning and transmits the warning information to the in-vehicle device 4. As a result, the lamps 51, the horn 52, etc. in the vehicle 2 output a warning. If the notification control unit 14 determines that there is no instruction from the user terminal 8 (NO in S16), the information processing device 10 ends the processing.

[0093] As described above, in the information processing system 1 according to this embodiment, the information processing device 10 acquires sensor information related to the parked vehicle 2 obtained by the sensor unit 3 of the vehicle 2. Based on the sensor information, the information processing device 10 estimates the parking situation, including the compliance status of the vehicle 2 with regulations, and calculates the degree of risk of harm to the vehicle 2 based on the parking situation. Furthermore, the information processing device 10 notifies the user terminal 8 of danger to the vehicle 2 based on the degree of risk.

[0094] In this way, the information processing system 1 can notify the user of the risk of harm to the vehicle 2, thereby preventing harm from being caused to the vehicle 2. Furthermore, the information processing system 1 can output a warning from the vehicle 2 in response to an instruction from the user terminal 8, thereby reducing the possibility of harm being caused to the vehicle 2.

[0095] Furthermore, since the information processing system 1 can use an existing drive recorder as the in-vehicle device 4, the addition of hardware can be minimized and can be handled by software improvements. Furthermore, since sensor information acquired by the sensor unit 3 provided in the vehicle 2 can be used, the information processing system 1 can be realized without relying on installed equipment such as a surveillance camera. As a result, the processing according to the present disclosure can be performed even when the vehicle 2 is parked in a location other than a designated parking lot.

[0096] In the present embodiment, the configuration and processing have been described with reference to the drawings, but the configuration and processing according to the present embodiment are not limited to the drawings that have been referred to. Furthermore, the configuration and processing according to the present embodiment may be related to drawings that have not been referred to.

[0097] <Example of Hardware Configuration> Each functional component of the information processing device 10, the in-vehicle device 4, and the user terminal 8 (hereinafter referred to as "information processing device 10, etc.") may be realized by hardware that realizes each functional component (e.g., a hardwired electronic circuit, etc.), or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it). Below, a case where each functional component of the information processing device 10, etc., is realized by a combination of hardware and software will be further described.

[0098] 10 is a block diagram illustrating an example of the hardware configuration of a computer 900 that realizes the information processing device 10, etc. The computer 900 may be a dedicated computer designed to realize the information processing device 10, etc., or may be a general-purpose computer. The computer 900 may also be a portable computer such as a smartphone or a tablet terminal.

[0099] For example, by installing a predetermined application on the computer 900, the computer 900 realizes each function of the information processing device 10, etc. The application is configured by a program for realizing the functional components of the information processing device 10, etc.

[0100] The computer 900 has a bus 902, a processor 904, a memory 906, a storage device 908, an input / output interface 910, and a network interface 912. The bus 902 is a data transmission path for the processor 904, the memory 906, the storage device 908, the input / output interface 910, and the network interface 912 to transmit and receive data to and from each other. However, the method of connecting the processor 904 and other components to each other is not limited to a bus connection.

[0101] The processor 904 is a variety of processors, such as a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), or a quantum processor (quantum computer control chip). The memory 906 is a main storage device realized using a random access memory (RAM) or the like. The storage device 908 is an auxiliary storage device realized using a hard disk, a solid state drive (SSD), a memory card, a read only memory (ROM), or the like.

[0102] The input / output interface 910 is an interface for connecting the computer 900 with input / output devices. For example, the input / output interface 910 is connected to an input device such as a keyboard and an output device such as a display device.

[0103] The network interface 912 is an interface for connecting the computer 900 to a network. This network may be a LAN (Local Area Network) or a WAN (Wide Area Network).

[0104] The storage device 908 stores programs (programs that realize the above-mentioned applications) that realize the various functional components of the information processing device 10, etc. The processor 904 reads these programs into the memory 906 and executes them to realize the various functional components of the information processing device 10, etc.

[0105] Each processor executes one or more programs containing instructions for causing a computer to perform the algorithms described with reference to the figures. The programs contain instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The programs may be stored on various types of non-transitory computer-readable or tangible storage media. By way of example and not limitation, non-transitory computer-readable or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The programs may also be transmitted over various types of transitory computer-readable or communication media. By way of example and not limitation, transitory computer-readable or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0106] The present disclosure is not limited to the above-described embodiments, and can be modified as appropriate within the scope of the present disclosure.

[0107] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Supplementary Note 1) An information processing device comprising: an acquisition means for acquiring sensor information related to a parked vehicle obtained by a sensor; an estimation means for estimating a parking situation including a compliance status of the vehicle with regulations based on the sensor information; a calculation means for calculating a risk of harm to the vehicle based on the parking situation; and a notification control means for notifying a user terminal of a risk to the vehicle based on the risk. (Supplementary Note 2) The information processing device according to Supplementary Note 1, wherein the sensor information includes information related to a parking location of the vehicle, and the estimation means estimates the parking situation including whether the parking location is within a no-parking zone. (Supplementary Note 3) The information processing device according to Supplementary Note 1 or 2, wherein the estimation means estimates the parking situation further including a status related to visibility of the vehicle from the surroundings based on the sensor information. (Supplementary Note 4) The information processing device according to Supplementary Note 3, wherein the sensor information includes a captured image of the surroundings of the vehicle, and the estimation means extracts objects present around the vehicle from the captured image and estimates a level of visibility of the vehicle from the surroundings based on the objects. (Supplementary Note 5) The information processing device according to Supplementary Note 3 or 4, wherein the sensor information includes information indicating brightness around the vehicle, and the estimation means estimates a level of visibility of the vehicle from the surroundings based on the brightness around the vehicle. (Supplementary Note 6) The information processing device according to any one of Supplements 1 to 5, wherein the estimation means estimates a level of pedestrian traffic around the vehicle based on a parking time zone, and estimates the parking situation in accordance with the estimation result. (Supplementary Note 7) The information processing device according to any one of Supplements 1 to 6, wherein the sensor information includes sound information indicating sounds generated around the vehicle, and the estimation means estimates a level of pedestrian traffic around the vehicle based on the sound information, and estimates the parking situation in accordance with the estimation result. (Supplementary Note 8) The information processing device according to any one of Supplementary Notes 1 to 7, wherein the notification control means issues a warning to the surroundings of the vehicle based on an instruction from the user terminal.(Supplementary Note 9) An information processing system comprising: a sensor that detects sensor information related to a parked vehicle; and an information processing device, wherein the information processing device has: an acquisition means for acquiring the sensor information obtained by the sensor; an estimation means for estimating a parking situation including a compliance status of the vehicle with regulations based on the sensor information; a calculation means for calculating a risk of harm to the vehicle based on the parking situation; and a notification control means for notifying a user terminal of a risk to the vehicle based on the risk. (Supplementary Note 10) The information processing system according to Supplementary Note 9, wherein the sensor information includes information related to a parking location of the vehicle, and the estimation means estimates the parking situation including whether the parking location is within a no-parking zone. (Supplementary Note 11) The information processing system according to Supplementary Note 9 or 10, wherein the estimation means estimates the parking situation further including a status related to visibility of the vehicle from the surroundings based on the sensor information. (Supplementary Note 12) The information processing system according to Supplementary Note 11, wherein the sensor information includes a captured image of the surroundings of the vehicle, and the estimation means extracts objects present around the vehicle from the captured image and estimates a level of visibility of the vehicle from the surroundings based on the objects. (Supplementary Note 13) The information processing system according to Supplementary Note 11 or 12, wherein the sensor information includes information indicating brightness around the vehicle, and the estimation means estimates a level of visibility of the vehicle from the surroundings based on the brightness around the vehicle. (Supplementary Note 14) The information processing system according to any one of Supplements 9 to 13, wherein the estimation means estimates a level of pedestrian traffic around the vehicle based on a parking time zone, and estimates the parking situation in accordance with the estimation result. (Supplementary Note 15) The information processing system according to any one of Supplements 9 to 14, wherein the sensor information includes sound information indicating sounds generated around the vehicle, and the estimation means estimates a level of pedestrian traffic around the vehicle based on the sound information, and estimates the parking situation in accordance with the estimation result. (Supplementary Note 16) The information processing system according to any one of Supplementary Notes 9 to 15, wherein the notification control means issues a warning to the surroundings of the vehicle based on an instruction from the user terminal.(Supplementary Note 17) An information processing method comprising: acquiring sensor information about a parked vehicle obtained by a sensor; estimating a parking situation including a compliance status of the vehicle with regulations based on the sensor information; calculating a risk of harm to the vehicle based on the parking situation; and notifying a user terminal of the risk of the vehicle based on the risk. (Supplementary Note 18) The information processing method according to Supplementary Note 17, wherein the sensor information includes information about a parking location of the vehicle; and estimating the parking situation includes estimating the parking situation including whether the parking location is in a no-parking zone. (Supplementary Note 19) The information processing method according to Supplementary Note 17 or 18, wherein the estimating the parking situation further includes a status regarding visibility of the vehicle from the surroundings based on the sensor information. (Supplementary Note 20) The information processing method according to Supplementary Note 19, wherein the sensor information includes captured images of the surroundings of the vehicle; and estimating the parking situation includes extracting objects present around the vehicle from the captured images and estimating a level of visibility of the vehicle from the surroundings based on the objects. (Supplementary Note 21) The information processing method according to Supplementary Note 19 or 20, wherein the sensor information includes information indicating brightness around the vehicle, and the estimating of the parking situation includes estimating a level of visibility of the vehicle from the surroundings based on the brightness around the vehicle. (Supplementary Note 22) The information processing method according to any one of Supplements 17 to 21, wherein the estimating of the parking situation includes estimating a level of pedestrian traffic around the vehicle based on a parking time zone, and estimating the parking situation based on the estimation result. (Supplementary Note 23) The information processing method according to any one of Supplements 17 to 22, wherein the sensor information includes sound information indicating sounds generated around the vehicle, and the estimating of the parking situation includes estimating a level of pedestrian traffic around the vehicle based on the sound information, and estimating the parking situation based on the estimation result. (Supplementary Note 24) The information processing method according to any one of Supplements 17 to 23, wherein the notifying of the danger includes issuing a warning around the vehicle based on an instruction from the user terminal.(Supplementary Note 25) A non-transitory computer-readable medium storing a program that causes a computer to execute the following: an acquisition process that acquires sensor information about a parked vehicle obtained by a sensor; an estimation process that estimates a parking situation including a compliance status of the vehicle with regulations based on the sensor information; a calculation process that calculates a risk of harm to the vehicle based on the parking situation; and a notification control process that notifies a user terminal of a risk to the vehicle based on the risk. (Supplementary Note 26) The non-transitory computer-readable medium according to Supplementary Note 25, wherein the sensor information includes information about a parking location of the vehicle, and the estimation process estimates the parking situation including whether the parking location is in a no-parking zone. (Supplementary Note 27) The non-transitory computer-readable medium according to Supplementary Note 25 or 26, wherein the estimation process estimates the parking situation further including a status regarding visibility of the vehicle from the surroundings based on the sensor information. (Supplementary Note 28) The non-transitory computer-readable medium according to Supplementary Note 27, wherein the sensor information includes a captured image of the surroundings of the vehicle, and the estimation process extracts objects present around the vehicle from the captured image and estimates a level of visibility of the vehicle from the surroundings based on the objects. (Supplementary Note 29) The non-transitory computer-readable medium according to Supplementary Note 27 or 28, wherein the sensor information includes information indicating brightness around the vehicle, and the estimation process estimates a level of visibility of the vehicle from the surroundings based on the brightness around the vehicle. (Supplementary Note 30) The non-transitory computer-readable medium according to any one of Supplements 25 to 29, wherein the estimation process estimates a level of pedestrian traffic around the vehicle based on a parking time zone, and estimates the parking situation according to the estimation result. (Supplementary Note 31) The non-transitory computer-readable medium according to any one of Supplements 25 to 30, wherein the sensor information includes sound information indicating sounds generated around the vehicle, and the estimation process estimates the number of people around the vehicle based on the sound information and estimates the parking situation based on the estimation result. (Supplementary Note 32) The non-transitory computer-readable medium according to any one of Supplements 25 to 31, wherein the notification control process issues a warning around the vehicle based on an instruction from the user terminal.

[0108] REFERENCE SIGNS LIST 1 Information processing system 2 Vehicle 3 Sensor unit 4 In-vehicle device 5 Notification unit 8 User terminal 10 Information processing device 11 Acquisition unit 12 Estimation unit 13 Calculation unit 14 Notification control unit 17 Communication unit 19 Memory unit 31 Front camera 32 Rear camera 33 Position sensor 34 Illuminance sensor 35 Microphone 100 Information processing device 101 Acquisition unit 102 Estimation unit 103 Calculation unit 104 Notification control unit 191 Definition information 192 Risk level information 193 Determination condition information 41 Acquisition unit 42 Communication unit 43 Vehicle control unit 51 Lamp 52 Horn 900 Computer 902 Bus 904 Processor 906 Memory 908 Storage device 910 Input / output interface 912 Network interface N Network

Claims

1. An acquisition means for acquiring sensor information about a parked vehicle obtained by a sensor, An estimation means for estimating the parking situation, including compliance with regulations, of the vehicle based on the sensor information, A calculation means for calculating the degree of risk of harm to the vehicle based on the parking situation, The system includes a notification control means that notifies a user terminal of the vehicle's danger based on the aforementioned level of danger. Information processing device.

2. The sensor information includes information regarding the parking location of the vehicle. The estimation means estimates the parking situation, including whether or not the parking location is within a no-parking zone. The information processing apparatus according to claim 1.

3. The estimation means estimates the parking situation, including the situation regarding the visibility of the vehicle from its surroundings, based on the sensor information. The information processing apparatus according to claim 1 or 2.

4. The sensor information includes images taken of the surroundings of the vehicle. The estimation means extracts objects present around the vehicle from the captured image and estimates the visibility of the vehicle from its surroundings based on these objects. The information processing apparatus according to claim 3.

5. The sensor information includes information indicating the brightness around the vehicle. The estimation means estimates the level of visibility of the vehicle from the surroundings based on the brightness of the area around the vehicle. The information processing apparatus according to claim 3.

6. The estimation means estimates the amount of pedestrian traffic around the vehicle based on the time of parking, and estimates the parking situation according to the estimation result. The information processing apparatus according to claim 1 or 2.

7. The sensor information includes sound information indicating sounds generated around the vehicle. The estimation means estimates the amount of pedestrian traffic around the vehicle based on the sound information, and estimates the parking situation according to the estimation result. The information processing apparatus according to claim 1 or 2.

8. A sensor that detects sensor information about a parked vehicle, Equipped with an information processing device, The aforementioned information processing device is An acquisition means for acquiring the sensor information obtained by the aforementioned sensor, An estimation means for estimating the parking situation, including compliance with regulations, of the vehicle based on the sensor information, A calculation means for calculating the degree of risk of harm to the vehicle based on the parking situation, The system includes a notification control means that notifies the user terminal of the vehicle's danger based on the aforementioned level of danger. Information processing system.

9. We acquire sensor information about parked vehicles obtained from sensors, Based on the aforementioned sensor information, the parking situation, including compliance with regulations by the vehicle, is estimated. Based on the aforementioned parking situation, the degree of risk of harm to the vehicle is calculated. Based on the aforementioned risk level, the user terminal is notified of the vehicle's hazard. Information processing methods.

10. An acquisition process to obtain sensor information about a parked vehicle obtained by a sensor, Based on the aforementioned sensor information, an estimation process is performed to estimate the parking situation, including the compliance status of the vehicle with regulations. A calculation process that calculates the degree of risk of harm to the vehicle based on the parking situation, A program that causes a computer to execute a notification control process that notifies a user terminal of the danger of the vehicle based on the aforementioned level of danger.